A pipe-laying vessel includes an upwardly extending tower (14) assembly defining a path down which the pipe passes as a pipeline (40) is being laid by the vessel, and a lower guide arrangement for guiding the pipeline after it has passed down the tower, the lower guide arrangement (61) including a plurality of sets of guide rollers spaced apart along the path of the pipeline and defining the lateral limits of the path, the guide rollers being located such that they allow some bending of the pipeline as it passes through the lower guide arrangement.