A folding box gluing machine has a folding station in which portions of blanks provided with a glue strip are folded, and a subsequent transfer station which includes as a conveyor mechanism at least two pairs of conveying straps, each including an upper and a lower strap, and having a device for achieving the sideways removal of defective boxes arranged on the outside next to one pair of conveying straps. The upper conveying strap on at least one lengthwise side in the transfer station is supported in one region of its conveying path by support rollers, which are secured to a bearing plate, which is mounted with its lower edge tilted inward relative to a perpendicular plane and can move upward to a limited extent, and a guide baffle is secured on the inside next to the support rollers and extends upward from the inner edge of the upper conveying strap and is angled in the direction of the other pair of conveying straps.