An apparatus for milking livestock, which apparatus has a milking box; a milking robot disposed close to or in the milking box; and a holder for receiving therein teat cups which during use are arranged on an animal for milking by the milking robot, and a holder for such an apparatus. The holder has a guard, a carriage with an engaging mechanism for engaging the teat cups and with a displacer for displacing the carriage between a first position, in which at least the teat cups are protected by the guard in the situation engaged by the carriage, and a second position, in which the teat cups are released for removal by the milking robot.