A hat with ball marker removably places a golf ball marker onto a cap for retrieval therefrom by a golfer. The device has a hat having a dome with an opening and an insert that has a base with a wing such that the wing is attached to an inner surface of the dome and the base protrudes through the opening. The upper surface of the base is magnetized and the marker, being magnetically attractive, is magnetically removably attached to the base. Removal of the marker from the base is accomplished by sliding the marker off of the base or by providing the base with a cavity such that placement of force onto the marker above and toward the cavity causes the marker to teeter thereby flipping the marker into the cavity for easy removal.