A chest fly box system having a harness, a base piece for supporting a fly box, and rotatable, hinged fasteners that secure fly boxes of various dimensions at the chest of a fisherman. The rotatable, hinged fasteners comprise hook-and-loop fasteners. The system may include a fishing rod holder that supports a fishing rod in a substantially horizontal orientation, freeing the hands of a fisherman. A bottle holder comprising resilient tubing holds fluid bottles in a horizontal orientation in an easily accessible location. The chest fly box system comprises soft material at the surface in contact with the chest of the fisherman. The soft material may include a pocket.