Devices, and methods of attaching accessory mounts to vertical fore grip handles on firearms, such as rifles. The accessory mounts can be molded to extend off of the handles. The accessory mounts can attach to the handles by interlocking plugs and slots. The accessory mount can have rails so that an accessory can attach to the rails on the accessory mount. The accessory can include lights, lasers, bayonets, sights, scopes, and the like. The vertical fore grip can be an elongated handle fixed to the firearm. The vertical fore grip can be an elongated handle that is detachable from beneath rails on the firearm. The vertical fore grip can include expandable bipod legs.