A collet assembly, for selectively attaching a tool accessory to a tool, having a collet nut rotatably connectable to the tool, a collet compressible by the collet nut, and a torque application feature movably connected with the tool. The torque application feature is cammingly actuated to engage the collet nut for compressing and loosening the collet.