A retracting mechanism of a retractable lens includes an external barrel movable in an optical axis direction, an adjustment frame positioned in the external barrel and configured to be guided linearly in the optical axis direction, a stopper configured to set a rear movement limit of the adjustment frame with respect to the external barrel, a lens frame configured to hold a lens group, the lens frame configured to be screwed into the adjustment frame, a fixing frame fixed to the external barrel and configured to prevent the adjustment frame from coming off the external barrel, and at least one spring positioned between the fixing frame and the adjustment frame and configured to bias the adjustment frame toward the rear movement limit of the adjustment frame with respect to the external barrel.