There is provided a document management system for retrieving document information from storage unit which correlates and stores user information, keyword information set for every user, and document information, the document management system including a first retrieval unit configured to retrieve document information from the storage unit using a first retrieval condition, a specifying unit configured to specify the user information, and a second retrieval unit configured to determine a second retrieval condition in accordance with a retrieval result of the first retrieval unit and the user information specified by the specifying unit and to retrieve document information from the storage unit using the second retrieval condition.