An imaging history display system and method is disclosed comprising diagnostic and patient summary interfaces for displaying, comparing and managing medical images. Imaging history display system displays studies in two interface modes in response to commands received from a user workstation. Display entities are displayed on display areas within display entity boxes that are defined by display entity layouts. Contextual summaries of display entities are provided in the patient summary interface to facilitate accurate and exhaustive diagnoses. Contextual summaries are generated in part based on pre-determined relevancy information. Display entities are easily organized in the patient summary interface. Display entities are easily activated in the diagnostic interface for diagnostic and comparison purposes.