A method and apparatus provides for real-time video data characterization and fast image retrieval. According to one aspect, a token is generated based on blocks or portions of data in a data stream. A mathematical algorithm that operates in real-time during a capture process is used to generate the token. The generated tokens are stored together with the captured data. According to another aspect, a retrieval system compares a token value to obtain matching tokens within a given set of thresholds and corresponding data from the stored captured data.