A searchable archiving system. A searchable archiving system includes one
or more compacted files of archive data loosely coupled to a search
process. To create a compacted file, an archiving process tokenizes the
archive data, optimizes the tokenized archive data, and extracts archive
metadata from the tokenized data. The tokenized data may then be
compressed in a variety of ways into compressed segments that may be
individually accessed and decompressed by the search agents. Before
compression, segment metadata is extracted from the segments. The
compressed segments and segment metadata are then combined to create a
compacted file. The search process accesses the compacted files by
consulting locally stored archive metadata extracted from the files
during the compaction process. The search process then invokes one or
more search agents that actively search the compacted files. The search
agents do so by using the segment metadata to identify segments to
decompress and search.