Documents are indexed in accordance with a process that separates the
filtering and word breaking portions of the process so that they are
performed under a restricted security setting. When a document is
requested by an indexer, the document is retrieved and then passed to the
higher security process. The document is then filtered one or more
filters and tokenized by one or more wordbreakers under the restricted
security setting before being passed to the indexer. The restricted
security setting prevents security vulnerabilities from being exploited
during the filtering and word breaking processes.