A system is disclosed for distributed generation and storage of relational
data which can be represented as a network or sub-network. The system
includes a plurality of distributed computing nodes (e.g., general
purpose computers) configured with software for generating and storing
relational data from input individual records. The system further
includes a decentralized management subsystem for distribution of input
records to the distributed computing nodes for processing (i.e.,
generation and storage of the relational data) and for providing access
to the relational data to a user. The management subsystem includes a) a
network management system process providing for dispatching input records
to the nodes, b) an optimization process for optimizing the dispatch of
input records to the nodes, c) an indexing process for indexing of
records dispatched to the nodes and relational data generated at the
nodes; and d) a query management process for responding to user queries
and providing transparent access to the relational data.