Described is a system and method for employing user created
database-structured queries and data extraction engines to crawl through
Websites extracting and organizing data from selected sources on a
network, such as the Internet. The structure of a query processed by a
Data Extraction engine enables a user to treat the network as a
searchable database. The database-structured queries provide a user with
tools to match patterns on selected sites on the network. A user may
automate database-structured queries to be executed on a regular
frequency. Output of the database-structured queries may be placed into a
data log, displayed on a user display screen, or optionally reshaped for
use by a plurality of data analysis tools. Additionally, an optional
graphical user interface is provided.