Storage mediums and a computer-implemented method for automating web
navigation and content extraction are provided. In particular, a storage
medium with program components which are executable through a common
application program interface and are utilizable by a developer to write
programming instructions is provided. In some cases, the storage medium
may include a program component for adaptively navigating through one or
more websites and another program component for extracting scripted
content from the one or more websites. In addition or alternatively, the
storage medium may include a program component for standardizing content
on a web page. In some cases, the storage medium may be configured to
allow a user to include XPath query language in program instructions
written from the storage medium. A storage medium comprising program
instructions executable using a processor for performing such functions
and a computer-implemented method employing such processes are also
provided herein.