03/12/2003 Denodo develops a system for the exploration of the hidden Web
One of the R&D projects that Denodo is developing, and which results
will be available at the end of this year, consists in developing a
powerful tool able to explore, in an automatic way, the "hidden web".
The search engines in Internet developed to date are based on the
construction of powerful spiders, that explore the Web from a
collection of home pages, crossing automatically their hyperlinks to
discover new pages to add to their index. Nevertheless, this method
does not allow these spiders to access to pages generated dynamically.
This portion of the Web is usually named "hidden web" or "deep web".
In this project Denodo develops a new type of spider oriented
to corporate environments, that will be able to explore the most
contents of the hidden web.