Lexibot: how to conquer the Invisible Web ?
The Lexibot software developed by BrightPlanet allows you to simultaneously query many databases in what is known as “Invisible Web”
The Invisible Web is made up of all the databases that can't be queried by traditional search engines. Information available in the Invisible Web is estimated to be 500 times greater than that accessible to classic tools.
Make the invisible, visible
The Lexibot is a metasearch engine that queries search engines as well as databases, launching simultaneously dozens of queries. To use the Lexibot and fully appreciate its potential, you must expect to take a few days to get familiar with it: this software has a lot of options. That's why it's possible to move back and forth from the advanced mode to the basic one. The basic mode is used by default when the software is launched. In this mode, the Lexibot consists of a main screen, with a text box at the top. Without the need for complex configurations, you can just type your query and click on the “search” button: the Lexibot displays the results in the main screen. They can be filtered by title, relevancy, file size, etc. These results can be viewed in the browser or directly with the Lexibot. The "Local text viewer" module lets you move rapidly from one document to another.
A many-faceted professional tool
You can enter your queries in the Lexibot with Boolean operators: the software takes charge of translating them into the correct syntax for the different databases. In the advanced mode, there are more screens that can be accessed by different tabs, at the bottom of the window: "Scores", "Terms", "Sources", "Statistics" and "Rejects". The “Scores” screen presentation is similar to the one proposed by default, with extra information about the retrieved references. From here it's possible to work on the references and reclassify them according to the relevance of each result. The “Terms” screen is used to highlight terms present in the returned pages and filter the results accordingly. The “Sources” screen gives details about the source of the results: so you know which search engine returned which answer. This is a good way to evaluate the search engines, but not the results themselves. A neat trick! Finally the “Statistics” and “Rejects” screens allow you respectively to get statistics about the search (number of pages, terms, etc.) and pages that have been rejected by the Lexibot during the search process.
These different visualization modes enable you to do thorough research and to further refine the search results. The choice of which information sources to query obviously influences search results. The Lexibot proposes many groups of thematic sources, that are easy to use.
The Invisible Web accessible to a wider public
Searching the Invisible Web widens your field of investigation to a huge amount of information. The Lexibot automatically enters this space and makes it accessible to a wider public. An essential tool for information professionals, it should also be appreciated by the demanding information seeker that is in every Internet user.