February 5, 2009

DeepDyve - Search Engine of Future

Image representing DeepDyve as depicted in Cru...DeepDyve which is previously known as Infovell has recently launched a free search engine that can be used to find the data in the so called Dark web. By dark data one means the data which is out of reach of various search engines and other searching algorithms.  The data can be databases, journals or some unstructured information which is located in the dark web.

This search engine will help in searching the dark web more easily to enable the access to data of life sciences, patents or Wikipedia data. This search Engine indexes around 500 million pages. Also the company said what they are indexing pages related to various other fields in science and technology hence increasing the number of indexed pages to a billion by the end of the year.

The search engine will be able to search the data which traditional search engines always look over as it is partnering the publications to gain access to the looked over data in the databases in field of science and technology. 

Google is also stepping forward in searching the dark web. Google said that they will try to include the PDF files which will help them in searching the dark web. Also it is trying to index the HTML forms that include various drop-down or similar kind of information and are also a part of dark web. 

According to data there are around 42 million consumers that spend 25 hours a week to search for researching material and personal information. Most of the time they get frustrated as the relevant information is not found on the web. Deepdyve is giving those customers a unique service that will help them in searching the data that they are looking for. Also there are additional functionalities that help the users to arrange filter and manipulate data according to them. The search engine introduced allows the user to type a key word or an entire article to search for the related topics in the dark web. 

Many researchers say that the approach used by Deepdyve is much more innovative than traditional approach. They also say that the researchers must observe the pattern of the data in the dark web so that they are able to retrieve more efficient data.  Sources say that the Deepdyve is using similar approach in finding the data on the web. The search engine indexes every word in the document and also follows some method by calculating the factorial of the keywords used in the article. Also there is some industrial statistical method which is used to assess the impact on information of these combinations.

If we summarize than the conclusion comes that this search engine calculates the meaning of the articles rather than searching for the keywords like traditional search engines do. Deepdyve is possessing threat to any other search engine; it is just another search engine with an added advantage of searching for the required data. It is a very good option for the people who are looking for information beyond the reach of the traditional search engines. 

 
Permalink Print Comment

Comments on DeepDyve - Search Engine of Future »

February 10, 2009

Larry Donahue @ 5:34 pm

Great article!

We've been watching DeepDyve, and wish them success.

I wanted to mention that my company, Deep Web Technologies (www.deepwebtech.com), provides another and perhaps superior way to reach the "dark web" or "deep web." The technology is called "federated search," and enables people or organizations to conduct one search, and have that search take place over tens or even hundreds of other databases. Our software, collects, ranks and displays the results.

Our clients include the DOD, DOE, Intel and Boeing.

Check it out for yourself! We have some public websites available for the business (www.mednar.com) and medical (www.mednar.com) sectors, and working on a few more in the coming months.

Sincerely, Larry.

Leave a Comment