admin's blog

Mining the Deep Web

"Searching on the Internet today can be compared to dragging a net across the surface of the ocean", said Michael Bergman in a study back in 2000.

Nearly a decade later, some estimates show that up to 500 times more online information remains hidden below the shallow nets cast by the general search engines. There's a wealth of information that is deep and therefore missed, unless you know how to go after it.

What are these information resources?

Searching Smarter

There's a lot of chatter these days about making online search easier, friendlier, serving more of the public in more ways.

For example:

  • natural language search, where we'll just type (or speak) in plain language
  • using prior search, adjusting future results to more closely reflect our past selections
  • social search, where the preferences of our network of friends will influence our results
  • emphasis on optimizing the very first search result since that's the one we'll want to click
  • and so on...

That's all fine, but do we see an underlying assumption emerging? 

Perhaps a problem (and an opportunity) in disguise?

Welcome to the Aware Research Blog

After several years as a vision and over two years of concentrated software and infrastructure development—we're now live!

Syndicate content