Federated Search Systems For Government Information

Exploring the deep web
Internal and external federated systems lead users to treasures that regular search engines can't find
By Drew Robb, GCN, 06/04/07 issue.

Google makes search look simple, but in fact, search is not simple, particularly when completeness is important.

...Public search engines may be fine for locating a hotel in Singapore, but not for professional research.

No votes yet

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

federated search + P2P = FDLP2.0

Here's an idea: let's connect federated search with P2P. The beauty of Napster and other P2P networks was that one could search and easily find files across thousands of computer hard drives. What if there were 1250 depository libraries that had collections like that at Outraged Moderates (OM distributes thousands of PDF documents via BitTorrent P2P protocol for file-sharing)?

There are several search engines specially designed to find BitTorrents (including search.bittorrent.com, The Pirate Bay, and Isohunt). Here are directions for creating a torrent and running a tracker (which coordinates connections among the peers). All you need to do is download files, put them in a directory on a Web server, and let the tracker know which directory to index. And if you add LOCKSS into the mix, you've got a highly findable, preservable and extensible distributed digital FDLP!

I'll be at ALA in Washington D.C. so if you're interested, come talk to me about this. Let's get crackin'!

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Lines and paragraphs break automatically.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Easily link to terms in various wikis. For help, see <a href="/interwiki/3">interwiki</a>.

More information about formatting options

Syndicate content