Federated Search: True Enterprise Search Abe Lederman, President and CTO Deep Web Technologies Search Engine Meeting – April 28-29, 2008

Who We Are… Founded in 2002 Headquartered in Santa Fe, New Mexico 20 Employees Over $2 million in R&D through DOE SBIR program DWT is focused on providing state-of-the-art federated search products and solutions which search, retrieve, aggregate and analyze content from web-based databases.

Enterprise Search Crawl and index internal content into a master index Searching of this index is intended for internal users Some searchers think that all of a companies’ information is available through a corporate portal.

Federated Search Managed Service or Customer-Hosted Two Meanings Web Service 1. Real-time search of multiple disparate data sources 2. Batch indexing of information from multiple information sources into a single master index. Read: What’s in a name: Federated Search August 2007 Newsletter

An Enterprise’s Information Universe Subscription Content Government Databases Competitor Web Sites Vendor and Partner Sources Repositories Federated Search Sales & Marketing Documents Manufacturing Databases Corporate Intranet R&D Databases Firewall

Limitations of Enterprise Search Scalability – Not feasible to index all desired content into a master index. Cost – Too expensive to create a master index of all content. Ownership of content – Internal content owners and licensors of subscription content won’t permit their content to be indexed. Security – Difficult to enforce content security and privacy requirements.

True Federated Search Solves These Limitations Current information is available at all times without costly duplication Authentication and security requirements of content can be enforced in real-time. Easy and inexpensive to create a portal that searches hundreds of information sources at the same time.

Creation and update of content is left to experts. Federated search can integrate well with content accessible through one or more Enterprise Search portals. True Federated Search Solves These Limitations (cont.)

Enterprise-Level Federated Search... (not the same as Federated Search for Libraries) Enterprise federated search authentication needs are more complex. Search requirements are more demanding. Information Sources are much more heterogeneous in Enterprise Search.

Federated Search- Not the answer to all... Indexed content is easier to relevance rank. Hard to implement taxonomies in Federated Search Advanced search syntax such as proximity searching, case sensitive searching and thesaurus-based searching may not be implemented by Federated Search. Federated Search is unable to search highly custom databases such as a parts database.

Federated Search can be a discovery tool.

Deep Web’s Federated Search Gallery

Climate Change

Thank You! Contact me via We are looking for corporate partners for our Enterprise-level Federated Search.