© 2012 Deep Web Technologies, Inc. 03 December 2012 By Abe Lederman, CEO Deep Web Technologies Show and Tell Presentation to
© 2012 Deep Web Technologies, Inc. 2 Abe Lederman Deep Web Technologies was founded by Abe Lederman in –BS & MS Degrees in Computer Science from MIT – A co-founder of Verity, acquired by Autonomy (now HP) – Developed (part of “Library without Walls”) – 25 years experience in Information Retrieval
© 2012 Deep Web Technologies, Inc. 3 About Deep Web Technologies person company based in Santa Fe, New Mexico Over $5M in DOE SBIR Grants ( ) Pioneer/trailblazer in federated search 100+ solutions in production
© 2012 Deep Web Technologies, Inc. Customers Include... Government: Defense Technical Info Center (DTIC) Office of Sci. & Tech. Info (DOE-OSTI) UN Economic Comm. for Africa (UNECA) European Space Agency Corporate: Boeing BASF Intel HP P&G Academic: Stanford University George Mason University Texas Medical Center University College of Cork Public Portals: WorldWideScience.org Science.gov Biznar Mednar ScienceResearch.com
© 2012 Deep Web Technologies, Inc. 5 Develop 3 POC’s (Top 10 DB, 5 Catalogs, Digital Repositories Launch xSearch for Science & Engineering (28 sources) Expand xSearch to include Social Sciences & Humanities. Also, expanded later in the year for GSB sources (170 sources) In November 2011 the Charleston Advisor Review was published Upgrade and Expand xSearch to 200 sources in December 2012 History of Partnership
© 2012 Deep Web Technologies, Inc PR
© 2012 Deep Web Technologies, Inc.
8
9
10 Federated Search allows users to submit a real-time search in parallel to multiple information sources and retrieve aggregated, ranked and de-duplicated results. What Is Federated Search?
© 2012 Deep Web Technologies, Inc. 11 In Other Words… One Search, Many Sources Internal Sources Blogs & Wikis Subscription Sources Public Web Sources Reports News & Social Media Begin Search
© 2012 Deep Web Technologies, Inc. 12 xSearch Status Upgraded early fall to v GSB linked to xSearch 200 collections in application 30 new connectors in acceptance testing (roll-out imminent)
© 2012 Deep Web Technologies, Inc.
16 Explorit Release Starting customer upgrades Visual clusters Full-text filters Content type/Media type Integration with Zotero, Mendeley
© 2012 Deep Web Technologies, Inc. 17
© 2012 Deep Web Technologies, Inc. 18
© 2012 Deep Web Technologies, Inc. 19
© 2012 Deep Web Technologies, Inc.
21 Explorit Release 4.0 Coming mid-2013 Dynamic tab searching Thesaurus-based searching (Do you also want to search for?) Personal library Big Data mashups (Enhanced content) Faceted navigation
© 2012 Deep Web Technologies, Inc. 22 Big Data Mashups
© 2012 Deep Web Technologies, Inc. 23 Related Content Major Science portals Science News Patent Databases Scholar Networks Subscription Sources Public Databases Open Access Journals
© 2012 Deep Web Technologies, Inc. Article Grouping
© 2012 Deep Web Technologies, Inc. Non-Invasive imaging
© 2012 Deep Web Technologies, Inc. Linking Open Data Cloud Diagram by Richard Cyganiak and Anja Jentzsch.
© 2012 Deep Web Technologies, Inc. Nature has 297 million triples.
© 2012 Deep Web Technologies, Inc. 28 Journey to 10,000 sources
© 2012 Deep Web Technologies, Inc. 29 Scalability Challenges Source selection Ranking and organizing of results Traffic management System load management Finding, building, and maintaining connectors
© 2012 Deep Web Technologies, Inc. 30 Scalability - Divide and Conquer ScienceResearch.com WorldWideScience. org Other Federated Search Engines ScienceAccelerator Science.gov
© 2012 Deep Web Technologies, Inc. 31
© 2012 Deep Web Technologies, Inc. 32
© 2012 Deep Web Technologies, Inc. 33 Multilingual WorldWideScience.org
© 2012 Deep Web Technologies, Inc. 34 How Multilingual Federated Search Works Ranked results translated by Microsoft to user’s language Results returned to user EXPLORIT Microsoft Translator German Chinese Russian Query in user’s language Ranked results in user’s language Query to be translated for each source Query in source’s language Foreign language search engines Results in source’s language Ranking
© 2012 Deep Web Technologies, Inc.
40
© 2012 Deep Web Technologies, Inc. 41 ESN – x2
© 2012 Deep Web Technologies, Inc. 42
© 2012 Deep Web Technologies, Inc. 43
© 2012 Deep Web Technologies, Inc. 44 UNECA ASKIA Portal (United Nations – Access Scientific Knowledge in Africa)
© 2012 Deep Web Technologies, Inc. 45
© 2012 Deep Web Technologies, Inc. 46
© 2012 Deep Web Technologies, Inc. 47
© 2012 Deep Web Technologies, Inc.
50 BASF
© 2012 Deep Web Technologies, Inc. 51
© 2012 Deep Web Technologies, Inc. 52
© 2012 Deep Web Technologies, Inc. 53
© 2012 Deep Web Technologies, Inc. 54
© 2012 Deep Web Technologies, Inc. 55
© 2012 Deep Web Technologies, Inc. 56 Find It! TMC’s Link Resolver
© 2012 Deep Web Technologies, Inc. 57
© 2012 Deep Web Technologies, Inc. 58
© 2012 Deep Web Technologies, Inc. 59
© 2012 Deep Web Technologies, Inc. 60
© 2012 Deep Web Technologies, Inc.
62
© 2012 Deep Web Technologies, Inc. 63 Abe’s Stanford Projects WISHLIST Assist SULAIR in integrating Explorit preview via Web Services into new library portal. Integration with SearchWorks Develop a stand-alone portal focused on Stanford core-competency (Energy, Environment, …)
© 2012 Deep Web Technologies, Inc. 64 Abe’s Stanford Projects WISHLIST (cont.) Develop Chinese Explorit in collaboration with Library of Congress and/other library xSearch / Explorit for Stanford Medical School Mash up Big Data (Link Data, Mendeley, citations) and articles Data Portal (expansion of Data searching in WorldWideScience.org) Integration with Sakai or other CMS
© 2012 Deep Web Technologies, Inc. 65 Explore our Applications xSearch WorldWideScience.org Science.gov Ciencia.Science.gov DTIC Multisearch
© 2012 Deep Web Technologies, Inc. 66 Thank you! Abe Lederman View this presentation online