1. © 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010

2. © 2010 Deep Web Technologies, Inc. 2 The “Google Myth”

3. © 2010 Deep Web Technologies, Inc. 3 Why Do Students Like Google and Google Scholar? It’s fast It’s easy to use It’s relevant It’s FREE

4. © 2010 Deep Web Technologies, Inc. 4 Library vs. Internet “Nearly three-quarters (73%) of college students say they use the Internet more than the library, while only 9% said they use the library more than the Internet for information searching.” *Pew & Internet American Life, 2002 Students Looking for Information

5. © 2010 Deep Web Technologies, Inc. 5

6. 6

7. 7 What Students Don’t Know 1. Links for many articles on Google Scholar require subscriber login or an access fee. 2. Many libraries have already paid for subscriptions. 3. Other content may be more relevant to the topic. 4. Google Scholar advanced search is not very powerful.

8. © 2010 Deep Web Technologies, Inc. 8 So Why NOT Google Scholar? “Scholarly content” intermixed with “non-scholarly” content Spotty coverage, requires publisher cooperation Poor relevance (citation counts don’t seem to help) Unable to limit searching to specific sources Difficult to find the needles in the haystack

9. © 2010 Deep Web Technologies, Inc. 9 Bringing Relevance Back to the Library Checking the Library Website… –Reference Libraries –Deep Web Databases –Specialized Search Directories –Specialized Search Engines –Subscription Databases –Library Catalogs “Ask A Librarian!”

10. © 2010 Deep Web Technologies, Inc. 10 Federated Search…

11. © 2010 Deep Web Technologies, Inc. 11 Intranet Journals In Other Words… One Search, Many Sources IP Authenticated IP Authenticated Small Publishers Small Publishers eBooks OPACS Enter Your Search… Begin Search Advanced Search Library Catalog Library Catalog Public Web Sources Public Web Sources Blogs Wikis News Sources

12. © 2010 Deep Web Technologies, Inc. 12 Tennant’s Tenets Only librarians like to search, everyone else likes to find. All things being equal, one place to search is better than two or more. Services should be placed as close to the user as possible. Roy Tennant: Internationally known speaker and writer on library and information technology issues.

13. © 2010 Deep Web Technologies, Inc. 13 Tennant’s Tenets (cont.) “Good enough” is often just that. Our ability to create effective one- stop searching is dependent on our ability to appropriately target user needs. The size of the result set doesn’t matter as much as how the results are presented. (‘the Google Lesson’)

14. © 2010 Deep Web Technologies, Inc. 14 How can Federated Search Help Your Users?

15. © 2010 Deep Web Technologies, Inc. 15 Benefits of Federated Search One-Stop Access Support of More Efficient Research Consolidated, Formatted Results Authentication and Access Control

16. © 2010 Deep Web Technologies, Inc. 16 One-Stop Access Single query search across multiple disparate sources in real- time: –Subscription services (journals, bibliographic databases, etc.) –In-house databases –Unstructured data (white papers, theses, reports, etc.) –Catalogs (web-based OPAC) –Publicly available databases Information Discovery

17. © 2010 Deep Web Technologies, Inc. 17 Support of More Efficient Research Results across all selected sources are: –Merged –Presented in relevance- ranked order –Sorted –Clustered

18. © 2010 Deep Web Technologies, Inc. 18 Consolidated, Formatted Results Filter and remove duplicates Rank by relevance Display results by source Permit results to be –Downloaded –Printed –Automatically emailed using Alerts

19. © 2010 Deep Web Technologies, Inc. 19 Authentication and Access Control Authorization based on: –IP address –User ID and password Implementation using: –Proxy server –Link resolver –Management of session cookies Different access levels for different user groups –Search Builder

20. © 2010 Deep Web Technologies, Inc. 20 #1 Benefit to Libraries

21. © 2010 Deep Web Technologies, Inc. 21 What does Federated Search look like? wastewater treatment

22. © 2010 Deep Web Technologies, Inc. 22 Automatic Alerts

23. © 2010 Deep Web Technologies, Inc. 23 Smart Clustering Filter and Sort Results

24. © 2010 Deep Web Technologies, Inc. 24

25. © 2010 Deep Web Technologies, Inc. 25

26. © 2010 Deep Web Technologies, Inc. 26

27. © 2010 Deep Web Technologies, Inc. 27

28. © 2010 Deep Web Technologies, Inc. 28

29. © 2010 Deep Web Technologies, Inc. 29 Bringing Federated Search to Your Users Search box on: –Library web pages –Department websites –Course web page –Subject guides –Blogs –Facebook

30. © 2010 Deep Web Technologies, Inc. 30 Search Builder Create custom search boxes and search pages easily Enable/disable collections and search fields Automatically generate search widget HTML

31. © 2010 Deep Web Technologies, Inc. 31

32. © 2010 Deep Web Technologies, Inc. 32

33. © 2010 Deep Web Technologies, Inc. 33

34. © 2010 Deep Web Technologies, Inc. 34 Not All Federated Search Engines Are Created Equal Easy-to-Use, Customizable Interface Complete Source Coverage Incremental display of real-time and indexed results Clustering Relevance ranking of results on-the-fly Support Boolean and fielded searching Access sources via multiple protocols (XML gateway, HTTP, Web Services, Z39.50)

35. © 2010 Deep Web Technologies, Inc. 35 The Future of Federated Search Multi-Lingual Searching Personal Libraries Automated Source Selection Integration with Social Networks

36. © 2010 Deep Web Technologies, Inc. 36 Conclusion Help Users to… –Improve their search –Find what they need –Access scholarly sources –Return to your library for information

37. © 2010 Deep Web Technologies, Inc. 37 Further Reading Federated Search Blog http://www.federatedsearchblog.com

38. © 2010 Deep Web Technologies, Inc. 38 Thank You! Abe Lederman abe@deepwebtech.com Marieke Heins mheins@nl.swets.com