1. ETD Search Services Ming Luo Edward A. Fox (fox@vt.edu) Virginia Tech

2. Acknowledgements (selected) Support: Adobe, AOL, DFG, NSF (DUE- 0333531,0136690,0121679; IIS- 0086227,0080748 ), OCLC, UNESCO, VTLS Colleagues: Vinod Chachra, Tom Dehn, Marcos Gonçalves, Thom Hickey, Aaron Krowne, Ming Luo, Gail McMillan, Hussein Suleman, Jeff Young

3. Where are the data coming from? From this community! Please join us, share your data! OCLC NDLTD Union – 112,652 ETDs metadata – 44 institutions – Will be able to provide 3 formats DC ETDMS MARC21

4. Where are the data coming from? OCLC (Research) contacts are – Thom Hickey [hickey@oclc.org] – Jeff Young [jyoung@oclc.org] – Tom Dehn [dehn@oclc.org] VTLS has some additional data sources – Providing data other than through OAI-PMH – Including in Korean and Greek – Contact is Vinod Chachra [chachrav@vtls.com]

5. Institutions in OCLC NDLTD Union Set (1)

6. Institutions in OCLC NDLTD Union Set (2)

8. OCLC SRU What is SRU? – Search and Retrieve URL Service (SRU) is web service based protocols for searching databases – Derived from Z39.50 – Uses Common Query Language – Current version: V1.1, 13th February 2004 – Three basic operations, explain, scan and searchRetrieve

10. CQL Examples (from http://www.loc.gov/z3950/agency/zing/cql/)http://www.loc.gov/z3950/agency/zing/cql/ dc.title cql.stem dc.title = "cat" cat dc.title = "cat" author = "smith" dc.title any "cat" bath.author cql.exact "smith, j." dc.title any/relevant/rel.CORI "cat fish" dc.author exact/stem "smith, j." dc.title = cat " " dc.title = "cat" and bath.author = "smith" " cat" or hat dc.title = "cat" prox/distance=1/unit=word dc.title = "in" "cat" prox/distance>2/ordered "hat" dc.title=cat and/rel.sum dc.title=dog > dc="http://www.dublincore.org/" dc.title = "cat"

12. OCLC SRU Interface

13. VTLS Search Based on Virtua system from – VTLS ( www.vtls.com ) – V isionary T echnology in L ibrary S olutions Developed in C++ Uses Oracle Database

14. Virtua User Interface Scan Search Key Word Search Expert Search

16. VTLS Union Catalog Content Languages The VTLS NDLTD Union Catalog has data in 6 different languages. These are: English German Greek Korean Portuguese Spanish Examples follow

17. Language = German; hits = 137

18. Full record display

19. Virginia Tech ETD Union Componentized Digital Library Software Uses OCLC’s OAI data provider Mirrored in China by CALIS About 200 queries and 400 pages per day for the past year and usage is increasing

20. Discovery Current Awareness Preservation Service Providers Data Providers Metadata harvesting The World According to OAI

21. VT ETD Union System Diagram BrowseSearchWhat’s New OCLC data provider User Interface

22. Open Digital Library Protocol Extended OAI-PMH Protocol for Metadata Harvesting

23. Open Digital Library Component Extended OPEN ARCHIVE OPEN ARCHIVE

24. Open Digital Library Components Running now – XML-File (data provider from file system) – Search: simple or in-memory (Essex) or generalized – Union, browse, recent, filter – E-journal/review, Submit, Edit, Annotation – Recommender, Rating; Mirroring (see JCDL’02) – Working with NCSA: from DB, unstructured text Others in process – Classification/categorization – Registry (and other connections with web services)

25. 1010100101 0100101010 1001010101 0101010101 Program 1010100101 0100101010 1001010101 0101010101 Document 1010100101 0100101010 1001010101 0101010101 Document 1010100101 0100101010 1001010101 0101010101 Document 1010100101 0100101010 1001010101 0101010101 Program 1010100101 0100101010 1001010101 0101010101 Program 1010100101 0100101010 1001010101 0101010101 Image 1010100101 0100101010 1001010101 0101010101 Image 1010100101 0100101010 1001010101 0101010101 Image 1010100101 0100101010 1001010101 0101010101 Video 1010100101 0100101010 1001010101 0101010101 Video 1010100101 0100101010 1001010101 0101010101 Video open digital library OA PMH XPMH

26. 1010100101 0100101010 1001010101 0101010101 Program 1010100101 0100101010 1001010101 0101010101 Document 1010100101 0100101010 1001010101 0101010101 Document 1010100101 0100101010 1001010101 0101010101 ETD-1 1010100101 0100101010 1001010101 0101010101 Program 1010100101 0100101010 1001010101 0101010101 ETD-2 1010100101 0100101010 1001010101 0101010101 Image 1010100101 0100101010 1001010101 0101010101 Image 1010100101 0100101010 1001010101 0101010101 ETD-3 1010100101 0100101010 1001010101 0101010101 Video 1010100101 0100101010 1001010101 0101010101 Video 1010100101 0100101010 1001010101 0101010101 ETD-4 ETD DL for the Networked Digital Library of Theses and Dissertations (www.ndltd.org) Search Filter Union Recent Browse PMH ODLRecent ODLBrowse ODLUnion ODLSearch ODLUnion PMH USER INTERFACE Students and researchers ETD collections Example Open Digital Library

28. ETD Union Search Mirror Site in China (CALIS) (http://ndltd.calis.edu.cn – popular site!)

29. Quality of Search Services ComposabilityEfficiencyEffectiveness OCLC SRUMediumHigh VTLSLowHighMedium Virginia Tech ETD Union Search HighMedium

30. Comparison of Software Software UsedSoftware License Price of Software Full Text Search OCLC SRUHomegrownN/A No VTLSVIRTUA (VTLS.com) CommercialDepends on user number, collection size No Virginia Tech ETD Union Search Open Digital Library BSD-like Open Source License FreeNo Virginia Tech ETD collection Ultraseek (Verity.com) CommercialDepends on user number, collection size Yes

31. Next Steps with VT ETD Union Web Services based component Easier user interface configuration Better precision of search results; full-text? Research studies (e.g., Ryan Richardson dissertation) – Studies of collections and genre – Summaries using concept maps – Cross-language retrieval

32. References: Z39.50 International - Next Generation: http://www.loc.gov/z3950/agency/zing VT Service: http://rocky.dlib.vt.edu/~etdunion/cgi- bin/OCLCUnion/UI/index.pl VTLS Service: http://www.vtls.com/ndltd OCLC Service (SRU): http://alcme.oclc.org/ndltd/SearchbySru.html

33. Thank You! Paper with more details is available at URL: http://tennessee.cc.vt.edu/~lming/software/ETD SearchServices0.7.doc DLRL: www.dlib.vt.edu, http://dlbox.nudl.org/ Fox: http://fox.cs.vt.edu