1. 1 World Bank (Washington, D.C. – 20 November 2007) “Digital Libraries, 5S, and Applications – esp. Archaeology, Education, ETDs, and CTR (Crisis, Tragedy & Recovery)” Edward A. Fox fox@vt.edu http://fox.cs.vt.edu Dept. of Computer Science, Virginia Tech Blacksburg, VA 24061 USA

2. Acknowledgements (selected) Colleagues: Lillian Cassel, Debra Dudley, Weiguo Fan, Marcos Gonçalves, Doug Gorton, Rohit Kelapure, Neill Kipp, Aaron Krowne, Ming Luo, Uma Murthy, Manuel Perez, Ananth Raghavan, Rao Shen, Hussein Suleman, Srinivas Vemuri, Layne Watson, … Sponsors: ACM, AOL, CAPES, DFG, Google, IBM, IMLS, INL, Microsoft, NSF (CCF- 0722259; IIS-9986089, 0080748, 0086227, 0307867, 0325579, 0535057, 0535060, 0736055 ; DUE-0121679, 0121741, 0136690, 0333531, 0333601, 0435059, 0532825), SUN, …

3. 3 Outline Digital Libraries 5S Archaeology Education ETDs CTR (Crisis, Tragedy & Recovery)

4. 4 Synchronous Scholarly Communication Same time, Same or different place

5. 5 Asynchronous, Digital Library Mediated Scholarly Communication Different time and/or place

6. DL Overview Why of Global Interest? National projects can preserve antiquities and heritage: cultural, historical, linguistic, scholarly Knowledge and information are essential to economic and technological growth, education DL - a domain for international collaboration –wherein all can contribute and benefit –which leverages investment in networking –which provides useful content on Internet & WWW –which will tie nations and peoples together more strongly and through deeper understanding

7. Digital Libraries --- Objectives World Lit.: 24hr / 7day / from desktop Integrated “super” information systems: 5S: Table of related areas and their coverage Ubiquitous, Higher Quality, Lower Cost Education, Knowledge Sharing, Discovery Disintermediation -> Collaboration Universities Reclaim Property Interactive Courseware, Student Works Scalable, Sustainable, Usable, Useful

8. Computing (flops) Digital content Communicat i ons (bandwidth, connectivity) Locating Digital Libraries in Computing and Communications Technology Space Digital Libraries technology trajectory: intellectual access to globally distributed information lessmore Note: we should consider 4 dimensions: computing, communications, content, and community (people)

9. 9 Borgman et al.: Workshop Report on Social Aspects of Digital Libraries: http://www-lis.gseis. ucla.edu/DL/ Information Life Cycle

10. 10 Information Life Cycle Authoring Modifying Organizing Indexing Storing Retrieving Distributing Networking Retention / Mining Accessing Filtering Using Creating

11. 11 creation distribution seeking utilization E1:starting E2: chaining E3: browsing E4: differentiating E5: monitoring E6: extracting storing, archiving, networking K1: initiation K2: selection K3: exploration K4: formulation K5: collection K6: presentation authoring, modifying, describing organizing, indexing preservability, similarity, timeliness, accuracy, completeness, conformance accessibility, preservability DL Success Constructs Active Semi-active Inactive E: Ellis’ model K: Kuhlthau’s model

12. 12 Digital Libraries Shorten the Chain from Editor Publisher A&I Consolidator Library Reviewer

13. 13 DLs Shorten the Chain to Author Reader Digital Library Editor Reviewer Teacher Learner Librarian

14. 14

15. 15 Informal 5S & DL Definitions DLs are complex systems that help satisfy info needs of users (societies) provide info services (scenarios) organize info in usable ways (structures) present info in usable ways (spaces) communicate info with users (streams)

16. 16 “Streams” - All types of contents (as well as communications and flows over networks, or into sensors, or sense perceptions) “Structures” - Organizational schemes (including data structures, databases, and knowledge representations – taxonomies, ontologies) 5S Framework

17. 17 5S Framework “Spaces” - 2D and 3D interfaces, GIS data, representations of documents and queries. “Scenarios” - System states and events, but also can represent situations of use by human users (or machine processes, yielding services or transformations of data). “Societies” - Both software “service managers” and fairly generic “actors” who could be (collaborating) human (users).

18. 18 5S and DL formal definitions and compositions (April 2004 TOIS)

19. 19 5S definitional structure

20. 20 5S and Generating DLs 5S Framework 5S definitions, services taxonomy, ontology 5SL 5SGraph 5SGen (and DL development) DL development of union DL 5SGen into DSpace 5SQual

21. 21 Digital Objects Metadata Services Completeness Conformance Accessibility Similarity Significanc e Timeliness Efficiency Reliability Numeric Indicators 5SQual - Dimensions

22. 22 ETANA-DL Archaeological DL Integrated DL –Heterogeneous data handling Applies and extends the OAI-PMH –Open Archives Initiative Protocol for Metadata Handling Design considerations –Componentized –Extensible –Portable

23. 23

24. 24 Member DLs of ETANA-DL

25. 25 Architecture of ETANA-DL, with centralized catalog and partially decentralized repository

26. 26 ETANA-DL Approach Applying and extending Digital Library (DL) techniques to solve key problems: making primary data available, data preservation, and interoperability Modeling archaeological information systems using 5S to better understand the domain and design the system and the supporting services Rapidly prototyping DLs that handle heterogeneous archaeological data using componentized frameworks: –eliciting requirements –refining metamodel and union schema –modeling sites –mapping –harvesting –providing useful services

27. 27 ETANA Societies 1.Historic and pre-historic societies (being studied) 2.Archaeologists (in academic institutes, fieldwork settings, or local and national governmental bodies) 3.Project directors 4.Technical staff (consisting of photographers, technical illustrators, and their assistants) 5.Field staff (responsible for the actual work of excavation) 6.Camp staff (e.g., camp managers, registrars, tool stewards) 7.General public (e.g., educators, learners, citizens)

28. 28 ETANA Societies Social issues 1.Who owns the finds? 2.Where should they be preserved? 3.What nationality and ethnicity do they represent? 4.Who has publication rights? 5.What interactions took place between those at the site studied, and others? What theories are proposed by whom about this?

29. 29 ETANA Scenarios 1.Life in the site in former times 2.Digital recording: the planning stage and the excavation stage 3.Planning stage: remote sensing, fieldwalking, field surveys, building surveys, consulting historical and other documentary sources, and managing the sites and monuments 4.Excavation 1.Detailed information is recorded, including for each layer of soil, and for features such as pole holes, pits, and ditches. 2.Data about each artifact is recorded together with information about its exact find spot. 3.Numerous environmental and other samples are taken for laboratory analysis, and the location and purpose of each is carefully recorded. 4.Large numbers of photographs are taken, both general views of the progress of excavation and detailed shots showing the contexts of finds. 5.Organization and storage of material 6.Analysis and hypotheses generation and testing 7.Publications, museum displays 8.Information services for the general public

30. 30 ETANA Spaces 1.Geographic distribution of found artifacts 2.Temporal dimension (as inferred by archaeologists) 3.Metric or vector spaces 1.used to support retrieval operations, and to calculate distance (and similarity) 2.used to browse / constrain searches spatially 4.3D models of the past, used to reconstruct and visualize archaeological ruins 5.2D interfaces for human-computer interaction

31. 31 ETANA Structures 1.Site Organization 1.Region, site, partition, sub-partition, locus, … 2.Temporal orderings (ages, periods) 3.Taxonomies 1.for bones, seeds, building materials, … 4.Stratigraphic relationships 1.above, beneath, coexistent

32. 32 ETANA Streams 1.successive photos and drawings of excavation sites, loci, unearthed artifacts 2.audio and video recordings of excavation activities and discussions 3.textual reports 4.3D models used to reconstruct and visualize archaeological ruins.

33. 33 local schemaglobal schema

34. 34 Mapping recommendation

35. 35 Mapping confirmationMapping history

36. 36 No recommendation for “Tomb_Area”

37. 37 User-decided mapping

38. 38 Degree of Structure Chaotic OrganizedStructured WebDLsDBs

39. 39 Digital Objects (DOs) Born digital Digitized version of “real” object –Is the DO version the same, better, or worse? –Decision for ETDs: structured + rendered Surrogate for “real” object –Not covered explicitly in metamodel for a minimal DL –Crucial in metamodel for archaeology DL

40. 40 Metadata Objects (MDOs) MARC Dublin Core RDF IMS OAI (Open Archives Initiative) Crosswalks, mappings Ontologies Topics maps, concept maps

41. 41 Databases 5S perspective: structures, streams, scenarios Extending database technology Structured and unstructured info Multimedia databases Link databases Performance, transaction processing Replicated storage, rollback/recovery

42. 42 User interfaces and visualization 2D interfaces 3D interfaces GIS Other paradigms Stepping Stones and Pathways –http://fox.cs.vt.edu/SSP/

43. 43

44. 44 OAI = Technical Umbrella for Practical Interoperability… Reference Libraries Publishers E-Print Archives …that can be exploited by different communities Museums

45. 45 OAI – Repository Perspective Required: Protocol DO MDO

46. 46 OAI – Black Box Perspective OA 1OA 2OA 4OA 3OA 5OA 6OA 7

47. 47 Goals of Institutional Repositories (by Steven Harnad, U. Southampton)  Self Archiving of Institutional Research  Thesis and Dissertations (VTLS NDLTD Project)  Article preprints and post prints  Internal documents and maps  Management of digital collections  Preservation of materials – decentralized approach  Housing of teaching materials  Electronic Publishing of journals, books, posters, maps, audio, video and other multimedia objects Adapted from Slide by V. Chachra, VTLS

48. 48 Fedora™ Repository Web Service Exposure Layer Adapted from Slide by V. Chachra, VTLS

49. 49

50. 50 Ontology: Applications

51. 51

52. 52 5S Meta Model 5SGraph DL Expert DL Designer 5SL DL Model 5SLGen Practitioner Researcher Tailored DL Services Teacher c omponent pool ODLSearch, ODLBrowse, ODLRate, ODLReview, ……. Requirements (1) Analysis (2) Implementation (4) Design (3) 5SGraph5SGen Mapping Tool 5SSuite 5SQual

53. 53 Help users model their own instances of a digital library (DL) in the 5S language (5SL). A simple modeling process which enables rapid generation of digital libraries Features –5SGraph loads and displays a metamodel in a structured toolbox. –The structured editor of 5SGraph provides a top- down visual building environment for the DL designer. –5SGraph produces syntactically correct 5SL files according to the visual model built by the designer. 5SGraph: A DL Modeling Tool

54. 54 Overview of 5SGraph Workspace (instance model) Structured toolbox (metamodel)

55. 55

56. 56

57. 57

58. 58

59. 59 5SLGen – Version 2: ODL, Services, Scenarios

60. 60 5SGraph 5S Archaeology MetaModel ArchDL Expert ArchDL Designer Structure Sub-model ETANA-DL Union Services Descriptions Harvesting Mapping Searching Browsing … Scenario Sub-model VN Metadata Format ETANA-DL Metadata Format HD Metadata Format Mapping Tool Wrapper4VNWrapper4HD Inverted Files Services DB Index Browse Service Search Service Browse DB Other ETANA-DL Services Web Interface XOAI VN Catalog HD Catalog Union Catalog 5SGen Component Pool Browsing …

61. 61 NSDL Information Architecture Essentially as developed by the Technical Infrastructure Workgroup referenced items & collections referenced items & collections Special Databases NSDL Services NSDL Services Other NSDL Services CI Services annotation CI Services discussion CI Services personalization CI Services authentication CI Services browsing Core Services: information retrieval Core Collection- Building Services harvesting Core Collection- Building Services protocols Core Services: metadata gathering Portals & Clients Portals & Clients Portals & Clients Usage Enhancement Collection Building User Interfaces NSDL Collections NSDL Collections NSDL Collections Core NSDL “Bus”

62. 62 Digital Libraries in Education Analytical Survey, ed. Leonid Kalinichenko © 2003, www.iite-unesco.org, info@iite.ru Transforming the Way to Learn DLs of Educational Resources & Services Integrated/Virtual Learning Environment Educational Metadata Current DLEs: US (NSDL, DLESE, CITIDEL, NDLTD), Europe (Scholnet, Cyclades), UK (Distributed National Electronic Resource)

63. 63 Living In the KnowlEdge Society (LIKES): Core surrounded by enabling concepts, problem providing disciplines

64. 64 Objectives – 1 of 3 Enhance education in the discipline: –New courses: Living in the Global Knowledge Society, Knowledge Management –Enhanced courses to be more driven by the LIKES theme: Artificial Intelligence, Data Mining, Digital Libraries, Multimedia/Hypertext/Information Access, …

65. 65 Objectives – 2 of 3 Give special attention, inside the discipline and across disciplines: to the areas of data, information, and knowledge; to key concepts and methods, such as: representation/viewssearch/discovery inference/decisionscomparison/matching complexity/heuristicsanalysis/mining integration/mappingmodeling/simulation

66. 66 Objectives – 3 of 3 Engage researchers and teachers and students in the Knowledge Society’s problems, as motivation, orientation, and to help with solutions, e.g., –Shifting toward digital government, including statutes, rules, regulations, and procedures; –Handling attacks, including spam and viruses; –Ensuring quality even with disinformation, through knowledge sourcing, provenance, and sharing of community expertise; –Ensuring changes through education, that is cross- disciplinary, globally contextualized, based on awareness of human development, learning theory, and cognitive psychology

67. 67 Potential Course Areas/Courses Personal Knowledge Management –Computer Science and Information Systems, e.g., multi-media, process design and evaluation, and Human-Computer / Human-Information interaction. –Psychology, e.g., knowledge organization principles, human cognitive processes. –Industrial Systems Engineering, e.g., Ergonomic factors of knowledge environments. –Ethics, e.g., ethical issues of information disclosure. Communication and Collaboration –Communications, e.g., Communication using digital visualizations, using knowledge access in constructing digital messages. –Information Systems and Computer Science, e.g., computer supported cooperative work and group support systems. –Marketing, e.g., influence of knowledge presentation on on-line customer behavior. Organization –Information Systems, e.g., service innovation and development, system design and development. –Management Science, e.g., decision support systems concepts, capabilities, techniques, and tools. –Management, Marketing, Accounting, and Finance, e.g., business in the information age. Society –Sociology, e.g., impact of knowledge differentials across society and countries. –Political Science, e.g., governmental collection and use of knowledge, impact of technology on elections and government. http://www.likes.org.vt.edu/

68. A Digital Library Case Study Domain: graduate education, research Genre:ETDs=electronic theses & dissertations Submission: http://etd.vt.edu Collection: http://www.theses.org Project: Networked Digital Library of Theses & Dissertations (NDLTD) http://www.ndltd.org

69. Aiding universities to enhance graduate education, publishing and IPR efforts Helping improve the availability and content of theses and dissertations Educating ALL future scholars so they can publish electronically and effectively use digital libraries (i.e., are Information Literate and can be more expressive) What are we doing?

70. 70 NDLTD Incorporation Networked Digital Library of Theses and Dissertations incorporated May 20, 2003 in Virginia, USA Charitable and educational purposes (501 c 3) Officers –Executive Director (Ed Fox) –Secretary (Gail McMillan) –Treasurer (Austin McLean)

71. 71 UNESCO and ETDs (by Axel Plathe at ETD2003) Promoting the use of the Internet as a tool for disseminating scientific knowledge Facilitating the transfer of ETD expertise from developed to developing countries 1998: Member of the NDLTD Steering Committee 1999: First UNESCO ETD meeting on ETD internationalisation 2002: “UNESCO Guide to Electronic Theses and Dissertations” 2003: Model training programmes and training courses 2003: Sponsor pilot projects 2003: Pilot projects (Africa, Europe, Latin-America)

72. 72 Why ETD? Short Answer For Students: –Gain knowledge and skills for the Information Age –Richer communication (digital information, multimedia, …) For Universities: –Easy way to enter the digital library field and benefit thereby For the World: –Global digital library – large, useful, many services General: –Save time and money –Increased visibility for all associated with research results

73. 73

74. 74 Moving from a minimal DL towards a DL reference model Minimal DLDL reference model (DELOS – EU Network of Excellence on DLs) Multimedia Annotation Knowledge management Practical DL systems PIM DL quality Domain- specific DLs

75. 75 HypothesizeModel a) Traditional research sequence b) DL-supported research sequence Collect DataAnalyze Results Test HypothesesPublish Results Refine Hypotheses Identify Scope (Study, Content) Collect Available Data, Request Added Data Add to DL: Ontologies, Classifications, Analyses, … Provide Services: Searching, Browsing, Mining, Visualization, … Support: Analysis, Synthesis, Collaboration, Hypothesis Testing, … DLs for Crisis, Tragedy & Recovery

76. 76 News Blogs, Wikis Web 2.0 Sites Online Forums CDDC Surveys, Interviews, Submissions Data Sources Crawling Indexing Categorizing Data Curation DL-VT416 Social Tagging Data Mining Visualization Browsing Searching Social Network Analysis Services Web Interface Desktop Client Specification Through Focus Groups Sustainability Through Archiving Federated Access, Mapping, Mediating http://www.dl-vt-416.org/

77. 77

78. 78 Summary Digital Libraries 5S Archaeology Education ETDs CTR (Crisis, Tragedy & Recovery)