Introduction to digital libraries How to Build a Digital Library Ian H. Witten and David Bainbridge

What is a Library? A building where books are kept A building where books are kept Most of the public Most of the public Preservation and Access to the Record Preservation and Access to the Record Librarians Librarians Collection & Organization of books, art, film, sound recordings, botanical specimen, cultural objects, etc. Collection & Organization of books, art, film, sound recordings, botanical specimen, cultural objects, etc. Networks of Information Networks of Information Researchers Researchers Web Web Students & youth Students & youth

What is a Digital Library? Is it an institution? Is it an institution? Is it a piece of technology? Is it a piece of technology? Is it a website? Is it a website?

What is a Digital Library? NOT a “Digitized Library” NOT a “Digitized Library” Not to replace books Not to replace books NOT a means to deconstruct existing institutions NOT a means to deconstruct existing institutions

What is a Digital Library? A digital library is an organized collection of information A digital library is an organized collection of information A focused collection of digital objects A focused collection of digital objects Methods for finding, access and retrieval Methods for finding, access and retrieval Methods for selection, organization, and maintenance of the collection Methods for selection, organization, and maintenance of the collection Methods for preservation Methods for preservation

What are Digital Objects? Text Text Audio Audio Video Video 3D objects 3D objects Simulations Simulations Dynamic visualizations Dynamic visualizations Virtual worlds Virtual worlds

Who is Involved? The User The User Finding Finding Access Access Retrieval Retrieval The Librarian The Librarian Selection Selection Organization Organization Maintenance Maintenance Preservation Preservation

What is a Digital Library? A library without walls A library without walls But it does need boundaries But it does need boundaries A new way of dealing with knowledge by A new way of dealing with knowledge by Preserving Preserving Collecting Collecting Organizing Organizing Propagating Propagating Accessing Accessing An organized collection of digital information An organized collection of digital information Purpose Purpose Principles Principles

What about the Librarian’s Job? Selection, organization, and maintenance are central to the notion of library Selection, organization, and maintenance are central to the notion of library Librarians classify and catalog the records of ascertained knowledge, the literature of the whole past Librarians classify and catalog the records of ascertained knowledge, the literature of the whole past It is the wisdom that librarians put into the library that will distinguish digital libraries from the chaos of the Web It is the wisdom that librarians put into the library that will distinguish digital libraries from the chaos of the Web Digital library software supports the role of librarians with organizational structures and maintenance Digital library software supports the role of librarians with organizational structures and maintenance

What is Metadata? Metadata is “data about data” (glibly) Metadata is “data about data” (glibly) Metadata is the information that is included in the library catalog (simplistic) Metadata is the information that is included in the library catalog (simplistic) Library catalog Library catalog A complete model that represents, in a predictable manner, the universe of books in the library A complete model that represents, in a predictable manner, the universe of books in the library Provides a summary of library contents Provides a summary of library contents Bibliographies and Indexes Bibliographies and Indexes Virtual representations that give access to journal articles, government documents, microfiche and microfilm, and special collections Virtual representations that give access to journal articles, government documents, microfiche and microfilm, and special collections

Scope of Digital Libraries Digital libraries offer unique ways of recording, preserving, and propagating culture in multimedia form Digital libraries offer unique ways of recording, preserving, and propagating culture in multimedia form Four Examples: Four Examples: Support human development Support human development Pushing on the frontiers of science Pushing on the frontiers of science Preserving a traditional culture Preserving a traditional culture Exploring popular music Exploring popular music

The Alexandrian Principle “It is a librarian’s duty to increase the stock of his library.” “It is a librarian’s duty to increase the stock of his library.” According to Encyclopedia Britannica, libraries are doubling in size every 16 to 20 years According to Encyclopedia Britannica, libraries are doubling in size every 16 to 20 years

Notions are Being Replaced Focused Collections Focused Collections Rather than the Alexandrian model Rather than the Alexandrian model Service to library users Service to library users Rather than massive storehouse of information Rather than massive storehouse of information Unrestrained growth leads to chaos Unrestrained growth leads to chaos

Building a Collection Once the building process is established, it becomes automatic Once the building process is established, it becomes automatic The process creates all the structures that are needed at runtime to access the collection The process creates all the structures that are needed at runtime to access the collection Searching is based on indexes: Searching is based on indexes: Metadata Metadata Full text Full text Browsing is based on: Browsing is based on: Metadata Metadata Derived structures from the media (e.g. phrase structure from full text) Derived structures from the media (e.g. phrase structure from full text) Rebuilding the collection Rebuilding the collection When new material becomes available, it can be fully incorporated into the collection When new material becomes available, it can be fully incorporated into the collection

Greenstone Software Greenstone Digital Library software New Zealand Digital Library Project University of Waikato Greenstone Digital Library software New Zealand Digital Library Project University of Waikato Open Source Open Source Extensible Extensible Issued under the GNU General Public License Issued under the GNU General Public License

Features of Greenstone Software Access through Web browser Access through Web browser Windows or Unix Windows or Unix Searching Searching Browsing Browsing Easy to maintain Easy to maintain Various metadata Various metadata Plug-ins for new document types Plug-ins for new document types Multiple languages Multiple languages Text, pictures, audio, video Text, pictures, audio, video Hierarchical phrase and key-phrase indexes Hierarchical phrase and key-phrase indexes Multi-gigabyte Compression Password Protection User logs Administrative functions Updates dynamically without bringing system down Publish to CD-ROM Uniform presentation across different computers Open-source software

DSpace Software DSpace Digital Library software MIT/HP DSpace Federation DSpace Digital Library software MIT/HP DSpace Federation Open Source Open Source Extensible Extensible Issued under the BSD General Public License Issued under the BSD General Public License

Things to Consider Copyright Copyright Collecting from the Web Collecting from the Web Illegal or harmful material Illegal or harmful material Standards vary Standards vary Cultural sensitivity Cultural sensitivity Others? Others?