HathiTrust: Building the Universal Collection John Wilkin 18 May 2009

Presentation structure Quick background on where we are A few pieces of whats in the hopper Development work underway New collaborative structures Explore HathiTrust as a vehicle for collaboration in the realm of collections

Mission and Goals to contribute to the common good by collecting, organizing, preserving, communicating, and sharing the record of human knowledge – materials converted from print – improve access …to meet the needs of the co-owning institutions – reliable and accessible electronic representations – coordinate shared storage strategies – public good … free-riders. – simultaneously …centralized …open

current members California Digital Library Indiana University Michigan State University Northwestern University The Ohio State University Penn State University Purdue University UC Berkeley UC Davis UC Irvine UCLA UC Merced UC Riverside UC San Diego UC San Francisco UC Santa Barbara UC Santa Cruz The University of Chicago University of Illinois University of Illinois at Chicago The University of Iowa University of Michigan University of Minnesota University of Wisconsin-Madison University of Virginia

Governance Model Executive Committee Strategic Advisory Board Coordinated input from groups of members – Hathi/CIC Steering Committee – UC library directors

Executive Committee Paul Courant, University Librarian and Dean of Libraries, University of Michigan Laine Farley, Executive Director, California Digital Library Paula Kaufman, University Librarian and Dean of Libraries, University of Illinois at Champaign-Urbana John King, Vice Provost for Academic Information, University of Michigan Brian Schottlaender, University Librarian, University of California, San Diego Libraries Patricia Steele, Dean of Libraries, Indiana University Brad Wheeler, Chief Information Officer, Indiana University John Wilkin, Executive Director of HathiTrust and Associate University Library, Library Information Technology, University of Michigan

Strategic Advisory Board – Ed Van Gemert (Chair), Director of Libraries, University of Wisconsin-Madison – John Butler, Associate University Librarian for Information Technology, University of Minnesota – Patricia Cruse, Director, Preservation, California Digital Library – Robin Dale, Associate University Librarian for Collections and Library Information Systems, University of California, Santa Cruz – R. Bruce Miller, University Librarian, University of California, Merced – Sarah Pritchard, University Librarian, Northwestern University – Paul Soderdahl, Director, Library Information Technology, University of Iowa – John Wilkin, Executive Director, HathiTrust (ex officio)

Preservation: OAIS Reference Model GRIN Internal Data Loading GRIN Internal Data Loading Google [OCA] In-house Conversion Google [OCA] In-house Conversion MARC record extensions (Aleph) Rights DB MARC record extensions (Aleph) Rights DB Page Turner HathiTrust API OAI GeoIP DB CNRI Handles [Solr] Page Turner HathiTrust API OAI GeoIP DB CNRI Handles [Solr] METS/PREMIS object TIFF G4/JPEG2000 OCR MD5 checksums METS/PREMIS object TIFF G4/JPEG2000 OCR MD5 checksums METS object PNG OCR PDF METS object PNG OCR PDF Isilon Site Replication TSM MD5 checksum validation Isilon Site Replication TSM MD5 checksum validation GROOVE (JHOVE) GROOVE (JHOVE)

growth trajectory

accomplishments to date 1.25 partners 2.successful ingest and millions of vols online 3.mirroring and backup 4.rich access 5.collection builder 6.Catalog beta and WCL working group

What next? Data API and other strategies for increased openness Internet Archive/OCA ingest followed by misc. non-Google ingest Full text search over entire repository Extending out services through Shib Creating research corpus Deeper collaborative strategies

Where next with collaboration? Begin sharing actual development, cf. ingest of Internet Archive content – Specifications – Validation routines? – Packaging? Collaboratively develop a collaborative framework – SAB and working group charges

Working groups? Security Collection management Non-Consumptive Research Digital preservation Discovery (bibliographic and full text) Externally-facing repository APIs Bibliographic metadata management Rights Management

Universal collection What is a collection? Bibliographic identity Certification (and for specific or purposes) – Object as content – Object as artifact

Toward the Cloud Library Shared Print repository or repositories with all the best attributes (service, treatment, management) Shared digital repository with all the best attributes (compliance with TRAC, accessible in every sense, a foundation for services) … and even some coordination between the two … and even (particularly for in-copyright works where we dont have permissions) a viewable copy in GBS

Expectations and plans? How would we define our requirements for satisfaction with each? What would the business model be? How would we build our local collections in light of the presence of something like this? What would we do on the core or shared collections?

Next steps for libraries Case study library: NYU Library ReCap storage facility in Princeton, NJ HathiTrust digital repository CLIR as broker and RLG Research as agent Futures that depend on looking beyond the local to the shared, from the shared as you to the shared as we

Thank you! RSS feed for updates