Presentation is loading. Please wait.

Presentation is loading. Please wait.

HATHI TRUST A Shared Digital Repository Use of PREMIS for Internet Archive AIPs September 22, 2010.

Published byArnold Henry Modified over 9 years ago

Similar presentations

Presentation on theme: "HATHI TRUST A Shared Digital Repository Use of PREMIS for Internet Archive AIPs September 22, 2010."— Presentation transcript:

1 HATHI TRUST A Shared Digital Repository Use of PREMIS for Internet Archive AIPs September 22, 2010

2 Overview University of Michigan and University of California worked together to develop ingest processes for Internet Archive content IA materials did not match previously developed standards for HathiTrust materials Solutions were developed to transform IA materials into HathiTrust-compatible AIPs Discuss our use of PREMIS events to document processes and transformations

3 HathiTrust Overview Launched in 2008 by CIC and University of California system libraries to archive and share digital collections Partnership is open to institutions worldwide Currently: Nearly 30 partners 6.6 million digital volumes 1.3 million public domain 247 terabytes

4 Internet Archive capture1 capture 2008-08-04T19:50:13 Initial capture of item AgentID Internet Archive Executor tool scribe7.la.archive.org image capture

5 UM fixity check1 fixity check 2010-04-27T16:34:02 Calculation of md5 hash values for downloaded IA files, comparison with pre-download md5 values warning files failed checksum validation arcanacaelestiah03swed_files.xml arcanacaelestiah03swed_meta.xml ….

6 … AgentID UM Executor tool md5sum software

7 UM package inspection1 package inspection 2010-04-27T16:34:01 Inspection of IA download package for missing files pass AgentID UM Executor tool ingest_ia_volumes.pl software

8 UM mod1_image_header image header modification 2010-04-27T16:34:29 Image header modification to HathiTrust conventions AgentID UM Executor tool ingest_ia_volumes.pl software …

9 tool exiftool software

10 UM mod2_file_rename file rename 2010-04-27T16:34:03 File renaming to HathiTrust conventions AgentID UM Executor tool ingest_ia_volumes.pl software

11 UM mod3_ocr_split ocr split 2010-04-27T16:34:05 Splitting of IA XML OCR into one plain text OCR file and one XML file (with coordinates) per page AgentID UM Executor tool ingest_ia_volumes.pl software

12 UM mod4_ia_mets_creation ia mets creation 2010-04-27T16:34:30 Creation of IA METS file AgentID UM Executor tool ingest_ia_volumes.pl software

13 UM message digest calculation1 message digest calculation 2010-04-27T16:34:30 Calculation of page-level md5 checksums AgentID UM Executor tool md5sum software

14 UM validation1 validation 2010-04-27T16:34:30 IA METS validation AgentID UM Executor tool Xerces-C software

15 identifier uc2.ark:/13960/t2p55qw6d 1 file count 1584 page count 528

16 UM transformation1 transformation 2010-04-27T16:34:30 Transformation of files for ingest: mod1-mod4 in IA METS AgentID UM Executor tool ingest_ia_volumes.pl software

17 UM page feature mapping1 page feature mapping 2010-04-27T16:35:48 Map original page feature tags to HathiTrust AgentID UM Executor tool GROOVE software

18 UM fixity check1 fixity check 2010-04-27T16:34:39 Validation page-level md5 checksums pass AgentID UM Executor tool md5sum software

19 UM ingestion1 ingestion 2010-04-27T16:35:48 Ingestion of object package into repository AgentID UM Executor tool GROOVE software

20 UM validation1 validation 2010-04-27T16:35:18 Validation of object components AgentID UM Executor tool GROOVE software tool jhove1.5 software

Download ppt "HATHI TRUST A Shared Digital Repository Use of PREMIS for Internet Archive AIPs September 22, 2010."

Similar presentations

Beyond the Google Book: the Future of the Digital Library Cory Snavely Library IT Core Services manager University of Michigan April 20, 2010.

Beyond the Google Book: the Future of the Digital Library Cory Snavely Library IT Core Services manager University of Michigan April 20, 2010.
HATHI TRUST A Shared Digital Repository Building A Future By Preserving Our Past The Preservation Infrastructure of HathiTrust Digital Library Jeremy York.

HATHI TRUST A Shared Digital Repository Building A Future By Preserving Our Past The Preservation Infrastructure of HathiTrust Digital Library Jeremy York.
HathiTrust: Building the Universal Collection John Wilkin 18 May 2009.

HathiTrust: Building the Universal Collection John Wilkin 18 May 2009.
This Library Never Forgets Preservation, Cooperation, and the Making of HathiTrust Digital Library Jeremy York Project Librarian HathiTrust Digital Library.

This Library Never Forgets Preservation, Cooperation, and the Making of HathiTrust Digital Library Jeremy York Project Librarian HathiTrust Digital Library.
Building the Universal Library: The Promise and Challenges of HathiTrust John Wilkin 2 April 2009.

Building the Universal Library: The Promise and Challenges of HathiTrust John Wilkin 2 April 2009.
Building the Universal Library: Introducing HathiTrust Patricia A. Steele Indiana University Libraries John Price Wilkin University of Michigan Libraries.

Building the Universal Library: Introducing HathiTrust Patricia A. Steele Indiana University Libraries John Price Wilkin University of Michigan Libraries.
Data Publishing Service Indiana University Stacy Kowalczyk April 9, 2010.

Data Publishing Service Indiana University Stacy Kowalczyk April 9, 2010.
1 Metadata Tools for JISC Digitisation Projects of still images and text Ed Fay BOPCRIS, Hartley Library University of Southampton.

1 Metadata Tools for JISC Digitisation Projects of still images and text Ed Fay BOPCRIS, Hartley Library University of Southampton.
HathiTrust Digital Library: Enrich Your Research and Scholarship Doreen Bradley Chris Powell University Library May 2011.

HathiTrust Digital Library: Enrich Your Research and Scholarship Doreen Bradley Chris Powell University Library May 2011.
October 28, 2003Copyright MIT, 2003 METS repositories: DSpace MacKenzie Smith Associate Director for Technology MIT Libraries.

October 28, 2003Copyright MIT, 2003 METS repositories: DSpace MacKenzie Smith Associate Director for Technology MIT Libraries.
MacKenzie Smith Associate Director for Technology MIT Libraries.

MacKenzie Smith Associate Director for Technology MIT Libraries.
PREMIS: To Be or Not To Be in My METS The Preservation Journey at the University of Connecticut Libraries ALA Annual 2013 ALCTS PARS Intellectual Access.

PREMIS: To Be or Not To Be in My METS The Preservation Journey at the University of Connecticut Libraries ALA Annual 2013 ALCTS PARS Intellectual Access.
The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.

The future’s so bright…. DAITSS DIGITAL PRESERVATION SYSTEM: RE-ARCHITECTED, RE- WRITTEN, AND OPEN SOURCE Priscilla Caplan Florida Center for Library Automation.
HATHI TRUST A Shared Digital Repository Digital Repositories for Preservation and Access Digital Directions 2013 Jeremy York July 22, 2013 Unless otherwise.

HATHI TRUST A Shared Digital Repository Digital Repositories for Preservation and Access Digital Directions 2013 Jeremy York July 22, 2013 Unless otherwise.
PREMIS Conformance. Agenda 1.NLNZ and NLB conformance exercise 2.History of PREMIS Conformance 3.Current status 4.Mapping to functionality.

PREMIS Conformance. Agenda 1.NLNZ and NLB conformance exercise 2.History of PREMIS Conformance 3.Current status 4.Mapping to functionality.
October 24, 2006Merit Technical Staff Meeting1 The Google Project at the University of Michigan Perry Willett Head, Digital Library Production Service.

October 24, 2006Merit Technical Staff Meeting1 The Google Project at the University of Michigan Perry Willett Head, Digital Library Production Service.
E-Live 20051 The UM-Google Digitization Deal What it is, how we got there, and what it will mean for the UM.

E-Live The UM-Google Digitization Deal What it is, how we got there, and what it will mean for the UM.
1 Large-scale collaborative digitisation 19 th Century Pamphlets Online Mar-2007 – Feb-2009 Grant Young Project Manager, 19 th Century.

1 Large-scale collaborative digitisation 19 th Century Pamphlets Online Mar-2007 – Feb-2009 Grant Young Project Manager, 19 th Century.
Authentication of the Federal Register Charley Barth Director, Office of the Federal Register United States Government.

Authentication of the Federal Register Charley Barth Director, Office of the Federal Register United States Government.
Digital archival storage for the University of Michigan Library collections.

Digital archival storage for the University of Michigan Library collections.

Similar presentations

Ads by Google