Download presentation
Presentation is loading. Please wait.
Published byHarvey Griffin Modified over 9 years ago
1
THE PURDUE UNIVERSITY RESEARCH REPOSITORY: HUBZERO CUSTOMIZATION FOR DATASET PUBLICATION AND DIGITAL PRESERVATION Amy Barton, MLS Assistant Professor of Library Science, Metadata Specialist Carly Dearborn, MSIS Digital Preservation and Electronic Records Archivist Neal Harmeyer, MLS Digital Archivist
2
WHAT IS PURR? TECHNICAL AND INSTITUTIONAL INFRASTRUCTURE
3
THE PURDUE UNIVERSITY RESEARCH REPOSITORY A BRIEF OVERVIEW: The Purdue University Research Repository (PURR) is a research collaboration and data management solution for Purdue researchers and their collaborators. Data management support A workspace for researchers to collaborate on research and publish datasets online Access to published datasets with unique Digital Object Identifier (DOI) Long-term preservation component https://purr.purdue.edu
4
THE PURDUE UNIVERSITY RESEARCH REPOSITORY A CUSTOMIZED INSTANCE OF HUBZERO ® PURR utilizes HUBzero as its foundation: https://hubzero.orghttps://hubzero.org Designed to facilitate virtual communities, online collaboration, research, and teaching Built on open source LAMP (Linux Apache, MySQL, and PHP) platform with Joomla! Content Management System (CMS) PURR was specially customized for data stewardship which includes a workflow for the curation, publication, dissemination and preservation of datasets Unique customization of HUB software will be added to base HUBzero package in next release
5
THE PURDUE UNIVERSITY RESEARCH REPOSITORY COLLABORATIVE INSTITUTIONAL INFRASTRUCTURE Collaborative effort Purdue University Libraries Information Technology at Purdue (ITaP) Office of the Vice President for Research (OVPR) Governed by an Executive Committee, Steering Group, and a Working Group PURR Libraries team Project Director 50% Digital Data Repository Specialist 100% Two Software Developers 100% Metadata Specialist 20% Digital Archivist 25% Two Graduate Assistants 50% Graduate Assistant 25%
6
DATA PRESERVATION ISO 16363 & OAIS
7
DIGITAL PRESERVATION IN PURR THE DATA DELUGE Long-term data management plans required by many federal funding agencies Trustworthy repositories, sound metadata creation and capture, open standards for file formats, and information literacy vital to longevity of digital resources Working Group drafted PURR Digital Preservation Policy using the Trustworthy Repository Audit Checklist (TRAC) as guiding document. TRAC/ISO 16363 influenced documentation such as mission statement, policies, job descriptions, business plan, etc.
8
DIGITAL PRESERVATION IN PURR DEVELOPING POLICIES AND STRATEGIES PURR’s preservation mandate and its organizational commitment. PURR commits to preservation for a period of 10 years after which the content is subject to the Libraries’ selection criteria and archival appraisal Preservation strategies: full preservation, bit-level preservation and no preservation. All objects receive bit-level maintenance, a DOI permanent identifier, PREMIS preservation metadata, onsite and offsite backups, regular virus checks, regular rotation to new storage media. PURR accepts all file formats but recommends formats which are more sustainable long-term.
9
DIGITAL PRESERVATION IN PURR OAIS & DISTRIBUTED DIGITAL PRESERVATION The Open Archival Information System (OAIS) Reference Model is a standard in digital preservation and an ISO standard – ISO 14721 Producers submit content item for publication with appropriate Dublin Core metadata – this acts as the Submission Information Package (SIP) The Content Information (CI) is then bundled together with Preservation Description Information using Library of Congress specifications for BagIt. This is the Archival Information Package (AIP) Unlike most OAIS repositories, the Dissemination Information Package (DIP) is not derived from AIP but rather its SIP. In February 2013, Purdue joined The MetaArchive Cooperative
10
Designated Community purr.purdue.edu APACHE HUBzero JOOMLA ! PHP MySQL LINUX BagIt Media Backup (MetaArchive) LOCKSS access SIP DIP AIP Diagram designed by: Sriram Kiran Valavala
11
PURR METADATA WEAVING OF STANDARDS FOR PRESERVATION
12
METADATA & AIP CREATION TOOL Metadata Overview Dataset Publication Process Archive Information Package Generation Metadata Generation TALKING POINTS
13
METADATA GOALS FOR PURR Capture all pertinent information about the dataset file for long term preservation Descriptive metadata Administrative metadata –Technical metadata –Structural metadata –Rights metadata –Preservation metadata DATASET METADATA
14
METADATA GENERATION METADATA STANDARDS FOR PURR Metadata Encoding and Transmission Standard (METS) Wrapper DCMI Metadata Terms (dcterms) Descriptive metadata Metadata Object Description Schema (MODS) Dataset ownership Access condition Preservation Metadata: Implementation Strategies (PREMIS) Preservation metadata
15
METADATA GENERATION WHY METS? METS acts as a structured container into which other standard metadata schemas can be pointed to externally or embedded internally. Structure: Descriptive Section Administrative Section Technical Section Rights Section Digital Provenance Section File Section File Structure Section DCTERMS PREMIS PREMIS & MODS METS
16
METADATA GENERATION WHY QUALIFIED DUBLIN CORE? Open Archives Initiative Protocol for Metadata Harvesting (OAI-PMH) Our Digital Library Software Developer, Brandon Beatty, developed OAI-PMH functionality The code was submitted to the HUBzero development group and added the core HUBzero code. HUBzero now comes standard with OAI-PMH functionality A contribution for the greater good
17
METADATA GENERATION WHY PREMIS? PREMIS is a robust preservation standard that captures digital preservation activities applied to a digital object. Intellectual Entity A coherent set of content that is reasonably described as a unit (dataset). Objects A discrete unit of information in digital form. Events An action that involves at least one object or agent known to the preservation repository. Rights Assertions of one or more rights or permissions pertaining to an object and/or agent. Agents A person, organization, or software program associated with preservation events in the life of an object. Data Dictionary for Preservation Metadata (http://www.oclc.org/content/dam/research/activities/pmwg/premis-final.pdf)
18
METADATA GENERATION PREMIS EVENTS FOR PURR Data Dictionary for Preservation Metadata (http://www.oclc.org/content/dam/research/activities/pmwg/premis-final.pdf) Event NameEvent DescriptionEvent Preservation Explanation captureInitial capture of the publication data from the user -- the first event in the event stream. Preserving capture would help with HUBzero debugging, as it tells us when the SIP capture/creation process started. in-revisionGenerated when a SIP must be revised before it can be approved (it would occur between capture and validation). Preserving in-revision would help with HUBzero debugging, as in-revision is a major change in the SIP status. Note that in-revision only occurs if the SIP is sent back to the author(s) for revision before it can be approved for AIP status. validationValidation of the SIP to ensure it is ready to become an AIP. Validation is one of the major steps in a SIP's journey to AIP status, so it should be preserved. ingestionCreation of the AIP from the approved SIP. Ingestion is the creation of the AIP, so it should be preserved. fixity checkPeriodic event where the fixity of the files in the AIP is re-validated. Preserving fixity check would help with HUBzero debugging, as it tells when there is a problem with the preservation process. replicationCopying the AIP bit-for-bit to another location for preservation purposes (as in LOCKSS). As replication creates another copy of the AIP, it should be preserved for debugging purposes. migrationTransforming the AIP and its contents into a more- contemporary format. As migration creates a newer, automatically-generated version of the AIP, it should be preserved for debugging purposes.
19
METADATA GENERATION WHY MODS? Capture Dataset Ownership The name of a person, organization, or event (conference, meeting, etc.) associated in some way with the resource. The name of an organization, institution, etc. with which the entity recorded in was associated at the time that the resource was created. Designates the relationship (role) of the entity recorded in name to the resource described in the record. Information about restrictions imposed on access to a resource. publically accessible embargoed until 2015-06-30
20
METADATA GENERATION AIP CREATION
21
METADATA GENERATION AIP CREATION
22
METADATA GENERATION AIP CREATION
23
METADATA GENERATION AIP CREATION CC0 - Creative Commons Creative Commons Attribution Unported 3.0 License Creative Commons Attribution-NoDerivs Unported 3.0 License Creative Commons Attribution-NonCommercial-ShareAlike Unported 3.0 License Creative Commons Attribution-ShareAlike Unported 3.0 License Creative Commons Attribution-NonCommercial Unported 3.0 License Creative Commons Attribution-NonCommercial-NoDerivs Unported 3.0 License CC0 - Creative Commons Creative Commons Attribution Unported 3.0 License Creative Commons Attribution-NoDerivs Unported 3.0 License Creative Commons Attribution-NonCommercial-ShareAlike Unported 3.0 License Creative Commons Attribution-ShareAlike Unported 3.0 License Creative Commons Attribution-NonCommercial Unported 3.0 License Creative Commons Attribution-NonCommercial-NoDerivs Unported 3.0 License
24
METADATA GENERATION AIP CREATION
25
METADATA GENERATION AIP CREATION PURR Puuuurrrrrrrrrrr….
26
METADATA GENERATION HUBzero premis-event-unpacking- 20130312T112352-processId-17937-seq-1 unpacking 2013-03-12T11:23:52+00:00 tool: HUBzero unpackaged … PREMIS EVENT CAPTURED
27
METADATA GENERATION METS WRAPPER & DC TERMS Amy Barton 2013-01-07T16:40:43-05:00 projectName: Metadata Project projectAlias: metadata publicationState: Draft under review publicationVersion: 1 abstract: A metadata workshop was developed based on subject liaison librarians’ feedback in a Qualtrics survey. notes: The dataset contains survey data. synopsis: Subject Librarian survey and resulting metadata workshop. BagIt doi:10.5072/FK250925 Purdue University Research Repository CC0 - Creative Commons Instruction Metadata Survey data Library Science Metadata Madness Workshop: dataset
28
METADATA GENERATION METS TECHNICAL SECTION
29
METADATA GENERATION METS TECHNICAL SECTION
30
METADATA GENERATION METS RIGHTS
31
METADATA GENERATION MODS DATASET OWNERSHIP
32
METADATA GENERATION PREMIS AGENT
33
METADATA GENERATION PREMIS EVENT
34
METADATA GENERATION METS FILES AND STRUCTURE MAP
35
PURR Puuuurrrrrrrrrrr….
36
WANT TO LEARN MORE? Visit https://purr.purdue.edu/ https://purr.purdue.edu/ Digital Data Repository Specialist: Courtney Matthews at matthew6@purdue.edu matthew6@purdue.edu PURR CONTACTS
37
SPECIAL THANKS TO: Neal Harmeyer, Digital Archivist Brandon Beatty, Digital Library Software Developer Courtney Matthews, Digital Data Repository Specialist Mark Fisher, Digital Library Software Developer
38
REFERENCES Faniel, Ixchel M., Zimmerman, Ann (2011) “Beyond the Data Deluge: A Research Agenda for Largee-Scale Data Sharing and Reuse.” The International Journal of Digital Curation 6(1): 59 Lee, C., and Tibbo, H. “Digital Curation and Trusted Repositories: Steps toward Success” (2007). Journal of Digital Information. http://journals.tdl.org/jodi/index.php/jodi/article/view/229/183http://journals.tdl.org/jodi/index.php/jodi/article/view/229/183 Klimeck, G., McLennan, M., Brophy, S.P., Adams, G.B., & Lundstrom, M.S.(2008). “nanoHUB.org: Advancing Education and Research in Nanotechnology,” Computing in Science and Engineering,10(5): 17, 19, 21 Witt, M., (2012). “Curation Service Models: Purdue University Research Repository” Libraries and Staff Presentations. Paper 3. http://docs.lib.purdue.edu/lib_fspress/3http://docs.lib.purdue.edu/lib_fspress/3 Witt, M. (2012). Co-designing, Co-developing, and Co-implementing an Institutional Data Repository Service. Journal of Library Administration, 52(2). DOI:10.1080/01930826.2012.655607
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.