Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Interoperability within the Grid Robert H. McDonald Digital Preservation.

Slides:

Advertisements

Similar presentations

ETD Preservation Survey Results Gail McMillan Digital Library and Archives, Virginia Tech 11th International ETD Symposium Robert Gordon University.

Advertisements

IRs: towards preservation services Steve Hitchcock Preserv Project Intelligence Agents Multimedia Group, School of Electronics and Computer Science (ECS),

A Community Approach to Preservation: Experiences with Social Science Data ASIST Summit 2010 Jonathan Crabtree April 9, 2010.

OGF-23 iRODS Metadata Grid File System Reagan Moore San Diego Supercomputer Center.

Ensuring Long-term Access to ETDs through Distributed Digital Preservation Gail McMillan Director, Digital Library and Archives Virginia Tech Newcomers.

Preserving and Sharing Digital Data Greg Colati, Director, Archives and Special Collections May 11, 2012.

Digital Preservation Lifecycle Management Building a demonstration prototype for the preservation of large-scale multi-media collections Arcot Rajasekar.

Connecticut State Data Center at the Map and Geographic Information Center - MAGIC Connecticut State Data Center Data Collaborator for Planning, Analysis,

Mairéad Martin, Penn State University Commons Solutions Group Storage Workshop May 2010.

National Digital Information Infrastructure and Preservation Program (NDIIPP) Data-PASS/NDIIPP: A new effort to harvest our history A funder view May 25,

San Diego Supercomputer Center, University of California at San Diego Grid Physics Network (GriPhyN) University of Florida A Data Storage Language for.

The Frame NSF-funded national supercomputer centers Centers have hosted significant projects: TeraGrid, NPACI, GEON, SCEC, Chronopolis Fostered development.

Background Chronopolis Goals Data Grid supporting a Long-term Preservation Service Data Migration Data Migration to next generation technologies Trust.

Wayne Schroeder, Paul Tooby Data Intensive Cyber Environments Team (DICE) DICE Center, University of North Carolina at Chapel Hill; Institute for Neural.

PREMIS in Thought: Data Center for LC Digital Holdings Ardys Kozbial, Arwen Hutt, David Minor February 11, 2008.

Hydra Partners Meeting March 2012 Bill Branan DuraCloud Technical Lead.

Trustworthy Repository Criteria, Virtual Organizations, and Infrastructure MacKenzie Smith, MIT Libraries NDIIPP Meeting, July 2010.

Trustworthy repository criteria, virtual organizations, and infrastructure Chronopolis.

Chronopolis: Preserving Our Digital Heritage David Minor UC San Diego San Diego Supercomputer Center.

ADAPT An Approach to Digital Archiving and Preservation Technology Principal Investigator: Joseph JaJa Lead Programmers: Mike Smorul and Mike McGann Graduate.

Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.

Sally Rumsey ORA Service & Development Manager Why ORA? Why Fedora?

SAN DIEGO SUPERCOMPTER CENTERUC SAN DIEGO LIBRARIESNDIIPP PARTNERS MEETING David Minor SDSC Robert H. McDonald SDSC Sangchul Song UMIACS Bryan.

Persistent Digital Archives and Library System (PeDALS) A Guide for Wisconsin State Agencies.

Trusted Datagrids: Library of Congress Projects with UCSD Ardys Kozbial – UCSD Libraries David Minor - SDSC.

Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.

Promoting Digital Preservation Partnerships at the U.S. Library of Congress April 2004.

Toward a Distributed and Collaborative Framework for Preservation Martin Halbert, UNT Dean of Libraries David Minor, Chronopolis Program Manager Katherine.

Digital Library Architecture and Technology

National Partnership for Advanced Computational Infrastructure Digital Library Architecture Reagan Moore Chaitan Baru Amarnath Gupta George Kremenek Bertram.

DATA CURATION & PRESERVATION CSG Fall Meeting, Princeton Mairéad Martin Penn State September, 2012.

San Diego Supercomputer CenterUniversity of California, San Diego Preservation Research Roadmap Reagan W. Moore San Diego Supercomputer Center

Tyler Walters Dean, University Libraries and Professor Virginia Tech July 18, 2013 Collaboratively Preserving Our Digital Memory.

Persistent Digital Archives and Library System (PeDALS) SC Department of Archives and History.

Digital Preservation through Cooperation: LOCKSS Gail McMillan Digital Library and Archives, University Libraries Virginia Polytechnic Institute and State.

Rule-Based Data Management Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar {moore, schroede, mwan, {moore, schroede, mwan,

Growing the MetaArchive Cooperative: ETDs (electronic theses and dissertations) Gail McMillan Digital Library and Archives, Virginia Tech July 2008 NDIIPP.

A brief overview… “The Obama Administration is committed to the proposition that citizens deserve easy access to the results of scientific research their.

Digital Preservation: Lessons learned through national action Digital Preservation Interoperability Framework Workshop April 2010.

ESRI User Conference, August 8, 2006 Long-term archiving of geospatial data: the NGDA project Julie Sweetkind-Singer John Banning Stanford University.

Preserving ETDs: NDLTD & MetaArchive Collaboration Gail McMillan Digital Library and Archives, Virginia Tech Newcomers’ USETDA 2012.

Production Data Grids SRB - iRODS Storage Resource Broker Reagan W. Moore

April 10, 2009CDL Users Council1 Digital Curation Services at CDL Perry Willett Digital Preservation Project Manager California Digital Library.

CONTENT DISCOVERY, SERVICES, AND SUSTAINED ACCESS Timothy Cole, William Mischo, Beth Sandore, Sarah Shreeves ~ University of Illinois Library

Rule-Based Preservation Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar Richard Marciano {moore, schroede, mwan, sekar,

Katherine Skinner, Executive Director, Educopia Institute ESOPI 2013 Chapel Hill, NC April 19, 2013.

Growing the MetaArchive Cooperative ETDs Gail McMillan Digital Library and Archives, Virginia Tech July 2008 NDIIPP Partners Meeting.

Martin Halbert President, MetaArchive Cooperative DigCCurr 2009 Meeting Chapel Hill, NC Friday, April 3, 2009.

UKSG 2006 Archiving scholarly material Gordon Tibbitts President Blackwell Publishing, Inc. April 4, 2006.

What is NDIIPP doing?. July 7 th, Web-At-Risk is opening its archives for public access, having captured nearly 6 TB of data—the entire CA State Government.

Persistent Digital Archives and Library System (PeDALS)

Top Priorities in IT and Digital Projects at Georgia Tech Tyler Walters Georgia Tech Library and Information Center For ASERL ITDIIG – September 24, 2009.

Chronopolis – MetaArchive Improving and Strengthening Inter-Institutional Preservation.

C HRONOPOLIS TM and the D IGITAL P RESERVATION I MPERATIVE Brian E. C. Schottlaender The Audrey Geisel University Librarian ECAR Symposium, 4 December.

Content Transfer NDIIPP Meeting July 9, 2008 Jane Mandelbaum, LC.

Martin Halbert MetaArchive Cooperative Thursday, June 25, 2009 NDIIPP Annual Meeting Washington, D.C.

System Development & Operations NSF DataNet site visit to MIT February 8, /8/20101NSF Site Visit to MIT DataSpace DataSpace.

The University of California Curation Center (UC3) A Plan for Curation Services: Organization, Technologies, Communities The Original NDIIPP Partners:

Distributed Digital Preservation Networks Across a Region, Across a State: Stretching LOCKSS Gail McMillan, Virginia Tech Martin Halbert, Emory Aaron Trehub,

Digital Preservation through Cooperation: LOCKSS Gail McMillan Digital Library and Archives, University Libraries Virginia Polytechnic Institute and State.

National Archives and Records Administration1 Integrated Rules Ordered Data System (“IRODS”) Technology Research: Digital Preservation Technology in a.

Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore

SAN DIEGO SUPERCOMPUTER CENTER Replication Policies for Federated Digital Repositories Robert H. McDonald Chronopolis Project Manager

Digital preservation of CBUC theses with MetaArchive 11th SELL Meeting Porto, June 4th 2011.

Digital Preservation Initiatives in the United States A Summary Deanna B. Marcum.

An Overview of Data-PASS Shared Catalog

Joseph JaJa, Mike Smorul, and Sangchul Song

Library of Congress Resources for Federal Records Managers

Clemson IT/Digital Priorities

Archiving and preservation services in the cloud

Presentation transcript:

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Interoperability within the Grid Robert H. McDonald Digital Preservation Initiatives SDSC David Minor Digital Preservation Initiatives SDSC Ardys Kozbial Digital Preservation Initiatives UCSD Libraries

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Outline Using DataGrids to enable hardware agnostic storage Using DataGrids for collaborative preservation services Open Collaboration for information lifecycle Shared Preservation Layers (UCSD/SDSC Model) Local Regional National Current Examples

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Interoperability for Data Grids Data Ingest – Grid Portal, Web, D-Space, Fedora, LOCKSS, Bagit, OAI-ORE, Dataverse, E-Prints, SWORD Collection A Collection B Data Grid Logical Resource Namespace Logical User Namespace Logical File Namespace Logical Rule Namespace Logical Micro-Service Name Logical Persistent State Data Grid Logical Resource Namespace Logical User Namespace Logical File Namespace Logical Rule Namespace Logical Micro-Service Name Logical Persistent State Adapted from Reagan Moore

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Partnership/Collaboration Many gateways to a datagrid environment supporting geographically dispersed copies and unified preservation services LOCKSS to LStor (Logistical Storage Network) Fedora to SRB/iRODS Fedora to Sun-Honeycomb Archival Storage (not datagrid enabled yet) DSpace to SRB/iRODS Bagit to SRB/iRODS DataVerse to SRB/iRODS UCSD DAMS to SRB/iRODS

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008.EDU and Open Collaboration Bamboo Project Mellon funded humanities datanet like initiative Who will be a part of the datagrid constructed to support this initiative Kuali Project All.edu erp software could be run on top of a datagrid Fedora could serve as a preservation gateway within this datagrid environment NSF DataNet Who will be a part of the datagrid that supports this initiative? NIH Public Access Policy Will this collection ever have the possiblity for data-mining across instiutions? Could be enabled via a datagrid?

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 A Place for Shared Preservation State Level Electronic government information University System Level UC Grid Regional Level MetaArchive National Level NSF Datanet Mellon Bamboo Project

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Layers of Technology Collaboration LOCAL SYSTEMWIDE NATIONAL UC Grid SDSC SRB, UCSD Libraries DAMS LC NDIIPP, Chronopolis

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Current Examples LOCKSS (Private LOCKSS Network) CLOCKSS MetaArchive Data-PASS Chronopolis (SRB DataGrid) Storage Resource Broker/iRODS CIC (Shared Digital Repository) Clustered (Grid) Storage (iSilon) California Digital Library (DataGrid enabled SRB) Digital Preservation Repository (DPR) Florida Center for Library Automation (silo based) Florida Digital Archive (DAITSS) NSF DataNet (First Round) EU PLANETS Project SRB/iRODS

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Q and A?

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Contact Info Robert H. McDonald (SDSC) – AIM/mcdonald at sdsc dot edu David Minor (SDSC) - minor at sdsc dot edu Ardys Kozbial (UCSD Libraries ) – akozbial at ucsd dot edu

Interoperability within the Grid NDIIPP Partners Meeting Arlington, VA July 9, 2008 Chronopolis Consortium Chronopolis Site -