Greg Janée 2005-11-151 5 topics Fedora NGDA project activities Two study ideas MODIS Preservation as series-of-handoffs.

Slides:



Advertisements
Similar presentations
Research Data Access and Preservation Summit Panel 2 - Promoting Re-Use of Scientific Collections Some responses to the questions posed... John Harrison.
Advertisements

Health Ingenuity Exchange (HingX) Best Practices for User Groups and Resource Registration.
JMS messaging service  All write-only Fedora operations are published to subscribed clients  Messaging system can be durable – if client/consumer/subscriber.
National Geospatial Digital Archive Greg Janée. Greg Janée May 31, Outline Two preservation misadventures Digital preservation problems Genesis.
Long-term Preservation as a Relay Greg Janée University of California at Santa Barbara.
PREMIS Implementation Fair San Francisco, CA, October Stanford Digital Repository PREMIS & Geospatial Resources Nancy J. Hoebelheinrich Knowledge.
Mark Evans, Tessella Digital Preservation Boot Camp – PASIG meeting, Washington DC, 22 nd May 2013 PREMIS Practical Strategies For Preservation Metadata.
R.Jantz, August 31, Two-day forum on PREMIS Preservation Metadata and the Trusted Digital Repositories August 31, September 1 National Library of.
MacKenzie Smith Associate Director for Technology MIT Libraries.
Future Access to the Scientific and Cultural Heritage – A shared Responsibility Birte Christensen-Dalsgaard State and University Library.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
1 CS 502: Computing Methods for Digital Libraries Lecture 27 Preservation.
NDIIPP and NGDA National Preservation Network For Digital Content.
University of Illinois at Urbana-ChampaignHDF 1McGrath/Yang 2/27/02 Transitioning from HDF4 to HDF5 Robert E. McGrath Kent Yang.
National Aeronautics and Space Administration Implementing DSpace at NASA Langley Research Center 1 Greta Lowe Librarian NASA Langley Research Center
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
An Overview of Selected ISO Standards Applicable to Digital Archives Science Archives in the 21st Century 25 April 2007 Donald Sawyer - NASA/GSFC/NSSDC.
ETD Repositories Using DSpace Software Andrew Penman The Robert Gordon University 27 th September 2004.
Dienst Distributed Networked Publishing Carl Lagoze Digital Library Scientist Cornell University.
Catherine Masi, National Geospatial Digital Archive May 16, 2005 NGDA Format Registry  Why do we need a FR? We are designing with long-term storage in.
DATA FOUNDATION TERMINOLOGY WG 4 th Plenary Update THE PLUM GOALS This model together with the derived terminology can be used Across communities and stakeholders.
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
The DSpace Course Module – An introduction to DSpace.
How to build your own Dark Archive (in your spare time) Priscilla Caplan FCLA.
ESRI User Conference, August 8, 2006 Long-term archiving of geospatial data: the NGDA project Julie Sweetkind-Singer John Banning Stanford University.
The Global Video Grid: DigitalWell Update & Plan For SRB Integration Myke Smith, Manager Streaming Media Technologies University of Washington / ResearchChannel.
Metadata Lessons Learned Katy Ginger Digital Learning Sciences University Corporation for Atmospheric Research (UCAR)
Topic Rathachai Chawuthai Information Management CSIM / AIT Review Draft/Issued document 0.1.
National Digital Information Infrastructure and Preservation Program (NDIIPP) CNI Project Briefing December 5, 2005.
Archival Information Packages for NASA HDF-EOS Data R. Duerr, Kent Yang, Azhar Sikander.
Ocean Observatories Initiative Data Management (DM) Subsystem Overview Michael Meisinger September 29, 2009.
Creating Archive Information Packages for Data Sets: Early Experiments with Digital Library Standards Ruth Duerr, NSIDC MiQun Yang, THG Azhar Sikander,
The FCLA Digital Archive Joint Meeting of CSUL Committees, 2005.
National Geospatial Digital Archive Greg Janée University of California at Santa Barbara.
May 2, 2013 An introduction to DSpace. Module 1 – An Introduction By the end of this module, you will … Understand what DSpace is, and what it can be.
National Geospatial Digital Archive Greg Janée University of California at Santa Barbara.
The KB e-Depot long-term preservation of scientific publications in practice Marcel Ras, National library of The Netherlands.
Best Practices for Digital Imaging and Metadata Roy Tennant The Library, University of California, Berkeley
Data in the NEES Data Repository Conditions for Current and Future Use and Re-Use Quake Summit 2012, Boston, Massachusetts July 12, 2012 Stanislav Pejša.
- 1 - HDF5, HDF-EOS and Geospatial Data Archives HDF and HDF-EOS Workshop VII September 24, 2003.
PREMIS Implementation Fair, San Francisco, CA October 7, Stanford Digital Repository PREMIS & Geospatial Resources Nancy J. Hoebelheinrich Knowledge.
1 GRID Based Federated Digital Library K. Maly, M. Zubair, V. Chilukamarri, and P. Kothari Department of Computer Science Old Dominion University February,
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
NGDA Architecture Update Greg Janée. Greg Janée May 16, Three motivations Archival has to be cheap & easy –little incentive –no funding Need to.
National Geospatial Digital Archive Greg Janée UC Santa Barbara.
Breakout # 1 – Data Collecting and Making It Available Data definition “ Any information that [environmental] researchers need to accomplish their tasks”
Preservation Program Digital Preservation Program Digital Preservation Services: Extending tools to meet campus needs Patricia Cruse, Director, Digital.
Archiving microdata Standards and good practices United Nations Statistics Commission New York, February 26, 2009 Olivier Dupriez World Bank, Development.
SDMX IT Tools Introduction
Institutional Repositories: the DSpace Experience Ann J. Wolpert Director of Libraries Massachusetts Institute of Technology.
Vicki Tobias Introduction to and Institutional Repositories.
Al Cornish, Systems Librarian Washington State University Libraries Preserving Access to Multimedia Collections.
DSpace An Open Source Dynamic Digital Repository Xizi (Cecilia) Cai IS565 Spring 2013 DL Topic Presentation.
Digital Library Storage Strategies Robert Cartolano, Director Library Information Technology Office November 14, 2008.
Lifecycle Metadata for Digital Objects November 15, 2004 Preservation Metadata.
Harokopio University of Athens – Department of Informatics and Telematics HAROKOPIOUNIVERSITY A Distributed Architecture for Building Federated Digital.
Collection Management Systems
Making the Case for Curation: The Practical Experiment of DSpace Managing Digital Assets February 5-6, 2005 Charleston, SC Ann J. Wolpert, Director of.
Nancy J. Hoebelheinrich, Metadata Coordinator, Stanford University 1 Metadata for the NGDA: Developing a Shared Approach Joint UCSB / Stanford meeting.
Developing a Dark Archive for OJS Journals Yu-Hung Lin, Metadata Librarian for Continuing Resources, Scholarship and Data Rutgers University 1 10/7/2015.
Joint Meeting of CSUL Committees,
NASA Earth Science Data Stewardship
Building A Repository for Digital Objects
Overview: Fedora Architecture and Software Features
Flexible Extensible Digital Object Repository Architecture
Flexible Extensible Digital Object Repository Architecture
Identifiers Answer Questions
CNI Project Briefing December 5, 2005
Metadata The metadata contains
Presentation transcript:

Greg Janée topics Fedora NGDA project activities Two study ideas MODIS Preservation as series-of-handoffs

Greg Janée Fedora— what Repository system Features –basic management functionality –programmatic APIs –object model & XML representation thereof –storage subsystem abstraction –inter-object relationships, versions, … Active user community

Greg Janée Fedora— why Avoid re-inventing wheel Value in describing our work as profiles of, additions to a base repository –intellectual value –practical value: contribute back to Fedora community Generic Fedora-ADL connection

Greg Janée Fedora— to do Define “long-term preservation” profile Additions to Fedora –richer model of semantic definitions –support for geospatial data types –Archivas storage driver

Greg Janée DEVELOPMENTRESEARCH Considerations for long-term preservation Best practices Collection development, prioritization, and scope Architectural and economic models Rights issues ADL federation geospatial format/product registry UCSB Stanford other multiple levels of information preservation: bits  semantics  viewability … prototype archives … NGDA project activities

Greg Janée computing platform semantics terminology provenance provider quality appropriate usage community environment capture object (data + metadata) object (data + metadata) 2005 object (data + metadata) object (data + metadata) 2105 How much is necessary? Capturable? Archivable? Affordable? Study #1 object migrate

Greg Janée Study #2 Survey people who have (tried to) use old geospatial data –What information did they need? –What was missing? –What would have been useful?

Greg Janée MODIS “Moderate Resolution Imaging Spectroradiometer”

Greg Janée MODIS challenges Size –2 petabytes; growing 1 TB/day –not backed up HDF file format –large, complex, long history –controlled/managed by NCSA source of funding –actual format is undocumented accessed through NCSA-provided software libraries reverse engineerable in principle, not in practice

Greg Janée MODIS challenges Raw data format –documented, but not publicly releasable includes satellite controls Attitude/ephemeris data format –“hard to find” Other format issues –packets, nested formats,...

Greg Janée MODIS challenges Calibration/processing algorithms –key to data interpretation –documentation: initially described by “algorithm theoretical basis document” (ATBD) –rapidly outdated, never updated journal articles Fortran/C source code is definitive –certain lookup tables re-calibrated monthly –moving to on-demand computation of products

Greg Janée MODIS challenges Other, related efforts –NASA committee(s) on long-term storage –NASA’s transition of operations to NOAA CLASS

Greg Janée MODIS Questions for you: –Is this within NGDA’s scope? –Is this within LoC’s scope?

Greg Janée Preservation as series of handoffs Chris Rusbridge –no such thing as a 100-year guarantee * “impossible perfection” –instead, a series of 10-year guarantees Jim Frew –“store-and-forward” model –analogous to Internet Greg’s conclusion –handoff/migration ability is key * except by LoC?