Archiving 40+ years of Planetary Mission Data - Lessons Learned and Recommendations K. E. Simmons LASP, University of Colorado, Boulder, CO

Slides:



Advertisements
Similar presentations
The Messy World of Grey Literature in Cyber Security 8 th Grey Literature Conference 4-5 December 2006 New Orleans, Louisiana Patricia Erwin – I3P Senior.
Advertisements

Organising and Documenting Data Stuart Macdonald EDINA & Data Library DIY Research Data Management Training Kit for Librarians.
Long-Term Preservation. Technical Approaches to Long-Term Preservation the challenge is to interpret formats a similar development: sound carriers From.
During spacecraft-level environmental testing, after all instruments were integrated, the government assembled a data clerk team to support test data collection.
Science Archives Workshop - April 25, Page 1 Archive Policies and Implementation: A Personal View from a NASA Heliophysics Data Policy Perspective.
Background Chronopolis Goals Data Grid supporting a Long-term Preservation Service Data Migration Data Migration to next generation technologies Trust.
Preserving Cloud Information Bruce R. Barkstrom & John J. Bates NCDC.
LADEE PDS4 Experience G. Delory LADEE Instrument and PDS Teams LADEE SOC PDS Management Council Nov /19/2014 LADEE PDS4 Experience 1.
PREMIS in Thought: Data Center for LC Digital Holdings Ardys Kozbial, Arwen Hutt, David Minor February 11, 2008.
The Academy of Motion Picture Arts & Sciences Building an Interim Digital Preservation System Nancy Silver Digital Archival Program Manager Science and.
River Campus Libraries (c) 2004 University of Rochester Libraries 1 CNI Task Force, Fall 2004 Nancy Foster, Lead Anthropologist University of Rochester.
Long-Term Preservation of Astronomical Research Results Robert Hanisch US National Virtual Observatory Space Telescope Science Institute Baltimore, MD.
A LOOMING CRISIS: MAINTAINING ACCESS TO ELECTRONIC RESEARCH PRODUCTS Daphne Fautin University of Kansas Gail Kampmeier Illinois Natural History Survey.
The Subject Librarian's Role in Building Digital Collections: Where Information Management and Subject Expertise Meet Ruth Vondracek Oregon State University.
1 CS 502: Computing Methods for Digital Libraries Lecture 27 Preservation.
Senior Review Evaluations (1 of 5) Proposals due: 6 March 2015 Panel evaluations: Week of 22 April 2015 Performance factors to be evaluated will include.
March 2010 PDS Imaging Node 1 NASA PDS Imaging Node: NASA PDS Imaging Node: Digital Data Archives and Distribution Archiving and distributing data and.
Data-PASS Shared Catalog Micah Altman & Jonathan Crabtree 1 Micah Altman Harvard University Archival Director, Henry A. Murray Research Archive Associate.
Different approaches to digital preservation Hilde van Wijngaarden Digital Preservation Officer Koninklijke Bibliotheek/ National Library of the Netherlands.
Elements of a Data Management Plan Alison Boyer Environmental Sciences Division Oak Ridge National Laboratory.
Elements of a Data Management Plan
Tietojärjestelmien peruskurssi Systeemisuunnittelu ja prototyyppimenetelmä Malin Brännback.
Preserving the Scientific Record: Establishing Relationships with Archives Matthew Mayernik National Center for Atmospheric Research Version 1.0 Review.
A Public Trust at Risk: The Heritage Health Index Report on the Condition of Alabama’s Collection.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
WORKFLOWS AND OTHER CONSIDERATIONS FOR DIGITIZATION  Steve Bingo  Processing Archivist Washington State University Libraries  Alex Merrill  Assistant.
Chasing Mayflies Archiving Geospatial Data Linda Zellmer Government Information & Data Services Librarian Western Illinois University
Digitization Panel August 12, 2010 Christopher C. Brown, coordinator Mike Culbertson, Colorado State U. James Mauldin, GPO.
U.S. Department of the Interior U.S. Geological Survey The NGGDPP's Best Practices in Data Preservation Project Brian Buczkowski U.S. Geological Survey.
Elements of a Data Management Plan Bill Michener University Libraries University of New Mexico Data Management Practices for.
PDSMC November 29-30, PDS Imaging Node PDS4 Migration Lisa Gaddis (USGS) Sue LaVoie (JPL) November 30, 2012 PDS Management Council Meeting UCLA.
Computer Forensics Principles and Practices
Thomas C. Stein PDS Geosciences Node Washington University in St. Louis 1MS Supporting Active Surface Missions and Adding Value.
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
Introduction to the ESA Planetary Science Archive  Jose Luis Vázquez (ESAC/ESA)  Dave Heather (ESTEC/ESA)  Joe Zender (ESTEC/ESA)
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
Rescuing EDL Data Presented by Adrian Tinio Jet Propulsion Laboratory, Pasadena, CA.
Managing the Impacts of Change on Archiving Research Data A Presentation for “International Workshop on Strategies for Preservation of and Open Access.
1 Digital Preservation Testbed Database Preservation Issues Remco Verdegem Bern, 9 April 2003.
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
Data in the NEES Data Repository Conditions for Current and Future Use and Re-Use Quake Summit 2012, Boston, Massachusetts July 12, 2012 Stanislav Pejša.
3/30/04 16:14 1 Lessons Learned CERES Data Management Presented to GIST 21 “If the 3 laws of climate are calibrate, calibrate, calibrate, then the 3 laws.
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
Digital Preservation across the technologies, strategies, open standards & interoperability aspects including the legal issues Pratik Shrivastava Scientist.
Science Data in the Science Mission Directorate (SMD) Jeffrey J.E. Hayes Program Executive for MO & DA, Heliophysics Division August 17, 2011.
Application of XTCE standard for the Scaleable Monitoring & Control System (SMACS) New generation of Java and XML based software components for spacecraft.
PDS Geosciences Node Page 1 Archiving LCROSS Ground Observation Data in the Planetary Data System Edward Guinness and Susan Slavney PDS Geosciences Node.
Dataset citation Clickable link to Dataset in the archive Sarah Callaghan (NCAS-BADC) and the NERC Data Citation and Publication team
Managing Access at the University of Oregon : a Case Study of Scholars’ Bank by Carol Hixson Head, Metadata and Digital Library Services
GLAST Science Support CenterAugust 10, 2004 Users’ Committee Meeting The Project Data Management Plan David Band – GSSC.
SOFTWARE ARCHIVE WORKING GROUP (SAWG) REPORT TODD KING PDS MANAGEMENT COUNCIL MEETING FEB. 4-5, 2016.
Zou Ziming 1 Ma Wenzhen Li Lei Zhao Hua Wang Chi 1: Center for Space Science and Applied Research Chinese Academy of Sciences Moscow ·
Data Management Practices for Early Career Scientists: Closing Robert Cook Environmental Sciences Division Oak Ridge National Laboratory Oak Ridge, TN.
Planetary Data System (PDS) Tom Morgan November 24, 2014.
Memory Masters Preserving Digitized Histories— for today, for tomorrow, and for the future This project is made possible by a grant from the federal Institute.
A Different Focus on NASA Science Mission Success (a first cut) Mark V. Sykes Planetary Science Institute.
Rebecca L. Mugridge LFO Research Colloquium March 19, 2008.
INFORMATION SYSTEMS SERVICES UNIVERSITY OF LEEDS ERPANET: OAIS Seminar Copenhagen - København 28th November 2002 Introducing the OAIS Model _________________________________.
Chapter 25 – Configuration Management 1Chapter 25 Configuration management.
7/17/07NASA Report1 NASA Archiving Activities - Lessons Learned 2nd International Planetary Data Alliance Steering Group July 17, 2007 Reta Beebe PDS Program.
NASA Earth Science Data Stewardship
Aji Subekti Tamara Adriani Susetyo-Salim
2016 Alliance Summer Meeting
ATom data management plan:
Active Data Management in Space 20m DG
Use It or Lose It! Preserving Your Digital Documents
Metadata to fit your needs... How much is too much?
Institutional Repositories
Fundamental Science Practices (FSP) of the U.S. Geological Survey
Presentation transcript:

Archiving 40+ years of Planetary Mission Data - Lessons Learned and Recommendations K. E. Simmons LASP, University of Colorado, Boulder, CO IN22A-02 AGU Dec 4,2012

Planetary Missions Mariner Mars 6 & 7, Mariner Mars 9, Pioneer Venus, Voyager 1 & 2, Galileo Jupiter, AGU Dec 4, p2 1 Archived at National Space Science Data Center (NSSDC) 2 Archived at Planetary Data System (PDS) Atmospheres Node

Lessons and Recommendations NASA needs a Mission Document Archive to recover old mission documents Hardware, Software and Migration issues Metadata from early stages is frequently lost Save science observation design documents Leftovers - what else is important to save? A trained archivist should be part of the team Consider post mission time and dollars for archiving More PDS Node funding for better response AGU Dec 4, p3

NASA needs to Establish a central Mission Document Archive and recover old mission documents Spacecraft Hardware and Software knowledge resides in these documents - they can be essential to data recovery and or later use –clock definitions, data handling and timing –spacecraft configuration, instrument specifications, commanding, engineering and computer subsystems Science teams routinely discard them as members retire or move and institutions clean house NASA should use its grant list to solicit submissions AGU Dec 4, p4

Hardware, Software and Migration issues Maintain a NASA technology center for recovering data from old machines and storage devices When designing mission products, consider future usability –Documentation: both product and within code –Backward compatibility –Non-proprietary software with readable file formats I suggest PDS creates a new catalog item to containing ASCII samples of each type of archived data product so migration can be verified. AGU Dec 4,12 -p5

Metadata from early stages of a mission are frequently poorly recorded Time and energy demands on the science and operations teams can leave few document trails –The exhilaration of ‘first data’, verifying instrument operation, turn-around PR, new observation designs –Instrument microprocessors improve science flexibility but changes can impact science and engineering formats, timing, data stream contents, ground handling, archive products; they are rarely archived –Spacecraft glitches: computer memory bit hits, fault protection, contingency planning AGU Dec 4, p6

Archiving science observation designs improves data recovery and use These describe the scientific objective, detail the instrument configuration, target body and pointing strategy Many Project planning design products are not archive friendly due to unique software packages and complex data files Observation graphics, with adequate descriptions, are good browse products AGU Dec 4,12 -p7

Leftovers - what else is important to save? Engineering data Photographs, newspaper articles, video presentations, digital press products Command sequences (routine and real time) Instrument operation journals - will the SPICE EK work? Scientist’s journals Other digital material These are not usually PDS archive items AGU Dec 4, p8

A trained archivist should be part of the team - at all levels An archivist whose main duty is to recognize, document and archive essential information should be an active team participant. Should be trained in the archive procedures and formats where data is to be archived (PDS, NSSDC, etc) to reduce time and costs Ideas –Part-time archivist with other support duties –Institution provided professional archivist / educator –Collaborative or Professional Society service AGU Dec 4, p9

More post mission time and dollars need to be allocated for archiving Real-time archiving of down linked (raw) data within 24 hours is now mandatory Most achievable reduced data is not available until there is a sizeable data set from which to analyze results so these products usually come later or post mission; calibrated data is different from publication level products Catalog metadata describes the entire mission Like JDAP do we need JARC for post mission preservation? AGU Dec 4,12 -p10

More PDS Node funding for better response More timely data ingestion and faster peer review would give quicker public access, for post mission data too Because publication quality data, and therefore archiving, frequently comes after the funded mission period is complete, the PDS Node to receive the data frequently has newer missions with higher priority so newly archived data from retired missions fall to the end of the PDS ingestion line. Another reason for JARC? AGU Dec 4, p11

Credits Thanks to the many science team members, NASA Headquarters and PDS node people, librarians and archivists who not only supported the mission work but encouraged the careful preservation of years of planetary mission data. AGU Dec 4, p12