NASA’s Planetary Data System (PDS) Michael F. A’Hearn

24 Jul 2007mfa - 2 PDS Overview PDS - the organization –An organization that archives and distributes all of NASA’s planetary mission data (and much other planetary data) according to PDS standards PDS - the archiving standard –A standard that defines how to label data products in order to make them automatically readable and interpretable and how to document everything for future generations PDS - the archive –A distributed but centrally searchable archive of all data from NASA’s planetary missions

24 Jul 2007mfa - 3 PDS Goals Ensure that all data from NASA’s planetary missions are archived in a manner that will make them usable far into the future Acquire and archive other planetary data relevant to NASA’s missions Distribute the data to researchers Provide appropriate tools for finding the right data Work with non-US partners to ensure compatible archiving of all planetary missions A wealth of data - waiting to be analyzed!

24 Jul 2007mfa - 4 PDS Organization PDS is a distributed system, with Discipline Nodes headed by various scientific specialists –DN leads selected competitively based on management and on scientific approach to data –PDS started as part of the R&A program run by active researchers PDS has centralized capabilities for searching data at all the nodes and also a central repository for PDS-wide documents, standards, policies, etc. –At the Engineering Node at JPL Individual scientific discipline nodes provide capabilities that are special to their area as well as archiving all the data relevant to that discipline

24 Jul 2007mfa - 5 PDS Organization Program Executive: Bill Knopf at NASA HQ Program Manager: Ed Grayzeck at NASA GSFC

24 Jul 2007mfa - 6 PDS Organization - Staff Key planetary scientists you may recognize –Atmospheres - Reta Beebe, Nancy Chanover –Geosciences - Ray Arvidsen, Ed Guinness –Imaging - Lisa Gaddis –Planetary Plasma Interactions - Ray Walker, Steve Joy –Rings - Mark Showalter, Mitch Gordon –Small Bodies - Mike A’Hearn, Ludmilla Kolokolova, Don Davis, Mark Sykes, Dave Tholen The scientists ensure the scientific value and usability of the data Many other staff are better known for their PDS activities rather than for scientific work With many different scientific PIs, PDS functions as much like a federation as like a coherent entity

24 Jul 2007mfa - 7 PDS - An Archiving Standard Standards go back to Proto-PDS in late 1980s, prior to the current structure of discipline nodes Standards allow many different types of data Standard evolves to accommodate new needs

24 Jul 2007mfa - 8 PDS Standards - Data Model

24 Jul 2007mfa - 9 PDS Standards - Data Products Product = image or spectrum or time series, etc. including label and, e.g., supplementary data Labels are like FITS headers –Keyword = value format Important differences from FITS –Label can be attached to data product or a separate file (FITS headers must be attached) –Keywords are ALL defined (FITS defines only a few and allows almost unlimited user-defined keywords) –Format of data is not prescribed (FITS requires, e.g., 2880-byte records) but the format must be described in the label –There are significant differences among discipline nodes, e.g., in how data are formatted

24 Jul 2007mfa - 10 PDS Standards - DI Image FITS version has FITS extensions for quality factors and SNR Generally in PDS, the PDS label is more reliable than the FITS header for documenting the data product –But it is often less extensive - many engineering keywords are omitted Product ID = MV _ _001_R_FIT –Used to find the image in indices or other tools JPEG version of image described in previous label

24 Jul 2007mfa - 11 PDS Standards - Sample Label And continuing with more …..

24 Jul 2007mfa - 12 Label continued

24 Jul 2007mfa - 13 PDS Standards - Cassini Image

24 Jul 2007mfa - 14 PDS Standards - Different Image A Cassini image of Titan - very different structure

24 Jul 2007mfa - 15 PDS Standards - Data Organization PDS requires a lot of ancillary information –Both raw and calibrated (physical units) data are required from NASA missions –Geometry is required either in the labels or in separate files or in SPICE –Catalog files are used to load the central search facility –Documents (including ascii versions) are required to explain enough that any intelligent scientist 20 years from now should be able to recalibrate and use the data (with the help of library references)

24 Jul 2007mfa - 16 PDS - The Archive All NASA planetary missions are required to archive in PDS (since mid 1990s) –Require raw data, calibrated data, & derived products (maps, etc.) as appropriate –Generally basic raw & calibrated data due in 6 months Archive also includes data from ESA and IKI and ISAS missions to comets Halley & Grigg-Skjellerup & some more recent shared archives Archive also includes selected planetary data from astrophysics missions (IUE, HST, etc.) Archive includes selected ground-based datasets, particularly at SBN and at Geosciences Archive includes comparative databases for small bodies

24 Jul 2007mfa - 17 PDS - Using The Archive Get a viewer for PDS data Try NASAView Get some data Nodes

24 Jul 2007mfa - 18 PDS - Searching the Archive Central search facility searches by mission, target, instrument, or instrument type Start at Click on search to go to gov/pds/index.jsp gov/pds/index.jsp –Shown at right 33 interplanetary missions plus earth-orbital & ground- based data

24 Jul 2007mfa - 19 Searching at DNs Start at the central, PDS-wide search if you aren’t sure which data you want or where the data are available Start at a DN or even at a subnode of a DN if you know which data you want and which DN has it

24 Jul 2007mfa - 20 PDS - Sample Ground-based Data You can even find your own data in PDS This is one of many ground-based surveys and special datasets And you see whom to ask locally about the PDS!

24 Jul 2007mfa - 21 PDS - Searching at PPI Find the magnetic field measurements (tables) at Gaspra & Ida at PPI In this case, the data are off-line and will be mailed to you In this case, they also have some errors noted after the CDs were produced Getting here from the top level is easy

24 Jul 2007mfa - 22 Tools You Should Have Simple Viewers (all free, available on-line) –NASAView - intended for all PDS products but has some limitations (I broke it yesterday on a product from Geosciences) –ds9 and fv - useful only for PDS-labeled FITS files A good analysis environment –IDL (somewhat expensive) A versatile environment for “exploring” your data as well as analyzing it Library of astronomical routines at NASA-GSFC Needs an I/O routine such as SBN’s readpds.pro (which works on many but not all products) –ISIS (free) Widely used by planetary geologists with many built-in functions Supported via Imaging Node of PDS at USGS I/O works only with products designed for ISIS compliance (not FITS) –IRAF (free) Can be used only for PDS-labelled FITS files since there are not (yet) any I/O routines for PDS-labeled products SPICE (free) –Tool for working out geometry of measurements (if not already in keywords or for updating the values) –Supported via NAIF on many platforms & languages

24 Jul 2007mfa - 23 Problems? Go back and read the “help” pages, e.g. at SBN –Guidelines to help reviewers access the data as well as review them Includes a list of tools –Guideline for all the mysterious file types that you will encounter Contact PDS –Usually the node closest to the data with which you have a problem

24 Jul 2007mfa - 24 PDS - Help functions

24 Jul 2007mfa - 25 PDS - Software Tools

24 Jul 2007mfa - 26 PDS - Archive File Types

24 Jul 2007mfa - 27 PDS - Archive File Types (cont.)

24 Jul 2007mfa - 28 PDS - Archiving Future The volume of data is growing faster than the number of scientists working with the data!