PDS4 Data Standards IPDA Steering Committee Meeting Paris, France July 16-18, 2013

Topics Overview Progress to Date Summary Acknowledgements 2

PDS4 in Context PDS4 Compliant Registries External Resources Internet Users Internet Service Endpoints Search, Retrieve, Transport, Transform, … Product Centric Discipline Curated Data PDS4 Data Standards

Requirements & Domain Knowledge PDS4 Information Model Query Models Information Model Specification XML Schema (pds) Filter and Translator Protégé Ontology Modeling Tool PDS4 Data Dictionary (Doc and DB) PDS4 Data Dictionary (Doc and DB) XML Document (Label Template) XMI/UML Registry Configuration Parameters PDS4 Data Dictionary (ISO/IEC 11179) PDS4 Model-Driven Process Results in a self- consistent Science Data Archive

Progress to Date PDS4 Data Standards V released on May 7, This is the data standards component of Build 3b. Included updates based on DDWG design decisions and RFA/Issue resolutions. Document Alignment Team tightened up the Standards Reference and brought it into alignment with the Information Model. Remaining documents have been reviewed and updated. 5

SCR / RFA Status SCRs 6 – Schematron rule changes 4 – Standard value changes – 2 resolved RFAs 7 Pending involve Primary Results Summary 9 Pending involve documentation 6 SCR OPEN10 IN PROGRESS 1 RESOLVED 3 TOTAL 14 RFAs OPEN 0 PENDING42 DELIVERED 26 CLOSED11 TOTAL79

Supporting the Change Control Board (CCB) Perform triage on proposed changes for CCB Coordinator Perform light review on simple changes. Form small teams for some issues Teams report back with recommendations and final discussions before submission to CCB Current teams Geometry White Paper Cartography Spectrum Primary Result Summary 7

Release V1.1 Classes Array_2D_Map Array_2D_Spectrum Array_3D_Image Array_3D_Spectrum Default_Display_Settings Cartography Product_SIP Product_DIP_Deep_Archive Change Requests Documentation Additional permissible values Validation rules 8

Summary PDS4 Data Standards V1 being used for: LADEE (Phoenix) MAVEN BepiColumbo InSight OSIRUS Rex PDS4 catalog (PDS3 catalog migrated) Several Local Data Dictionaries Prototyped Russian terms and definitions for SBN discipline data dictionary The core PDS4 Data Standards are stable. Extensions are planned to the discipline levels. 9

Acknowledgements* * Anyone who sat through a DDWG 2-hour telecon or provided useful input. Ed Bell Richard Chen Dan Crichton Amy Culver Patty Garcia Ed Grayzeck Ed Guinness Mitch Gordon Sean Hardman Lyle Huber Steve Hughes Chris Isbell Steve Joy Ronald Joyner Debra Kazden Todd King John Kodis Joe Mafi Mike Martin Thomas Morgan Lynn Neakrase Paul Ramirez Anne Raugh Shannon Rees Mark Rose Matias Roybal Elizabeth Rye Boris Semenov Dick Simpson Susie Slavney Dillon White Santa Martinez David Heather Peter Allan Michel Gangloff Thomas Roatsch Alain Sarkissian

Questions and Answers 11

Backup 12

Product_Observational Label 13 Identification_Area Logical_Identifier Version_Id Identification_Area Logical_Identifier Version_Id Observation_Area Time_Coordinates Primary_Result_Summary Investigation_Area Observing_System Target_Identification Observation_Area Time_Coordinates Primary_Result_Summary Investigation_Area Observing_System Target_Identification Reference_List Internal_Reference External_Reference Reference_List Internal_Reference External_Reference File_Area_Observational File Header Array_2d_Image … File_Area_Observational File Header Array_2d_Image … Cartography Node_Area Mission_Area

14 digital object: An object which is real data — for example, a binary image of a redwood tree or an ASCII table of atmospheric composition versus altitude. physical object: An object which is physical or tangible (and, therefore, does not itself fit into a digital archive). Examples of ‘physical objects’ include the planet Saturn and the Venus Express magnetometer. conceptual object: An object which is intangible (and, because it is intangible, does not fit into a digital archive). Examples of ‘conceptual objects’ include the Cassini mission and NASA’s strategic plan for solar system exploration.

Fundamental Data Standards 15

Candidate Classes For V1.0 Fundamental Data Structures 1 16 ClassSubclassesDescription ArrayArray_2D, Array_2D_Image Array_2D_Spectrum Array_3D Array_3D_Spectrum The Array class defines a homogeneous N-dimensional array of scalars. Table (Base)Fixed-width Character Table, Fixed-width Binary Table The Table class defines a set of repeating records, each with a heterogeneous set of fields. Parsable Byte Stream Delimited Table, Header, SPICE Kernel, Stream Text The Parsable Byte Stream class defines byte streams that have standard parsing rules. Encoded Byte Stream Encoded_Image, PDF/AThe Encoded Byte Stream class defines byte streams that must be decoded by software before use. These byte streams must only use standard encodings. 1 And all component and supporting classes.

Base Products 1 and Aggregate Products 17 ClassSubclassesDescription Product ObservationalN/AA Product_Observational is a set of one or more information objects produced by an observing system. Product DocumentN/AThe Product Document class describes a document. Product XML_SchemaN/AThe Product_XML_Schema is used to describe XML schemas. 1 And all component and supporting classes. ClassSubclassesDescription Product Collection N/AA Product_Collection has a table of references to one or more data products. Product BundleN/AA Product_Bundle has a table of references to one or more collections.

18 PDS4 Documents and their Relationships Concepts Document Big Picture Standards Reference Requirements User Friendly XML Schemas Blueprints PDS4 Product Labels Deliverables Data Dictionary Definitions PDS4 Information Model Specification Requirements Engineering Specification Data Dictionary Tutorial Informative Data Provider’s Handbook Cookbook derive generate references create / validate instruct generate references Registry Configuration File Object Descriptions configure generate Registry Product Tracking and Cataloging generate Informative Document Standards Document File System Legend

Referenced Standards Open Archival Information System (OAIS) Reference Model - Defines the “Information Object” a key component of the model. ISO/IEC : Registry Metamodel and Basic Attributes - Provides the schema for the data dictionary. Defines the concepts of registration authority and steward for governance. CCSDS G-1: Reference Architecture for Space Information Management Object_Oriented Data Modeling – Used as the modeling methodology. XML/XML Schema – Provides the label syntax and validation mechanism. OASIS/ebXML Registry Information Model - Provides attributes for object registration within a federated registry/repository. ISO 15836:2009 The Dublin Core Metadata Element Set – Provides standard web resource identification attributes. Semantics - RDF, RDFS, OWL - Provides W3C standards for knowledge representation. 19

Testing Oxygen is used to test the generated XML Schemas and Schematron files for validity and well- formedness. File Difference (Ultra-Edit Compare) is used to identify differences between current and prior versions of generated files after updates. XML Schema, Schematron, Information Model Specification, ISO/IEC Data Dictionary files. Regression tests are performed against a suite of example products. Regression tests are performed against selected node bundles (Imaging, Atmospheres)

Task Title: Geometry White Paper Team lead and members: E. Guinness, C. Acton Short Description: Interview geometry experts from the various PDS disciplines and write a white paper that describes the scope and a set of high-level requirements for Geometry. Goals: Collect a PDS-wide set of requirements for Geometry Schedule (Major milestones): Dec – Start Gathering Geometry Requirements May – Distribute Draft for Review and Comment Jul – Finalize and Distribute White Paper. 21

Task Title: Cartography Team lead and members: E. Rye, C. Isbell Short Description: Using existing and accepted cartography standards extend/develop a PDS4 cartography model that can be used across the PDS discipline nodes and also extended as needed for specific purposes. Goals: Develop a cartography model suitable for use across the PDS discipline nodes. Schedule (Major milestones): Apr – Continue Development May – Test ingest Cartography Model into PDS4 Sep – Release for general use in next Build. 22

Information Architecture Concepts 23 Tagged Data Object (Information Object) MPFL-M-IMP_IMG_GRAYSCALE… 0 2 Last Index Fastest… UnsignedMSB2 data number Line 248 not applicable 1 Sample 256 not applicable 2 Label Schema Used to Create Describes Extracted/Specialized Information Model Data Object Data Element Class has Planetary Science Data Dictionary Expressed As Product Validates

PDS4 Concept Map 24

Architecture Goals Setup an information model development and management framework that includes methodologies and tools to address the following tasks across geographical, political, and domain boundaries. 1.Develop and manage an archive information model for diverse and complex planetary science domains 2.Maintain the information model independent of system implementation choices. 3.Use the information model to drive implementation and documentation. 4.Enable and maintain interoperability between domains. 5.Manage continuous evolutionary changes and additions to the information model. 25

Summary of Progress to Date (Since Inception) Continuously applied the model-driven paradigm Use an Ontology Modeling Tool to capture and validate the PDS4 Information Model. Automatically generate the Information Model Specification Document, Data Dictionary Document, XML Schemas, and other artifacts. Participated in all Builds: build 1(a,b,c,d), 2 (a,b,c), 3(a) Participated in all major reviews and tests E.g. Beta test conducted by Atmospheres to get user input on PDS4 concepts (XML, Bundles, etc) PDS4 Data Standards were used to design and develop data product labels for the LADEE and MAVEN teams PDS4 Data Standards are endorsed and in use by IPDA International implementation by PSA for Bepi Colombo underway International access prototype demonstrated at IPDA 2012 SC PDS4 Data Standards are included in all deployed operational capabilities Registry and harvest infrastructure at EN Central catalog migration to registry; High level search PDS3 data ingestion into PDS4 system at EN 26

Documents 1 27 Information Model Specification – Version XML Schemas – Version Data Dictionary – Version Concepts Document – Version Standards Reference - Version Data Providers Handbook - Version PDS4 Example Products - Version Posted to