1 PDS 4 Data Design Report PDS Management Council April 2, 2009 PDS 2010 Data Design WG.

Slides:



Advertisements
Similar presentations
Purpose Scope Debriefing is a concept of providing a “Feedback point” to the program manager of the project scope and those who were involved in preparing.
Advertisements

DRS 2 Metadata Migration June 25, Agenda Introduction Preliminary results - content analysis Metadata options Next steps Questions.
PDS MC April 2-3, Wash. D. C.1 PDS4 Data Model Working Group Status Report to the PDS Management Council April 2-3, 2008.
InterPARES Project Joanne Evans, School of Information Management and Systems, Monash University Description Cross-domain Description Cross Domain - Metadata.
DigiTool METS Profile DigiTool Version 3.0. DigiTool METS Profile 2 What is METS? A Digital Library Federation initiative built upon the work of MOA2.
Philips Research France Delivery Context in MPEG-21 Sylvain Devillers Philips Research France Anthony Vetro Mitsubishi Electric Research Laboratories.
1 Project Management & Project Management Software Yale Braunstein School of Information Management & Systems UC Berkeley.
WRAP Technical Support System Project Update AoH Call October 19, 2005.
THE ADVANCED TECHNOLOGY ENVIRONMENTAL AND ENERGY CENTER (ATEEC) Summative External Evaluation July 1, 2013 – June 30, 2014 PRELIMINARY OUTLINE.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
PDS Radio Science Dick Simpson Stanford University Stanford Status PDS4 Status at Stanford o Testing o Mission Support o Migration Proposal o Tools o Issues.
Method of Converting Resource definitions into XSD Group Name: WG3 (PRO) Source: Shingo Fujimoto, FUJITSU, Meeting Date:
InSight Archive Status Ed Guinness and Susie Slavney PDS Geosciences Node PDS Management Council Berkeley, California November 18-19, 2014.
Information Model and DDWG Updates MC Face-to-Face Berkeley, California November 18-19, 2014.
METS-Based Cataloging Toolkit for Digital Library Management System Dong, Li Tsinghua University Library
1 Data Design Implementation and support for Build 2b November 30, 2011 Steve Hughes.
IPDA Assessment Results Build 1c Steve Hughes August 2011.
PDS4 Build 3b Status and Readiness Steve Hughes MC Face-to-Face Columbia, Maryland April 2-3, 2013.
PDSMC November 29-30, PDS Imaging Node PDS4 Migration Lisa Gaddis (USGS) Sue LaVoie (JPL) November 30, 2012 PDS Management Council Meeting UCLA.
Handshake across the border… The North American Profile Sharon Shin Federal Geographic Data Committee.
PDS 2010 Project Update Dan Crichton MC Face-to-Face Washington DC March 25-26, 2010.
Update from the Data Integrity & Tracking WG Management Council F2F UCLA Los Angles, CA August 13-14, 2007
1 - A View from the Field - The Next Generation Data Standards For the PDS - PDS4 - ESIP Federation Meeting July 8, 2009 J. Steven Hughes JPL Copyright.
PDS4 Tool Development Strategy PDS Management Council Meeting November 18, 2014 Dan Crichton.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
Label Design Tool Management Council F2F Washington, D.C. November 29-30, 2006
Data Standards and Build 3b Plans Steve Hughes MC Face-to-Face UCLA, Los Angeles, CA November 28-29, 2012.
Information Architecture WG: Report of the Fall 2010 Meeting October 29, 2010 Dan Crichton, Chair Steve Hughes (presenting) NASA/JPL.
PDS4 Project Update PDS MC F2F Flagstaff, AZ Dan Crichton August 22,
1 SDS&ADaM sub-team 28 January 2004 Mineko FUJIMOTO Rieko ICHIHARA Kazue TOMITA Hiroaki MATSUDA.
PDS M/C August 2012 PPI Node Report PDS Management Council August 28-29, 2012 R. J. Walker S. P. Joy T.A. King J. Mafi.
Validation Tool (VTool) PDS Management Council Meeting Washington, D.C. November 2006
PDS Atmospheres Node Plans for PDS4 User Roll-out 8/28/12PDS4 Roll-outStatus 1 Reta Beebe Lyle Huber Lynn Neakrase Jim Murphy Nancy Chanover Joni Johnson.
1 PDS 4 Data Design WG Face-to-Face Summary PDS Management Council March 25, 2010.
Operations Report PDS Management Council Meeting Flagstaff, Arizona August 2006
Data Standards Development August 29, Topics 1.Current Status 2.What was delivered for Build 2c 3.How was IPDA supported 4.What mission support.
Data Model & DDWG Update Management Council Face-to-Face Flagstaff, Arizona August 22-23, 2011.
PDS Geosciences Node Page 1 Archiving LCROSS Ground Observation Data in the Planetary Data System Edward Guinness and Susan Slavney PDS Geosciences Node.
Presented to Wisconsin Department of Transportation presented by Traffic Operation Infrastructure Plan Team 3/10/08 Traffic Operation Infrastructure Plan.
Development Report Engineering Node August 2006
Djc -1 Daniel J. Crichton NASA/JPL 9 May 2006 CCSDS Information Architecture Working Group.
PDS4 Mission Needs Assessment Reta Beebe Dan Crichton.
Standards & Interoperability (S&I) Structured Data Capture (SDC) FHIR Profile IG SWG.
Small Bodies Node Report Michael F. A’Hearn, Donald R. Davis, Ludmilla Kolokolova, & Carol Neese 28/8/12PDS Management Councilmfa 1.
Information Model and DDWG Updates MC Face-to-Face UCLA Los Angeles, California August 26-27, 2014.
Data Integrity Management Council F2F Washington, D.C. November 29-30, 2006
Query Health Technical WG Update 1/5/2012. Agenda TopicTime Slot Administrative stuff and reminders2:00 – 2:05 pm Technical Approach Consensus Update.
1 Steve Hughes Daniel J. Crichton NASA/JPL January 16, 2007 CCSDS Information Architecture Working.
Planetary Data System (PDS) Tom Morgan November 24, 2014.
1940 Census Workshop September 13, 2010 Rebecca C. Warlow National Archives and Records Administration (NARA) Digital Strategies and Services Staff
Presented By Margaret Hellen Atiro Uganda Bureau of Statistics at the United Nations Regional Seminar on Census Data Archiving 20 – 23 Sep 2011, Addis.
Project Introduction Spring InSPIRESS Challenge 2 Design an autonomous science payload for the Titan Environmental and Atmospheric Measurement (TEAM)
Tools Report Engineering Node March 2007
Movies Engineering Node Standards August 13, 2007.
PDS4 Project Report PDS MC F2F UCLA Dan Crichton November 28,
PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,
Digitizing Historical Newspapers South Carolina Digital Newspaper Program's participation with the Library of Congress' Chronicling America: Historic American.
IPDA Architecture Project International Planetary Data Alliance IPDA Architecture Project Report.
PDS4 Data Standards IPDA - JAXA July 22, Topics Schedule and Status of the PDS4 Information Model (IM) Data Design Working Group and Task Statuses.
PDS4 Data Standards IPDA Steering Committee Meeting Paris, France July 16-18, 2013.
International Planetary Data Alliance Registry Project Update September 16, 2011.
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
Tools Report Engineering Node August 2007
IPDA Standards Identification Project - Report B Gopala Krishna Elizabeth Rye Dan Crichton Steve Hughes Dave Heather Navita Thakkar.
The Next Generation PDS Archive Data Standards
Implementation Review Team Meeting
PDS 2010 Project Overview: Description, Plans and Status
Summary and Action Points
Presentation at VOPlaneto 2009 Under the SC-B of COSPAR
Presentation transcript:

1 PDS 4 Data Design Report PDS Management Council April 2, 2009 PDS 2010 Data Design WG

Data Architecture Scope 2

Key Deliverables PDS4 Information Model The Information Model defines the objects in the PDS archive. This includes data structures, formats, and products as well as data sets, documents, missions. PDS4 Data Dictionary Model The Data Dictionary Model provides the schema for the PDS data dictionary. The data dictionary defines the data elements used in the PDS4 Information Model. PDS Standards Reference V4.0 and V4.1 Version 4.0 of the PDS Standards Reference document will be a rewrite of Version 3.x. Version 4.1 will be an update released toward the end of the project. Grammar The Grammar will be used to capture PDS archive metadata for product labels. The plan is to replace or fix ODL. XML is being considered as an additional grammar. 3

Data Design Working Group Formed in December 2008 Personnel Steve Hughes (Lead) Mitch Gordon (Rings) Edward Guinness (Geosciences) Lyle Huber (Atmospheres) Ron Joyner (EN) Anne Raugh (SBN) Elizabeth Rye (Imaging, Standards) Steve Joy (PPI) Dick Simpson (Observer) Weekly Telecons Project Website Just released version “m” of the model to the PDS engineering website. The design documents and example labels are re-generated after the application of updates to the information model database. 4

Data Design WG Schedule 04-Dec Project and Project Members Defined 31-Dec Requirements updated 30-Apr General Data Model (Draft) 30-Apr Product Data Model (Draft) 30-Apr Data Dictionary Model (Draft) 30-Apr Grammar Options 30-Apr PDS Standards Reference (Outline) 30-Sep Data Dictionary Model (Final) 30-Sep Grammar Decision 30-Sep PDS Standards Reference (Draft) Interim - PDS and community wide review 30-Jul General Data Model (Final) 30-Jul Product Data Model (Final) 30-Jul PDS Standards Reference (Final) 5 Done Substantial Progress

PDS4 Data Product Concept Map 6 Web ViewProgrammer ViewDesigner ViewUser View

Working Group Accomplishments To Date 7 Four basic data structures Homogeneous N-dimensional array of scalars – Array_Base Heterogeneous repeating record structure of scalars – Table_Base Unencoded byte stream Encoded byte stream Identifiable Digital Product Data Product 2-D Image Product … Document Set Non-Digital Product Mission Instrument Resource Data Type Binary Data Type Decimal Integer … Character Literals Character Integer … Array_Base 2D_Array 2D_Image 2D_Spectrum 3D-Array 3D_Wavelength_Array 3D_Image 3D-Spectral_Array 3D_Time_Array Movie 3D_Spatial_Array N>3-D Array Table_Base Character_Table_Base Binary_Table_Base Draft PDS Data Dictionary Model Grammar – ODL+, XML, and AnneML Labels

Prototype ODL+ Label Template (Data Structure) 8 /* Object Section */ Object = 2D_Image axes_order = FAST2SLOW axis_length = (${axis_length}, ${axis_length}) axis_name = (${axis_name}, ${axis_name}) axis_type = (${axis_type}, ${axis_type}) axis_unit = (${axis_unit}, ${axis_unit}) byte_order = MSBF description = ${description} /* Optional */ element_bytes = ${element_bytes} /* Optional */ element_offset = ${element_offset} /* Optional */ element_scale = ${element_scale} /* Optional */ element_type = ${element_type} element_unit = ${element_unit} /* Optional */ first_element = TOPLEFT min_index = 0 number_of_axes = 2 End_Object = 2D_Image END

Prototype ODL+ Label Template (Other stuff) 9 #PDS4# /* ******* Label Template : 2D_Image_Label ******* */ PDS_Unique_Identifier = ${PDS_Unique_Identifier} /* Identification Section */ Object = Identification_Section dd_version_id = ${dd_version_id} label_revision_note = ${label_revision_note} pds_version_id = PDS4.0 End_Object = Identification_Section /* Dataset Section */ Object = Dataset_Section data_set_id = ${data_set_id} End_Object = Dataset_Section /* Instrument Section */ … /* Mission Section */ … /* Node Section */ … /* Circumstances of Observation Section */ …

Prototype XML Label – XML/Schema <xs:complexType name="2D_Image_Type <xs:element name="axis_length" <xs:element name="axis_name" <xs:element name="axis_type" <xs:element name="axis_unit" <xs:element name="byte_order" <xs:element name="element_bytes" <xs:element name="element_offset" <xs:element name="element_scale" <xs:element name="element_type" <xs:element name="element_unit" <xs:element name="first_element" <xs:element name="min_index" <xs:element name="number_of_axes" …

Prototype AnneML Label 11 PDS4 Label { Use Dictionary PDS4; Use Dictionary ; … class 3D_Image { axes_order = FAST2SLOW; axis_length = (${axis_length},${axis_length}, ${axis_length}); axis_name = (${axis_name}, ${axis_name}, ${axis_name}); axis_type = (${axis_type}, ${axis_type}, ${axis_type}); axis_unit = (${axis_unit}, ${axis_unit}, ${axis_unit}); … element_bytes = ${element_bytes}; /* Optional */ element_offset = ${element_offset}; /* Optional */ element_scale = ${element_scale}; /* Optional */ element_type = ${element_type}; element_unit = ${element_unit}; /* Optional */ … number_of_axes = 3; … };

Next Steps 12 Continue design work in preparation for Tech Session PDS Technical Staff Review Information Model Obtain consent to continue along current design path Grammar Present options and move toward adoption of one or two of the options Data Dictionary Model Present draft model and consider adoption Standards Reference Present outline and request feedback