C. Huc/CNES, D. Boucon/CNES-SILOGIC, D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon Producer-Archive Interface Methodology Abstract Standard PAIMAS

SpaceOps, Montreal, Producer-Archive Methodology2 Contents  Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status  Proposed methodology Context - description The 4 phases  Specialization  Aid Tool for the use of the Methodology  Towards an implementation standard  Conclusions

SpaceOps, Montreal, Producer-Archive Methodology3 Why a new standard? Space data archiving: archive types Telemetry Operation control Payload control Mission exploitation Mission archives Mission control system Scientific multi-mission data centers: long-term archives

SpaceOps, Montreal, Producer-Archive Methodology4  Data Producers: the operating systems of each mission the mission processing and archiving centres the scientific teams in the laboratories  Archive specialized independent organizations (CDS) specialized services within the agencies (NSSDC) services common to several organizations (CDPP) a P roducer-Archive Project is a set of activities and the means used by the Information Producer as well as the Archive to ingest a given set of information into the Archive. Why a new standard? Space data archiving: key roles and players

SpaceOps, Montreal, Producer-Archive Methodology5  The relations between archives and data Producers are rarely simple and easy: nonconformity of received data unclear and imprecise definition of the data to be delivered, failure to meet delivery schedule, late detection of errors in archived data, non-management of modifications ==> Can be detrimental to archived information quality and the cost of the operation.  Ever increasing diversity of the producers  Data complexity  Each project develops its own methodology on the basis of a process that is roughly the same from one project to another ==> Work duplicated, no generality, excessively high costs, etc. Why a new standard? Needs for standardization: problems

SpaceOps, Montreal, Producer-Archive Methodology6 PAIMAS Generic abstract standard Community abstract standard PAIMAS Implementation standard Approved by the CCSDS Development in progress Why a new standard? Needs for standardization: multiple standards

SpaceOps, Montreal, Producer-Archive Methodology7  Ease some typical problems (as noted earlier)  Make it easier to follow schedules and commitments  Help with human resources turnover  Anticipate new problems  Address the legal aspects early  Increase data quality of archive holdings  Have weight and credibility for adoption  And finally, save time (and money) Why a new standard? What standardization will bring

SpaceOps, Montreal, Producer-Archive Methodology8  Today: CCSDS standard (blue book) and standardization with ISO in progress  Various communities have helped produce this document : space agencies (CNES, NASA, ESA, …) archivists (NARA, …) and librarians (BNF -French National Library, RLG- Research Library Group). Why a new standard? Abstract standard status

SpaceOps, Montreal, Producer-Archive Methodology9 Contents  Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status  Proposed methodology Context - description The 4 phases  Specialization  Aid Tool for the use of the Methodology  Towards an implementation standard  Conclusion

SpaceOps, Montreal, Producer-Archive Methodology10 Methodology Context: OAIS environment

SpaceOps, Montreal, Producer-Archive Methodology11 AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package Methodology Context: PAIMAS focus

SpaceOps, Montreal, Producer-Archive Methodology12 AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package Ingest Methodology Context: PAIMAS focus

SpaceOps, Montreal, Producer-Archive Methodology13  The archive project is broken down into 4 main phases: Preliminary Phase, Formal Definition Phase, Transfer Phase, Validation Phase.  Each phase has extensive action tables.  Specification for a community. Methodology Description

SpaceOps, Montreal, Producer-Archive Methodology14 Data ready to archive Methodology The phases: relationships Preliminary Agreement Dictionary Formal model Submission Agreement Transferred object files Validation agreement Phase objective Preliminary Phase Formal Definition Phase Transfer Phase Validation Phase Anomalies Validate the transferred objects Identification and preliminary agreement Define the information to be archived resources estimation Negotiate the Submission Develop agreement (data to be delivered, complementary elements, schedule) Actual transfer of the data Actual transfer of the objects

SpaceOps, Montreal, Producer-Archive Methodology15 Preliminary Phase Preliminary Agreement Methodology Preliminary phase: context Archive Producer

SpaceOps, Montreal, Producer-Archive Methodology16 Methodology Preliminary phase: sub-phases Action table Description

SpaceOps, Montreal, Producer-Archive Methodology17 Formal Definition Phase Preliminary Agreement Dictionary Data Model Submission Agreement Methodology Formal Definition Phase: context

SpaceOps, Montreal, Producer-Archive Methodology18 Methodology Formal Definition Phase: sub-phases and action table

SpaceOps, Montreal, Producer-Archive Methodology19 Transfer Phase Actual transfer of the objects: carry out the transfer test manage the transfer Data Model of object files to deliver Schedule Transferred object files Methodology Transfer Phase

SpaceOps, Montreal, Producer-Archive Methodology20 Validation Phase Validate the transferred objects: carry out the validation test manage the validation Transferred object files Data ready to archive Anomalies Methodology Validation Phase Producer Validation acknowledgement

SpaceOps, Montreal, Producer-Archive Methodology21 Contents  Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status  Proposed methodology Context - description The 4 phases  Specialization  Aid Tool for the use of the Methodology  Towards an implementation standard  Conclusion

SpaceOps, Montreal, Producer-Archive Methodology22  Adapt the generic standard to a particular community (which can range from an international organization to a simple archive service)  Steps involved to define a community standard terminology, data dictionary and information model, standards, common tools.  Analyze each action of the generic standard (add actions if necessary) Specialization

SpaceOps, Montreal, Producer-Archive Methodology23  Example (CDPP -Plasma Physics Data Center- Archive) F-4: Define the formats, coding rules, and standards to be applied for the objects to be delivered Generic Action (Methodology) Specific Action (CDPP) Apply the ‘specification of products for delivery to the CDPP’ including Use the Data Description Language EAST Specification defined by the CCSDS for the syntactic data description Use the CCSDS DEDSL- Data Entity Dictionary Structure Language- —XML/DTD Syntax for the semantic data description Use the CCSDS time code format for the date and time coding Etc. Specialization: Example

SpaceOps, Montreal, Producer-Archive Methodology24 Contents  Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status  Proposed methodology Context - description The 4 phases  Specialization  Aid Tool for the use of the Methodology  Towards an implementation standard  Conclusion

SpaceOps, Montreal, Producer-Archive Methodology25 A methodology application and archive project aid tool would be a real advantage for both the Producer and the Archive. First mockups produced Aid Tool

SpaceOps, Montreal, Producer-Archive Methodology26 Aid Tool

SpaceOps, Montreal, Producer-Archive Methodology27 Contents  Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status  Proposed methodology Context - description The 4 phases  Specialization  Aid Tool for the use of the Methodology  Towards an implementation standard  Conclusion

SpaceOps, Montreal, Producer-Archive Methodology28 PAIMAS Generic abstract standard Implementation standard Methodology application aid Languages Tools Community standard Archive project Towards an implementation standard Context

SpaceOps, Montreal, Producer-Archive Methodology29 generic data model –transfer data model (generic objects) –transfer data dictionary (generic descriptors) –community dictionary diagram of data to transfer for the archive project transfer sequencing and chronology transfer session Implementation standard Languages Tools XML XML Schema UML XMLScheme DEDSL DTD XMLScheme XFDU Towards an implementation standard Approach

SpaceOps, Montreal, Producer-Archive Methodology30 Towards an implementation standard Relationships CLUS-CIS-CODIF-Jm CLUS-CIS-CODIF-EAST CODIF CIS HIA CLUS-CIS-HIA-EAST CLUS-CIS-HIA-Jn CLUSTER

SpaceOps, Montreal, Producer-Archive Methodology31  Delivery plan all the elements to be delivered easy to understand from the Producer side expression of constraints Towards an implementation standard Schema

SpaceOps, Montreal, Producer-Archive Methodology32 Conclusion  PAIMAS identifies: the phases in the process of transferring information, the objective of the phases, the actions that must be carried out, the expected results.  PAIMAS is a basis: for the identification of standards and implementation guides, for identification and development of a set of software tools.

SpaceOps, Montreal, Producer-Archive Methodology33