Download presentation
Presentation is loading. Please wait.
Published byDebra Stewart Modified over 9 years ago
1
C. Huc/CNES, D. Boucon/CNES-SILOGIC, D.M. Sawyer/NASA/GSFC, J.G. Garrett/NASA-Raytheon Producer-Archive Interface Methodology Abstract Standard PAIMAS
2
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology2 Contents Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status Proposed methodology Context - description The 4 phases Specialization Aid Tool for the use of the Methodology Towards an implementation standard Conclusions
3
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology3 Why a new standard? Space data archiving: archive types Telemetry Operation control Payload control Mission exploitation Mission archives Mission control system Scientific multi-mission data centers: long-term archives
4
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology4 Data Producers: the operating systems of each mission the mission processing and archiving centres the scientific teams in the laboratories Archive specialized independent organizations (CDS) specialized services within the agencies (NSSDC) services common to several organizations (CDPP) a P roducer-Archive Project is a set of activities and the means used by the Information Producer as well as the Archive to ingest a given set of information into the Archive. Why a new standard? Space data archiving: key roles and players
5
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology5 The relations between archives and data Producers are rarely simple and easy: nonconformity of received data unclear and imprecise definition of the data to be delivered, failure to meet delivery schedule, late detection of errors in archived data, non-management of modifications ==> Can be detrimental to archived information quality and the cost of the operation. Ever increasing diversity of the producers Data complexity Each project develops its own methodology on the basis of a process that is roughly the same from one project to another ==> Work duplicated, no generality, excessively high costs, etc. Why a new standard? Needs for standardization: problems
6
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology6 PAIMAS Generic abstract standard Community abstract standard PAIMAS Implementation standard Approved by the CCSDS Development in progress Why a new standard? Needs for standardization: multiple standards
7
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology7 Ease some typical problems (as noted earlier) Make it easier to follow schedules and commitments Help with human resources turnover Anticipate new problems Address the legal aspects early Increase data quality of archive holdings Have weight and credibility for adoption And finally, save time (and money) Why a new standard? What standardization will bring
8
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology8 Today: CCSDS standard (blue book) and standardization with ISO in progress Various communities have helped produce this document : space agencies (CNES, NASA, ESA, …) archivists (NARA, …) and librarians (BNF -French National Library, RLG- Research Library Group). Why a new standard? Abstract standard status
9
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology9 Contents Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status Proposed methodology Context - description The 4 phases Specialization Aid Tool for the use of the Methodology Towards an implementation standard Conclusion
10
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology10 Methodology Context: OAIS environment
11
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology11 AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package Methodology Context: PAIMAS focus
12
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology12 AIP : Archival Information Package, SIP : Submission Information Package, DIP : Dissemination Information package Ingest Methodology Context: PAIMAS focus
13
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology13 The archive project is broken down into 4 main phases: Preliminary Phase, Formal Definition Phase, Transfer Phase, Validation Phase. Each phase has extensive action tables. Specification for a community. Methodology Description
14
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology14 Data ready to archive Methodology The phases: relationships Preliminary Agreement Dictionary Formal model Submission Agreement Transferred object files Validation agreement Phase objective Preliminary Phase Formal Definition Phase Transfer Phase Validation Phase Anomalies Validate the transferred objects Identification and preliminary agreement Define the information to be archived resources estimation Negotiate the Submission Develop agreement (data to be delivered, complementary elements, schedule) Actual transfer of the data Actual transfer of the objects
15
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology15 Preliminary Phase Preliminary Agreement Methodology Preliminary phase: context Archive Producer
16
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology16 Methodology Preliminary phase: sub-phases Action table Description
17
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology17 Formal Definition Phase Preliminary Agreement Dictionary Data Model Submission Agreement Methodology Formal Definition Phase: context
18
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology18 Methodology Formal Definition Phase: sub-phases and action table
19
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology19 Transfer Phase Actual transfer of the objects: carry out the transfer test manage the transfer Data Model of object files to deliver Schedule Transferred object files Methodology Transfer Phase
20
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology20 Validation Phase Validate the transferred objects: carry out the validation test manage the validation Transferred object files Data ready to archive Anomalies Methodology Validation Phase Producer Validation acknowledgement
21
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology21 Contents Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status Proposed methodology Context - description The 4 phases Specialization Aid Tool for the use of the Methodology Towards an implementation standard Conclusion
22
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology22 Adapt the generic standard to a particular community (which can range from an international organization to a simple archive service) Steps involved to define a community standard terminology, data dictionary and information model, standards, common tools. Analyze each action of the generic standard (add actions if necessary) Specialization
23
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology23 Example (CDPP -Plasma Physics Data Center- Archive) F-4: Define the formats, coding rules, and standards to be applied for the objects to be delivered Generic Action (Methodology) Specific Action (CDPP) Apply the ‘specification of products for delivery to the CDPP’ including Use the Data Description Language EAST Specification defined by the CCSDS for the syntactic data description Use the CCSDS DEDSL- Data Entity Dictionary Structure Language- —XML/DTD Syntax for the semantic data description Use the CCSDS time code format for the date and time coding Etc. Specialization: Example
24
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology24 Contents Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status Proposed methodology Context - description The 4 phases Specialization Aid Tool for the use of the Methodology Towards an implementation standard Conclusion
25
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology25 A methodology application and archive project aid tool would be a real advantage for both the Producer and the Archive. First mockups produced Aid Tool
26
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology26 Aid Tool
27
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology27 Contents Why a new standard? Space data archiving Needs for standardization What standardization will bring Abstract standard status Proposed methodology Context - description The 4 phases Specialization Aid Tool for the use of the Methodology Towards an implementation standard Conclusion
28
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology28 PAIMAS Generic abstract standard Implementation standard Methodology application aid Languages Tools Community standard Archive project Towards an implementation standard Context
29
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology29 generic data model –transfer data model (generic objects) –transfer data dictionary (generic descriptors) –community dictionary diagram of data to transfer for the archive project transfer sequencing and chronology transfer session Implementation standard Languages Tools XML XML Schema UML XMLScheme DEDSL DTD XMLScheme XFDU Towards an implementation standard Approach
30
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology30 Towards an implementation standard Relationships CLUS-CIS-CODIF-Jm CLUS-CIS-CODIF-EAST CODIF CIS HIA CLUS-CIS-HIA-EAST CLUS-CIS-HIA-Jn CLUSTER
31
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology31 Delivery plan all the elements to be delivered easy to understand from the Producer side expression of constraints Towards an implementation standard Schema
32
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology32 Conclusion PAIMAS identifies: the phases in the process of transferring information, the objective of the phases, the actions that must be carried out, the expected results. PAIMAS is a basis: for the identification of standards and implementation guides, for identification and development of a set of software tools.
33
SpaceOps, Montreal, 2004-05-15Producer-Archive Methodology33
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.