Data SG – Archive Task Team - 9th May 2002 CEOS ICF Baseband Data Archive InterChange Format Baseband Data Archive InterChange Format Commitee on Earth Observation Satellites (CEOS) Working Group on Information Systems and Services (WGISS) Meeting Frascati, Italy Stéphane MBAYE GAEL Consultant

Data SG – Archive Task Team - 9th May 2002 Rationale  Document status  CEOS ICF - Changes  Presentation - “Data Request Broker” (DRB)  Demo – Derby application  Document status  CEOS ICF - Changes  Presentation - “Data Request Broker” (DRB)  Demo – Derby application

Data SG – Archive Task Team - 9th May 2002 Document status  21/04/2000 – Draft 0 - Creation of the document  29/08/2000 – Draft 1 - Use of XML Schema instead of DTD  09/01/2001 – Draft 2 - Includes outputs of Bangkok ATT meeting  09/04/2001 – Draft 3 – Presented at Sioux Falls (USA)  23/07/2001 – Draft 4 – Includes outputs of Sioux Falls ATT meeting  23/08/2001 – Draft 5 – Vega France - Technical proof reading  06/04/2002 – Draft 6 – ESA-ESRIN - Technical proof reading  19/04/2002 – GAEL-CEOS-ICF – Issue 1, Revision 0  21/04/2000 – Draft 0 - Creation of the document  29/08/2000 – Draft 1 - Use of XML Schema instead of DTD  09/01/2001 – Draft 2 - Includes outputs of Bangkok ATT meeting  09/04/2001 – Draft 3 – Presented at Sioux Falls (USA)  23/07/2001 – Draft 4 – Includes outputs of Sioux Falls ATT meeting  23/08/2001 – Draft 5 – Vega France - Technical proof reading  06/04/2002 – Draft 6 – ESA-ESRIN - Technical proof reading  19/04/2002 – GAEL-CEOS-ICF – Issue 1, Revision 0

Data SG – Archive Task Team - 9th May 2002 Partitioning – Analysis  For archives biggest than 2 Gigabytes  Continuous subsets of a single Baseband Interchange Unit  Free cutting policy  For archives biggest than 2 Gigabytes  Continuous subsets of a single Baseband Interchange Unit  Free cutting policy Doc. §3.1 > CEOS ICF > Metadata File (XML) > Signal Data File (binary) 1 1..* > Allows partitioning

Data SG – Archive Task Team - 9th May 2002 Partitioning – Declaration  New markup:  Moved attribute: “src”  Updated Naming convention  New markup:  Moved attribute: “src”  Updated Naming convention ceos_icf signal_data subset block signal_data 1 subset 1..* block 1 start : dateTime stop : dateTime T09:37: T09:46: … Examples ERS dat ERS dat

Data SG – Archive Task Team - 9th May 2002 CEOS ICF Namespace  New XML Namespace:  Proposed XML Schema location: (TBC)  Use of xsd:targetNamespace in the CEOS ICF Schema  Recommend the use of xsi:schemaLocation  New XML Namespace:  Proposed XML Schema location: (TBC)  Use of xsd:targetNamespace in the CEOS ICF Schema  Recommend the use of xsi:schemaLocation Doc. §4.1 <ceos_icfxmlns=” xmlns:xsi=” xsi:schemaLocation=” …

Data SG – Archive Task Team - 9th May 2002 Blocks

Data SG – Archive Task Team - 9th May 2002 Block interface occurrence : positiveInteger > block name : string type : string offset : positiveInteger length : positiveInteger name : string type : string offset : positiveInteger length : positiveInteger

Data SG – Archive Task Team - 9th May 2002 Composite block composite

Data SG – Archive Task Team - 9th May 2002 Telemetry map telemetry_map downlinkOffset : positiveInteger downlinkLength : positiveInteger property [*] : string downlinkOffset : positiveInteger downlinkLength : positiveInteger property [*] : string

Data SG – Archive Task Team - 9th May 2002 Telemetry map - example pn_decoded compressed

Data SG – Archive Task Team - 9th May 2002 Timestamp time_stamp Facility facility

Data SG – Archive Task Team - 9th May 2002 Timestamp - example 2 ESA FUCINO ITALY TMFR 1.4.0

Data SG – Archive Task Team - 9th May 2002 Quality flag quality_flag 1

Data SG – Archive Task Team - 9th May 2002 ERS example T09:37: T09:46:

Data SG – Archive Task Team - 9th May 2002 The “Data Request Broker” - DRB

Data SG – Archive Task Team - 9th May extension DRB Derby Software

Data SG – Archive Task Team - 9th May 2002 DRB architecture Applications Data Request Broker (DRB) XQuery Engine Schema File SDF XML docs Directories & Files XQuery scripts XML HDF HDF files Binary files ENVISAT-PDS Formats Landsat 5/7 CEOS, Fast SPOT etc. Interface Implementations Data sources Facilities XML Schema CEOS ICF SPOT 5 - DIMAP

Data SG – Archive Task Team - 9th May 2002 Derby software (demo)

Data SG – Archive Task Team - 9th May 2002 ESA + Industry Format design iterative loop Application 1 – Sharing knowledge description ESA CAO Control Authority Office Version management ESA + Industry Processor design in ground segments Validation, non regression ESA PDCC Long loop Quality Control ESA Ground segments Product Quality Control Other agencies Archive interchange End users Data display, analysis Sciences community Multi-disciplinary approach ENVISAT AATSR XML Schema ENVISAT MERIS XML Schema ENVISAT ASAR XML Schema ERS SAR XML Schema

Data SG – Archive Task Team - 9th May 2002 Application 2 – Towards a generic transcription 1 – Physical + logical transcription FRED to MDPS semantic translation MDPS writerFRED reader MDPS baseband Archive FRED baseband Archive CEOS ICF format Generic « EO mission » model CEOS ICF interchange Archive CEOS ICF to MDPS semantic translation FRED to CEOS ICF semantic translation FRED reader DOM MDPS writer DOM

Data SG – Archive Task Team - 9th May Logical transcription (DRB) FRED to MDPS semantic translation DRB / SDF Application 2 – Up to a generic transcription MDPS XML Schema CEOS ICF XML Schema or Generic « EO mission » model FRED XML Schema CEOS ICF interchange Archive MDPS baseband Archive FRED baseband Archive CEOS ICF to MDPS semantic translation FRED to CEOS ICF semantic translation DRB / SDF DRB / XML DRB / SDF DRB / XML

Data SG – Archive Task Team - 9th May 2002 Application 2 – Up to a generic transcription 3 - Generic transcription MDPS XML Schema CEOS ICF XML Schema or Generic « EO mission » model FRED XML Schema Generic translation engine DRB / SDF CEOS ICF interchange Archive MDPS baseband Archive Generic translation engine FRED baseband Archive Generic translation engine DRB / SDF DRB / XML DRB / SDF DRB / XML

Data SG – Archive Task Team - 9th May 2002 Thank you !