ESA Report to DAI/IPR WG

Slides:



Advertisements
Similar presentations
A Tour of the OAIS Reference Model Brian Lavoie Research Scientist Office of Research OCLC Museum Computer Network Annual Conference September 2002.
Advertisements

Long-Term Preservation. Technical Approaches to Long-Term Preservation the challenge is to interpret formats a similar development: sound carriers From.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group Session LTDP Activities & DSIG Introduction WGISS-37 Meeting Cocoa Beach (Florida-US)
Slide: 1 ROSA GRAS Meeting February 2009 Matera, Italy User Services EUMETSAT EUMETSAT Data Access & User Support.
DOSTAG Meeting #51, 3 rd May 2007 Access to ESA Earth Observation data (past and current missions)
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
ISO & OAI-PMH By Neal Harmeyer, Amy Hatfield, and Brandon Beatty PURDUE UNIVERSITY RESEARCH REPOSITORY.
Mike Smorul Saurabh Channan Digital Preservation and Archiving at the Institute for Advanced Computer Studies University of Maryland, College Park.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
ESA Report to DAI/IPR WG Gian Maria Pinna ESA/ESRIN DAI/IPR meeting Colorado Springs January 2007.
An Overview of Selected ISO Standards Applicable to Digital Archives Science Archives in the 21st Century 25 April 2007 Donald Sawyer - NASA/GSFC/NSSDC.
Statewide Digitization and the FCLA Digital Archive Priscilla Caplan, Florida Center for Library Automation Statewide Digitization Planners Meeting OCLC,
APA Conference, London, 8-9 November 2011 Mirko Albani (Earth Observation Ground Segment Department, European Space Agency) ESA Long Term Data Preservation.
1 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview.
CAPACITY Operational Atmospheric Chemistry Monitoring Missions CAPACITY Final Meeting - WP Ground Segment synthesis Final Meeting ESTEC02/06/05.
Reference Model for an Open Archival Information System (OAIS) ESIP Summer Meeting John Garrett – ADNET Systems at NASA/GSFC ESIP Summer Meeting.
Current Applications of the OAIS Model David Giaretta.
Satellites, Ground Segment, and Data Access Evolution at DLR K
Standard Archive Format for Europe Gian Maria PinnaESA WGISS-21 Budapest 8 May 2006.
CCSDS MOIMS Springs Meeting 2006 – Rome - June 2006 XFDU & SAFE - ESA return from experience ESA return from experience & f Stéphane Mbaye
OAIS Rathachai Chawuthai Information Management CSIM / AIT Issued document 1.0.
Funded by: © AHDS Preservation in Institutional Repositories Preliminary conclusions of the SHERPA DP project Gareth Knight Digital Preservation Officer.
April 12, 2005 WHAT DOES IT MEAN TO BE AN ARCHIVES? Trusted Digital Repository Model Original Presentation by Bruce Ambacher Extended by Don Sawyer 12.
M-1 ISO “Reference Model For an Open Archival Information System (OAIS)” ISO “Reference Model For an Open Archival Information System (OAIS)” Presentation.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group WGISS-40 Meeting Preservation of SW & Documents at CEOS Agencies Approaches and Lessons.
ESA Report to DAI/IPR WG Gian Maria Pinna DAI/IPR meeting Toulouse 2-5 November 2004.
OAIS Based Certification David Giaretta ERPANET WORKSHOP Antwerpen April 2004.
M-1 INGEST OVERVIEW Don Sawyer National Space Science Data Center NASA/GSFC October 13, 1999.
Some OAIS Concepts ICPSR Conforming to OAIS 1. Fulfill 6 OAIS Responsibilities 2. Conform to the OAIS Information Model.
Preservation metadata and the Cedars project Michael Day UKOLN: UK Office for Library and Information Networking University of Bath
Open Grid Services for Earth Observation Pedro Gonçalves.
Infrastructure Breakout What capacities should we build now to manage data and migrate it over the future generations of technologies, standards, formats,
The OAIS model SEEDS meeting May 5 th, 2015, Lausanne Bojana Tasic.
OAIS (archive) Producer Management Consumer. Representation Information Data Object Information Object Interpreted using its Yields.
Frascati, 2-3 July 2008 Slide 1 HMA User Management in G-POD HMA-T Phase 2 KO Meeting 2-3 July 2008, Frascati Fabrice Brito, Terradue Srl
OAIS (archive) OAIS (archive) Producer Management Consumer.
INFORMATION SYSTEMS SERVICES UNIVERSITY OF LEEDS ERPANET: OAIS Seminar Copenhagen - København 28th November 2002 Introducing the OAIS Model _________________________________.
Page 1PV2009, 1-3/12/2009 The ESA Earth Observation Payload Data Long Term Storage Activities Gian Maria Pinna (1), Francesco Ferrante (2) (1) ESA-ESRIN.
Frascati, 2-3 July 2008 Slide 1 User Management compliance testing for G-POD HMA-T Phase 2 KO Meeting 2-3 July 2008, Frascati Andrew Woolf, STFC Rutherford.
Jordi Farres HMA-WG Meeting ESRIN, 23 Jan 2013
Preservation Planning
CESSDA SaW Training on Trust, Identifying Demand & Networking
Ingest and Dissemination with DAITSS
RSS Data-farm: from local storage to the cloud
Criteria for Assessing Repository Trustworthiness: An Assessment
Trusted Repository Systems Overview
Gian Maria Pinna, Vincenzo Beruti ESA
OAIS Producer (archive) Consumer Management
Adapted from Presentations by:
22 September 2017, ESA/ESRIN - Frascati
DAITSS: Dark Archive in the Sunshine State
Statewide Digitization and the FCLA Digital Archive
Active Data Management in Space 20m DG
Copernicus Programme European Commission CEOS Plenary 2017
Data Access Operational Interfaces for GMES Contributing Missions
Open Archival Information System (OAIS)
The VITO Earth Observation LTDA Facility
Metadata for preservation
Pier Giorgio Marchetti, Philippe Mougnaud European Space Agency
Research data preservation in Canada
OGC and activities HMA-T Phase 2 KO Meeting
e-Invoicing – e-Ordering 20/11/2008
Open Archival Information System
Institutional Repositories
A Tale of Two Archives: Notes from the Dark Side
Robin Dale RLG OAIS Functionality Robin Dale RLG
The Reference Model for an Open Archival Information System (OAIS)
Data Management Components for a Research Data Archive
Federated Earth Observation (FedEO)
Presentation transcript:

ESA Report to DAI/IPR WG Gian Maria Pinna ESA/ESRIN DAI/IPR meeting Athens 12 April 2005

MMFI Current Status MultiMission Facility Infrastructure is evolving to accommodate the full set of requirements from existing and future ESA supported missions Main contract is FEOMI (Facilities Evolution into and Open Multimission Infrastructure), aiming at defining the new MMFI architecture porting present mission-specific Envisat, ERS and TPMs ground segments Phase-1 successfully completed with Preliminary Design Review milestone achievement

Facility Ground Segment

Facility Ground Segment and MMFI FGS Mission Specific Elements

MMFI and OAIS With respect to the OAIS reference model, there are conceptually two approaches to analyze the FGS in the context of the ESA mission payload infrastructure: The FGS can be viewed as one essential part of the whole organization providing an OAIS conformant distributed archive. This is the ADAR approach The FGS can be itself defined as an OAIS conformant archive that is part of a cluster of federated OAIS archives, where the central infrastructure elements provide federation

MMFI and OAIS (2) The requirements on the responsibilities are applicable to the organization that operates the OAIS archive. The OAIS conforming system shall enable the organization to: Negotiate for and accept appropriate information from data producers Obtain sufficient control of the information provided to the level needed to ensure long-term preservation Determine, either by itself or in conjunction with other parties, which communities should become the designated community and therefore should be able to understand the information provided Ensure that the information to be preserved is independently understandable to the designated community Follow documented policies and procedures which ensure that the information is preserved against all reasonable contingencies, and which enable the information to be disseminated as authenticated copies of the original, or as traceable to the original Make the preserved information available to the designated community The MMFI enables ESA at the sites to fulfil the requirements 1, 2 and 6. The other requirements have to be fulfilled on organizational level.

MMFI Logical Model (OAIS-based) Cataloguing Monitoring & Control Archiving Facility Ground Segment Ingest Access Processing DI AIP IDIP DIP ISIP Other FGS Central Infrastructure Exchange Production Request Handling SIP Data Producer Consumer Dissemination Legend: · SIP – Submission Information Package ISIP Internal Submission Information Package DI Descriptive Information DIP Dissemination Information Package IDIP Internal Dissemination Information Package AIP Archive Information Package

Monitoring and Control MMFI Architecture Central Infrastructure MMMC MMOHS Data Library Request Handling ULS Local Inventory POH Monitoring and Control CAR PSM AMS SatStore PR PSM Ingestion Processing Dissemination Online Archive OA-IF PSM Processing System IPF Other Proc. Processing System GFE Product Distri- bution PSM E-PFD PFD Network Server PFD Central Server DRS NRT Site Cache Circulation Cache In Circulation Cache Out DDS, ... Monitoring & Alarm Monitoring & Alarm Logging Operating Tool

MMFI - Ingestion

MMFI - On Request Diss. with Processing

MMFI - Re-processing

MMFI - Product Circulation

MMFI Hardware Setup

New Missions and Developments In line with Oxygen, all new ESA EO missions will rely at various levels on the MMFI architecture and components GOCE LTA development started, based on present MMFI (pre-FEOMI) AEOLUS LTA development to be started, architecture now re-baselined to be fully MMFI compliant SWARM and SMOS full ground segments (Core PDS and LTA) proposed to be fully MMFI-based GMES Sentinel missions concept. Study ITT published, awaiting for industry proposals. SoW requires MMFI analysis and reuse New processing systems under development will have MMFI interface (e.g. new Linux-based Envisat processors)

HARM (Historical Archive Rationalization and Management) See presentation given in Toulouse Analysis of data volume reduction from orbit stitching on-going Transcription HW&SW from old media (D1, DLT) to AMS (StorageTek T9940B based) started for selected datasets Transcription of Envisat off-line datasets to be started (~60000 tapes on shelves) SAFE (Standard Archive Format for Europe) – see later

Other activities PV-2004 proceedings CD-ROM ready to be delivered to participants Support to PV-2005 organization. Edinburgh, UK – 21-23 November 2005) PV-2007 to be hosted by DLR in Oberpfaffenhofen, Germany 2002-2004-2005-2007-…  PV is becoming a regular venue! Presentation to 19th International CODATA conference in Berlin MMFI architecture based on OAIS and SAFE based on XFDU presented Presentation on data compression usage in ESA EO ground segment given to OGC meeting held in Frascati Interest in collaboration with OGC for upcoming GML/JPEG2000 packaging OGC standard

Standard Archive Format for Europe (SAFE) ESA’s goal is to make SAFE: Compliant with ISO 14721:2003 OAIS (Open Archival Information System) reference model Compliant with emerging CCSDS/ISO XFDU (XML Formatted Data Units) packaging format Designed to act as a standard format for archiving and conveying data within ESA Earth Observation archiving facilities Although the primarily goal of SAFE, in the framework of the HARM project, is to handle EO data with processing levels close to the usually called “level 0”, no a-priori limitations should exist regarding the packaging of higher level products