1. APA Conference, London, 8-9 November 2011 Mirko Albani (Earth Observation Ground Segment Department, European Space Agency) ESA Long Term Data Preservation Activities and SCIDIP-ES project

2. ESA Earth Observation Long Term Data Preservation (LTDP) Activities SCIDIP-ES Project ESA LTDP future programme Presentation Outline ESA Earth Observation Long Term Data Preservation (LTDP) Activities SCIDIP-ES Project ESA LTDP future programme

3. METEOSAT Second Generation MSG-1, -2, -3 METEOSAT M-1, 2, 3, 4, 5, 6, 7 METOP-1, -2, -3 Earth Watch Earth Explorers ERS-1, -2ENVISAT GOCE GMES in cooperation with EC SMOS (Gravity and Ocean Circulation Explorer) Earthnet: Access for European users to non-ESA missions: Landsat, SPOT, CZCS, J-ERS, SeaWiFS, ALOS... Sentinel 1 Sentinel 2 to better understand the Earth System in cooperation with EUMETSAT Meteo Applications Services to initiate long term monitoring systems and services Sentinel 4/5 Science (Gravity and Ocean Circulation Explorer) (Soil Moisture and Ocean Salinity) CryoSat2 (Polar Ice Monitoring) ADM/Aeolus (Atmospheric Dynamics Mission) SWARM (Magnetic Mission) EarthCARE (Clouds, Aerosols & Radiation Mission) Sentinel 3 MTG EE 7 Sentinel 5P 1990 2000 2010 Since 1977 ESA and Earth Observation missions

4. EO Archives Data volume expected trend The plans of new ESA missions indicates 5-10 times more data to be archived (Level 0) in next 10-15 years.

5. ESA EO LTDP Preliminary Programme 2009-2011 Objectives: For all ESA Earth Observation and TPM ESA managed missions:  Ensure and secure the preservation of archived data and associated knowledge for an unlimited time span.  Ensure, enhance and facilitate archived data accessibility. As part of a coordinated and harmonized collective approach among the data owners in Europe (i.e. European EO LTDP Framework) aimed at preserving all European EO data and associated knowledge, at favouring their exploitation and sustained through cooperative (multi-source) long term funding schemes. Most urgent activities to prevent data loss and to enhance accessibility implemented in the ESA archives following the “European LTDP Common Guidelines” and “Data Set Content Standard”

6. ESA EO LTDP Preparatory Programme 2009-2011 Work Plan Completed or close to completion Started Analysis and Studies Implementation activities Evolution activities

7. International EO LTDP Context ESA membership Participation to several projects LTDP task WGISS Standards (e.g. OAIS)

8. SCIence Data Infrastructure for Preservation – Earth Science Project Overview Contacts: Mirko.Albani@esa.int www.scidip-es.euwww.scidip-es.eu (under construction)

9. Project: SCIence Data Infrastructure for Preservation – Earth Science (SCIDIP-ES) INFRA-2011-1.2.2 Data infrastructures for e-Science Introduction and Participants Project ID: 283401 Project Type: CP-CSA Start Date: 01.09.2011 Duration: 36 Months Website: www.scidip-es.eu Total Budget: 7,721,082 € EC Funding: 6,599,992 € Total funded effort in person/months: 605 Coordinator: European Space Agency Contact Person: Mirko Albani (EOP-GS) Project Consortium (17 partners):

10. Digital data preservation: the need “A fundamental characteristic of our age is the raising tide of data – global, diverse, valuable and complex. In the realm of science, this is both an opportunity and a challenge.” Report of the High-Level Group on Scientific Data, October 2010 “Riding the Wave: how Europe can gain from the raising tide of scientific data” 2

11. SCIDIP-ES Context 2 Needs and Communities Technology and Infrastructure Heritage System and standards SCIDIP From generic to specific The case The users From specific to generic 3

12. Main Objectives Deliver generic sustained services for long-term preservation and usability as part of the data infrastructure for e-Science. Harmonize data preservation policies, approaches and tools in the Earth Science Domain. Demonstration through advanced test-beds.

13. Approach: the HLEG Vision “Researchers and practitioners from any discipline are able to find, access and process the data they need. They can be confident in their ability to use and understand data and they can evaluate the degree to which the data can be trusted”. SCIDIP-ES addresses these points in the following ways: By working closely with real users. By ensuring the availability of an effective governance and maintenance of the services from the start, and by not trying to impose a top-down system. By addressing disciplinary and cross-disciplinary strategies for metadata definition to ensure that data can be re-used. By applying the subsidiarity and taking advantage of the growing need for researchers to use data from outside their own discipline.

14. Action Plan Combine a top-down, data centric point of view, using a proven design for generic infrastructure services for persistent storage, access and management, with a bottom- up, user-centric view, based on requirements, development, testing and validation, from the Earth Science community, within the framework of OAIS.

15. SCIDIP-ES Work packages relation

16. SCIDIP-ES Services

17. Projects & Dissemination links APA Members Organizations Research Projects Research Projects ESA LTDP Earth Science Community Earth Science Community APA Virtual Center of Excellence APA Virtual Center of Excellence

18. SCIDIP-ES results SCIDIP-ES will provide by the end of the project: Generic sustained long-term preservation services tested, validated and used in different domains and in particular in the Earth Science one. Harmonized Earth Science data preservation policies, approaches and architecture. SCIDIP - ES is a practical answer to one of the most challenging problems of the current digital era using the sensitive Earth Science domain as pathfinder.

19. ESA Earth Observation Long Term Data Preservation (LTDP) Activities SCIDIP-ES Project ESA LTDP future programme Presentation Outline ESA Earth Observation Long Term Data Preservation (LTDP) Activities SCIDIP-ES Project ESA LTDP future programme

20. ESA LTDP Future Programme It covers the period beyond 2013 and will be submitted to ESA delegations in 2012 for approval as part of the ESA mandatory activities. Objective to guarantee long term preservation, access and exploitation of data, and associated knowledge, archived at ESA facilities and generated by ESA and ESA-managed Third Party missions in ALL fields of space Science and in particular:  Scientific data generated by payloads and instruments onboard space platforms (e.g. spacecrafts, ISS) today not preserved systematically.  Enabling and supporting ESA’s and European Exploitation Programmes and activities requiring long term data series (e.g. Climate Change Initiative) or the utilization of old data holdings in the long term (e.g. in astronomy for change detection in stars, pre-ISS missions in Life & Physical Sciences) and to support new missions.  In coordination with other space science data owners in Europe aiming at coherently preserve all European space data and associated knowledge. Preservation and access to spaceborn Science data and associated knowledge is fundamental. The ESA LTDP Programme will significantly contribute to the future of science (and in particular Earth Science).

21. Thank you ! Any question ? Contacts: Mirko.Albani@esa.int Mirko.Albani@esa.int