The Copernicus Collaborative Ground Segment

Slides:



Advertisements
Similar presentations
GEOSS Workshop 20 September 2013 ESRIN P. Bargellini, Ground Segment and Mission Operations Department, Earth Observation Programmes Directorate, European.
Advertisements

Space/GMES and Climate Change Mikko Strahlendorff, GMES Bureau.
Earth Observation Envelope Programme Earthnet / Third Party Missions EarthWatch programme ERS & ENVISAT Missions The Living Planet Programme Meteo missions.
E arth Observation Information Day, Bruxelles 3rd October 2000 ESA EARTH WATCH STRATEGY OUTLOOKS L. Marelli Head of EO Earth Watch strategy.
Slide: 1 ROSA GRAS Meeting February 2009 Matera, Italy User Services EUMETSAT EUMETSAT Data Access & User Support.
DOSTAG Meeting #51, 3 rd May 2007 Access to ESA Earth Observation data (past and current missions)
Frank Martin Seifert EO Science and Applications Division ESA Earth Observation Programme SDCG-6 | 23 October 2014 | Oslo The European Copernicus Programme.
Spanish space activities Workshop of the interparliamentary space conference Cracovia, May 14th.
GEONETCast Implementation Group GEONETCast: Delivery global data and observations Presented by: Sally Wannop – EUMETSAT EU’s Speaker Corner at GEO-X, Geneva,
1 Volker Liebig (H/ESRIN, D-EOP) Gunther Kohlhammer Head of Earth Observation Ground Segment & Mission Operations Department 06 November 2012 Introduction.
Agency, version?, Date 2012 Coordination Group for Meteorological Satellites - CGMS Add CGMS agency logo here (in the slide master) Coordination Group.
23 rd CEOS Plenary I Phuket, Thailand I 3-5 November 2009 Status of the ESA Earth Observation Programmes Dr. Simonetta Cheli Head of Earth Observation.
Climate Sciences: Use Case and Vision Summary Philip Kershaw CEDA, RAL Space, STFC.
CAPACITY Operational Atmospheric Chemistry Monitoring Missions CAPACITY Final Meeting - WP Ground Segment synthesis Final Meeting ESTEC02/06/05.
EOP Standard Presentation
ERS & ENVISAT for the Ice Community Andrea Celentano IICWG Meeting 2001 – Norway.
Satellites, Ground Segment, and Data Access Evolution at DLR K
Slide 1 Second GPS/RO Users Workshop, August , The EUMETSAT Polar System GRAS SAF and Data Products Martin B. Sorensen GRAS SAF Project Atmosphere.
Committee on Earth Observation Satellites Plenary Agenda Item #3 29 th CEOS Plenary Kyoto International Conference Center Kyoto, Japan 5 – 6 November 2015.
ESA Report to DAI/IPR WG Gian Maria Pinna DAI/IPR meeting Toulouse 2-5 November 2004.
IPSentinel Portuguese Infrastructure for Storage and dissemination of Satellite Sentinel Images PT02_Aviso3_003.
The Copernicus Sentinel-3 Mission: Update on status Susanne Mecklenburg – ESA Sentinel-3 Mission Manager Sentinel-3 ESA development & operations teams.
2. WP9 – Earth Observation Applications ESA DataGrid Review Frascati, 10 June Welcome and introduction (15m) 2.WP9 – Earth Observation Applications.
|‌ 1 Task Coordinator: Brian Killough (CEOS) GEO Task IN-01 Status Report January 2014.
CEOS WGISS-40 COSMO-SkyMed Ground Segment & other Ground Segment Developments Richard Lowe – Group Manger, EO Systems & Operations.
Cloud-based e-science drivers for ESAs Sentinel Collaborative Ground Segment Kostas Koumandaros Greek Research & Technology Network Open Science retreat.
ESA UNCLASSIFIED – For Official Use High Speed Network and Security For Copernicus Communities Case Study ESA EOP-G Network & Security Team Francesco Nisi,
COMPREHENSIVE SECURITY FRAMEWORK FOR COPERNICUS: FREE & OPEN DATA ACCESS TNC15 - Porto (Portugal), 17/06/2015 ESA EOP-G Network and Security team Barbara.
Contribution to the Implementation of the African Space Programme: EO Data and Infrastructure *9.a) space segment - available observations (space & in-situ.
Status of Sentinel-3 activities at EUMETSAT SIT-31 Agenda Item # 13 ESA/ESRIN, Frascati, Italy 19 th -20 th April 2016 Committee on Earth Observation Satellites.
Sentinel Data Access for Africa 11 December 2014 Sentinels Data Access for Africa.
Jordi Farres HMA-WG Meeting ESRIN, 23 Jan 2013
Copernicus Data & Information Access Service → DIAS 28 September 2016.
Datacube projects in ESA
2nd GEO Data Providers workshop (20-21 April 2017, Florence, Italy)
2nd Data Providers Workshop
OGC Technical and Planning Committee Meeting Welcome
ESA’s Earth Observation Programmes and GOCE
TOWARDS OPEN EARTH OBSERVATIONS DATA POLICIES PROGRESSES, CHALLENGES AND SUPPORT TOOLS 3. Challenges in Implementing Data Sharing Principles Gunter Schreier.
RSS Data-farm: from local storage to the cloud
Data Stewardship Interest Group WGISS-43 Meeting
The GEO Renewable Energy Initiative
BIG data: EO innovation Europe LSI-VC#2, Jul 2016, LA
INTAROS – Integrated Arctic Observation System
Copernicus Sentinels Space and Ground Segment Status
Dr. Evangelos Gerasopoulos, Research Director
Copernicus Data & Information Access Services DIAS.
Copernicus Programme European Commission CEOS Plenary 2016
UK Space Agency Update CEOS Plenary Oct 2017
Big Data in Earth Observation
Technology for Long-Term Digital Preservation
Presentation on Copernicus Dissemination
CCNET Managed Services
ESA Report to DAI/IPR WG
Copernicus Programme European Commission CEOS Plenary 2017
How OSS could be used for GMES?
Copernicus DIAS European Commission CEOS 2018 Chair team WGISS
CEOS Future Data Architecture Big Data Workshop
Exploitation Platforms and Common Reference Architecture
CODE-DE Copernicus Data and Exploitation Platform - Deutschland
Copernicus Global Land monitoring service
AGEOS CB ACTIVITIES AGEOS By Aboubakar Mambimba Ndjoungui
WGISS Connected Data Assets April 9, 2018 Yonsook Enloe
Copernicus DIAS Objectives
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
Copernicus Data in the EGI infrastructure
Copernicus Sentinel Data Uptake and Application
French Access to Copernicus Space Data
ESA EO Data Preservation System: CBA Infrastructure and its future
Federated Earth Observation (FedEO)
Presentation transcript:

The Copernicus Collaborative Ground Segment Gioacchino Buscemi European Space Agency EGI Conference 2017 and INDIGO Summit 2017 Catania 09-12 May 2017

Before we start Gioacchino Buscemi European Space Agency (ESA) ESRIN, Frascati, Italy EOP Security Officer; ISO27001 Auditor EOP Data Centre Manager Responsible for EOP Networks, System (mm), EO Virtual Infrastructure and Cloud (mm) Italian football (soccer) team supporter gioacchino.buscemi@esa.int

Agenda ESA Earth Observation environment EOP Core Ground Ground Segments Dissemination, Processing, Archiving and Network EOP Core Facilities EOP Security Copernicus : The space Components ESA-EO Operated the Data Hub ESA-EO the Collaborative Data Hub ESA-EO the Collaborative Ground Segment Conclusions

ESA’s eye on earth ESRIN, in Frascati, Italy, is ESA’s center for Earth Observation where operations and exploitation of Earth Observation satellites are managed. The world’s largest database of environmental data for both Europe and Africa is managed from ESRIN.

Pioneers in Earth observation ESA has been dedicated to observing Earth from space ever since the launch of its first meteorological mission, Meteosat-1 in 1977. ERS-1 (1991–2000) and ERS-2 (1995–2011) providing a wealth of invaluable data about Earth, its climate and changing environment. Envisat (2002–12) the largest satellite ever built to monitor the environment, it provided continuous observation of Earth’s surface, atmosphere, oceans and ice caps.

Global monitoring for a safer world Copernicus: an Earth observation programme for global monitoring for environment and security. Led by the European Commission in partnership with ESA and the European Environment Agency, and responding to Europe’s need for geo-spatial information services, it will provide autonomous and independent access to information for policy-makers, particularly for environment and security issues. ESA is implementing the space component: developing the Sentinel satellite series, its ground segment and coordinating data access. ESA has started a Climate Change Initiative, for storage, production and assessment of essential climate data.

+ development of PDGS for future missions EO Missions Overview earthcare adm-aeolus sentinel-3b sentinel-5p sentinel-2b sentinel-1b sentinel-3a sentinel-2a sentinel-1a proba-v swarm cryosat smos proba-1 + Third Party Missions # of missions Landsat, Aura OMI, Cosmo-Skymed, DEIMOS, GOSAT, RapidEye, Radarsat …. sentinel-1b sentinel-3a sentinel-2a sentinel-1a proba-v swarm cryosat smos proba-1 + development of PDGS for future missions goce envisat ers-2 proba-1 goce envisat ers-2 ers-1 goce envisat ers-2 ers-1 ers-1 https://earth.esa.int/ http://www.copernicus.eu/

Sentinel missions ESA missions EO missions growth 60000 15000 The figure does not include the statistics for EO data distributed by partners (e.g. GOCE geoid through GFZ, Sentinel by Collaborative Ground Segment, EUMETSAT, etc.) 60000 A growing increase resulting from: the increase in data offering, the upgraded data access, the open and free data policy, the support to data exploitation Sentinel missions # of users 15000 ESA missions

ESA EO Core Ground Segments Dissemination Dissemination (Mix of Virtual and Physical resources): Virtual Central Dissemination (DissHarm) Copernicus Dissemination Platform (Pick-Up Point) Local DMZ on remote sites Multi-Mission Central Services Copernicus Central Services Dissemination Center DissHarm Internet Pick-Up Point Data Hub Portals ELVIS Processing Center KSAT e-GEOS INTA DLR Airbus UK ESAC Multi-Mission MPLS Backbone Copernicus MPLS Over DWDM EUMETSAT SSC CLS - B Cloud Services CNES CNMCA CLS - T DAS ESRIN ACRI Indra

ESA EO Core Ground Segments Processing Processing (Mix of Virtual and Physical resources): Virtual Central Processing (ELVIS) Mixed local physical servers and local virtual solutions Private PaaS high performing infrastructure (Insourced ESA) Interconnected Public Cloud Multi-Mission Central Services Copernicus Central Services Dissemination Center DissHarm Processing Center ELVIS Internet Pick-Up Point Data Hub Portals KSAT e-GEOS INTA Cloud Services DLR Airbus UK ESAC Multi-Mission MPLS Backbone Copernicus MPLS Over DWDM EUMETSAT SSC CLS - B CNES CNMCA CLS - T DAS ESRIN ACRI Indra

ESA EO Core Ground Segments Archiving Local LTA at PACs Data Archival Center (DAS) Cold Backup Multi-Mission Central Services Copernicus Central Services Dissemination Center DissHarm Internet Pick-Up Point Data Hub Portals ELVIS Processing Center KSAT e-GEOS INTA DLR Airbus UK ESAC Multi-Mission MPLS Backbone Copernicus MPLS Over DWDM EUMETSAT SSC CLS - B Cloud Services CNES CNMCA CLS - T DAS ESRIN ACRI Indra

ESA EO Core Ground Segments Network Two networks based on MPLS/DWDM up to 10 Gbps Central Internet break-outs LAN at remote sites with heterogeneous technologies and ownership Multi-Mission Central Services Copernicus Central Services Dissemination Center DissHarm Processing Center ELVIS Internet Pick-Up Point Data Hub Portals KSAT e-GEOS INTA Cloud Services DLR Airbus UK ESAC Multi-Mission MPLS Backbone Copernicus MPLS Over DWDM EUMETSAT SSC CLS - B CNES CNMCA DAS ESRIN CLS - T ACRI Indra

Copernicus Core Ground Segment WAN Details The Ground Segment 3 Core Ground Stations (CGS) 7 Processing and Archiving Centres (PAC) 3 Mission Performance Centres (MPC) 3 Payload Data Monitoring Centres (PDMC ) 1 Marine Centres (Eumetsat) 1 Coordinated Data Access Service (CDS) EDRS Receiving Station

DLR @ Oberpfaffenhofen EO Core facilities Site ACRI @ Luxemburg ACRI @ S. Antipolis Airbus @ Newport Airbus @ Weilheim CLS @ Brest CLS @ Toulouse CNES @ Toulouse DLR @ Oberpfaffenhofen E-GEOS @ Matera ESAC ESRIN EUMETSAT @ Darmstadt Indra @ Madrid INTA @ Maspalomas KSAT @ Svalbard KSAT @ Tromsoe SSC @ Kiruna MM 1   0,3 0,1 0,15 2 0,4 Copernicus 10 2.5 Gb/s Intranet combined capacity: 100 Gb/s Internet access combined capacity: 45 Gb/s Mission Globe Coverage Orbit # BW S 1A/B 6 days 175 2 x 280 Mb/s S 2A/B 5 days 143 1 x 280 Mb/s S 3A 27 days 385

EO Data Volume Central Virtual Hub Size DataHuB 8 PB, +1200CPU, 8+TB RAM, 70 VM DISSHARM 2.75 PB, +130CPU, +500 GB RAM, 33 VM ELVIS 2.5 PB, 250 CPU, 700 GB RAM, 80 VM 21 facilities spread over Europe 2 central hosting and dissemination facilities Data volume Data/Day S1A+B 16 TB   S2A  800 GB S3A 420 GB Swarm 5 GB Cryosat 33 GB Traffic Volume/month Copernicus Circulation 1.25 PB MM Circulation 170 TB Dissemination from DataHub 1.98 PB Dissemination from DISSHARM + Centres 130 TB

Security organization ESA EO - Security Security requirements Secure operations management Systems Network policy Data classification User classification Access control Secure Operations & Management Disaster Recovery & Business Continuity Applications Security organization SECOPS EOP-G Security Framework ESA SECURITY DIRECTIVES Physical Security Information Protection Personnel Security INFOSEC Business Continuity Management EOP-G Security Framework Two Security Operations Centres (SOCs) Local Security Managers Centralised Security Services (DDoS, F/W, IDS/IPS, AntiBot, Antispam, AntiVirus, URL Filtering) Peripheral and distributed Security Services (F/W, IDS/IPS, end-system security) Event Correlation (SIEM), Analytics Secure code Analysis and development Regular Patching ISO 27001 as governance tool to manage security over a distributed, multi-actors and heterogeneous environment

EO Security Operations Total number of logs lines collected from all security devices: 29 Trillions (2016) Security events blocked: >1,6 Trillions attack attempts Blocked (SIEM+ Security measures 2016) Security numbers Total # systems (DMZ + internal) > 3700 # network devices > 400 # logs collected every day + 79.000.000.000 # attacks blocked every day +4.300.000.000

EO Network and Security Services Summary Two network with 21 Facilities and 3 Virtual sites (Data Hub, Dissharm, Elvis) Near 41.000 Km of fibers only for Copernicus Intranet combined capacity: 100 Gbps Internet access combined capacity: 45 Gbps Remote access :4 sites and more than 200 Mobile users Number of deployed and managed devices: 400+ Number of security elements: 60+ Amount of data Circulated and disseminated per Month for Copernicus: 3.5+ Petabytes (2017) Virtual dissemination & Processing facility for near 30 Missions and 13+ PB of on-line rolling archive storage Total number of logs lines collected from all security devices: 29 Trillions (2016) Security events blocked:>1,6 Trillions attack attempts Blocked (SIEM+Security measures 2016)

Copernicus: The Space Components Collaborative Ground Segment Contributing Mission Sentinel-1 Sentinel-2 Sentinel-3 Sentinel-4 Sentinel-5P EDRS CSC Coordinated Data Access Acquisition Station TT&C Station Dedicated Missions Centre A

ESA-EO Operated Data Hubs (1 of 2) Open Access Data Hub Collaborative > 53,660 Users 13 Collaborative Users 5 Data Hub Relay Users Max 2 Concurrent Downloads International Access Hub Copernicus Services 4 Users 166 Users No Rolling Policy Applied No limits Self Registration Sentinel-1 NRT1 & NTC Sentinel-2 L1C Sentinel-1 NRT & NTC Sentinel-1 NTC No Rolling Policy Applied Node 1: 30 days Node 2: 9 days 30 Days Node 1: Max 10 downloads Node 2: No limits Max 10 concurrent downloads NRT1 via dedicated ftp Sentinel-3 pre-ops

ESA-EO Operated Data Hubs (2 of 2)

Member States mirror sites ESA-EO Collaborative Hub Member States mirror sites Node 1 Node 2 STFC Use of Collaborative Hub and the International Hub requires a technical arrangement with ESA or an international arrangement with the European Commission. The Collaborative Hub was initially setup for ESA Member states participating in the GMES program and later expanded to all GMES/Copernicus participating states. Partners retrieving data from the Collaborative Hub and the International Hub will redistribute the products from their own platforms and data access points.

The Collaborative Ground Segment (1 of 2) Collaborative Ground Stations: acquisition of data in passive mode during core visibility. Interconnection Agreement with specific partners (e.g. Industry). The Collaborative Ground Segment provides: Complementary access to SENTINEL data and/or to specific data products or distribution channels. Complementary national and commercial services for the exploitation of Copernicus Sentinel data. Redistribution of Sentinel product. Creation of additional data sets or complementary products, such as regional datasets or higher level products. SENTINEL data exploitation in various areas.

The Collaborative Ground Segment (2 of 2) A total of 12 Collaborative Ground Segment agreements have been signed with ESA. 69% of the Collaborative Ground Segment partners had opened their national mirror sites. The European Commission and ESA have agreed with NASA, the National Oceanic and Atmospheric Administration (NOAA), the US Geological Survey (USGS) and Geoscience Australia (GA) to make Copernicus Sentinel data available to them via a dedicated access point, the International Hub.

The Collaborative Ground Segment - mirror sites

The Collaborative Ground Segment User Distribution Slovenian company Sinergise Laboratory for Geographical Information Systems, Ltd , and the Polish company CloudFerro sp. z o.o. opened its EO Cloud platform for Commercial use LAND is the most common used fields Research and Education are the most popular sites A Considerable portion of data is used for Commercial use

Conclusions Upgrade of the Core Front end to 40 Gbps for Academic users Evaluation of federated Cloud Service Model Introduction of a SDN (Software Defined Network) Increased of security Microsecurity Intelligence and behavior analysis Copernicus Security Centre ISO 27001 Data Hub software enhancements (New DHuS version for Data Relays, Improved Synchronizers, Improved API for “catalogue view”, Geographic selection for Synchronizers, Remote retrieval of products outside relay cache)

Would you like to know more? Visit www.esa.int