ET-CTS - Cache in and through the cloud Background information

Slides:



Advertisements
Similar presentations
World Meteorological Organization Working together in weather, climate and water WMO OMM WMO GFCS Governance proposal Process of development.
Advertisements

Alan Edwards European Commission 5 th GEO Project Workshop London, UK 8-9 February 2011 * The views expressed in these slides may not in any circumstances.
Luxembourg, Ville Kajala Senior Officer on Transparency Directive Issues Pan-European Access to Financial Information Disclosed by Listed Entities.
Council in the Cloud Justin Thomas, ICT Manager Noosa Shire Council.
EVALUATION AND QUALITY ASSURANCE STRATEGY PRESENTED BY DR SHYAM PATIAR.
“”Capacity and services to road users” Task descriptions Paul van der Kroon, Paris November 2005.
Initiating and Planning Systems Development projects
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Engineering, Operations & Technology | Information TechnologyAPEX | 1 Copyright © 2009 Boeing. All rights reserved. Architecture Concept UG D- DOC UG D-
The Challenge of IT-Business Alignment
Joanna Fiedler Enlargement and Neighbouring Countries Unit DG Environment European Commission REReP → RENA Vision of the European Commission PEIP Regional.
Report on TTonT By: Jan Rozema. Contents Historical overview Status (at PFAC-02) Terms of Reference How to go onward.
SDCG-6 Oslo, Norway October 22-24, 2014 SDCG 3-Year Work Plan Stephen Ward, SDCG EXEC (Australia) SDCG-6: Oslo,
Regional Action Plan for Sustainable Transport of Dangerous Goods along the Mekong River Final Regional Workshop, October 2014 Bangkok, Thailand.
Possibilities for joint procurement of commercial cloud services for WLCG WLCG Overview Board Bob Jones (CERN) 28 November 2014.
3rd Helix Nebula Workshop on Interoperability among e-Infrastructures and Commercial Clouds Carmela ASERO, EGI.eu 17 September 2013, Madrid
URBACT IMPLEMENTATION NETWORKS. URBACT in a nutshell  European Territorial Cooperation programme (ETC) co- financed by ERDF  All 28 Member States as.
André Hoddevik, Project Director Enlargement of the PEPPOL-consortium 2009.
Capacity Building in: GEO Strategic Plan 2016 – 2025 and Work Programme 2016 Andiswa Mlisa GEO Secretariat Workshop on Capacity Building and Developing.
Moving away from the fish-eye view Integrating Surveys for the Ecosystem Approach 29 May 2013, Ingeborg de Boois (WGISUR)
Project Management PTM721S
Roland Gilbert BSc MRICS; Prince 2 Practitioner
INSPIRE and the role of Spatial Data Interest Communities (SDIC)
EUMETSAT Perspectives on Inter GISC Communication (ET-CTS 2014 Doc 19)
A proposed Security Incident Management Process for WMO Member States
TT-GISC – Brasilia – October 2015 Rémy Giraud (Météo-France)
Chapter 8 Environments, Alternatives, and Decisions.
RMDCN Status Report Submitted by: Oliver GORWITS (ECMWF) (Doc 20)
ITIL SERVICE LIFECYCLE
Concept Proposal for RA-III Regional WIGOS Centre
Update on the WIS Monitoring project
Ivan Čačić President RA VI
REPORTING SDG INDICATORS USING NATIONAL REPORTING PLATFORMS
GEOSS Data Sharing Principles
How do we best share and manage the data within WIS in order to fulfil the ever increasing demand for Weather and Climate Data? Submitted by: Working Group.
R. Kolli Chief World Climate Applications & Services Division
<Name of Product>Pilot Closeout Meeting <Customer Name>
Enterprise Content Management Owners Representative Contract Approval
Outcome TFCS-11// February Washington DC
Agenda item 2.3 Report of OPAG ISS Matteo dell’Acqua
WMO IT Security Incident Process
Risk Register I want to plan a project
5. STATUS OF THE PRIORITY AREAS IMPLEMENTATION OF THE PLAN FOR THE WIGOS PRE-OPERATIONAL PHASE (PWPP) 5.2 WIGOS Regulatory Material complemented with necessary.
Dr Sue Barrell, Australia
WMO Global Multi-Hazard Alert System
EC Strategy, Globalization, and SMEs
WIS Strategy – WIS 2.0 Submitted by: Matteo Dell’Acqua(CBS) (Doc 5b)
1 Stadium Company Network. The Stadium Company Project Is a sports facility management company that manages a stadium. Stadium Company needs to upgrade.
Definition of Project and Project Cycle
ET-CTS - Cache in and through the cloud
WMO Information System
Proposal for setting up a RDG Task Force on Cooperation Models
Portfolio, Programme and Project
Use of External Consultants
ET-CAC Report Kevin ALDER Agenda item 6-3 (1)
ICTT-WIS 1st Session CAS perspective on WIS
Fitness Check of EU Freshwater Policy
Audit Criteria Mark Francis ET-WISC/TT-DC Agenda item 10
ET-WISC structure and work plan
The WIGOS Pre-Operational Phase
- Measurement of traffic volume -
The status and Plan in 2019 for the WIGOS centers in RA II
Commission for Basic Systems, Technical Conference
WIS Project Office WMO Managing WIS WIS Project Office WMO
KEC Dhapakhel Lalitpur
Inter-Commission Coordination Group On WIGOS
4. STATUS OF THE PRIORITY AREAS IMPLEMENTATION OF THE PLAN FOR THE WIGOS PRE-OPERATIONAL PHASE (PWPP)   4.4 Development and implementation of the WIGOS.
TT-eWIS/2018 Introduction
TT-eWIS/2018 Future technology workshop
OU BATTLECARD: E-Business Suite Courses and Certifications
Presentation transcript:

ET-CTS - Cache in and through the cloud Background information ICT-ISS – Geneva 16-18 Jan 2018

History For GISC to GISC communication and in particular for exchange of « GlobalExchange » data the current architecture is based on an any to any unicast based solution The solution is: Politically very challenging (some bilateral links are virtually impossible to set up) Technically difficult to establish, to monitor and to maintain Financially unattractive as the same data is sent multiple times on an expensive network In 2014, at TT-GISC and ET-CTS, a solution using a cloud based approach was presented It was then agreed to run a pilot in 2015 to assess whether this option was viable Suitability of this solution will be established based on: The technical outcome of the pilot The result of a questionnaire (it appears that some organisations forbid the storage of their data into the cloud) The financial and contractual aspects The agreement of the GISCs to proceed with such a solution

The should and the may What we should have now… What we may have tomorrow…

The Pilot (2015-2016) The pilot has been managed by ET-CTS with the support of DWD From a technical point of view, we have been using AFD (Automated File Distribution). Used Internet only Pilot limited to data exchange, not to metadata INTERNET GISC A GISC B GISC C GISC D GISC E GISC F AFD in the cloud cloud.1.teganet.eu

Final report of ET-WISC 2016 The meeting noted that target solution should be scalable and should not rely on one host. Should be based on technical functionality and reliability. It should address security and other related risks such as denial of service attack TT-GISC decided, as a consequence, to establish a working group lead by Meteo France and including the following experts UK, Republic of Korea, Japan, China tasked to prepare the requirements, to define the potential architecture, to prepare a workable financial and manageable solution, and to establish the required elements for the implementation of an operational service starting in mid-2018 at the latest. This document presents the outcome of the working group described above

Background As a follow-up to the successful cache in and through the cloud pilot, follow-up activities were undertaken in the following areas: Definition of key functional and technical requirements for operating the WIS cache (data + metadata) in and through the cloud Analysis of financial and service level implications (costs, areas of uncertainty, service level management) Analysis of requirements for executing management functions necessary to operate the cache in and through the cloud Development of a proposed implementation strategy Highlight remaining concerns to be investigated going forward

Approach

Proposed approach - Iterative Operation of the cloud service should be step-by-step transition (as prescribed by the WIS 2.0 implementation strategy) Initial stage: All GISCs participate. Add data meant for Global Exchange. Add Metadata to the cloud. Evolution stages: Incorporate some of the concepts of WIS 2.0. Final stages: Subscription to data/products by users. Meet WIS 2.0 requirements. Initial stage Evolution stage Final stage 2025-? 2022 – 2025 ? Scope of data included in each phase of the project and access are controlled by metadata keywords set by originating centre/data provider: WMO_DataLicenseCode – whether or not the data is considered essential and if the data has associated licensing/access constraints WMO_DistributionScopeCode – level of data exchange (global, regional, centre) WMO_ProductCategoryCode – GTS priority level (also determines if QoS mechanisms are required) 2019 - 2022

Proposed implementation approach

Architecting and implementing the solution Public cloud providers use similar approaches for configuring and procuring services (storage, compute, network, application services, security services, etc.), and use tiers to allow customers to balance capabilities against costs. Public cloud providers were reasonably consistent in terms of costing for baseline services. Niche players provide other capabilities, but public cloud provides were more open/consistent in pricing, approach, tools. It is recommended that a single solution provider be engaged to handle the implementation and management of the service. Along with commercial vendors, NMHSs (e.g. those operating GISCs) may choose to respond to the tender. Baseline services are the minimum capabilities required to store and exchange data meeting the capacity of the existing WIS cache. This does not include failover and other services needed to fulfill other certification requirements such as availability.

Procurement requirements and options

Proposed financial strategy For expedience during « initial phase », WMO to run a tender on behalf of the 15 GISCs A « trust fund » mechanism to be implemented to handle the money stream Provisionally, split costs equally between the participating GISCs. GISCs require a level of certainty in terms of cost implication with this solution Outstanding actions: Execute the tender, determine successful vendors, and determine baseline costs Check with GISCs regarding “value for money” of the solution before contracting with the proposed vendor

Conclusions and next steps

Next steps Align the process with the upcoming WMO official bodies (ICT-ISS, CBS TECO 2018, EC-17, Cg-18) Define requirements and constraints for the tender process Develop position papers related to cache in and through the cloud and the proposed path forward, for approval by WMO governing bodies Execution of the tender and selection of successful bidder Implementation of cloud environment and connections to GISCs Operational monitoring of cloud environment Progress through phases of implementation described previously

Planned approach toward the « Initial Phase » - 1 ICT-ISS - January 2018 Present the project and the plan TECO – March 2018 Get approval on the project and the plan Starts working on the future tender documents – March 2018 Evaluate budget for the overall 3-year contract – April 2018 Include management cost, cloud infrastructure running cost, WMO management cost (contract, tender,…) Paper for EC including – April 2018: Expected WMO support/role Description of the project and expected benefits EC - June 2018 Endorse the concept and allow CBS to proceed once the financial commitment from the GISCs has been received

Planned approach toward the « Initial Phase » - 2 Approval from GISCs with commitment to pay – October 2018 WMO issue a “Expression Of Interest” allowing pre-selection of potential bidders – October 2018 Once potential bidders are identified, address conflict of interests among experts (if an NMHSs is selected no expert from that country should be involved in the tender) Complete tendering documents – November 2018 WMO to issue the documents to the selected bidders – January 2019 Answers received – March 2019 Analysis of the answers and prepare tender report - May 2019 WMO to choose the successful tender – June 2019 Approval by CBS Management Group - Summer 2019 Commissioning - Initial phase – Late 2019 – mid-2020 Operational phase – Mid-2020 - 2022 By 2022, we should know what WIS 2.0 will look like and will be prepared for any required changes through the evolution phase

Questions?