IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre.

Slides:

Advertisements

Similar presentations

Project Overview Daniel Mallmann, Research Centre Juelich Alistair Dunlop, University of Southampton.

Advertisements

XtreemOS IP project is funded by the European Commission under contract IST-FP XtreemOS: Building and Promoting a Linux-based Operating System.

© Fraunhofer Institute SCAI and other members of the SIMDAT consortium Data Grids for Process and Product Development using Numerical Simulation and Knowledge.

SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.

Earth System Curator Spanning the Gap Between Models and Datasets.

Climate Analytics on Global Data Archives Aparna Radhakrishnan 1, Venkatramani Balaji 2 1 DRC/NOAA-GFDL, 2 Princeton University/NOAA-GFDL 2. Use-case 3.

Data-intensive Research Policy In Ireland A brief overview By J.-C. Desplat.

NERC Data Grid Helen Snaith and the NDG consortium …

CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.

TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.

Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.

VO Sandpit, November 2009 CEDA Mission: “curation and facilitation” “Managing complex datasets and accompanying information for reuse and repurpose” Sam.

Eric Guilyardi (LOCEAN/IPSL and Univ. Reading) and the Metafor team Common Metadata for Climate Modelling Digital Repositories IS-ENES kick-off meeting.

1 Eric Guilyardi and the Metafor team Common Metadata for Climate Modelling Digital Repositories Metafor Dissemination Workshop Abingdon, 14 March 2011.

Distributed Access to Data Resources: Metadata Experiences from the NESSTAR Project Simon Musgrave Data Archive, University of Essex.

CEMS: The Facility for Climate and Environmental Monitoring from Space Victoria Bennett, ISIC/CEDA/NCEO RAL Space.

IS-ENES Kick-off meeting Paris, March 2009 Overview of JRA2 European ESM: Performance Enhancement Graham Riley, University of Manchester IS-ENES Kick-off.

Metafor Year 2 review: 29 th April 2010 Work Package 7 – Training and Dissemination.

What is OMII-Europe? Qin Li Beihang University. EU project: RIO31844-OMII-EUROPE 1 What is OMII-Europe? Open Middleware Infrastructure Institute for Europe.

CIM – The Common Information Model in Climate Research

Presented by The Earth System Grid: Turning Climate Datasets into Community Resources David E. Bernholdt, ORNL on behalf of the Earth System Grid team.

Initiatives toward Climate Services in France and in the European Communities C. Déandreis (CNRS/IPSL); M. Plieger and W. Som de Cerff (KNMI); Ph. Dandin,

INFSO-RI Enabling Grids for E-sciencE EGEODE VO « Expanding GEosciences On DEmand » Geocluster©: Generic Seismic Processing Platform.

Planning for Arctic GIS and Geographic Information Infrastructure Sponsored by the Arctic Research Support and Logistics Program 30 October 2003 Seattle,

Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute for Meteorology German Climate Computing Centre (DKRZ)

ExArch: Climate analytics on distributed exascale data archives Martin Juckes, V. Balaji, B.N. Lawrence, M. Lautenschlager, S. Denvil, G. Aloisio, P. Kushner,

14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.

DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.

Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:

A Flexible Component based Access Control Architecture for OPeNDAP Services Philip Kershaw STFC Rutherford Appleton Laboratory.

Towards a Virtual Institute for Research into eGovernment Prof. Zahir Irani & Dr Tony Elliman Information Systems Evaluation and Integration Group School.

NA2 objectives The „v.E.R.C.“ (virtual Earth System Resource Center) v.E.R.C is: A (technical) infrastructure to improve the utilization of the ESM core-infrastructure,

The GRelC Project: architecture, history and a use case in the environmental domain G. Aloisio - S. Fiore The Climate-G testbed is an interdisciplinary.

- EGU 2010 ESSI May Building on the CMIP5 effort to prepare next steps : integrate community related effort in the every day workflow to.

MEDIN Work Plan for By March 2011 MEDIN will be 3 years into the original 5 year development plan started in Would normally ask for continued.

Sarah Callaghan 1, Eric Guilyardi 2, Charlotte Pascoe 3 and the Metafor Project Team 1 BADC- UK, 2 University of Reading, UK.

1 Earth System Modeling Framework Documenting and comparing models using Earth System Curator Sylvia Murphy: Julien Chastang:

The Earth System Grid (ESG) Computer Science and Technologies DOE SciDAC ESG Project Review Argonne National Laboratory, Illinois May 8-9, 2003.

EU-IndiaGrid (RI ) is funded by the European Commission under the Research Infrastructure Programme WP5 Application Support Marco.

1 PRogramme for Integrated earth System Modelling (PRISM) An Infrastructure Project for Climate Research in Europe.

- Vendredi 27 mars PRODIGUER un nœud de distribution des données CMIP5 GIEC/IPCC Sébastien Denvil Pôle de Modélisation, IPSL.

The Climate-G testbed towards a large scale data sharing environment for climate change S. Fiore Scientific Computing and Operations Division, CMCC, Italy.

IPCC TGICA and IPCC DDC for AR5 Data GO-ESSP Meeting, Seattle, Michael Lautenschlager World Data Center Climate Model and Data / Max-Planck-Institute.

WP6/SA2: Access to IS-ENES Data Federation SA2 is a European distributed data infrastructure providing access to data from ESM simulations produced in.

Utility Computing: Security & Trust Issues Dr Steven Newhouse Technical Director London e-Science Centre Department of Computing, Imperial College London.

1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.

Sarah Callaghan 1, Gerry Devine 2, Eric Guilyardi 3, Bryan Lawrence 1, Charlotte Pascoe 1, Lois Steenman-Clark 2 and the Metafor Project Team 1 NCAS-BADC;

1 Overall Architectural Design of the Earth System Grid.

1 Gateways. 2 The Role of Gateways  Generally associated with primary sites in ESG-CET  Provides a community-facing web presence  Can be branded as.

Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.

1 Summary. 2 ESG-CET Purpose and Objectives Purpose  Provide climate researchers worldwide with access to data, information, models, analysis tools,

WGSIP meetingBuenos Aires, July 2010 INSTITUT CATALÀ DE CIÈNCIES DEL CLIMA ENSEMBLES forecasts: ocean and atmosphere THREDDS (OPeNDAP) public server.

The Modeling Circle Courtesy M. Lautenschlager, DKRZ.

1 SIMDAT Simdat Project –GTD. Meteo Activity – SIMDAT Meteo Activity OGF June 2008 Barcelona Marta Gutierrez, Baudouin Raoult, Cristina.

The DEER Distributed European Electronic Resource Dr Suzanne Keene Francesca Monti University College London.

Technology-enhanced Learning: EU research and its role in current and future ICT based learning environments Pat Manson Head of Unit Technology Enhanced.

OGC/OGF usage in UK e-Social Science OGF 21, Seattle, USA Paul Townend School of Computing, University of Leeds.

ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.

ECMWF 24 th November 2008 Deploying secure OGC services in front of a heterogeneous data archive. Bryan Lawrence, Phil Kershaw, Dominic Lowe, and Stephen.

The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.

EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu

Metadata Support for Model Intercomparison Projects Sylvia Murphy: Cecelia DeLuca: Julien.

A Quick Tour of the NOAA Environmental Software Infrastructure and Interoperability Group Cecelia DeLuca Dr. Robert Detrick visit March 28, 2012

Bob Jones EGEE Technical Director

AP7/AP8: Long-Term Archival of CMIP6 Data

World Conference on Climate Change October 24-26, 2016 Valencia, Spain

J. Marotzke, R. Budich, A. Navarra, P. Kabat, B. Lawrence

Climate Data Analytics in a Big Data world

Barcelona Supercomputing Center

Metadata Development in the Earth System Curator

Presentation transcript:

IS-ENES [ees-enes] InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre (vERC) Martin Juckes, BADC

Funded by EU Framework Programme 7 to develop infrastructure for Earth System Modelling, 7.6M€, 4 years. 20 partners, led by IPSL. Objectives include:  education,  enhancing model efficiency,  model evaluation tools,  data management and  services for data users. IS-ENES:key facts

IS-ENES: data management Core funding objective: enhance European capability to deal with large and diverse datasets from Earth System Modelling projects, using distributed data archives. Software to support EU contribution to CMIP5/AR5 archive

Key partners in data management activities PCMDIProgram for Climate Model Diagnosis and Intercomparison USA IPSLInstitute Pierre Simon LaplaceFrance BADCBritish Atmospheric Data CentreUK MPIMax-Planck InstituteGermany CMCCEuro-Mediterranean Centre for Climate Change Italy BSCBarcelona Supercomputer Centre Spain LIUNational Computer CentreSweden

Challenges Flexibility: an archive distributed between partners with different funding sources and development priorities. Accessibility: diverse and growing user group oGetting CMIP5/AR5 archive running oEnhancing user services oPreparing for future archives

Background CMIP3 [PCMDI], ESG [USA] METAFOR: develop common information model [EU] NERC Data Grid: discovery service [BADC] C3CGrid [DKRZ] IPCC Data Distribution Centre [BADC/DKRZ] UK Climate Impacts Programme Data Delivery Package [BADC + UK partners] GRelC [BSC] Grid superscalar [CMCC]

Visualisation

Visualisation

A few aims A comprehensive data policy Optimise resource usage in execution of user services Enhance the efficiency of metadata transfer between nodes OGC, wget and OPeNDAP Visualisation Regional model support (OPeNDAP + OASIS) Slice, regrid, differences and aggregates Checksums Post download support {e.g. fileStatusAtProvider: }

How might a distributed archive work? Core archive Data providers Data transformations Users

UKCIP08 Data Delivery Package X pdf-maxtemp-bristol

Barcelona Supercomputer Centre Founded in 2004 as Spain’s national computer centre Run the 95Teraflop MareNostrum supercomputer Will provide software for data analysis across a distributed archive

National Computer Centre, Sweden (Linköping University) 59Tflop

Euro-Mediterranean Centre for Climate Change (CMCC) provides models, simulations, middleware, application software and high quality personnel training both in the specific field of climate dynamics and computer technolog

Core archive High value data High service reliability Provide