NA4 F2F Meeting ES Cluster

Slides:



Advertisements
Similar presentations
ESA Data Integration Application Open Grid Services for Earth Observation Luigi Fusco, Pedro Gonçalves.
Advertisements

European Commission Directorate-General Information Society Unit F2 – Grid Technologies INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW /
Project Overview Daniel Mallmann, Research Centre Juelich Alistair Dunlop, University of Southampton.
Conference xxx - August 2003 Fabrizio Gagliardi EDG Project Leader and EGEE designated Project Director Position paper Delivery of industrial-strength.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.
Gaël YOUINOU EGEE Industry Day 1 Paris, 27th april 2006 EGEE 1st Industry Day Paris, 27th April 2006 EGEE 1st Industry Day Paris, 27th April 2006 Compagnie.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYCLOPS:Integrating Sensors into the Grid.
The Open Grid Service Architecture (OGSA) Standard for Grid Computing Prepared by: Haoliang Robin Yu.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
The OMII Perspective on Grid and Web Services At the University of Southampton.
DISTRIBUTED DATA FLOW WEB-SERVICES FOR ACCESSING AND PROCESSING OF BIG DATA SETS IN EARTH SCIENCES A.A. Poyda 1, M.N. Zhizhin 1, D.P. Medvedev 2, D.Y.
ESSE Environmental Scenario Search Engine for the Data Services Grid Mikhail Zhizhin, Geophysical Center Russian Academy of Sciences Eric Kihn,
ES Metadata Management Enabling Grids for E-sciencE ES metadata OGSA-DAI NA4 GA Meeting, D. Weissenbach, IPSL, France.
EPOS a long term integration plan of research infrastructures for solid Earth Science in Europe Preparatory Phase Project
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
INFSO-RI Enabling Grids for E-sciencE ES applications in EGEEII – M. Petitdidier –11 February 2008 Earth Science session Wrap up.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
WP9 – Earth Observation Applications – n° 1 WP9 report to Plenary ESA, KNMI, IPSL Presented by M. Petitdidier, IPSL DataGrid Plenary Session 5 th Project.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks INTRODUCTION Monique Petitdidier & Horst.
Interoperability Grids, Clouds and Collaboratories Ruth Pordes Executive Director Open Science Grid, Fermilab.
The Climate-G testbed towards a large scale data sharing environment for climate change S. Fiore Scientific Computing and Operations Division, CMCC, Italy.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
The Climate-G testbed towards a large scale data sharing environment for climate change S. Fiore Scientific Computing and Operations Division, CMCC, Italy.
INSERT PROJECT ACRONYM HERE BY EDITING THE MASTER SLIDE (VIEW / MASTER / SLIDE MASTER) Monique Petitdidier IPSL/CETP CEOS/WGISS.
INFSO-RI User Forum 1-3 March 2006 Enabling Grids for E-sciencE Worldwide ozone distribution by using Grid infrastructure ESA: L.
International Collaboration, Interoperable Data Flows, Architecture of GEOSS R.B. Husar, E. M. Robinson, J. D. Husar and M. Kieffer, Wash. Univ. G. Percivall,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Going from EGEE-NA ES cluster to EGI SSC.
Grid Interest Group Activities WGISS-28, September 30, 2009 Pretoria, South Africa.
Open Grid Services for Earth Observation Pedro Gonçalves.
1 SIMDAT Simdat Project –GTD. Meteo Activity – SIMDAT Meteo Activity OGF June 2008 Barcelona Marta Gutierrez, Baudouin Raoult, Cristina.
BE18 – Seismic Processing and Reservoir Simulation Gaël Youinou – CGG
SAFE SSCs for A&A, Fusion and ES Coordinator: Claudio Vuerli, INAF, Italy.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
EGI-InSPIRE EGI-InSPIRE RI Services for Earth Sciences Services for the EGI Heavy User Communities – EGITF 2010 Horst Schwichtenberg.
DataGrid France 12 Feb – WP9 – n° 1 WP9 Earth Observation Applications.
Some considerations and ideas for the (next) future Roberto Barbera University of Catania and INFN IWSG’10.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
EGI… …is a Federation of over 300 computing and data centres spread across 56 countries in Europe and worldwide …delivers advanced computing.
INFSO-RI Enabling Grids for E-sciencE Earth Science Applications M. Petitdidier (CNRS/IPSL-Paris)
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support SSC and proposal Gergely Sipos
INFSO-RI Enabling Grids for E-sciencE ESR Database Access K. Ronneberger,DKRZ, Germany H. Schwichtenberg, SCAI, Germany S. Kindermann,
Jordi Farres HMA-WG Meeting ESRIN, 23 Jan 2013
ESA-FAO GEOPortal STATUS & PLANS
Bob Jones EGEE Technical Director
Regional Operations Centres Core infrastructure Centres
Tamas Kiss University Of Westminster
INTAROS WP5 Data integration and management
The Open Grid Service Architecture (OGSA) Standard for Grid Computing
Porting MM5 and BOLAM codes to the GRID
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
Flanders Marine Institute (VLIZ)
Long-term Grid Sustainability
EGEE support for HEP and other applications
Dissemination and Exploitation of GRids in Earth sciencE
Connecting the European Grid Infrastructure to Research Communities
iSERVOGrid Architecture Working Group Brisbane Australia June
Exploring Interoperability Solutions for Interplanetary Data
DOE 2000 PI Retreat Breakout C-1
Cécile Germain-Renaud Grid Observatory meeting 19 October 2007 Orsay
Google Sky.
Grid Systems: What do we need from web service standards?
Status of Grids for HEP and HENP
Data Management Components for a Research Data Archive
Maria Teresa Capria December 15, 2009 Paris – VOPlaneto 2009
VIFI : Virtual Information Fabric for Data-Driven Discovery from Distributed Fragmented Repositories PI: Dr. Ashit Talukder Bank of America Endowed Chair.
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

NA4 F2F Meeting ES Cluster Monique Petitdidier Horst Schwichtenberg Paris, IPGP 27/28 March, 08

ES Cluster Partners FhG SCAI (leader, 24) GCRAS (18) CNRS (12) II SAS (12) CGGV (CGG Veritas) (12) Taiwan (6) KNMI (only consultant) ESA Esrin (only consultant) Earth Science Cluster

TNA 4.2.3/Goals Specific Support providing and supporting core functionalities (generic tools) esp. for ES workflow and data models/formats Data model example: Level 1 reconstructed, uncompress instrument data in HDF or netcdf Workflow tools with automatic annotation have been developed for Flood applications by an ES Cluster partner for integration of geographical information systems (GIS) for access to external web service toolkits like Google maps, MS Virtual Earth in the context of ES grid-jobs (easy executing, QoS, advanced reservation, steering) (different agent based solutions presented on the last EGEE User meeting) direct ES User- and ES Application support (for existing and for new Users) . Earth Science Cluster

TNA 4.2.3/Goals Evolution of gLite Example: Webservice are needed by ES applications Providing Webservice based interfaces e.c. for OpenGIS as defined by OGC for OPeNDAP (community standard to access remote data (netcdf, HDF)) for Data Access and Integration Example: Earth observation Grid Processing on Demand (G-POD) is based on Webservice interfaces tools from gLite included ESA Esrin developed the framework The cluster will share technologies with ESA ESRIN and the G-POD and the GENESI-DR project Earth Science Cluster

The Vision Architecture example Earth Science Cluster

The Vision Portal and Service Infrastructure example http://www.geongrid.org/technology/poral GRIDSPHERE Earth Science Cluster

Applications/Clients from meterology: models (i.e. Simulation codes) like MM5, WRF ... from Civil protection e.g. Cyclops project OpenGIS standards are indispensible integrated in GEOCLUSTER (CGG, part of EGEE-II) From Neries project (in discussion) Neries has connected a seismological networks in Europe is looking for an integration like GEON and EGEE to run applications Ozone predicition (CNRS) from GEOSCOPE ... . Earth Science Cluster

Communication INSPIRE Infrastructure for Spatial Information in Europe (used for civil protection) Cyclops (civil protection) Virtual Observatory for Geoscience (initiative) eGY(electronic Geophysical Year) centred on data management, policy, rescue…. Data fusion (Grid technologies for Multi-Source Data Integration, Ukrainia) Regional Initatives (ES in D-Grid, Grid5000, …) Inside EGEE with SA1 (ROCS) Clusters (Astro !, … ) – we will not reinvent the wheel ! Earth Science Cluster

ES Cluster Tools under consideration Data Source Grid-services for authorized very large databases. DB candidate list: NCEP/NCAR Reanalysis, ECMWF ERA-40 Reanalysis, NOAA Space Weather Reanalysis, SPIDR, ORFEUS, GEOSCOPE, some remote sensing archives… The Data Sources will be interfaced by OGSA-DAI (OMII-Europe Version interoperable with gLite) Expandable Grid-service based ES modeling framework with 2-3 models are pre-installed (GRASS GIS toolkit, MM5 mesoscale weather model, …) High-definition visualization grid-service for tiled display video walls based on SAGE technology. (nice to have) “Data Cloud” service to upload user datasets to the Data Source service (data file + metadata record) Metadata repository to search for data sources/models and to compose data/model run request with basic workflow composition capabilities. We have a prototype VxOware (developed for NASA Virtual Observatories initiative), but it should be adopted for the EGEE III ES tasks. Earth Science Cluster

ES Frameworks Today we have different frameworks by cluster partners Geocluser (CGGV, see EGEE-II) Kwfgrid middleware solution (II-SAS, Flood) VxOware (NASA/GCRAS Moscow, sourceforge) Gpod (ESA) ... Workplan is not ready: Open: - identify interfaces to be wrapped by Webservices (applications, gLite services) - which standards (WS-*) - … Earth Science Cluster

Project Tools Codemanagement: Gforge @ SCAI (svn, Wiki, mailman) Repository for ES with: Services and Tools including Usecases, design + implementation patterns modeling frameworks with applications ( best practice) may be DEGREE Portal ! Metrics: -- number of publications (results) -- number of applications and users -- number of tools in the repository -- hits to our portal Earth Science Cluster

Upcoming ES events: EGU European Geoscience Union @ Vienna, 16 April 08 2 Grid related tracks, EGEE booth See http://meetings.copernicus.org/egu2008 DEGREE workshop @ KNMI in 8/9 of May 08 ES Roadmap http://www.eu-degree.eu/ A Earth Science Cluster