The CYCLOPS Platform: geospatial services implementation

Slides:



Advertisements
Similar presentations
Stefano Nativi 1 Co-authors Paolo Mazzetti 1, Valerio Angelini 1 Marco Verlato 2, Mirco Mazzucato 2 CYCLOPS: an EGEE SSA Implementation of Geosciences.
Advertisements

Challenges for Interactive Grids a point of view from Int.Eu.Grid project Remote Instrumentation Services in Grid Environment RISGE BoF Manchester 8th.
CWE, EC – ESA joint activities on e-collaboration Brussels, 13 April 2005 IST Call 5 Preparatory workshop.
Cloud computing in spatial data processing for the Integrated Geographically Distributed Information System of Earth Remote Sensing (IGDIS ERS) Open Joint-Stock.
ICT and Civil ProtectionSenigallia, June 2007 A Service-Oriented Middleware for EU Civil Protection cooperation Regione Marche.
RISICO a system for wide-nation wildfire risk assessment and management Paolo Fiorucci, Francesco Gaetani, Riccardo Minciardi.
Web-based Distributed Flexible Manufacturing System (FMS) Monitoring and Control Student: Wei Liu Instructor: Dr. Chang Apr. 23, 2003.
Sensor & Computing Infrastructure for Environmental Risks SCIER FP IST-5 Stathes Hadjiefthymiades (NKUA) 1st Student Workshop on Wireless Sensor.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
Standards meet applications for the Earth Sciences domain: the CP use case Stefano Nativi (ESSI-Lab of the CNR-IMAA) OGF25/EGEE User Forum Le Ciminiere.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
The Client/Server Database Environment
Anna Scipioni Stefano Nativi Jerome Bequignon Mirco Mazzucato Lorenzo Bigagli Vincenzo Cuomo CYCLOPS Project.
This Programme is funded by the European Union And implemented by a conrtium led by MWH in partnership with DEMA, CIMA Research Foundation, Austrian Red.
Stefano Nativi 1, Paolo Mazzetti 1 and Marco Verlato 2 1 Italian National Research Council-IMAA 2 INFN CYCLOPS Project CYber-Infrastructure for CiviL protection.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Towards an e-Infrastructure for Civil Protections Stefano Nativi (Earth and Space Sciences Informatics-Lab of CNR) TERENA networking conference 2009 University.
Your university or experiment logo here Caitriana Nicholson University of Glasgow Dynamic Data Replication in LCG 2008.
Personal Computer - Stand- Alone Database  Database (or files) reside on a PC - on the hard disk.  Applications run on the same PC and directly access.
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
State Key Laboratory of Resources and Environmental Information System China Integration of Grid Service and Web Processing Service Gao Ang State Key Laboratory.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
INFN Research Roadmap for Eric Frizziero (INFN) Marco Verlato (INFN) Luigi Zangrando (INFN) EGEE’09 Conference, Barcelona September.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Implementation of Web Coverage Service functionalities.
INFSO-RI SA2 ETICS2 first Review Valerio Venturi INFN Bruxelles, 3 April 2009 Infrastructure Support.
D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.
Developing GRID Applications GRACE Project
September 2003, 7 th EDG Conference, Heidelberg – Roberta Faggian, CERN/IT CERN – European Organization for Nuclear Research The GRACE Project GRid enabled.
Operational flash flood forecasting based on grid technology Monitoring and Forecasting Thierion Vincent P.-A. Ayral, V. Angelini, S. Sauvagnargues-Lesage,
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
Frascati, 2-3 July 2008 Slide 1 HMA User Management in G-POD HMA-T Phase 2 KO Meeting 2-3 July 2008, Frascati Fabrice Brito, Terradue Srl
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
Thierion V. Ayral P.-A. Flash Floods Applications 2 nd Training Worshop Chania, Greece May 2008.
Successfully Implementing The Information System Systems Analysis and Design Kendall and Kendall Fifth Edition.
CrossCutting topic: Data Quality and European Network of EO Networks
8 th International Desktop Grid Federation Workshop, Hannover, Germany, August 17 th, 2011 DEGISCO Desktop Grids for International Scientific Collaboration.
Distributed Systems Architectures Chapter 12. Objectives  To explain the advantages and disadvantages of different distributed systems architectures.
Frascati, 2-3 July 2008 Slide 1 User Management compliance testing for G-POD HMA-T Phase 2 KO Meeting 2-3 July 2008, Frascati Andrew Woolf, STFC Rutherford.
Distributed Systems Architectures. Topics covered l Client-server architectures l Distributed object architectures l Inter-organisational computing.
Enabling Grids for E-sciencE University of Perugia Computational Chemistry status report EGAAP Meeting – 21 rst April 2005 Athens, Greece.
CLOUD ARCHITECTURE Many organizations and researchers have defined the architecture for cloud computing. Basically the whole system can be divided into.
Chapter 12: Architecture
IOT – Firefighting Example
Achievements in Wildland Fire Risk Mapping
Data Management on Opportunistic Grids
Information Systems Development
Computing models, facilities, distributed computing
The Client/Server Database Environment
Design rationale and status of the org.glite.overlay component
Environmental Intelligence Platform – Monitoring Nutrients Pollution with Earth Observation Data for Sustainable Agriculture and Clean Waters Blue.
CYCLOPS activities at DDSC-EMA
The Client/Server Database Environment
CSC 480 Software Engineering
Chapter 9: The Client/Server Database Environment
GSAF Grid Storage Access Framework
GSAF Grid Storage Access Framework
#01 Client/Server Computing
Management of Virtual Execution Environments 3 June 2008
Ch 4. The Evolution of Analytic Scalability
Chapter 12: Physical Architecture Layer Design
European Forest Data Centre & European Soil Data Centre Progress report Jesús San-Miguel Databases, early waringn, remote sensing, simulation models,
Future EU Grid Projects
CNR-IMAA Proposal ( and )
Introduction to the SHIWA Simulation Platform EGI User Forum,
#01 Client/Server Computing
Presentation transcript:

The CYCLOPS Platform: geospatial services implementation Chania 5th May 2008 CYCLOPS Second Training Workshop The CYCLOPS Platform: geospatial services implementation Valerio Angelini1 Paolo Mazzetti1 Stefano Nativi1 Paolo Fiorucci2 Marco Verlato3 1CNR-IMAA 2CIMA Foundation 3INFN angelini@imaa.cnr.it

Outline The Civil Protections requirements The CYCLOPS architecture The gridded OGC Web Coverage Server Use case: the RISICO forest fires assessment application Porting RISICO in the CYCLOPS Grid infrastructure throug OGC Standard Web Services CYCLOPS, as you probaby know, is a SSA founded in FP6 which aims to study a cyber infrastructure to connect the various European Civil Protections Our work started from the analysis of the Civil Protection requirements From these requirements we derived our CYCLOPS architecture Recently we chosen a particular operative use case, the RISICO forest fires assessment application, and we ported it to the Cyclops Grid Infrastructure

From CP/GMES needs Civil Protection and GMES applications/systems have specific requirements: to share geospatial information that has complex characteristics: Huge amounts of remotely-sensed observations, which are multidimensional and frequently updated to access infrastructure, run models and search information in a real-time (RT) or near-real-time (NRT) way, privileging time of response instead of accuracy have access to computational power for working out simulation tasks or tasks for critical missions To implement the strict data policy and the security requirements typical of dual systems (civil/military); To formalise the knowledge required to analyse data and provide decision-makers with effective information They need At least

To GRID (Why to use Grid Platform for GMES applications?) Provide physical resources to support heavy application workloads Virtual Organization management Provide a security infrastructure Provide a quality of service agreement & monitoring infrastructure We have chosen the grid tecnology to be the base of our architecture The grid technology

Communities Interoperability Semantic Level GMES & CP Communities Strategic Applications Geospatial Community Geospatial Information services Goal is to bring together these two communities: BLA BLA Resources Provision GRID Community

CYCLOPS Architectural Framework Appl. Platform Real Time and Near Real Time Applications for Civil Protection (Data integration, high-performance computing and distributed environment for simulations) CYCLOPS Platform Security Infrastructure Business logic Services Presentation and Fruition Services Interoperability Platform CYCLOPS Infrastructure Spatial Data Infrastructure Services Environmental Monitoring Resource Infrastructure Geospatial Resources Services Advanced Grid Services I will show you the architecture we developed: GRID Platform (EGEE) Processing Systems Infrastructure Data Systems Sensor Element Services

Traditional WCS Data Request Response WCS interface Subsetting Resampling Data Encoding Request Response WCS interface

GRID WCS CE CE CE Workload Manager Result URL WCS Interface SE SE Subsetting Data Resampling CE CE CE R D S Data Encoding EGEE Grid Interface EGEE Grid Interface EGEE Grid Interface WCS interface Workload Manager EGEE Grid Interface Result R D S Result URL WCS Interface Async. response Request

GRID WCS : Technologies SE SE EGEE GRID Computing Layer (Java) CE CE CE R D S EGEE Grid Interface EGEE Grid Interface EGEE Grid Interface Java Serialization Workload Manager JDL EGEE Grid Interface Result R D Application Layer (Java) S HTTP/SOAP WCS Interface Async. response WEB Request

RISICO use case: Forest fires risk assesment RISICO is a forest fire risk forecasting system, operative for the Italian Civil Protection (DPC) since august 2003 It is developed by the CIMA Foundation for the DPC. Such a system is made of two main models: the fuel moisture model the potential fire spread model the fuel moisture model representing the dynamic behaviour of the distribution throughout the territory of the variable expressing the water contents of the vegetation; the potential fire spread model evaluate the physical characteristics that a fire could assume, on the basis of the variables that locally determine the possibility of a successful ignition and fire propagation.

RISICO current implementation RISICO current implementation runs on a single node on the CIMA premises It accesses LAM and Earth Observation input data through heterogeneous protocol and interfaces Heterogeneous interfaces/protocols Processing Server Running RISICO on a time base LAM data EO data model output data GUI EO data

RISICO execution on Grid 2 CYCLOPS WPS GUI GRID CYCLOPS WEB LAM data EO data Old Input Files Computing Elements WCS CYCLOPS Model Input files 1 GRID The old in put files are stored in the Grid storage elements The WCS dynamically generates the model input files, subsetting and/or resampling the origin files stored on the SE Storage Elements

Gridded WPS Activity diagram Through standard Access services Parallelized on grid Can handle response time (CP Requirement) All begins with an WPS Request Every process defines a “job splitting” strategy

RISICO advanced data access RISICO GUI CYCLOPS WCS WFS WPS request WCS GetCapabilities CS-W GetRecords WEB CS-W WCS requests CYCLOPS WPS Making use of standard web services CYCLOPS WCS GRID

RISICO improvements Flexibility: The geospatial services layer allow to: Integrate new and heterogeneous input data. Dynamically choose the spatial location and resolution of the run. Be interoperable with other “standard-based” infrastructures. Scalability. The grid infrastructure provides high processing and storage capabilities on-demand, allowing to: Improve output data resolution. Widen the covered area. Improve the response time. (Futures) Improve model complexity. The introduction of the geospatial services layer allowed

Architecture main achievements CP Requirement Strategy sharing geospatial information OGC Web Services strict data policy Grid security layer / VO management real-time or near-real-time Advanced grid services computational power for working out simulation task Grid computing capabilities Large and fast storage Grid storage capabilities

Progress of Work The RISICO prototype that makes use of the CYCLOPS platform is in the deploying phase The prototype will be presented in the next IBERGRID ‘08 in Porto (12-14 March 2008)

Thank you for your attention ! I’ll be happy to answer you questions

Back-up slides

Web Site Updated and revamped Contacts Corrado De Rosa (DPC) Valerio Angelini (IMAA) http://www.cyclops-project.eu

Forest Fire Risk Management application A system for wildland fire hazard mapping and resource management Vegetation modelling, along with meteorological data and topography, allow simulating moisture dynamics of different kinds of dead and live fuels over a given area A semi-physical fire propagation model gives a quantitative evolution of the hazardousness

WEB CYCLOPS CYCLOPS CYCLOPS WPS Basic functioning GRID RISICO GUI WPS request WEB WCS request CYCLOPS WPS CYCLOPS WCS GRID

GUI Preview