1. Presentation at the OGF23 Poznań Supercomputing and Networking Center
RISGE RG
Barcelona, June 3rd, 2008
Norbert Meyer,
Poznań Supercomputing and Networking Center

2. Project partners Poznan Supercomputing and Networking Center, PSNC
Consejo Superior de Investigaciones Cientificas, CSIC
Consorzio Nazionale Interuniversitario per le Telecomunicazioni, CNIT
Sincrotrone Trieste SCpA, ELETTRA
European Centre for Training and Research in Earthquake Engineering, EUCENTRE
Johannes Kepler University, GUP
Universität Stuttgart, USTUTT
Istituto Nazionale di Oceanografia e di Geofisica Sperimentale, OGS
Ecohydros SL, ECOHYDROS
Greek Research and Technology Network S.A., GRNET
Universidad de Cantabria, UC

3. DORII in a nutshell http://www.dorii.eu
DORII – Deployment of Remote Instrumentation Infrastructure
Started – Feb. 1st, months
Kick-off Meeting - next week
11 partners:
scientific community
IT partners
Service providers: services + infrastructure
industry
7 FP project, started at the Infrastructure Unit
Grant agreement for: Combination of Collaborative projects & Coordination and support action
Call1: Deployment of e-Infrastructures for scientific communities

4. Outline Motivation Objectives Applications – 2 examples
Project Structure
Research and Development
General Framework
Standardisation
Summary

5. Motivation Scientific community
the ICT technology is still not present at the appropriate level
but is demanded by the users to empower the daily work processes
There is strong interest of scientific groups of users that are eager to profit from Remote Instrumentation
e-Infrastructure
This is the reference for DORII, with experimental equipment and instrumentation, which is not integrated or integrated only partially with the European infrastructure
We collected requirements from various owners of equipments, selected scientific disciplines (only areas where hardware instrumentations are required for experimental work)
The current capital investment, collected since a few years and coming from many international and national projects, where we were co-operating together
7+ years experience

6. Objectives
Integration of instrumentation and selected applications with e-Infrastructure and maintenance on production level
Adaptation of e-Infrastructure across selected areas of science and engineering
Step forward in accessing scientific instruments
combine the experimental science community and its research facilities with the support given by e-Infrastructure
Deployment and operation of persistent, production quality, distributed instrumentation integrated with e-Infrastructure
to provide added values of e-Infrastructure in the integrated environment of scientific and engineering instrumentation, networking, visualisation and computational infrastructures
Generalize and deploy a framework environment that can be used for fast prototyping
to use expertise and demands collected from various groups/owners of scientific instrumentation
to integrate selected functionalities from infrastructure and ICT-oriented projects
The DORII project aims to deploy e-Infrastructure for new scientific communities, where on the one hand the ICT technology is still not present at the appropriate level, but on the other hand it is demanded to empower its daily work
Adaptation of e-Infrastructure across selected areas of science and engineering
to give added value in terms of performance and access to scientific equipment and instruments
to combine the experimental science community and its research facilities with the support given by e-Infrastructure
Deployment and operation of persistent, production quality, distributed instrumentation integrated with e-Infrastructure
to build a production quality distributed computational and visualisation infrastructure, integrated with the distributed instrumentation environments of the selected scientific area
to provide and support added values of e-Infrastructure (like interactivity, parallelization, collaborative tools, dynamic measurement scenarios - workflows, low latency) that would be used in the integrated environment of scientific and engineering instrumentation, networking, visualisation and computational infrastructures.
Generalize and deploy a framework environment that can be used for fast prototyping
to use expertise and demands collected from various groups/owners of scientific instrumentation (RINGrid, GRIDCC);
to provide advanced applications and capabilities to more researchers by developing an integrated framework for fast prototyping
to integrate selected functionalities from infrastructure and IST-oriented projects (GRIDCC, Int.EU.Grid, g-Eclipse)

7. Scientific community Earthquake community:
The selected user groups is a balanced sample of all existing European and international communities
Their daily activities will benefit greatly after the integration with
e-Infrastructure
And even more… Deploying the results to a wider community outside the project
MOON (Mediterranean Ocean Observing Network),
European organisation EuroGOOS
ECOHYDROS – represents the industry area (SME)
Earthquake community:
Network-centric seismic simulations
Earthquake early warning system
Environment community with selected applications:
Oceanographic and coastal observation and modelling
Mediterranean Ocean Observing Network
Experimental science community
On-line data analysis - synchrotron and free electron lasers
Reference installation mentioned by ESFRI
We are aiming to support the selected communities in the development and deployment of their respective applications in the e-Infrastructure, The project plans to support three well-established communities at all the required levels:
Earthquake community with following selected applications:
Network-centric seismic simulations
Earthquake early warning system design and simulation
Antarctic Seismographic Argentinean Italian seismographic network
Environment community with selected applications:
Oceanographic and coastal observation and modelling Mediterranean Ocean Observing Network - an integrated system from sensors to model predictions
Oceanographic and coastal observation and modelling using imaging
Monitoring inland waters and reservoirs
Experimental science community
On-line data analysis in experimental science coming from increased efficiency of the light sources (synchrotron and free electron lasers) and of the detectors with higher and higher resolution and faster readouts.

8. Application Example Monitoring inland waters and reservoirs
Need to be controlled in a daily basis (process of fast development and decayment). Also prediction of risks from weather and management changes (models)
Both detection and prediction systems need to be fuelled with data acquired in continuous mode from different deployed sensors
Toxic algae blooms surveillance:
The whole picture
Meteorological Data
Water Quality data in reservoir
Reservoir physical submodel
Reservoir ecological submodel
Basin hydrological model
Early detection
Daily water and nutrient loads
Prediction
Water quality at the inflows
Toxic algae blooms
Hidraulical Management
Biomanipulation
Communication to WQ Managers and sanitary authorities
Corrective measures

9. Monitoring inland waters and reservoirs (cont.)
Application Example
Monitoring inland waters and reservoirs (cont.)
Real time data generated by in lake sensors: floating station with a meteorological station above the surface and a chain of thermistors below the surface. Among others sensor, it is remarkable a fluorescence optical one to monitor cyanobacteriae concentration.
Monitoring, Visualisation and Evaluation in near real time
Processing by Reservoir Modelling System: simulations are computationally intensive, taking several hours or even days to run. In order to give realistic predictions, simulations must show circulations patterns and water quality gradient: An early warning system needs short simulation periods –”close” to real time

10. Application Example
Oceanographic and coastal observation and modelling Mediterranean Ocean Observing Network: an integrated system from sensors to model predictions
The main OGS application is devoted to develop a work flow control between observing sensors and numerical model:
from the measured data to the numerical simulations, passing through data transmission, data receiving, data quality check, data pre-processing, data flow control, data assimilation (both physical and biological);
post-processing of model outputs: visualization, dissemination…
Seismographic network

11. Floats deployment

12. FLOAT Sampling and cycle characteristics

13. GLIDER sensor packages
Conductivity, Temperature, Depth
Oxygen
Fluorometer
Optical Backscatter
Optical Attenuation
PAR sensor
Spectrophotometer (red tide detection)
Bathyphotometer (bioluminescence)
Altimeter (important for coastal applications)
ADCP
Hydrophone & Towed Arrays
Acoustic Modem

14. Deployment of 1st Italian glider
GLIDER properties
Start
End
7 km
7.25 km
6.3 km
1) Steering possibility:
- repeated sections
- virtual mooring
- respond to events
- adaptive sampling
using model forecasts to improve “Glider Routing“
2) Long endurance (to be soon even more increased
with Lithium batteries = 3-5 months ~ km)
3) Possibility to measure many parameters physical and biogeochemical
(optical properties)
4) Very high density and horizontal resolution (400m-2km) > numerical model
grid size
5) Complementarity with the other observing system components:
- Satellite data
- Argo floats
- Moorings
- Ships of opportunity XBT lines
Deployment of 1st Italian glider
in Ligurian Sea

15. Expectations
As a SME, a good outcome of this project could help us to speed up the integration of more sensors (like remote sensing platforms, inflow stations, discrete surveys, …) to improve prediction capacity and to spread the use of these kind of systems in the water quantity and quality management agencies.
In our implementation we prioritise two applications that appear to represent a good and significant test, easily expandable and portable/scalable:
control and interaction with the network of free-floating profiling buoys
demonstrate the capability of tracking the data flow from generic oceanographic autonomous multi-parametric measuring platforms equipped with a variety of sensors;
implement a GUI to facilitate operator control of the system functioning;
create a protocol for remote bi-directional control to be implemented in the new generation of floats that will be deployed in the next years.
the ecosystem model operational chain
implement a GUI to facilitate operator control of the system functioning (synchronisation of the processes, timeliness of data exchange);
integrate a visual browser into the operational chain to remotely track (and/or eventually stir) the simulation, and communicate with remote operators;
seamlessly link a scientific visualization tool(s) for model output exploration.

16. State of the art
Significant experience for almost 7 years in all strategic areas
interactivity in grids and distributed environment (Int.EU.Grid, BalticGrid, CrossGRID)
visualisation (Int.EU.Grid, CrossGrid)
collaborative tools (GRIDCC, Int.EU.Grid)
steering, monitoring and accessing remote instrumentation (GRIDCC, RINGrid, VLAB, CRIMSON)
building software frameworks for fast prototyping and easy adaptation (g-Eclipse, Int.EU.Grid, CrossGrid)
workflows (VLAB)
networking, quality of service and bandwidth on demand (GN2 project)
The hardware and software technology will be incorporated mainly from the EC projects: GRIDCC, RINGrid, Int.EU.Grid, g-Eclipse, GN2, EGEE, national projects: VLAB and CRIMSON
The IT technology is provided by the project partners, who will deliver the functionality developed in previous projects
The experience gained in these projects, allows us to expect a very positive result of integrating applications with the existing infrastructure
As the DORII consortium has taken part in the mentioned projects, we can minimize the risk related to porting the technology into new groups of scientific communities

17. Project activities
NA1 will provide the managerial structure and procedures to ensure effective and successful work of the project as a whole. It will monitor the overall project progress (work done in all workpackages) and quality of results, co-ordination of work- and information-flow between activities. SA1 and SA2 will provide the infrastructure necessary for application integration of scientific communities and integration of equipment and instrumentation. The NA3 activity is the major part where we are going to adopt the existing applications, integrate with e-Infrastructure and empower the daily users work with the existing and future e-Infrastructure.
The NA2 activity deals with dissemination and knowledge transfer, with a base and input receiving from NA3, NA4, JRA1, SA1 and SA2. The research and development work is done in JRA1. The DORII consortium is planning to be active in standardisation bodies and having an influence on policy definition of e-Infrastructure, especially in terms of visionary view and introducing new resources in e-Infrastructure.

18. Joint Research Activity
The aim of this joint research activity is to integrate and further develop work that has been successfully carried out by the projects RINGrid, GRIDCC, Int.EU.Grid and gEclipse.
It will take advantage of best practices and operate the Remote Instrumentation Infrastructure together with the interactive computation resources offered by the Int.EU.Grid project.
It will enable powerful workflows consisting of instrumentation gathering, interactive simulation, and effective visualization of the gained output (GridCC, VLAB, gEclipse).
Tasks
Identification of generic interface remote sensor/devices and implementation of support for sensors and devices
Adaptation of selected services and middleware from other projects to implement a generic model of architecture of remote instrumentation.
Supporting interactive jobs for experiment workflows
Application developers’ support (performance analysis, remote debugging)
Advanced visualization techniques
Collaboration tools
Integration of all enhanced components and applications into a common framework

19. Standards related work
Goal:
To generalize and deploy a framework environment that can be used for fast prototyping
Strong need for continuation of already started activities (worldwide importance)
INGRID – conference (planned as annual event, exchange forum)
Research group at OGF – RISGE - Remote Instrumentation Services in Grid Environment
to explore issues related to the usage of advanced Grid capabilities in the process of monitoring as well as execution of measurement tasks and experiments on complex remote scientific equipment
to integrate approaches in defining remote access interfaces to sophisticated laboratory equipment in e‑Infrastructure environments
it concerns steering, monitoring and user access to unique instruments
the advances of Grid technologies in areas such as interactivity and visualization will play and important role in the process of accessing remote devices

20. Summary
Very well defined objectives and added value (significant impact on user communities, standardisation, business usage of e-Infastructure – SME’s involved)
Existing pieces of the proposed software framework
Strong and balanced consortium with experience that covers all relevant project parts, deep involvement of user communities
Challenging testbed including real end users
Strong need for continuation of already started activities (worldwide importance)
INGRID – conference (planned as annual event, exchange forum)
Research group at OGF – Remote Instrumentation Services in Grid Environment – work on common instrumentation architecture
And even more …deploying the results to a wider community outside the project community - exploitation