Supporting eScience Communities: The D4Science Perspective on EGI Pasquale Pagano D4Science TD User Community Transition from EGEE to EGI 17 December2008 Paris (France)

2 Outline D4Science in a nutshell Communities characterization D4Science as a mediator Resources Support Speculation on the EGI model Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

3 D4Science highlights Introduction Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

4 D4Science vision calls for the realization of scientific e-Infrastructures that will remove technical concerns from the minds of scientists, hide all related complexities from their perception, and enable users to focus on their science and collaborate on common research challenges gCube is a framework to manage distributed e-infrastructures where it is possible to define, host, and maintain dynamic virtual research environments capable to satisfy the collaboration needs of distributed Virtual Organizations (VOs) Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

5 Virtual Research Environment (VRE) VRE is a distributed highly dynamic environment for carrying out cooperative activities like data analysis and processing; data generation, integration, enrichment, and curation; production of new knowledge using specialized tools largely based on retrieval and access of always updated knowledge from diverse heterogeneous data sources produce knowledge that is preserved and made available for other usages inside and outside the VRE Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

6 Virtual Research Environments Resources VRE environment is designed, dynamically deployed, and operated as a set of cooperating resources:  computing, storage‏  VRE enabling middleware‏  Information system, monitoring, resource management and orchestration  VRE services  content and storage management, discovery and access, …  applications  mostly provided by the VOs  collections of raw data, content, and metadata  enriched with schemas, mapping rules, transformation programs, relationships, …  processes defined to manage such resources Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

7 Communities characterization Part 1 Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

8 ENVIRONMENTAL MONITORING VO: CHLOROPHYLL AND VEGETATION DISTRIBUTION VREs Courtesy by Luigi Fusco ESA

9 VREs: to enhance current procedures The VRE integrated environment puts at disposal a functionality set which is not today available in Earth Science to support and perform research activities: examples are  the ability to process information on-demand ingesting the results,  to set-up further VREs opening to colleagues,  to perform customized collection of information,  to store user actions and exploit them for further use,  to aggregate relevant information into ad-hoc information sources and keeping them updated. Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

10 VREs data sources eogrid.esrin.esa.int: daily updated data sets and applications ~4.7k global data set key community portal to data set and applications daily updated data sets reference documentation, metadata, and applications idn.ceos.org: reference thesaurus, ~30k products environmental data sets and reports Products: Landsat 7, AATSR, Meris level 2, Meris Level 3, MGVI. Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

11 VREs: to enhance current procedures Currently these steps are carried on manually, on different technologies and systems delaying the delivery of research results. The planned VREs offer a dynamic set up and utilization of Virtual DL which are created for the specific scope defined by the users. The focus, once again, is not in the processing, but in the dynamic allocation of resources. Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

12 FISHERIES AND AQUACULTURE RESOURCES MANAGEMENT VOs INTEGRATED FISHERIES CAPTURE INFORMATION SYSTEM - ICIS VRE Courtesy by Marc Taconet FAO Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

13 WorldFish Center  One of 15 centers supported by the Consultative Group on International Agricultural Research (CGIAR). Close relationship with IWMI (water management)  HQ in Penang, Malaysia with 11 Country Offices: AFRICA: Cameroon, The Democratic Republic of Congo, Egypt, Malawi, Zambia; ASIA: Bangladesh, Cambodia, China, The Philippines; PACIFIC: New Caledonia, Solomon Is.  Partnership with government and non-governmental agencies at regional, national and local levels in the developing world, and with advanced research institutions in more than 25 countries with more than 200 partners representing 50 countries  Priority to help regional and national bodies to develop fisheries and aquaculture management strategies Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

14 Food and Agriculture Organization of the United Nations  FAO: UN agency  Institutional, inter-governmental  Establish standards, controlled vocabularies, ontologies  Gather data, information incl. landing statistics, and methodologies  Propose recommendation of good practices  Fishery Department investigates the impact of fisheries on the world's marine ecosystems in collaboration with Regional Fisheries Bodies  Academic research  Reconstruct historical catches and biomasses at ocean level Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

15 Regional Fishery Bodies  Intergovernmental bodies  Management of shared resources On geography basis (sea) On stock basis (migratory species like tuna)  Gather data, information including catches and landing statistics  Recommendations for quotas by country (to be endorsed by regional political bodies) Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

16 Regional Fishery Bodies Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France) Source: FAO:

17 Community member selection – phase one  Begin at regional level  Clearest need for VRE’s at this level  Multiple nations  Multiple data sources  High profile assessments on commercially important stocks  Partner selection criteria  who FAO is currently involved with  who is regularly performing assessments  who has expressed interest  who has good IT experience  data without problems of access rights  Current candidates  ICES ICES  NAFO NAFO Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)  SEAFDEC SEAFDEC  SPC SPC

18 ICES FAO (GFCM/CECAF) NAFO Data services Data model Data services Data model Data services Data model Mapping rules Data import services Reallocation rules Data formatting CSV tableDB connection XML WSDL PDF HTML import model harmon- ization analysis realloc- ation output Annotation / User rights Query support GIS services data services Common data model Reliability index FAO (GFCM / CECAF) NAFOICES Geo Network Aqua Map Species habitat index VREs: to enhance current assessment procedures Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

19 Professional backgrounds  Fishery biologists and marine ecologists  Statisticians and modelers  Economists  Sociologists  Lawyers and enforcement skills (rangers, customs, coast guards)  Conservationists: Threatened species and Marine Protected Areas (MPA: are also seen as a fishery management tool) Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

20 Scope: Socio-Ecological Systems (SES) Increase the resiliency (= decrease the vulnerability) of fisher communities (with respect to e.g.  Overfishing (by locals or intruders)  Natural stock variability  Natural hazards  Global climate change Taking into account external impacts e.g.  Political and economic situations  Cultural peculiarities  Epidemiological situations Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

21 D4Science as a mediator Part 2 Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

22 D4Science Mediation  Mediates over the definition, deployment, and maintenance of EGEE sites VOs users management Applications porting to the Grid and execution, e.g. Aquamaps data challenge (>100k jobs, >10M compound products) Applications integration, e.g. Landsat 7 Grid Services integration, e.g. ESA gPod MGVI  Support the definition, deployment, and maintenance of gCube sites for the creation and maintenance of VREs Resource description, monitor, and provision (GLUE, WSRP, WSDL,..) Dynamic selection, configuration, and secure resources exploitation in VREs scope Services orchestration (BPEL) Data integration Support for compound objects, multiple metadata formats, mixed media annotation Support for advanced information retrieval, fusion and merge of the result, access Support for curation, transformation, and enhancement of data Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

23 D4Science Resources D4Science provides seed resources through the provision of 3 EGEE sites maintained by technological partners (64 WNs, >100 cores) D4Science supports communities through SA and its production support team but the maintenance of am EGEE site is still perceived too costly (number of updates and duties) D4Science promotes communities VOs through the establishment of agreements with other EGEE VOs, e.g. csTCDie (Trinity College, Dublin) Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

24 Speculation on the EGI model Part 3 Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

25 Towards EGI D4Science facts:  Institutional partners with world-wide mandate  Shared vision towards a data infrastructure ecosystem  User-pulled requirements  Buying-in plans from partners organizations  Strategy for growth by contamination Long Term Vision:  Institutionalized entity responsible for  the coordination and maintenance of the data infrastructure ecosystem  the secretariat for the ecosystem governing body Current implementation:  Project-based organization coordinating project partners and EGEE provided resources

26 Towards EGI Envisioned solution:  Specialised Support Center  Hosted by EGI.org  Providing seed resources  Empowered and Governed by Ecosystem Members Project-based Institutionalized Entity FROMTO

27 TIME FOR QUESTIONS AND DISCUSSION Thanks for your attention Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

28 ADDITIONAL SLIDES Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

29 Fisheries User Community: Overview 10 January 2008, Sophia Antipolis (France) World FAO areas

30 Organizational level and workflow  Roles distributed:  by themes  Ecology – environment  Fisheries  by mission:  Policy – management – development  Research  Control and enforcement  by geographical scale:  Global level  Regional level  National level FAOWFCRFBs National researc h center National administ ration x xx x x x x x xx x x x x x x x x x x Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

31  Needs at global level for High Seas fisheries  UN recommendations  “distinguish catch in the High Seas from catch within EEZs”  current status: reporting by statistical areas Organizational level and workflow Global organizational framework: High Seas Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

32  Needs at global level for High Seas fisheries  UN recommendations  “distinguish catch in the High Seas from catch within EEZs”  current status: reporting by statistical areas Organizational level and workflow Global organizational framework: High Seas Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

33 REGIONAL LEVEL standard reporting format fishbase DB FAO WFC RFBs Catch + GIS peer review editing NOAA OBIS GLOBAL LEVEL Catch + GIS Satellite oceanographic Species occurrence end user Fishery ontology Reference system Aquamap  Needs for High Seas fisheries  Organigram of possible workflow Organizational level and workflow Global organizational framework: High Seas Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)

34 Conclusion on needs  Regional level:  Scope: assessment and management of shared and straddling stocks  Needs for VREs: sharing workspace, replaying and streamlining  legacy information systems  scientific knowledge elaboration  management advice  status and trends reporting  Global level:  Scope: High Seas fisheries  Needs for VREs: permanent shared services to providers and web-services to end users  Networked catch regional databases, and global fishery ontology  Modelling of ecological processes - Aquamap process: Species likeliness of spatial occurrence indexes  Peer review processes Supporting eScience Communities: The D4Science Perspective on EGI 17 December 2008, Paris (France)