1. Pasquale Pagano (CNR-ISTI) Project technical director
Collaborating with e-infrastructures for innovative data management solutions
Pasquale Pagano (CNR-ISTI)
Project technical director
Understanding how ecosystems of EU
e-infrastructures can boost Blue Growth
11 January 2017
Brussels, Belgium

2. BlueBRIDGE Services Offer
BlueBRIDGE Infrastructure
- Ecosystem
Tailored services addressing three heterogeneous domains
One common infrastructure
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

3. BlueBRIDGE Infrastructure Services Offer
- Ecosystem
Data services addressing the whole data management value chain
Infrastructure services addressing the access and management of infrastructure resources
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

4. BlueBRIDGE hides ICT complexities
- Ecosystem
BlueBRIDGE
Storage
Computing
Data
Database
GIS
NoSQL
D4Science
EGI
SeaDataNet
OSCAR
Copernicus
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

5. BlueBRIDGE hides ICT complexities
BlueBRIDGE provides solutions for dealing with modern science increasingly global, multi-disciplinary and networked
Data and Services
Hosted by different Organizations
Accessible through different Protocols
Described with different Metadata
Policies
Different Licenses
Different Terms of Use
Different approaches for Credits
Heterogeneity
Provide Discovery, Access, Use
Support Validation, Curation, Harmonization
Trace Provenance
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

6. BlueBRIDGE realizes an open scientific infrastructure ecosystem
>800 data providers
>19k temporal datasets
>50k spatial datasets
>350 physical and chemical variables with global coverage spanning the last ten years
40k data analysis/month
Data
5 EGI sites
4 D4Science sites
4 Organization sites
1000 CPUs
400 TB storages
4 TB Memory
Computing
>250 services
>180 analytical models
>500 software components integrated
Services
BlueBRIDGE provides access to Data, Computing, and Services
BlueBRIDGE simplifies
the integration of new community services
the exploitation of community-specific analytical models
The analysis of community/user data
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

7. BlueBRIDGE supports data analytics
Not performed by individuals but group of data analysts
are multidisciplinary, involve members belonging to diverse organisations 
require to access data and services that are spread among many providers 
Dynamic groups addressing specific questions/problems
Without relying on pre-organised and costly supporting environments managed by dedicated organizations
BlueBRIDGE builds and operates their own VRE
BlueBRIDGE allows to operate on remote resources via dedicated interfaces
With limited or no additional costs for the resource providers
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

8. BlueBRIDGE supports data analytics via sharing of data and workflows
Support collaborative data analysis and experimentation via a virtual workspace
Enable secure and controlled data sharing
Manage heterogeneous data access policies
Implement Traceability and Reproducibility-Repeatability-Reusability
Information objects can be
files, dataset, workflows, experiments, etc.
organized into folders
Users can
share with selected users
disseminate via persistent public URLs
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

9. Software Integration Scientist provides a method to analyse data
Download the (python, R, Java, …) script and the user’s data
User’s data
Execute script
Collect output
BB Infrastructure
Save Output on the User’s Workspace, with provenance info
Destroy local copies of I/O and script
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

10. Collaborative Experiments
Shared online folders
In the e-Infrastructure
Inputs
Results
Outputs
Computational system
Through third party software WS
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

11. Enabling New Workflow VRE Social Updates the script on1
Updates the script on
his private Workspace
Script provider
The BB service downloads
the script on-the-fly 2 9 8
This user can execute the experiment again
and share the computation with other users 4 3
A user executes an experiment on his/her data 5 7 5
The output, the input and the parameters can be shared with another user 6
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

12. Access, integrate, process and analyse very heterogeneous resources
BlueBRIDGE is close to community needs
Simplify Integration
applications
methods
data
Promote Collaboration
Sharing
Publication
Provenance
Re-use
Easy-to-use
standard BB
Togliere le frecce e trovare un altro paradigma per mostrare …
secure
collaboration
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

13. Very different purposes
BlueBRIDGE delivers tailored environments
Same capabilities, different access policies
Same capabilities, access to different datasets
Different capabilities
BlueBRIDGE supports all the scientific phases
Testing of new methods and algorithms
Validation of methods and algorithms
Provision of production services
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

14. Very different purposes
BlueBRIDGE Common Facilities
BlueBRIDGE for Ecosystem Approach to Fisheries
BlueBRIDGE for Aquaculture
BlueBRIDGE for Education
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

15. Conclusions
BB manages
BB supports
BB operates
Users exploits
Policies
Authz
ToU
Training
Adoption
Use
Monitoring
Accounting
Provision
Security
Discover
Access
Re-use
Share
BlueBRIDGE simplifies the integration of user applications into e-infrastructure
BlueBRIDGE promotes access to an integrated environment where personal applications are managed as enabling technologies
BlueBRIDGE delivers a community-cloud where virtual services hide cloud and related technologies
BlueBRIDGE delivers an open Infrastructure Ecosystem contributing to Blue Growth
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017

16. Thank You
Questions?
“Understanding how ecosystems of EU e-infrastructures can boost Blue Growth,” Brussels, 11 January 2017