Visita al sito di Catania RECAS 06-09-2013 1 Attività correlate a RECAS condotte a Catania Roberto Barbera.

Slides:



Advertisements
Similar presentations
Grid Initiatives for e-Science virtual communities in Europe and Latin America The VRC-driven GISELA Science Gateway Diego Scardaci.
Advertisements

Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
Federated access to e-Infrastructures worldwide
Introduction on Science Gateway Understanding access and functionalities Catania, 09/06/2014Riccardo Rotondo
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures – Proposal n ABINIT,
Thee-Framework for Education & Research The e-Framework for Education & Research an Overview TEN Competence, Jan 2007 Bill Olivier,
Catania Science Gateway Framework Motivations, architecture, features Catania, 09/06/2014Riccardo Rotondo
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures – Proposal n A Standard-based.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures – Proposal n The CHAIN-REDS.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Grid Engine Riccardo Rotondo
EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Co-funded.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
STAR net, Resources and VOs C. Vuerli, A. Costa, U. Becciani, P. Massimino, G. Castelli.
Digital Earth Communities GEOSS Interoperability for Weather Ocean and Water GEOSS Common Infrastructure Evolution Roberto Cossu ESA
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Interoperability from the e-Science Perspective Yannis Ioannidis Univ. Of Athens and ATHENA Research Center
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement n° Data Repositories.
Data Repositories and Science Gateways for Open Science Presenter: Roberto Barbera – UNICT and INFN EGI Community Forum Bari – 11 November 2015.
NeuroLOG ANR-06-TLOG-024 Software technologies for integration of process and data in medical imaging A transitional.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Widening the number of e-Infrastructure users with Science Gateways and Identity Federations Giuseppe Andronico INFN -
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Evolution of AAI for e- infrastructures Peter Solagna Senior Operations Manager.
How to integrate EGI portals with Identity Federations Roberto Barbera Univ. of Catania and INFN EGI Technical Forum – Prague,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI strategy and Grand Vision Ludek Matyska EGI Council Chair EGI InSPIRE.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures – Grant Agreement n
Science gateway e risultati dei progetti Europei di e-Infrastructure Roberto Barbera Univ. di Catania & INFN Riunione CCR.
Tutorial on Science Gateways, Roma, Riccardo Rotondo Introduction on Science Gateway Understanding access and functionalities.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
Rome - 24 January Earth Server EU FP7-INFRA project Scalability for Big Data Roberto Barbera - University of Catania and INFN - Italy
Introduction to Distributed Computing Infrastructures and the Catania Science Gateway Framework Roberto Barbera Univ. of Catania.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
Storing digital assets on Grid/EGI FedCloud with gLibrary Giuseppe La Rocca, INFN DARIAH ERIC.
Utilizzo di portali per interfacciamento tra Grid e Cloud Workshop della Commissione Calcolo e Reti dell’INFN, May Laboratori Nazionali del.
Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures – Grant Agreement n The CHAIN project and its worldwide interoperability.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Co-funded.
Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures – Grant Agreement n The CHAIN Project Federico Ruggieri, INFN.
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement n° The Sci-GaIA.
The Catania Grid Engine Mr. Riccardo Rotondo Consortium GARR, Rome, Italy
REST API to develop application for mobile devices Mario Torrisi Dipartimento di Fisica e Astronomia – Università degli Studi.
The Open Access Repository of INFN Roberto Barbera and Rita Ricceri – INFN
Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures – Grant Agreement n CHAIN sustainability guidelines Dr. Ognjen.
The Catania Grid Engine and some implementations of the framework Diego Scardaci INFN The Catania Science Gateway Framework.
Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures – Grant Agreement n CHAIN sustainability guidelines Dr. Ognjen.
The eCSG Mobile App Mario Torrisi INFN – Division of Catania 24 June 2013 Webinar on the eCSG 1.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures – Grant Agreement n
Co-ordination & Harmonisation of Advanced e-INfrastructures CHAIN Worldwide Interoperability Test Roberto Barbera – Univ. of Catania and INFN Diego Scardaci.
Co-ordination & Harmonisation of Advanced e-INfrastructures Technical program: advancement & issues Roberto Barbera University.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
Web and mobile access to digital repositories Mario Torrisi National Institute of Nuclear Physics – Division of
The Catania Science Gateway framework Mr. Riccardo Rotondo Consortium GARR, Rome, Italy
Some considerations and ideas for the (next) future Roberto Barbera University of Catania and INFN IWSG’10.
A Data Engine for Grid Science Gateways Enabling Easy Transfers and Data Sharing Dr. Marco Fargetta (1), Mr. Riccardo Rotondo (2,*), Prof. Roberto Barbera.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
Accessing the VI-SEEM infrastructure
Giuseppina Inserra INFN Catania
The CHAIN-REDS Project: an overview
Extending Authentication to Members of Social Networks
Technical Meeting with CNR and INAF 7 October 2014
EMI Interoperability Activities
CHAIN-REDS computing solutions for Virtual Research Communities CHAIN-REDS Workshop – 11 December 2013 Roberto Barbera – University of Catania and.
Wrap-up and future activities Roberto Barbera (roberto.
CHAIN-REDS Data Solutions for Virtual Research Communities
Open Access Repository INFN Roberto Barbera (roberto
Elisa Ingrà – Consortium GARR
The SADE mini-project of the EGI DARIAH Competence Centre
Grid Engine Riccardo Rotondo
Grid Engine Diego Scardaci (INFN – Catania)
Presentation transcript:

Visita al sito di Catania RECAS Attività correlate a RECAS condotte a Catania Roberto Barbera

2 Outline Current projects where Catania is involved The Catania Science Gateway Framework Open Access, Linked Data and Semantic Search Summary and conclusions

3 List of projects where Catania is involved Currently running: – agINFRA (EU-FP7) – e-Infrastructure for Agricultural Sciences – CHAIN-REDS (EU-FP7) – Harmonisation of e-Infrastructures worldwide – DCH-RP (EU-FP7) – Roadmap for preservation of Digital Cultural Heritage data – EarthServer (EU-FP7) – Geospatial Big Data Analytics – eI4Africa (EU-FP7) – e-Infrastructure building and support in Sub-Saharan Africa – PRISMA (PON Smart cities) Cloud computing – RECAS (PON) Funded but not yet started: – VESPA (PO FESR Sicilia) Virtual-reality-based e-Infrastructure for early diagnosis of mental diseases

Research networks at «global» scale 4

The “Global” Grid 5

The “non-global” middleware 6 Genesis II Interoperability and easiness of access are issues

7 Using Grids is not straightforward  Users have to cope with complex security procedures, execution scripts, job description languages, command line based interfaces and lack of standards This makes the learning curve very steep and keeps non IT-experts away

8 (1) The eResearch 2020 report (1) Some barriers in the adoption of Grids: – Changes on Grids means changes on applications – Time required to adapt usual workflows – Lack of structure to support anonymous access – Download and installation of applications – Interface – Slow to get to compared to other resources – Difficult to use in the beginning – Time spent to get the application compiled and running

9 Some numbers… (*)  1100 users in Italy

10 The path to technology uptake – Where are we with e-Infrastructures ? The Rogers “bell-shape” curve - Rogers, E. M. (1962), “Diffusion of Innovations”, Glencoe: Free Press.

Interoperability – Does this definition apply to e-Infrastructures ? Interoperability is a property referring to the ability of diverse systems and organizations to work together (inter-operate). The term is often used in a technical systems engineering sense, or alternatively in a broad sense, taking into account social, political, and organizational factors that impact system to system performance; According to ISO/IEC (Information Technology Vocabulary, Fundamental Terms), interoperability is "The capability to communicate, execute programs, or transfer data among various functional units in a manner that requires the user to have little or no knowledge of the unique characteristics of those units". 11

12 Science Gateways “A Science Gateway is a community-developed set of tools, applications, and data that is integrated via a portal or a suite of applications, usually in a graphical user interface, that is further customized to meet the needs of a specific community.” Teragrid/XSEDE

IT acceptance model – the Grid Development of Science Gateways Requirement for sustainability Davis, F. D. (1989), "Perceived usefulness, perceived ease of use, and user acceptance of information technology", MIS Quarterly 13(3): 319–340 13

14 Building Science Gateways should be like playing with Sc. Gtwy E Sc. Gtwy DSc. Gtwy CSc. Gtwy B Sc. Gtwy A Standards Simplicity Easiness of use Re-usability

15 The Catania Science Gateway Framework ( Science Gateway Science Gateway App. 1 App. 2 App. N Embedded Applications Administrator Power User Basic User Users from different organisations having different roles and privileges Standard-based (SAGA) middleware-independent Grid Engine Standard-based (SAGA) middleware-independent Grid Engine Grid/Cloud/Local middleware supported so far

16 Summary of adopted standards The framework for Science Gateways developed at Catania is fully web-based and adopts official worldwide standards and protocols, through their most common implementations These are: – The JSR 168 and JSR 286 standards (also known as "portlet 1.0" and "portlet 2.0" standards)JSR 168JSR 286 – The OASIS Security Assertion Markup Language (SAML) standard and its Shibboleth and SimpleSAMLphp implementationsOASISSecurity Assertion Markup LanguageShibboleth SimpleSAMLphp – The Lightweight Direct Access Protocol, and its OpenLDAP implementationOpenLDAP – The Cryptographic Token Interface Standard (PKCS#11) standard and its Cryptoki implementationCryptographic Token Interface Standard – The Open Grid Forum (OGF) Simple API for Grid Applications (SAGA) standard and its JSAGA implementationOpen Grid ForumSimple API for Grid Applications JSAGA

17 AuthN/AuthZ Schema AuthorisationAuthorisation Science Gateway GrIDP (“catch-all”) GrIDP (“catch-all”) IDPCT (“catch- all”) IDPCT (“catch- all”) IDP_y LDAP Register to a Service 2. Sign in Authentication Social Networks’ Bridge IdP

18 The eduGAIN inter-federation ( Catania Science Gateways are also registered as Service Providers of eduGAIN

19 The GrIDP “catch-all” federation ( v

1. sign in User 6. get the results 4. execute action 3’/4’. track user eCSG Admin 5. get output Local/ Grid/ Cloud 2”. authZ eToken server 2’. authN Identity Provider User Registry Compliant with the EGI.eu Portal and Traceability Policies 3. create a proxy from an eToken server with robot certificates Catania Science Gateway Access Workflow 20

Robot certificates «in a nutshell» Robot certificates have been introduced to allow users, who do not have/want personal certificates and do not belong to any Virtual Organisation, to use the Grid They are usually issued on USB form factor’s smartcards Basically, these certificates can be used to identify a person responsible for an unattended service or process acting as client and/or server for a Virtual Research Community

The Catania Grid & Cloud Engine Grid/Cloud Engine Users Tracking DB Science GW Interface SAGA/JSAGA API Job Engine Data Engine Users Track & Monit. Science GW 1 Science GW 2 Science GW 3 Grid/Cloud/Local MWs Liferay Portlets eToken Server New ModifiedNewModified New

CHAIN Demo Contributors 23

CHAIN Demo Status ( 24

CHAIN Demo Status ( 25 A demo is in preparation for next week to show interoperability also with clouds

The GISELA Science Gateway ( 26

The GISELA SG: A new concept of Application Registry Links to applications run pages 27

The GISELA Science Gateway: Phylogenetics (MrBayes) Input Parameters

The GARR Science Gateway ( 29 A Catania Science Gateway is being installed at Napoli for RECAS

30 Uptake of Catania Science Gateways in the world (as of the end of 2012) Users from 219 Organisations in 47 Countries 14 Science Gateways in production; 4 in preparation

Some considerations – Mobile Access More than 25% of mobile phones in the world are smartphones and the number of people connected through mobile appliances increases every year Social networking amounts to 91% of mobile internet access, compared to 79% on desktops, and it is expected that by 2014 mobile internet should take over desktop internet usage (*) So, mobile access to “everything” is not any more an option; it is a must and e-Infrastructures shouldn’t/won’t be an exception (*)

32 “Mobile” Science Gateways

33 “Mobile” Science Gateways

34 “Mobile” Science Gateways

Big challenges are in front of us… Now that many users can potentially access and use Catania Science Gateways, a new training and communication strategy is needed as well as a portfolio of appealing applications to attract them 35

Users/VRCs Ex.: Africa Grid Science Gateway SG Dev. The Science Gateway Market Place

Training for Science Gateway developers New training material: New training tools: New kind of training events: – –

Web-course summary information Home page: – Timetable (direct URL): – ?view=standard&confId=942 ?view=standard&confId=942 All presentations have been uploaded Links are provided both to watch and download recordings of all the webinars This will be the base of the Science Gateway school Catania will run for RECAS

Training material summary information Training material page (short URL): – Available sections: This will be the base of the Science Gateway school Catania will run for RECAS 39

Code summary information (1/2) The Catania Science Gateway Framework on Sourceforge: –

A unique entry point The Catania Science Gateway Framework on the web: –

The Catania Science Gateway Market Place: – The Science Gateway Market Place (the first real implementation !) 42

The list of available applications 43

To propose new applications

To port new applications Register as a Catania Science Gateway Developer: – Sign In and book an application «to be ported» Once your booking is accepted, you have 30 days to create the needed portlet(s) for the application (the sooner the better) – After that time the access to our VPN will be denied Once you are registered you can also port the applications YOU proposed 45

46 First summary and conclusions e-Infrastructures can be very beneficial platforms for many users, provided they are really «easy to use» and users are at their centre The Catania Science Gateway Framework changes the way Grid infrastructures are used, hugely widening their potential user base across continents and organisations, especially non-IT experts and the “citizen scientist” The adoption of standards (JSR 286, SAGA, SAML, etc.) represents a concrete investment towards sustainability We now need to establish a task force of Science Gateway developers able to quickly develop portlets for scientific applications to be included in the available Science Gateways Developers will gain the access to a worldwide e-Infrastructure to develop and run their own applications All these materials and services will be re-used in RECAS and we will see how to involve people trained by RECAS in the Science Gateway Market Place

What do researchers do and how can e-Infrastructures help them to improve it ? Data Infrastructures Open Access Doc. Repos. Data Repos. Semantic-web enrichment of linked data Data preservation HTC/HPC Clusters Grids, Clouds The Scientific Method (worldwide, cross-domain, collaboration enabler) 47

CHAIN-REDS program for Data Infrastructures Identify standards to easily gather and access both Open Access Document Repositories (OADRs) and Data Repositories (DRs) Build a demonstrator to easy visualise and access OADRs and DRs (both geo-views and tab-views) Correlate OADRs and DRs to create linked data and discover new knowledge through semantic enrichment of metadata Promote Data Infrastructure standards and identify new OADRs and DRs from regions addressed by the project (Africa, Middle- East and Gulf Region, Latin America, China, India, Far-East Asia) Populate the demonstrator with these new repositories, add them to the semantic enrichment tool, and set-up at least two use-cases from different domains 48

The CHAIN Knowledge Base ( RREN(s) NREN NGI CA(s) Ident. Fed(s) ROC(s) Grid site(s) Application(s) Largest e-Infrastructure related knowledge base. Information both from the survey and other sources for more than half of the countries of the world 49

Open Access Document Repositories (OADRs)  2,500 repos >33 M docs 50

Open Access Document Repositories (OADRs) 51

Data Repositories (DRs)  600 repos Lots of data ! 52

Data Repositories (DRs) 53

Data Repositories (DRs) 54

55 The CHAIN-REDS Semantic Search Engine

Linked data semantic search Semantic enrichment Metadata harvesting Multi-layered architecture 56

OADRs Data Repos. OAI-PMH Harvester (running on grid/cloud) Linked-data search engine Semantic-web enrichment End-points Harvester (running on grid/cloud) Multi-layered architecture 57

Semantic enrichment 58

59 Linked data semantic search ( More than 22 million resources, almost 600 million triples

Linked data semantic search ( 60

61 Linked data semantic search (

Preliminary ! New knowledge discovery! Linked data semantic search ( 62

Preliminary ! New knowledge discovery! Linked data semantic search ( 63

Preliminary ! New knowledge discovery! Linked data semantic search ( 64

Second summary and conclusions Data Infrastructures are becoming an essential component of e- Infrastructures Next years’ biggest challenge will be to uniquely correlate scientific papers with data used to write them with applications used to analyse them so to be able to go across the knowledge path both ways Semantic-web and linked-data technologies can play a major role in this context and CHAIN-REDS aims to promote these standards in the targeted regions The CHAIN-REDS Semantic Search will be customised for RECAS and included in the RECAS Science Gateway 65

66 Thank you !