The Catania Science Gateway framework Mr. Riccardo Rotondo Consortium GARR, Rome, Italy

Slides:



Advertisements
Similar presentations
Grid Initiatives for e-Science virtual communities in Europe and Latin America The VRC-driven GISELA Science Gateway Diego Scardaci.
Advertisements

Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
Federated access to e-Infrastructures worldwide
Introduction on Science Gateway Understanding access and functionalities Catania, 09/06/2014Riccardo Rotondo
Dorian Grid Identity Management and Federation Dialogue Workshop II Edinburgh, Scotland February 9-10, 2006 Stephen Langella Department.
Beispielbild Shibboleth, a potential security framework for EDIT Lutz Suhrbier AG Netzbasierte Informationssysteme (
1 The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) GRID Science Gateway Riccardo Rotondo
Catania Science Gateway Framework Motivations, architecture, features Catania, 09/06/2014Riccardo Rotondo
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Research Infrastructures – Proposal n A Standard-based.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Grid Engine Riccardo Rotondo
GILDA testbed GILDA Certification Authority GILDA Certification Authority User Support and Training Services in IGI IGI Site Administrators IGI Users IGI.
STAR net, Resources and VOs C. Vuerli, A. Costa, U. Becciani, P. Massimino, G. Castelli.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Shibboleth & Grid Integration STFC and University of Oxford (and University of Manchester)
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
EGI-InSPIRE RI EGI-InSPIRE RI User Support in IGI: Related Tools and Services in Italy EGI Technical Forum
Widening the number of e-Infrastructure users with Science Gateways and Identity Federations Giuseppe Andronico INFN -
EGI Technical Forum Amsterdam, 16 September 2010 Sylvain Reynaud.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Evolution of AAI for e- infrastructures Peter Solagna Senior Operations Manager.
DECIDE DECIDE ( Diagnostic Enhancement of Confidence by an International Distributed Environment ) Valeria Ardizzone Consorzio COMETA & INFN Catania (DECIDE.
How to integrate EGI portals with Identity Federations Roberto Barbera Univ. of Catania and INFN EGI Technical Forum – Prague,
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Science gateway e risultati dei progetti Europei di e-Infrastructure Roberto Barbera Univ. di Catania & INFN Riunione CCR.
Tutorial on Science Gateways, Roma, Riccardo Rotondo Introduction on Science Gateway Understanding access and functionalities.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
Introduction to Distributed Computing Infrastructures and the Catania Science Gateway Framework Roberto Barbera Univ. of Catania.
Utilizzo di portali per interfacciamento tra Grid e Cloud Workshop della Commissione Calcolo e Reti dell’INFN, May Laboratori Nazionali del.
Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures – Grant Agreement n The CHAIN project and its worldwide interoperability.
Development of portlets for special jobs: parametric, collections, workflows Mario Torrisi National Institute of Nuclear Physics.
The Catania Grid Engine Mr. Riccardo Rotondo Consortium GARR, Rome, Italy
REST API to develop application for mobile devices Mario Torrisi Dipartimento di Fisica e Astronomia – Università degli Studi.
The Catania Grid Engine and some implementations of the framework Diego Scardaci INFN The Catania Science Gateway Framework.
Visita al sito di Catania RECAS Attività correlate a RECAS condotte a Catania Roberto Barbera.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Co-ordination & Harmonisation of Advanced e-INfrastructures CHAIN Worldwide Interoperability Test Roberto Barbera – Univ. of Catania and INFN Diego Scardaci.
Co-ordination & Harmonisation of Advanced e-INfrastructures Technical program: advancement & issues Roberto Barbera University.
A. Costa, P. Massimino, C. Vuerli, U. Becciani INAF CTA Gateway Prototype Based on gUSE/WS-PGRADE and Single-Sign-On (SSO)
Web and mobile access to digital repositories Mario Torrisi National Institute of Nuclear Physics – Division of
Portlet Development Konrad Rokicki (SAIC) Manav Kher (SemanticBits) Joshua Phillips (SemanticBits) Arch/VCDE F2F November 28, 2008.
The Catania Science Gateway Success Stories Mr. Riccardo Rotondo Consortium GARR, Rome, Italy
Sistema di Autenticazione e Autorizzazione per Science Gateway basato su Shibboleth M. Fargetta Consorzio.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
Some considerations and ideas for the (next) future Roberto Barbera University of Catania and INFN IWSG’10.
Servizi di AAI e job management per Science Gateway basati su standard D. Scardaci INFN Catania.
A Data Engine for Grid Science Gateways Enabling Easy Transfers and Data Sharing Dr. Marco Fargetta (1), Mr. Riccardo Rotondo (2,*), Prof. Roberto Barbera.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
D. Scardaci INFN Catania
User authentication on the e-Culture Science Gateway with Identity Federations and Identity Providers INDICATE Final Conference, Ankara,
Operations Management Board 19th Dec. 2013
Giuseppe LA ROCCA INFN - Catania, Italy
Extending Authentication to Members of Social Networks
Identity Federations - Overview
Grid accounting system
CHAIN-REDS computing solutions for Virtual Research Communities CHAIN-REDS Workshop – 11 December 2013 Roberto Barbera – University of Catania and.
Middleware independent Information Service
Riccardo Rotondo INFN Catania – Italy
(Exchange Programme to advance e-Infrastructure Know-How)
GSAF Grid Storage Access Framework
gLite Information System
Status report of the LToS platform
ESA Single Sign On (SSO) and Federated Identity Management
Introduction to Databases Transparencies
Elisa Ingrà – Consortium GARR
Grid Engine Riccardo Rotondo
Grid Engine Diego Scardaci (INFN – Catania)
User Support in EGI Reactive and proactive services
Grid Computing Software Interface
Support services for EGI portal-* communities
Check-in Identity and Access Management solution that makes it easy to secure access to services and resources.
Presentation transcript:

The Catania Science Gateway framework Mr. Riccardo Rotondo Consortium GARR, Rome, Italy

Outline Introduction The Catania Science Gateway framework: o Architecture o Authentication and Authorisation Schema o Access workflow o The Catania Grid Engine OGF35, Delft (NL), 18 Jun 20122

The eResearch2020 report ( Some barriers in the adoption of Grids: o Changes on Grids means changes on applications o Time required to adapt usual workflows o Lack of structure to support anonymous access o Download and installation of applications o Interface o Slow to get to compared to other resources o Difficult to use in the beginning o Time spent to get the application compiled and running OGF35, Delft (NL), 18 Jun 20123

Using Grids is not straightforward  OGF35, Delft (NL), 18 Jun Users have to cope with complex security procedures, execution scripts, job description languages, command line based interfaces and lack of standards. This makes the learning curve very steep and keeps non IT-experts away.

Another consideration… OGF35, Delft (NL), 18 Jun There is a huge number of non IT-experts out there who do not belong to any constituted Virtual Research Community. How can we attract them ? VRCs # of users

The evolution leap in web browser OGF35, Delft (NL), 18 Jun evolution leap 6

Grid Interface Evolution The way users access Grid resources has continuously evolved towards simplicity and transparency: Command Line o Globus and gLite CLI o Used by the enthusiastic and early adopter scientists GUI applications o gEclipse, Grid2Win o Good to expand the communities but difficult to maintain Web Interface o GENIUS, P-GRADE o Easier for new users but monolithic Science Gateways OGF35, Delft (NL), 18 Jun “robot” certificate s on “e-tokens”

Community-driven web portals have started to integrate Grid Tools and Applications OGF35, Delft (NL), 18 Jun “A Science Gateway is a community-developed set of tools, applications, and data that is integrated via a portal or a suite of applications, usually in a graphical user interface, that is further customized to meet the needs of a specific community.” Teragrid/XSEDE

Our Reference Model OGF35, Delft (NL), 18 Jun Science Gateway Science Gateway App. 1 App. 2 App. N Embedded Applications Administrator Power User Basic User Users from different organisations having different roles and privileges Standard-based (SAGA) middleware-independent Grid Engine Standard-based (SAGA) middleware-independent Grid Engine

Authentication & Authorisation 10OGF35, Delft (NL), 18 Jun 2012

Identity Federationsh OGF35, Delft (NL), 18 Jun An Identity Federation consists of “[…] the agreements, standards, and technologies that make identity and entitlements portable across autonomous domains.” Burton Group

Identity Federations in the world ( OGF35, Delft (NL), 18 Jun

Identity Federation (IF) In the web technology arena many approaches are available to federate authentication A standard provided by OASIS defines the Security Assertion Markup Language (SAML) Several tools are available, e.g.: o Shibboleth o SimpleSAMLphp Organisations can rely on traditional tools to manage users: o LDAP, CAS, plain text, etc. Free and Open Source OGF35, Delft (NL), 18 Jun

Enabling Grid to Federations Grid services are starting to be integrated in community-dedicated web portals; The distributed/cross-domain nature of Grid requires strong security mechanisms Users struggle to comply with complex security rules: o Get & manage digital certificates, create proxy, update credentials and so on Some institutions want to maintain the control of their own users’ authentication OGF35, Delft (NL), 18 Jun

Federated Grid Science Gateway OGF35, Delft (NL), 18 Jun AuthorisationAuthorisation Science Gateway GrIDP (“catch-all”) GrIDP (“catch-all”) IDPCT (“catch- all”) IDPCT (“catch- all”) IDP_y LDAP Register to a Service 2. Sign in Authentication

Federated Grid User OGF35, Delft (NL), 18 Jun Science Gateway

Identity provided federated OGF35, Delft (NL), 18 Jun { idp1, idp2, … idpN } { idp1, idp2, … idPN } { idp1, idp2, … idpN }

Federated Grid User OGF35, Delft (NL), 18 Jun Science Gateway

Number of users in … OGF35, Delft (NL), 18 Jun

Why Social Federation Federated identities are only a subset of potential users o Users can work in non-federated institutions o IDP can be not included in supported federations Mash-up Grid and social tools could be useful for many users and special applications o Outreach of science organizations to broader communities o “Citizen scientist” to government services o Freely accessible repositories (e.g. of cultural heritage) where one wants to profile visitors o E-collaboration using social facilities/tools in the same page user performs e-research Grid-based activities OGF35, Delft (NL), 18 Jun

Social Grid Authentication Social services are grouped in a special IDP o Included in our “catch-all” federation GrIDP Users have the same account even they access with different credentials, either social or federated o Each account can register a list of user s and these are used for identification OGF35, Delft (NL), 18 Jun

Federated Grid User OGF35, Delft (NL), 18 Jun Science Gateway

The Social Networks’ Bridge Identity Provider ( OGF35, Delft (NL), 18 Jun For more information watch the video

Authorisation (1/2) Technically a social IDP has same security mechanisms of other IDP but user identity are not generally verified Social user requires a stronger control on the authorisation o A preliminary identity control is requested Users from Social Networks can not automatically access resources o An authorisation request is mandatory The authorisations process does not use SAML A central server maintains authorisation assertions o An OpenLDAP server is used OGF35, Delft (NL), 18 Jun

Authorisation (2/2) To be authorised, users have to provide verifiable information o E.g., an address of an official organisation Name and available in institutional pages o Users registered in a federation don’t need to specify an official mail. o Users can own both federated and social credentials enabled for authorisation. Information is verified by the portal administrators who decide to accept/reject the request OGF35, Delft (NL), 18 Jun

Federation supported by DECIDE Science Gateway OGF35, Delft (NL), 18 Jun

Federation supported by the INDICATE Science Gateway OGF35, Delft (NL), 18 Jun

The GrIDP Identity Provider (1/2) 4 Identity Providers are available in GrIDP: A “catch-all” IdP created at Catania; The maat-G (enterprise) IdP; INFN-AAI IdP (all INFN researchers and associates); An idp that enables Social Networks credentials. OGF35, Delft (NL), 18 Jun

The GrIDP Identity Provider (2/2) OGF35, Delft (NL), 18 Jun

Register to GISELA Science Gateway 30 OGF35, Delft (NL), 18 Jun 2012

Access GISELA SG with IDEM credentials 31 OGF35, Delft (NL), 18 Jun 2012

Accessing with GRIDP credentials 32 OGF35, Delft (NL), 18 Jun 2012

The Social Networks’ Bridge Identity Provider ( OGF35, Delft (NL), 18 Jun For more information watch the video

Current Status 16 Liferay-based Science Gateways (hosted in 2 servers) are currently powered by Shibboleth at INFN Catania; 7 Federations supported; 4 instances are registered as official IDEM Service Provider; 4 Identity Providers are available in GrIDP. 34 OGF35, Delft (NL), 18 Jun 2012

Portal Framework 35OGF35, Delft (NL), 18 Jun 2012

Liferay ( Highly-configurable, scalable, open source portal framework; Compatible with JSR 168/286 standards and based on modern web 2.0 technologies; Liferay services planned to be used: o Portal; o CMS & WCM; o Collaboration and “social” software 36 OGF35, Delft (NL), 18 Jun 2012

Grid Access enable: Portlets as bricks Portlets can interact with the Grid e-Infrastructure Different approaches are available: o Execute the Command Line behind the portal; o Using API where available: Must be in Java or other languages supported by Liferay; o Call REST services from Javascript code in the browser; Additional layers between Liferay and the Grid can be necessary for some services; Each portlet can follow its own communication method. 37 OGF35, Delft (NL), 18 Jun 2012

Mixing portlet as well as OGF35, Delft (NL), 18 Jun Sc. Gtwy E Sc. Gtwy DSc. Gtwy CSc. Gtwy B Sc. Gtwy A Standards Simplicity Easiness of use Re-usability

Interaction with Grid Services 39OGF35, Delft (NL), 18 Jun 2012

How to interact with GRID A Simple API for Grid Applications (SAGA): o The OGF (Open Grid Forum) Standard; o JSAGA: a Java implementation of SAGA; A generic Grid Engine for Science Gateways based on SAGA; o Grid Engine based on JSAGA; o EGI Portal Policy & Grid Security Traceability; Grid Engine usage example. OGF35, Delft (NL), 18 Jun

A Simple API for Grid Applications (SAGA) SAGA is an API that provides the basic functionality required to build distributed applications, tools and frameworks; It is independent of the details of the underlying infrastructure (e.g., the middleware); SAGA is an OGF specification: Several Implementations are available: o A C++ and a Java implementation developed at the Louisiana State University / CCT and Vrije Universiteit Amsterdam ( ); o A Java implementation developed at CCIN2P3 ( o A Python implementation based on those above. OGF35, Delft (NL), 18 Jun

The Catania Grid Engine An additional layer interposed between the Portal Framework and the GRID in other to make applications access directly to GRID Services. It’s based on two essential components: o The Job Engine o The Data Engine OGF35, Delft (NL), 18 Jun

Job Engine Not only a collection of API for job submission; A complete layer able to make portlets, and so applications, to access all GRID services need for the execution: o Thread pool responsible for the submission; o User Tracking Database; o Permanent checking of the job status; o Output automatically retrived by the Science Gateway; o Easy interface for Job Managment OGF35, Delft (NL), 18 Jun

Data Engine Make interfaces simple for non expert users o CLI-based Grid storage interface is not straightforward Grid transactions require user certificates Complexity of current protocols to manage grid storage elements o Very little or no support for access through modern browsers or others web-based applications OGF35, Delft (NL), 18 Jun

Summary of standards adopted The framework for Science Gateways developed at Catania is fully web-based and adopts official worldwide standards and protocols, through their most common implementations These are: o The JSR 168 and JSR 286 standards (also known as "portlet 1.0" and "portlet 2.0" standards)JSR 168JSR 286 o The OASIS Security Assertion Markup Language (SAML) standard and its Shibboleth and SimpleSAMLphp implementationsOASISSecurity Assertion Markup LanguageShibbolethSimpleSAMLphp o The Lightweight Direct Access Protocol, and its OpenLDAP implementationOpenLDAP o The Cryptographic Token Interface Standard (PKCS#11) standard and its Cryptoki implementationCryptographic Token Interface Standard o The Open Grid Forum (OGF) Simple API for Grid Applications (SAGA) standard and its JSAGA implementationOpen Grid ForumSimple API for Grid ApplicationsJSAGA 45 OGF35, Delft (NL), 18 Jun 2012

Current Status 16 Liferay-based Science Gateways (hosted in 2 servers) are currently powered by Shibboleth at INFN Catania; 7 Federations supported; 4 instances are registered as official IDEM Service Provider; 4 Identity Providers are available in GrIDP. 46 OGF35, Delft (NL), 18 Jun 2012

References OGF35, Delft (NL), 18 Jun

Credits & Acknowledgments Valeria Ardizzone (GARR); Roberto Barbera (UNICT & INFN) Riccardo Bruno (COMETA); Antonio Calanducci (COMETA); Marco Fargetta (COMETA) Elisa Ingrà (GARR); Giuseppe La Rocca (INFN) Salvatore Monforte (INFN); Fabrizio Pistagna (INFN); Rita Ricceri (INFN); Diego Scardaci (INFN); 48 Credits Acknowledgments Vincenzo Ciaschini (INFN); Enrico Fasanelli (INFN); Maria Laura Mantovani (GARR); Barbara Monticini (GARR); Simona Venuti (GARR) OGF35, Delft (NL), 18 Jun 2012

Thank you for your kind attention OGF35, Delft (NL), 18 Jun