The GENIUS portal and the GILDA t-Infrastructure

Slides:

Advertisements

Similar presentations

CHEP 2000, Roberto Barbera NA3, NA4, and NA5 activities Milano, Università di Catania and INFN Catania - Italy ALICE Collaboration.

Advertisements

CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.

1 CHEP 2000, Roberto Barbera Recent grid activities at INFN Catania (*) HEPiX/HEPNT 2002, Catania, (*) work in collaboration with.

CHEP 2000, Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, Università di Catania and INFN Catania - Italy ALICE.

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Roberto Barbera EGEE NA4 Generic Applications coordinator.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid portal Moisés Hernández.

Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.

CHEP 2000, Roberto Barbera Roberto Barbera (*) The GENIUS grid portal CHEP 2003, (*) work in collaboration with A. Falzone and.

CHEP 2000, Roberto Barbera Roberto Barbera (*) The GENIUS Grid Portal Portals & Portlets 2003, Edinburgh, (*) work in collaboration.

EGEE is a project funded by the European Union under contract IST Generic Applications: strategy, organization, tools and manpower Roberto.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America GENIUS server installation and configuration.

INFSO-RI Enabling Grids for E-sciencE The GENIUS Grid portal Tony Calanducci INFN Catania - Italy First Latin American Workshop.

EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN SEE-GRID.

CHEP 2000, Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, work in collaboration with A.

Computational grids and grids projects DSS,

IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Domenico Vicinanza,

Induction: Additional features of GENIUS 18 May Some additional features of GENIUS EGEE is funded by the European Union under contract IST

EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN First Latinamerican.

EGEE is a project funded by the European Union under contract IST The GILDA testbed Roberto Barbera University of Catania and INFN SEE-GRID.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid Portal Roberto Barbera Univ.

EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.

E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA GILDA t-Infrastructure Claudio Cherubino.

EGEE is a project funded by the European Union under contract IST Presentation of NA4 Generic Applications Roberto Barbera NA4 Generic Applications.

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The GILDA t-Infrastructure Roberto Barbera.

Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.

EGEE-0 / LCG-2 middleware Practical.

INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Alexandre Duarte CERN IT-GD-OPS UFCG LSD 1st EELA Grid School.

INFSO-RI Enabling Grids for E-sciencE Introduction to the gLite tutorial: the GILDA t-Infrastructure for Dissemination and Training.

INFSO-RI Enabling Grids for E-sciencE The GILDA t-Infrastructure Roberto Barbera University of Catania and INFN EGEE Tutorial Seoul,

1 P-GRADE Portal hands-on Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.

13th EELA Tutorial, La Antigua, 18-19, October E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA

EGEE is a project funded by the European Union under contract IST The GILDA Testbed Valeria Ardizzone INFN Catania EGEE tutorial,

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure Roberto Barbera.

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA: a status report Roberto Barbera NA4 Generic Applications.

INFSO-RI Enabling Grids for E-sciencE GILDA t-Infrastructure Antonio Fuentes Bermejo

First South Africa Grid Training June 2008, Catania (Italy) GILDA t-Infrastructure Valeria Ardizzone INFN Catania.

INFSO-RI Enabling Grids for E-sciencE The GENIUS portal and the GILDA t-Infrastructure Roberto Barbera University of Catania and.

IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Christian Grunfeld,

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.

Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.

EGEE is a project funded by the European Union under contract IST The GENIUS portal Assaf Gottlieb University of Tel Aviv EGEE tutorial, Ra’anana,

E-science grid facility for Europe and Latin America The GILDA t-Infrastructure Riccardo Bruno INFN, Sez. CT Joint EELA-2/EGEE-III Tutorial.

EGEE is a project funded by the European Union under contract IST The GILDA Project and the GENIUS portal Roberto Barbera University of Catania.

FESR Trinacria Grid Virtual Laboratory Practical using WMProxy advanced job submission Emidio Giorgio INFN Catania.

Gri2Win: Porting gLite to run under Windows XP Platform

Grid2Win Porting of gLite middleware to Windows XP platform

Introduction to GILDA testbed and Genius portal

Grid Computing: Running your Jobs around the World

Job monitoring and accounting data visualization

GILDA t-Infrastructure

GILDA Project Valeria Ardizzone INFN Catania Italy

Practical: The Information Systems

P-GRADE Portal tutorial

Grid Training done in/by the Italian Federation in 2007 Roberto Barbera Univ. of Catania and INFN NA3 Partner Review Meeting at EGEE’07 Budapest,

Grid2Win: Porting of gLite middleware to Windows XP platform

The GENIUS portal Roberto Barbera University of Catania and INFN

Grid2Win: Porting of gLite middleware to Windows XP platform

The GILDA testbed Roberto Barbera University of Catania and INFN

Short update on the latest gLite status

5. Job Submission Grid Computing.

Gri2Win: Porting gLite to run under Windows XP Platform

Grid2Win: Porting of gLite middleware to Windows XP platform

GENIUS: A Portal for Computing Grids

EGEE Middleware: gLite Information Systems (IS)

The GILDA t-Infrastructure and the GENIUS portal

GENIUS Grid portal Hands on

Il Portale GENIUS Alberto Falzone NICE srl Primo Tutorial TriGrid VL

Introduction to the SHIWA Simulation Platform EGI User Forum,

Presentation transcript:

The GENIUS portal and the GILDA t-Infrastructure Roberto Barbera University of Catania and INFN EGEE Tutorial Roma, 02.11.2005

Outline Introduction The GENIUS portal The GILDA t-Infrastructure services tools applications tutorial lay-out Summary and conclusions EGEE Tutorial, Roma, 02.11.2005

The Grid metaphor Mobile Access G R I Supercomputer, PC-Cluster D M L W A Visualising Workstation Mobile Access Supercomputer, PC-Cluster Data-storage, Sensors, Experiments Internet, networks EGEE Tutorial, Roma, 02.11.2005

A typical job workflow Replica Catalogue Information Service Resource UI JDL Input “sandbox” DataSets info grid-proxy-init Information Service Output “sandbox” SE & CE info Resource Broker Output “sandbox” Expanded JDL Job Submit Event Job Query Job Status Input “sandbox” + Broker Info Publish Author. &Authen. Storage Element Globus RSL Job Submission Service Job Status Logging & Book-keeping Compute Element Job Status EGEE Tutorial, Roma, 02.11.2005

The transparent grid access VO colleague local disk Replica Catalogue UI dis k Resource Broker Storage Element Compute Element EGEE Tutorial, Roma, 02.11.2005

The GENIUS hourglass model GENIUS® (Grid Enabled web eNvironment for site Independent User job Submission) https://genius.ct.infn.it INFN/NICE collaboration GENIUS web portal OS & Net services Basic Services High level GRID middleware ALICE ATLAS CMS LHCb Applications’ specific layer Other apps GLOBUS toolkit EGEE (LCG/gLite) architecture EGEE Tutorial, Roma, 02.11.2005

GENIUS: how it works the Grid https+java/xml+rfb WEB Browser GENIUS 3-tier model https+java/xml+rfb WEB Browser GENIUS EnginFrame Local WS Apache the Grid M/W+GSI UI EGEE Tutorial, Roma, 02.11.2005

GENIUS on gLite home page (https://glite-tutor.ct.infn.it) EGEE Tutorial, Roma, 02.11.2005

GENIUS file services (1/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS file services (1/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS Grid authentication with MyProxy EGEE Tutorial, Roma, 02.11.2005

Grid authentication with MyProxy UI MyProxy Server grid-proxy-init myproxy-init myproxy-get-delegation GENIUS Server (UI) WEB Browser the Grid execution Local WS output any grid service EGEE Tutorial, Roma, 02.11.2005

GENIUS grid settings (1/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS VO selection EGEE Tutorial, Roma, 02.11.2005

GENIUS gLite single job submission EGEE Tutorial, Roma, 02.11.2005

GENIUS gLite single job submission EGEE Tutorial, Roma, 02.11.2005

GENIUS gLite single job submission EGEE Tutorial, Roma, 02.11.2005

GENIUS gLite single job submission EGEE Tutorial, Roma, 02.11.2005

GENIUS graphic job editor (work in collaboration with DATAMAT) EGEE Tutorial, Roma, 02.11.2005

GENIUS single job queue EGEE Tutorial, Roma, 02.11.2005

GENIUS job output EGEE Tutorial, Roma, 02.11.2005

GENIUS data spooler (1/2) EGEE Tutorial, Roma, 02.11.2005

MPI Jobs (1/2) EGEE Tutorial, Roma, 02.11.2005

MPI Jobs (2/2) EGEE Tutorial, Roma, 02.11.2005

DAG Jobs (1/6) EGEE Tutorial, Roma, 02.11.2005

DAG Jobs (2/6) EGEE Tutorial, Roma, 02.11.2005

DAG Jobs (3/6) EGEE Tutorial, Roma, 02.11.2005

DAG Jobs (4/6) EGEE Tutorial, Roma, 02.11.2005

DAG Jobs (5/6) EGEE Tutorial, Roma, 02.11.2005

DAG Jobs (6/6) EGEE Tutorial, Roma, 02.11.2005

GENIUS graphic workflow editor (integration with TRIANA from GridLab Project) EGEE Tutorial, Roma, 02.11.2005

TRIANA at work EGEE Tutorial, Roma, 02.11.2005

GENIUS Catalog browsing (1/4) EGEE Tutorial, Roma, 02.11.2005

GENIUS Catalog browsing (2/4) EGEE Tutorial, Roma, 02.11.2005

GENIUS Catalog browsing (3/4) EGEE Tutorial, Roma, 02.11.2005

GENIUS Catalog browsing (4/4) EGEE Tutorial, Roma, 02.11.2005

GENIUS gLite data publication (1/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS gLite data publication (2/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS gLite data download (1/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS gLite data download (2/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS monitoring services EGEE Tutorial, Roma, 02.11.2005

GENIUS interactive services (1/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS interactive services (2/2) EGEE Tutorial, Roma, 02.11.2005

GENIUS for PDA EGEE Tutorial, Roma, 02.11.2005

GENIUS for cell phone EGEE Tutorial, Roma, 02.11.2005

GENIUS present status Current implementation of GENIUS includes more than 100 services. Among them: grid authentication with MyProxy ! several Resource Brokers, VO’s and RLS/Catalog available; full support for “interactive” and DAG jobs; web guided job description, submission and monitoring (in collaboration with DATAMAT) Web guided workflow description (in collaboration with GridLab) P2P services available PDA and cell phone versions available Transparently compliant with EGEE-0 LCG2, Grid.it and gLite 1 middlewares/VO’s Interfaced to many generic applications EGEE Tutorial, Roma, 02.11.2005

The GILDA project (https://gilda.ct.infn.it) EGEE Tutorial, Roma, 02.11.2005

The GILDA Test-bed (https://gilda.ct.infn.it/testbed.html) ~15 sites in 3 continents ! EGEE Tutorial, Roma, 02.11.2005

All gLite Services available and tested on GILDA EGEE Tutorial, Roma, 02.11.2005

The GILDA Certification Authority (https://gilda.ct.infn.it/CA) EGEE Tutorial, Roma, 02.11.2005

The GILDA Certification Authority EGEE Tutorial, Roma, 02.11.2005

The GILDA Virtual Organization EGEE Tutorial, Roma, 02.11.2005

The GILDA VOMS EGEE Tutorial, Roma, 02.11.2005

The GILDA VOMS Groups and Roles EGEE Tutorial, Roma, 02.11.2005

The GILDA Accounting System (based on DGAS) EGEE Tutorial, Roma, 02.11.2005

The GILDA Monitoring System (based on GridICE) (http://alifarm7. ct EGEE Tutorial, Roma, 02.11.2005

The Grid Tutor (https://grid-tutor. ct. infn. it, https://glite-tutor EGEE Tutorial, Roma, 02.11.2005

The Grid Demonstrator (1/2) (https://grid-demo. ct. infn Applications EGEE Tutorial, Roma, 02.11.2005

The GILDA User Interface Plug&Play combined (https://gilda. ct. infn EGEE Tutorial, Roma, 02.11.2005

Tutorial layout and acronyms Students User Interfaces UI PnP Test RB UI PnP UI PnP UI PnP RB/BDII CE SE UI RLS Catalog WN WN WN LFC Catalog WN RB/BDII FireMan Catalog EGEE Tutorial, Roma, 02.11.2005

WMS layout in GILDA … … GILDA site GILDA site GILDA site UI LCG gLite UI PnP “combined” RB LCG RB gLite BDII LCG CE gLite CE LCG GILDA site GILDA site CE LCG WN gLite WN LCG … WN LCG … GILDA site EGEE Tutorial, Roma, 02.11.2005

DMS layout in GILDA … LCG RLS Catalog LCG LFC Catalog gLite Fireman UI LCG gLite UI PnP “combined” LCG RLS Catalog LCG LFC Catalog gLite Fireman Catalog SE LCG GILDA site SE LCG GILDA site SRM d C a c h e GILDA site I/O s r v SRM d C a c h e GILDA site I/O s r v … EGEE Tutorial, Roma, 02.11.2005

IS layout in GILDA … GILDA site GILDA site UI PnP “combined” SE SRM CE LCG gLite UI PnP “combined” BDII LCG R-GMA gLite CE LCG WN … GILDA site SE CE gLite WN GILDA site SRM d C a c h e I/O s r v EGEE Tutorial, Roma, 02.11.2005

The GILDA Live User Interface (https://gilda.ct.infn.it/live-cd/) EGEE Tutorial, Roma, 02.11.2005

The GILDA Video Tutorials (https://gilda.ct.infn.it/video.html) EGEE Tutorial, Roma, 02.11.2005

GILDA summary numbers 15 sites in 3 continents > 2300 certificates issued, >15% renewed at least once > 75 tutorials and demos performed in 15 months > 50 jobs/day on the average Job success rate above 80% > 950,000 hits (> 46,000 visits) on (of) the web site from 10’s of different countries > 0.6 TB of videos and UI’s downloaded from the web site EGEE Tutorial, Roma, 02.11.2005

Summary and conclusions The EGEE middleware: Is exiting prototyping phase and entering real production phase (LHC first real data are only 2 years away from now!) Implements a full and complete stack of grid services that can be used all together or separately at user’s discretion Closely follow the standardization process going in GGF and other for a GILDA is a real virtual laboratory for dissemination of grid computing: It is a “de facto” standard t-Infrastructure adopted both by EGEE and some forthcoming EU-FP6 projects (EELA, EUCHINAGRID, EUMEDGRID, ICEAGE) It is a complete suite of grid elements (test-bed, CA, VO, monitoring system, web portal, live user interface, user interface plug&play) and applications fully dedicated to dissemination purposes and pre-porting of new applications to EGEE Infrastructure GILDA runs latest production (stable) version of both the LCG grid middleware but it is also early adopting gLite in order to make the transition to the new middleware smoother and easier EGEE Tutorial, Roma, 02.11.2005