CHEP 2000, 10.02.2000Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, 02.12.2003 work in collaboration with A.

Slides:

Advertisements

Similar presentations

CHEP 2000, Roberto Barbera NA3, NA4, and NA5 activities Milano, Università di Catania and INFN Catania - Italy ALICE Collaboration.

Advertisements

CHEP 2000, Roberto Barbera Roberto Barbera (*) GENIUS: a Web Portal for the GRID Meeting Grid.it, Bologna, (*) work in collaboration.

The Quantum Chromodynamics Grid James Perry, Andrew Jackson, Matthew Egbert, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

UKQCD GridPP NeSCAC Irving, 4/2/041 9 th GridPP Collaboration Meeting QCDgrid: Status and Future Alan Irving University of Liverpool.

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.

Data Management Expert Panel - WP2. WP2 Overview.

1 CHEP 2000, Roberto Barbera Recent grid activities at INFN Catania (*) HEPiX/HEPNT 2002, Catania, (*) work in collaboration with.

CHEP 2000, Roberto Barbera The AliEn GENIUS interface ALICE Offline Week, CERN, Università di Catania and INFN Catania - Italy ALICE.

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Roberto Barbera EGEE NA4 Generic Applications coordinator.

10 April 2003Deploy Grid in Israel Universities1 Deploy Grid testbed in Israel universities Lorne Levinson David Front Weizmann Institute.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid portal Moisés Hernández.

Basic Grid Job Submission Alessandra Forti 28 March 2006.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

INFSO-RI Enabling Grids for E-sciencE The GENIUS grid portal Roberto Barbera University of Catania and INFN Science Gateways Workshop.

QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.

EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera Univ. of Catania and INFN SEE-GRID.

Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.

DIRAC Web User Interface A.Casajus (Universitat de Barcelona) M.Sapunov (CPPM Marseille) On behalf of the LHCb DIRAC Team.

ILDG5QCDgrid1 QCDgrid status report UKQCD data grid Chris Maynard.

CHEP 2000, Roberto Barbera Roberto Barbera (*) The GENIUS grid portal CHEP 2003, (*) work in collaboration with A. Falzone and.

CHEP 2000, Roberto Barbera Roberto Barbera (*) The GENIUS Grid Portal Portals & Portlets 2003, Edinburgh, (*) work in collaboration.

EGEE is a project funded by the European Union under contract IST Generic Applications: strategy, organization, tools and manpower Roberto.

3 Sept 2001F HARRIS CHEP, Beijing 1 Moving the LHCb Monte Carlo production system to the GRID D.Galli,U.Marconi,V.Vagnoni INFN Bologna N Brook Bristol.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America GENIUS server installation and configuration.

INFSO-RI Enabling Grids for E-sciencE The GENIUS Grid portal Tony Calanducci INFN Catania - Italy First Latin American Workshop.

EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN SEE-GRID.

INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.

QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter

ILDG Middleware Status Chip Watson ILDG-6 Workshop May 12, 2005.

Training and the NGS Mike Mineter

IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Domenico Vicinanza,

Induction: Additional features of GENIUS 18 May Some additional features of GENIUS EGEE is funded by the European Union under contract IST

EGEE is a project funded by the European Union under contract IST The GENIUS portal Roberto Barbera University of Catania and INFN First Latinamerican.

K.Harrison BNL, 7 May 2002 Overview of GANGA – First steps towards GANGA – Outline of required functionality – Some existing technology – Conclusions.

Lattice QCD Data Grid Middleware: status report M. Sato, CCS, University of Tsukuba ILDG6, May, 12, 2005.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America The GENIUS Grid Portal Roberto Barbera Univ.

June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.

GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.

Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.

UKQCD Grid Status Report GridPP 13 th Collaboration Meeting Durham, 4th—6th July 2005 Dr George Beckett Project Manager, EPCC +44.

E-infrastructure shared between Europe and Latin America GENIUS PORTAL Valeria Ardizzone INFN-Catania 1° EELA Grid School Itacuruçà Island, State of Rio.

EGEE is a project funded by the European Union under contract IST Presentation of NA4 Generic Applications Roberto Barbera NA4 Generic Applications.

EGEE is a project funded by the European Union under contract IST GENIUS and EnginFrame Roberto Barbera EGEE NA4 Generic Applications coordinator.

Lattice QCD Data Grid Middleware: Meta Data Catalog (MDC) -- CCS （ tsukuba) proposal -- M. Sato, for ILDG Middleware WG ILDG Workshop, May 2004.

USQCD regional grid Report to ILDG /28/09ILDG14, June 5, US Grid Usage  Growing usage of gauge configurations in ILDG file format.  Fermilab.

EGEE-0 / LCG-2 middleware Practical.

INFSO-RI Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An induction to EGEE for GOSC and the NGS NeSC,

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Alexandre Duarte CERN IT-GD-OPS UFCG LSD 1st EELA Grid School.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.

Induction: General components of Grid middleware and User Interfaces –April 26-28, General components of Grid middleware and User Interfaces Roberto.

Introduction to Portals.

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA: a status report Roberto Barbera NA4 Generic Applications.

Bob Jones – Project Architecture - 1 March n° 1 Project Architecture, Middleware and Delivery Schedule Bob Jones Technical Coordinator, WP12, CERN.

EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.

IST E-infrastructure shared between Europe and Latin America The GILDA t-Infrastructure and the GENIUS portal Christian Grunfeld,

EGEE is a project funded by the European Union under contract IST GENIUS and GILDA Guy Warner NeSC Training Team Induction to Grid Computing.

REST API to develop application for mobile devices Mario Torrisi Dipartimento di Fisica e Astronomia – Università degli Studi.

Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.

EGEE is a project funded by the European Union under contract IST The GENIUS portal Assaf Gottlieb University of Tel Aviv EGEE tutorial, Ra’anana,

EGEE is a project funded by the European Union under contract IST The GILDA Project and the GENIUS portal Roberto Barbera University of Catania.

Moving the LHCb Monte Carlo production system to the GRID

The GENIUS portal Roberto Barbera University of Catania and INFN

GENIUS: A Portal for Computing Grids

EGEE Middleware: gLite Information Systems (IS)

The GENIUS portal and the GILDA t-Infrastructure

The GENIUS Security Services

The GILDA t-Infrastructure and the GENIUS portal

Il Portale GENIUS Alberto Falzone NICE srl Primo Tutorial TriGrid VL

Presentation transcript:

CHEP 2000, Giuseppe Andronico Grid portal based data management for Lattice QCD data ACAT03, Tsukuba, work in collaboration with A. Falzone and R. Barbera Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

Roberto Barbera Giuseppe Andronico Outline Introduction Grid and GENIUS ILDG Metadata Workgroup GENIUS implementation Future developments Università di Catania and INFN Catania - Italy ILDG and DataGrid Project ACAT03, Tsukuba,

Giuseppe Andronico The Grid metaphor Università di Catania and INFN Catania - Italy ILDG and DataGrid Project ACAT03, Tsukuba,

DataGrid job work-flowReplicaCatalogue UI JDL Logging & Book-keeping ResourceBroker Job Submission Service StorageElement ComputeElement InformationService Job Status DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Globus RSL Output “sandbox” Job Status Publish grid-proxy-init Expanded JDL SE & CE info Giuseppe Andronico Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

Roberto Barbera A web portal: why and how ? It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone). It can keep the same user interface to several back-ends (grid “dialects”  command-line UI’s). It must be redundantly “secure” at all levels: 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level. All available grid services must be incorporated in a logic way, just “one mouse click away”. Its layout must be easily understandable and user friendly. Università di Catania and INFN Catania - Italy ILDG and DataGrid Project ACAT03, Tsukuba, Giuseppe Andronico

GENIUS ® (Grid Enabled web eNvironment for site Independent User job Submission) [ INFN/NICE collaborationhttps://genius.ct.infn.it OS & Net services Basic Services High level GRID middleware ALICEATLASCMSLHCb Applications’ specific layer Other apps GLOBU S toolkit DataGRID architecture GENIUS web portal ACAT03, Tsukuba, Giuseppe Andronico Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

Roberto Barbera GENIUS : how it works Apache EnginFrame GENIUS https+java/xml+rfb WEB Browser ED G UI Loc al WS the Grid EDG+GSI Giuseppe Andronico Università di Catania and INFN Catania - Italy ILDG and DataGrid Project 3-tier model

Grid authentication with MyProxy Giuseppe Andronico ED G UI MyPro xy Server grid-proxy-init myproxy-init myproxy-get-delegation Loc al WS GENIU S Server (EDG UI) any grid service output WEB Browser the Grid execution Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, Upon initiative of Prof. Richard Kenway ILDG people Tomoteru Yoshie (Japan) Convener Chris Maynard (UK) Paul Coddington (Australia) Jim Simone (USA - SciDAC) Robert Edwards (USA - SciDAC) Giuseppe Andronico (Italy) Dirk Pleiter (Germany) Balint Joo (UK) ILDG International Lattice Data Group

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, ILDG Configurations as LQCD resources Different algorithms and implementations Different data file format Standardize metadata to describe configurations: Management Implementation Configuration

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, ILDG XML for metadata Last draft at Lattice 2003, Tsukuba (hep-lat/ ) Evolving with LQCD people contribution

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, XML to SQL

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, Software PERL scripts DOM parser Storing procedure Several DB querying procedures All this is handles from GENIUS

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, GENIUS

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, Selecting VO

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, The VO page

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, Storing a configuration

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, Storing a configuration

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, A trial search

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, The result

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, Show metadata info

Roberto Barbera Giuseppe Andronico Summary and conclusions (1/2) ILDG is defining a metadata XML structure to help LQCD people to share their work The Grid offers a proper tool to physically sharing the files world wide in a secure way We implemented a trial service to: Store configurations Search between configuration by querying XML informations Show the search result and, potentially, download the data GENIUS offers a quick and simple way to build a WEB interface to these services to simplify their use GENIUS is the targeted Grid-portal for Generic Applications in EGEE-NA4 (kick-off meeting in Paris on Dec 18) Università di Catania and INFN Catania - Italy ILDG and DataGrid Project

Università di Catania and INFN Catania - Italy ILDG and DataGrid Project Giuseppe Andronico ACAT03, Tsukuba, Future developments XML to SQL mapping XML database test Advanced search engine Summary and conclusions (2/2)