DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help.

Slides:

Advertisements

Similar presentations

DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.

Advertisements

EU DataGrid progress Fabrizio Gagliardi EDG Project Leader

Workload Management David Colling Imperial College London.

EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.

Workload management Owen Maroney, Imperial College London (with a little help from David Colling)

INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.

NIKHEF Testbed 1 Plans for the coming three months.

Réunion DataGrid France, Lyon, fév CMS test of EDG Testbed Production MC CMS Objectifs Résultats Conclusions et perspectives C. Charlot / LLR-École.

Job Submission The European DataGrid Project Team

INFSO-RI Enabling Grids for E-sciencE EGEE Middleware The Resource Broker EGEE project members.

The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

The EDG Testbed Introduction and Setup The European DataGrid Project Team

DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Title – n° 1 Grid Data Management in Action Experience in Running and.

DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.

INFN Testbed status report L. Gaido WP6 meeting CERN - October 30th, 2002.

11 Dec 2000F Harris Datagrid Testbed meeting at Milan 1 LHCb ‘use-case’ - distributed MC production

C. Loomis – Testbed: Status… – Sep. 5, 2002 – 1 Testbed: Status & Plans Charles Loomis (CNRS) Sept. 5, th Project Conference (Budapest)

EU 2nd Year Review – Jan – WP9 WP9 Earth Observation Applications Demonstration Pedro Goncalves :

The EDG Testbed Deployment Details The European DataGrid Project

GridPP9 – 5 February 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC WP2+5: Data and Storage Management.

5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)

Computational grids and grids projects DSS,

SLICE Simulation for LHCb and Integrated Control Environment Gennady Kuznetsov & Glenn Patrick (RAL) Cosener’s House Workshop 23 rd May 2002.

QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.

L ABORATÓRIO DE INSTRUMENTAÇÃO EM FÍSICA EXPERIMENTAL DE PARTÍCULAS Enabling Grids for E-sciencE Grid Computing: Running your Jobs around the World.

DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.

Your university or experiment logo here Caitriana Nicholson University of Glasgow Dynamic Data Replication in LCG 2008.

- Distributed Analysis (07may02 - USA Grid SW BNL) Distributed Processing Craig E. Tull HCG/NERSC/LBNL (US) ATLAS Grid Software.

C. Loomis – Integration Status- October 31, n° 1 Integration Status October 31, 2001

November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.

Tier-2  Data Analysis  MC simulation  Import data from Tier-1 and export MC data CMS GRID COMPUTING AT THE SPANISH TIER-1 AND TIER-2 SITES P. Garcia-Abia.

Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.

Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.

TERENA 2003, May 21, Zagreb TERENA Networking Conference, 2003 MOBILE WORK ENVIRONMENT FOR GRID USERS. TESTBED Miroslaw Kupczyk Rafal.

CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.

J.J.Blaising April 02AMS DataGrid-status1 DataGrid Status J.J Blaising IN2P3 Grid Status Demo introduction Demo.

Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.

29/1/2002A.Ghiselli, INFN-CNAF1 DataTAG / WP4 meeting Cern, 29 January 2002 Agenda  start at  Project introduction, Olivier Martin  WP4 introduction,

2-Sep-02Steve Traylen, RAL WP6 Test Bed Report1 RAL and UK WP6 Test Bed Report Steve Traylen, WP6

Andrew McNab - Manchester HEP - 17 September 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –“How much of the Testbed has.

High-Performance Computing Lab Overview: Job Submission in EDG & Globus November 2002 Wei Xing.

EGEE-0 / LCG-2 middleware Practical.

A Grid Approach to Geographically Distributed Data Analysis for Virgo F. Barone, M. de Rosa, R. De Rosa, R. Esposito, P. Mastroserio, L. Milano, F. Taurino,

Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.

INFN - Ferrara BaBar Meeting SPGrid: status in Ferrara Enrica Antonioli - Paolo Veronesi Ferrara, 12/02/2003.

15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK

DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 The EU DataGrid Project Three years.

The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

Stephen Burke – Sysman meeting - 22/4/2002 Partner Logo The Testbed – A User View Stephen Burke, PPARC/RAL.

DutchGrid KNMI KUN Delft Leiden VU ASTRON WCW Utrecht Telin Amsterdam Many organizations in the Netherlands are very active in Grid usage and development,

The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.

CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.

ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,

Grid Computing at NIKHEF Shipping High-Energy Physics data, be it simulated or measured, required strong national and trans-Atlantic.

Testbed: Status & Plans

Grid Computing: Running your Jobs around the World

BaBar-Grid Status and Prospects

The EDG Testbed Deployment Details

GILDA Project Valeria Ardizzone INFN Catania Italy

ALICE Physics Data Challenge 3

Introduction to Grid Technology

OpenGATE meeting/Grid tutorial, mars 9nd 2005

5. Job Submission Grid Computing.

CMS report from FNAL demo week Marco Verlato (INFN-Padova)

Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF

The EU DataGrid Project Tutorial

The GENIUS portal and the GILDA t-Infrastructure

The EU DataGrid Fabric Management Services

Presentation transcript:

DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help solve complex problems David Groep, NIKHEF Zeger Hendrikse, UvA IvI

VisualJob Demonstration with EDG 1.4.x – n° 2 The EU DataGrid Project u Largest operational grid infrastructure u 21 partners in EDG project u More partners in related projects (LCG, CrossGrid) u Specifically looking at deployable grids n 40 sites, 600 users n Interconnected with high-speed networks u Europe-wide resource distribution … you’ll see in the demo

VisualJob Demonstration with EDG 1.4.x – n° 3 A 3 Tier Architecture ClientApplication Server Data Server Request Result Data Request User Interface Computing Element & Worker Nodes Storage Element On the EU DataGrid test bed: Linked together with Information Services and Resource Brokers

VisualJob Demonstration with EDG 1.4.x – n° 4 Current EU DataGrid Testbed CERN Lyon RAL ScotGrid NIKHEF Reference site Testbed1 EDG sites NorduGrid ~40 sites ~600 users About 1000 machines are available. Some of them are dual processor. Some machines are only used for EDG. They are split into: - Production - Development NorduGrid is as a Grid infrastructure in the Nordic countries CNAF Tutorial and Core site

VisualJob Demonstration with EDG 1.4.x – n° 5 Services Used in this Demonstration u User Interfaces n NIKHEF Netherlands u Resource Brokers n Imperial College, UK; CCIN2P3 Lyon, FR; CNR Roma, IT u Information Services n RAL, UK u Compute services n Anywhere in Europe, e.g. NIKHEF, Glasgow, Barcelona, Catania, … u Storage Elements n not used in this demo

VisualJob Demonstration with EDG 1.4.x – n° 6 Our (simple) example problem u Render a complex image u e.g. for use in animation movies u using many resources (to get speedup) u Rendering package: Rendrib u Method n Split image in NxN parts n Distribute N 2 jobs over the Grid n Combine parts on the User Interface afterwards u Using the EDG Application Test Bed This job does not need any staged input data, but more realistic jobs will

VisualJob Demonstration with EDG 1.4.x – n° 7 UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) The job flow through the system submitted waiting ready scheduled running done Job Status outputready

VisualJob Demonstration with EDG 1.4.x – n° 8

VisualJob Demonstration with EDG 1.4.x – n° 9 What else could we have shown? u This demonstration showed only “simple” jobs u There are more enhanced EU DataGrid capabilities n Intelligent data replication n Job migration to data n Inclusion of network costs u Scales to many users in a production environment The EU DataGrid project webwww. edg.orgwww. edg.org DutchGrid Platformwww. dutchgrid.nlwww. dutchgrid.nl DutchGrid Forumwww.dutchgridforum.orgwww.dutchgridforum.org For other grid projects, seewww. gridstart.org www. enterthegrid.comwww. gridstart.org www. enterthegrid.com

VisualJob Demonstration with EDG 1.4.x – n° 10 Acknowledgements u Roberto Puccinelli u Heinz Stockinger u Flavia Donno u … and all site managers & ITeam