1. DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help solve complex problems David Groep, NIKHEF davidg@nikhef.nl Zeger Hendrikse, UvA IvI zegerh@science.uva.nl

2. VisualJob Demonstration with EDG 1.4.x – n° 2 The EU DataGrid Project u Largest operational grid infrastructure u 21 partners in EDG project u More partners in related projects (LCG, CrossGrid) u Specifically looking at deployable grids n 40 sites, 600 users n Interconnected with high-speed networks u Europe-wide resource distribution … you’ll see in the demo

3. VisualJob Demonstration with EDG 1.4.x – n° 3 A 3 Tier Architecture ClientApplication Server Data Server Request Result Data Request User Interface Computing Element & Worker Nodes Storage Element On the EU DataGrid test bed: Linked together with Information Services and Resource Brokers

4. VisualJob Demonstration with EDG 1.4.x – n° 4 Current EU DataGrid Testbed CERN Lyon RAL ScotGrid NIKHEF Reference site Testbed1 EDG sites NorduGrid ~40 sites ~600 users About 1000 machines are available. Some of them are dual processor. Some machines are only used for EDG. They are split into: - Production - Development NorduGrid is as a Grid infrastructure in the Nordic countries CNAF Tutorial and Core site

5. VisualJob Demonstration with EDG 1.4.x – n° 5 Services Used in this Demonstration u User Interfaces n NIKHEF Netherlands u Resource Brokers n Imperial College, UK; CCIN2P3 Lyon, FR; CNR Roma, IT u Information Services n RAL, UK u Compute services n Anywhere in Europe, e.g. NIKHEF, Glasgow, Barcelona, Catania, … u Storage Elements n not used in this demo

6. VisualJob Demonstration with EDG 1.4.x – n° 6 Our (simple) example problem u Render a complex image u e.g. for use in animation movies u using many resources (to get speedup) u Rendering package: Rendrib u Method n Split image in NxN parts n Distribute N 2 jobs over the Grid n Combine parts on the User Interface afterwards u Using the EDG Application Test Bed This job does not need any staged input data, but more realistic jobs will

7. VisualJob Demonstration with EDG 1.4.x – n° 7 UI JDL Logging & Bookkeeping (LB) Resource Broker (RB) Job Submission Service (JSS) Storage Element (SE) Compute Element (CE) Information Service (IS) Replica Catalogue (RC) The job flow through the system submitted waiting ready scheduled running done Job Status outputready

8. VisualJob Demonstration with EDG 1.4.x – n° 8

9. VisualJob Demonstration with EDG 1.4.x – n° 9 What else could we have shown? u This demonstration showed only “simple” jobs u There are more enhanced EU DataGrid capabilities n Intelligent data replication n Job migration to data n Inclusion of network costs u Scales to many users in a production environment The EU DataGrid project webwww. edg.orgwww. edg.org DutchGrid Platformwww. dutchgrid.nlwww. dutchgrid.nl DutchGrid Forumwww.dutchgridforum.orgwww.dutchgridforum.org For other grid projects, seewww. gridstart.org www. enterthegrid.comwww. gridstart.org www. enterthegrid.com

10. VisualJob Demonstration with EDG 1.4.x – n° 10 Acknowledgements u Roberto Puccinelli u Heinz Stockinger u Flavia Donno u … and all site managers & ITeam