Large-Scale Distributed Computing in the Netherlands an overview David Groep, NIKHEF,

What is DutchGrid? collaboration of 12 organisations established in 2000 functions as a platform, getting manpower & hardware from partner orgs major contributors –NIKHEF –WTCW Virtual Laboratory Project ( ICES/KIS - II ) –ASCI (5 combined Dutch CS Faculties) –Foundation NCF (NWO)

DutchGrid Sites KNMI Nijmegen Delft Leiden Amsterdam VU WCW Utrecht Telin NIKHEF SARA UvA AMOLF CWI DutchGrid site map David Groep, NIKHEF ASTRON, JIVE WCW Amsterdam

Resources ASCI DAS-2 (VU, UvA, Leiden, TUDelft, Utrecht) –200 dual P-III 1GHz CPUs –homogeneous clusters, 5 locations NIKHEF DataGrid clusters –75 dual P-III ~ 1GHz –1Gb/s IPv4 + 1Gb/s IPv6 NCF Grid national computer facilities foundation from NWO –66 node dual AMD - K7 Fabric Research Cluster ( NIKHEF ) –32 node duals “production quality” cluster ( SARA )* –10Gb/s optical “lambda” test bed † –… BioASP – various smaller O (10 node) clusters

Resources (cont.) SARA – National HPC Centre Processing –SGI 1024 processor MPP Mass storage –StorageTek NearLine tape robot –currently: 500 TByte –will grow “indefinitely” (with funds from NCF) User expertise centre In Total Operations/deployment effort ~ 8 FTE available Research effort O (40 FTE) over 12 organisations

Resource Usage

Farm use by Experiment NIKHEF App TB 2002 excl. local users

CR1-1CR1-2 CR2-1CR2-2BR2 AR5 BR1 AMS 10G POS 2.5G POS BR1 CHI 622M PO Prot. Tyco/IEEAF AMSTERDAM 2x2.5Gb 622Mb L2 VPN 2xGbE 622Mb “rest” Global Xing 622Mb to “rest” NY CR1-1CR1-2 CR2-1CR2-2BR2 AR5 BR1 AMS 10G POS 2.5G POS BR1 CHI 622M PO Prot. Tyco/IEEAF AMSTERDAM 622Mb L2 VPN NY CR1-1CR1-2 CR2-1CR2-2BR2 AR5 BR1 AMS 10G POS 2.5G POS 622M PO Prot. Tyco/IEEAF 622Mb L2 VPN NY Networks IGRID 6509 BR4 SP 01 OC48c SR Star Light 6509 ONS ONS Star Light T640 ABILEN E NY ARGONNE IL SingAREN TANet2 … SingAREN TANet2 … Star Light RTR STAR TAP GbE CERN RTR ONS 10G POS Tyco 10G POS Level3 2xGbE 10GbE 2xGbE 2.5Gb lambda OC48c lambda 7xGbE GbE GbE’s CHICAGO, IL CERN,CH 18xGbE UvA NIKHEF “NCSA” “ANL”

NIKHEF network load Monthly graph NIKHEF-SURFnet5 IPv4 interconnect October/November 2002

New Initiatives inside NL NCFGrid strengthening Grid Infrastructure in NL 4 partners ( NIKHEF, ASCI, SARA, ASTRON ) 600 k EUR funding hardware (3 clusters, 10Gb/s networking) and people (1.5 FTE over 3 years) fabric research + production-quality grids approved August 2002 First cluster assembled and being tested…

New Initiatives inside NL (2) Virtual Laboratory for e-Science Dutch “knowledge infrastructure” project Higher-level services to efficiently use global resources Both “bottom-up” and “top-down” in same project 14 partners, 6 application domains middleware research programme LSDSSec AAA Transport Int Visual. Inf. Mngt Intg Exp Envs UIs DISc.FoodInfBioInfDutellaEcoGrid… Scaling & Validation in planning stage O (50 M EUR )

What is happening where in NL?

DutchGrid Services Authentication Services (Certification Authority) –EDG CACG “proper” CA –Student and educational CA –EDG “Tutorial” CA Regular coordination and tutorials Installation support –Distributing EDG software to other (HEP) sites User support

Principal Apps today HEP: DØ, Atlas, LHCb, Alice, BaBar Monte-Carlo and Analysis OPERA – o zone monitoring WTCW Virtual Laboratory visual analysis environment for (small-scale) experimental science –Chemo-physical surface analysis (PIXE,FT-IR,SIMS) –BioASP – correlating “omics” databases –Virtual Surgery (planning by-passes, artery repairs) EcoGrid correlating bio-diversity information databases Radio Astronomy LOFAR, AVO, VLBI – semi-online and offline processing

Research Areas in NL High-bandwidth networking SURFnet, UvA, SARA, NIKHEF Generic AAA and `security’ UvA, NIKHEF Cluster, Storage Management & Monitoring NIKHEF, SARA Adaptive programming environments Free University Amsterdam Memory-processor co-allocation TU Delft Federated Information & Content Management UvA Interactive visualisation CWI, UvA

Summary DutchGrid Platform started informally in 2000 de-facto focus for Grid computing in NL Full centre, operations (CA, web, …) supported by partners mix of people from all ‘layers’ networks, fabrics, security&AAA, prog. environments, HPC visualisation, semantic DBs, applications Collaboration between users and providers leads to great opportunities …