Fotis Karayannis HellasGrid Scientific Coordinator GRNET The National Grid Initiative in Greece www.hellasgrid.gr Fotis Karayannis HellasGrid Scientific Coordinator GRNET
Outline GRNET dual mission: The HellasGrid National Grid initiative Research Networking and Grid infrastructure The HellasGrid National Grid initiative Infrastructure Organisation Applications communities HellasGrid as part of the European efforts Networking and Grid projects Challenges/Experiences EGI SEE Workshop Athens, 19 April 2006
GRNET Dual Mission The EU e-Infrastructure vision: Integrated Networking + Grid infrastructures GRNET was one of the first NRENs* in Europe adopting the EU e-Infrastructure initiative: Providing both networking and grid infrastructures * NREN: National Research and Education Network Being infrastructure-oriented and application-neutral serving all user eScience communities Expanding its scope to e-Business and e-Government Source: European Commission Unit F3: Research Infrastructures EGI SEE Workshop Athens, 19 April 2006
GRNET strategic projects and funding Research Network projects GRNET2 project, 2000-2005, 20 MEuro 2,5 Gbps leased lambda backbone network Pilot dark fiber acquisition projects (15 years lease) + optical equipment Pilot Grid node @ Demokritos (Isabella) Access project (called “105”), 2005-2008, 10 MEuro 1 Gigabit Access for ~50 institutes GRNET3 project, 2005-2008, 30 MEuro (recently approved!) Dark fiber research back-bone network in Greece Optical MANs for Athens, Thessaloniki (the rest to be covered by regional MANs (called “93”) Optical equipment RFI already published PanEuropean connectivity & integration project: GEANT2, 2004-2008 Regional Support Projects: SEEREN-SEEREN2, Eumedconnect Grid projects Hellasgrid Task Force, 2002-2004, (support money) Hellasgrid Strategy Document Pilot Grid node @ Demokritos (0,5M by GRNET2) Hellasgrid Project, 2004-2007, ~2 MEuro ~800 CPUs, ~ 90TB storage (30TB disks + 60 TB tape libraries), 4 advanced video-conferencing Access Grid nodes Grid Applications Call, 2006-2007,~0,5M PanEuropean integration projects: EGEE Project, 2004-2006, 1,3MEuros EGEE-II, 2006-2008, 1,8M Euros Supported operations, training, policies Regional Support projects: SEEGRID, SEEGRID2, Eumedgrid, EuChinaGrid Other projects: GridCC, e-IRGSP EGI SEE Workshop Athens, 19 April 2006
The GRNET Network Backbone is currently based on 2,5 Gbps leased lambdas Dark fiber has been acquired for 3 network spans (pilot phase) Dark fiber tender for the whole backbone on-going (one offer received) International connectivity 2 * 10 Gbps any day (currently 2* 2,5 Gbps) EGI SEE Workshop Athens, 19 April 2006
The HellasGrid National Grid Initiative HellasGrid Task Force appointed by the Ministry of Economy and Finance at the end of 2002 (MNEC is running the national InfoSoc programme) A strategy group supported by a scientific committee Produced a strategy document The Task Force prepared the National Integration Proposal The HellasGrid MoU was signed at the end of 2003 Pilot Phase (Phase I): 2003-2004 GRNET Pilot Infrastructure installation Isabella site: 64 CPUs, 10 TB SAN, 12 TB Tape Library Participation in EGEE proposal, Coordination of SEE-GRID Consolidation Phase (Phase II): 2004-2006 HellasGrid project implementation Extension of Grid infrastructure (~800 CPUs, 30TB disks, 60TB tape libraries) – (~2 MEuros) Integration in EGEE The HellasGrid MoU was used to form a Joint Research Unit (JRU) GRNET provided a recognition letter by the Ministry after EC request Further application support (~0,5M – 1M Euros) Investigation for further infrastructure support (~1 MEuros) EGI SEE Workshop Athens, 19 April 2006
The HellasGrid members Coordinator National Research and Education Network, GRNET –www.grnet.gr Universities (10) Aristotle University of Thessaloniki, AUTH www.auth.gr Athens University of Business, AUEB www.aueb.gr National Technical University of Athens, NTUA www.ntua.gr University of the Aegean www.aegean.gr University of Athens, UoA www.uoa.gr University of Crete, UoC www.uoc.gr University of Ioannina, UoI www.uoi.gr University of Macedonia, UoM www.uom.gr University of Patras UPATRAS www.upatras.gr University of Pireus UNIPI www.unipi.gr Research Centres (8) Research and Academic Computer Technology Institute, CTI www.cti.gr Centre for Research and Technology Hellas, CERTH www.certh.gr Institute of Computer Science – FORTH, www.ics.forth.gr Institute of Accelerator Systems and Applications, IASA www.iasa.gr Institute of Communication and Computer Systems, ICCS www.iccs.ece.ntua.gr National Meteorology Service, EMYwww.emy.gr National Observatory of Athens, NOA www.noa.gr Research Centre Demokritos, DEMOKRITOS www.demokritos.gr EGI SEE Workshop Athens, 19 April 2006
HELLASGRID infrastructure http://www.hellasgrid.gr/infrastructure HG-01 cluster @ Demokritos: 64 CPU, 10TB FC SAN, 12TB Tape Library, EGEE LCG2 middleware HG02-HG06 clusters located in: Athens (NDC/EKT, IASA) Thessaloniki (AUTH) Crete (ICS-FORTH) Patras (CTI) ~800 CPUs (x86_64, 2 GB RAM, 80GB HDD, 2x Gbit) ~30 TBytes total raw SAN storage capacity ~80TBytes Tape Library 4 Access Grid nodes EGI SEE Workshop Athens, 19 April 2006
HG organisation: Teamwork! Overall coordination: GRNET headquarters Cooperation with HellaGrid partners: Main site + ROC operator : HG-01-GRNET (Isabella, cslab@ICCS/NTUA) HG-02…HG-06 sites + operation centers (NDC, IASA, AUTH, FORTH, CTI) 5 smaller private sites (AUTH, UoM, FORTH, Demokritos, HEP-NTUA) HG CA and VOMS (GridAUTH, Dept. of Physics, AUTH) HG helpdesk (CTI) Regional monitoring tools (ICS-FORTH) HG user support/apps (Demokritos + all site teams) 4 AccessGRID sites HG membership: ~18 members (10 Universities + 8 Research Institutes) 6 HellasGrid+5 private sites > 900 CPUs in total EGI SEE Workshop Athens, 19 April 2006
HG-01-GRNET Isabella EGI SEE Workshop Athens, 19 April 2006
HellasGrid Infrastructure, Phase II, EKT (2/2006) National Documentation Center (EKT) EGI SEE Workshop Athens, 19 April 2006
HG Local Users distribution per Discipline EGI SEE Workshop Athens, 19 April 2006
CPU Hours per Site EGI SEE Workshop Athens, 19 April 2006
HellasGrid CA statistics: EGI SEE Workshop Athens, 19 April 2006
CPU time: distribution of overall EGEE VOs usage of HG infrastructure EGI SEE Workshop Athens, 19 April 2006
HellasGrid as part of European efforts Scale > 170 sites in 39 countries > 17 000 CPUs > 5 PB storage > 10 000 concurrent jobs per day > 60 Virtual Organisations EGI SEE Workshop Athens, 19 April 2006
SEE Europe promoting the NGI/EGI model NGI: National Grid Initiative Infrastructure oriented & application neutral Not driven by applications GRNET acts as an early champion for the SEE area One partner per country since EGEE Phase I! EGEE-SEE and SEE-GRID countries adopted the same model! EGI SEE Workshop Athens, 19 April 2006
Challenges/Experiences/Conclusions Building the HG infrastructure proved difficult Housing, SLAs with local institutes are slow, tedious and expensive! Getting applications /users to exploit the infrastructure is slow! Training/education and dissemination is important Application projects and funding are essential! Received 45 proposals in last Grid-Applications call! Sustainability of the infrastructure and services Equipment will need to be changed after 3-5 years Local “incubators” for GRID technology needed: Experts in local sites Operators should have appropriate mentality (shifts, support) Gained a lot from networking experience (NOCs, NOC-ROC cooperation) Regional, Pan-European and International collaborations are vital Our European friends lead the way: Middleware, VOs, support projects EGI SEE Workshop Athens, 19 April 2006
www.hellasgrid.gr www.egee-see.org For more: mailto:fkara@grnet.gr EGI SEE Workshop Athens, 19 April 2006