International e-Infrastructure Mike Mineter mjm@nesc.ac.uk Footer

Overview The view from the European Commission GEANT – European network DEISA – for when High Performance Computing is just not HP enough! EGEE – establishing grid e-Infrastructure WHY?! HOW?! With whom? International e-Infrastructure Footer

View from European Commission Entering the “knowledge society” from the “industrial society” Industrial society = Transportation Infrastructure Knowledge society = Communications infrastructure Lisbon strategy: Research and Innovation will be the most important factors in determining Europe’s success through the next decades THE GOAL: “UNLEASH CREATIVITY”- by investment in Human skills Infrastructures Demands in growth of e-infrastructure International e-Infrastructure Footer

HOW . . . . . . . operational Digital support Libraries Biomedics e-Infrastructure - Implementation blocks High Energy Physics Digital Libraries . . . . . . . Biomedics global filing system security middleware operational support certification one stop shop networking specific services joint research activities GRID . INFRASTRUCTURE networking specific services joint research activities GÉANT . INFRASTRUCTURE Technology testbeds User research results EU policies Mário Campolargo DG INFSO F3, Pisa 24th October 2005 Footer

HOW Market Research IST e-Infrastructure - Strategic building blocks … EGEE DEISA … + 18 proposals international, policies, user communities GRID . INFRASTRUCTURE Research Market e-Infrastructure IST GÉANT . INFRASTRUCTURE GÉANT2 Mário Campolargo DG INFSO F3, Pisa 24th October 2005 Footer

DEISA “integration of existing national high-end platforms, tightly coupled by a dedicated network and supported by innovative system and grid software” Initial scientific applications include Material Sciences Cosmology Plasma Physics Life Sciences http://www.deisa.org International e-Infrastructure Footer

GEANT Interconnects 34 National Research & Education Networks-NRENs of the extended European Research Area (ERA) Connects more than 3500 Research & Education Institutions Serves millions of end-users + eScience Projects (e.g. Grids) under Accepted Usage Policy (AUP) rules 3-tier Federal Architecture, partially subsidized by National and EU Research & Education funds: The Campus Network (LAN/MAN) The NREN (MAN/WAN) The Pan-European Interconnection GEANT2 en route http://www.geant.net/ International e-Infrastructure Footer

EGEE- building grid infrastructure To underpin collaboration Link with and build on national, regional and international initiatives Foster world-wide international cooperation both in the creation and the use of the e-infrastructure Collaboration Grid Operations, Support and training In Europe we use the term e-infrastructure to refer to the goal of integrating networks, grids and the operations in support of collaborations that are in the “service of society” …. not only research, but also commerce and public service. The GEANT network, the EGEE grid and a couple of VOs are shown in the figure. The e-Infrastructure includes the organisational, support and training inherent in providing services. In Europe the GEANT initiative shows the way, in that researchers enjoy high bandwidth connections – and few even know that GEANT exists. That is the sign of a good infrastructure. Linking with other initiatives world-wide is vital. The GGF recognises this; economy of effort, the Grid goal of collaboration, the quest for open standards all these lead to these links being vital. There is also the basic fact that so much of science is multi-national. Grid computing exists to serve virtual organisations – these often bridge cultures, between organisations, across research disciplines as well as between nations. (Perhaps - One of the hardest to bridge may prove to be academic cultures of competition??) International cooperation is more than an incidental benefit of European investment in research and technology: it is a goal of the EU investment. The EU has recently expanded; not that long ago an iron curtain split Europe, even more recently there were wars in former Yugoslavia: EGEE crosses many political, historical and racial borders. Building cooperation across these perceived borders is necessary for EGEE to succeed, is intrinsic to Grid computing, as well as being a consequence of its success. GEANT achievements: Pan-European coverage (43 countries) Interconnecting 33+ NRENs Linking more than 3900 Universities, i.e. virtually all the researchers in Europe in all disciplines 16 international circuits operating at 10 Gbps while 17 other run at 2,5 Gbps Network infrastructure(GÉANT ) International e-Infrastructure Footer

In the first 2 years EGEE is Establishing production quality sustained Grid services 3000 users from at least 5 disciplines integrate 50 sites into a common infrastructure offer 5 Petabytes (1015) storage Demonstrating a viable general process to bring other scientific communities on board Proposed a second phase to take over EGEE in April 2006 Pilot New Production quality = reliable, secure, with comprehensive operational support Sustainable = a research community can rely on this grid lasting longer than their research initiatives…, in the case of high energy physics that’s in the order of 20 years. A relatively small but growing number of VOs use Grids. The eInfrastructure goal is to support a very wide range of research; public service and ultimately commerce too. International e-Infrastructure Footer

EGEE Organisation 70 leading institutions in 27 countries, federated in regional Grids ~32 M Euros EU funding for first 2 years starting April 2004 (matching funds from partners) Leveraging national and regional grid activities Promoting scientific partnership outside EU International e-Infrastructure Footer

LCG and EGEE LCG : Large Hadron Collider Compute Grid EGEE committed to “hit the ground running” EGEE profits from the resources - no funded computing/data resources in EGEE Provided by the VOs LCG obtains additional production and operation efforts LCG experiments now comprise several of the many VOs in EGEE Current service (“LCG-2”) based on work done in LCG Middleware components to be upgraded by “gLite” services as they are proven “gLite 3” will be forged from LCG 2.7 + gLite services LCG : Large Hadron Collider Compute Grid International e-Infrastructure Footer

EGEE Activities 48 % service activities (Grid Operations, Support and Management, Network Resource Provision) 24 % middleware re-engineering (Quality Assurance, Security, Network Services Development) 28 % networking (Management, Dissemination and Outreach, User Training and Education, Application Identification and Support, Policy and International Cooperation) Emphasis in EGEE is on operating a production grid and supporting the end-users International e-Infrastructure Footer

gLite: Guiding Principles Service oriented approach Allow for multiple interoperable implementations Lightweight (existing) services Easily and quickly deployable Use existing services where possible Condor, EDG, Globus, LCG, … Portable Being built on Scientific Linux and Windows Security Sites and Applications Performance/Scalability & Resilience/Fault Tolerance Comparable to deployed infrastructure EDG VDT . . . LCG AliEn Co-existence with deployed infrastructure Co-existence with LCG-2 and OSG (US) are essential for the EGEE Grid services Site autonomy Reduce dependence on ‘global, central’ services Open source license International e-Infrastructure Footer

EGEE Middleware Intended to replace present middleware with production quality services Developed from existing components Aims to address present shortcomings and advanced needs from applications Prototyping short development cycles for fast user feedback Initial web-services based prototypes being tested LCG-1 LCG-2 gLite-1 gLite-2 Globus 2 based Web services based Application requirements http://egee-na4.ct.infn.it/requirements/ International e-Infrastructure Footer

Grid Operations CIC The grid is flat, but Hierarchy of responsibility ROC OMC The grid is flat, but Hierarchy of responsibility Essential to scale the operation CICs act as a single Operations Centre Operational oversight (grid operator) responsibility rotates weekly between CICs Report problems to ROC/RC ROC is responsible for ensuring problem is resolved ROC oversees regional RCs ROCs responsible for organising the operations in a region Coordinate deployment of middleware, etc CERN coordinates sites not associated with a ROC RC = Resource Centre ROC = Regional Operations Centre CIC = Core Infrastructure Centre OMC = Operations Management Centre International e-Infrastructure Footer

The GGUS Portal Global Grid User Support - first contact for users http://www.ggus.org You need to register in order to be able To use this portal (GSI or password based) You can register as User or as Supporter. Supporter ? If you think you have a good knowledge in Grid and have time to provide support, please contact your ROC or directly ESC at: International e-Infrastructure Footer

EGEE pilot applications High-Energy Physics (HEP) Provides computing infrastructure (LCG) Challenging: thousands of processors world-wide generating petabytes of data ‘chaotic’ use of grid with individual user analysis (thousands of users interactively operating within experiment VOs) Biomedical Applications Similar computing and data storage requirements Major additional challenge: security & privacy Chemistry, Earth Observation, Astronomy, Geophysics, ... EGEE tutorial, Seoul Footer

EGEE is running… … the largest multi-VO production grid in the world! What’s happening now? http://gridportal.hep.ph.ic.ac.uk/rtm/ What resources are connected? http://goc.grid-support.ac.uk/gridsite/monitoring/ International e-Infrastructure Footer

GILDA demonstrator and testbed (https://gilda.ct.infn.it) Marc-Elian Bégin - Demos - 1st EU review Footer

Policy and International Cooperation To foster cooperation between EGEE and other Grid activities around the world Globus Alliance, Condor Training/workshop events (International Grid Summer School, Italy, July) To participate in an eInfrastructure reflection group in Europe http://www.e-irg.org/ To play a leading role in standard setting through attendance at global standard bodies such as the Global Grid Forum. Grid Storage Management GGF working group - http://sdm.lbl.gov/gsm/ Security, Authentication: US – EU cooperation Mutual recognition of CA’s Requires collaboration to establish policy - and mutuality International e-Infrastructure Footer

Related Projects Change Existing Project to Active Projects Change In Negotiation to New Projects Change Submitted to September 2005 Proposals SSA: Specific support actions complement the implementation of the Framework Programme and may be used to help in preparations for future Community research and technological development policy activities including monitoring and assessment activities. In particular, they involve conferences, seminars, studies and analyses, high level scientific awards and competitions, working groups and expert groups, operational support and dissemination, information and communication activities, or a combination of these, as appropriate in each case. Specific support actions are also implemented to stimulate, encourage and facilitate the participation of SMEs, small research teams, newly developed and remote research centres, as well as those organisations from the candidate countries in the activities of the Communication Network Development scheme. The implementation of these actions rely on the specific information and assistance structures, including the network of national contact points, established by the Member States and the associated countries at local, regional and national level and aim at ensuring a smooth transition from the Fifth to the Sixth Framework Programme. International e-Infrastructure Footer

Market Research IST Summary … DEISA EGEE GÉANT2 + 18 proposals international, policies, user communities GRID . INFRASTRUCTURE Research Market e-Infrastructure IST GÉANT . INFRASTRUCTURE GÉANT2 Mário Campolargo DG INFSO F3, Pisa 24th October 2005 International e-Infrastructure Footer

Further information EGEE Website How to join EGEE Project Office http://www.eu-egee.org How to join http://public.eu-egee.org/join/ EGEE Project Office project-eu-egee-po@cern.ch Global Grid Forum http://www.gridforum.org/ Globus Alliance http://www.globus.org/ Condor http://www.cs.wisc.edu/condor/ VDT http://www.cs.wisc.edu/vdt/ Open Science Grid http://www.opensciencegrid.org/ Grid Center http://www.grids-center.org/ LCG http://lcg.web.cern.ch/LCG/ International e-Infrastructure Footer