1. LIP workshop 2010 1 LIP Computing Overview Jorge Gomes Laboratório de Instrumentação e Física Experimental de Partículas

2. Comprehensive set of activities: –Internal infrastructures and services –International infrastructures and services –National initiatives –International initiatives –Research and application projects Activities scope: –Goes far beyond the LIP internal context –Mostly focused in distributed computing –National and international responsibilities –Technical –Political Computing at LIP LIP workshop 2010 2 LIP-LX NCG

3. Participation in EU funded projects –Research, development and production –Continuous participation since 2001 –Contribution to new technologies –Pilot and demonstration projects –Production quality infrastructures Worldwide LHC Computing Grid –CERN project –Generic computing infrastructure and services for all LHC experiments –Memorandum of Understanding (MoU) –Portuguese obligation to provide a Tier-2 National projects –Initially complementary funding to EU –Funded through the national grid initiative Projects LIP workshop 2010 3 Between 2008 and 2009: Int.Eu.grid EGEE-II EGEE-III WLCG Grid Middleware Main node for grid computing EGI IBERGRID

4. ~ 290 centres ~ 55 countries ~ 150,000 CPUs ~ 28+41 PetaBytes ~ 17,000 users ~ 200 VOs ~ 330K jobs/day Archeology Astronomy Astrophysics Fluid Dynamics Civil Protection Chemistry Earth Sciences Condensed matter physics Finance Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences … LIP workshop 2010 4 Largest grid computing infrastructure WLCG operations depend on EGEE

5. EGEE is organized in federations Southwest federation Portugal –8 centres Spain –14 centres EGEE in the Iberian region LIP workshop 2010 5 –The reginal infrastructure operations are distributed –LIP coordinates the Portuguese side –LIP also supports the regional and global operations

6. 6 Worldwide LHC Computing Grid (WLCG) LIP operates the Portuguese WLCG federated Tier-2 The Portuguese Tier-2 supports ATLAS and CMS LIP is member of the WLCG RRB and GDB The WLCG collaboration: –4 experiments –15 PetaBytes per year –34 countries –170 datacenters –12 large datacenters (T0, T1) –38 federations smaller centres (T2) –Regional grid infrastructures EGEE, OSG, Nordugrid Computing MoU: –Between CERN and governments –Agreed in October 2005 LIP workshop 2010

7. 32 Tier-2s One per country Data for: –ALICE –ATLAS –CMS –LHCB In December the Portuguese T2 was the 7th WLCG largest CPU provider WLCG Tier-2 Centres Usage LIP workshop 2010 7

8. WLCG Tier-2 Evolution LIP workshop 2010 8

9. The Portuguese national grid initiative (NGI) was created in 2006: –It is coordinated by UMIC and LIP –Aims to: Support distributed computing for complex problem solving Integrated Portugal in major international distributed computing infrastructures The Portuguese NGI is creating a national grid computing infrastructure: –Provide resources to be shared by the research communities –Integrate existing resources The project “Main Node for Grid Computing” is the corner stone: –Provisioning of core processing and storage resources for sharing –Central services to enable a national grid and its integration in major international distributed computing infrastructures Creating Infrastructures LIP workshop 2010 9 The WLCG MoU is being fulfilled in the context of the Portuguese NGI The WLCG Tier-2 is a customer of the infrastructure shared resources

10. 10 NGI Core Infrastructure –Main Node for Grid Computing (NCG) New National Grid Initiative computer centre Managed by LIP on behalf of the Portuguese National Grid Initiative –LIP computing resources Lisbon Coimbra –Everything was built with funds to be returned to the EU Extremely strict deadlines and rules LIP Coimbra Main node LIP Lisbon Layer 2 10 Gbps1Gbps 10 Gbps 3Gbps FCCN Layer 3 backbone LIP Braga LIP workshop 2010

11. gLite Grid Clusters LIP workshop 2010 11 Based on x86 systems Linux operating system Batch system Storage system 11 PC x86 LRMS PC Firewall CE Grid services SE UI

12. Lisbon and Coimbra –Computing farm –Storage systems –Room improvements –Power distribution –AVAC –UPS –Environment sensors –Fire detection –Fire extinction –Network core switching –Access switching –Wide area connectivity –Management network –Support systems –Virtualization platform –Tape backup LIP Upgrades and Improvements LIP workshop 2010 12

13. Lisbon Topology LIP workshop 2010 13 CPU farm (80) HP DL160 G5 HP DL160 G6 SUN X4100 SUN X2200 SUN X2100 DELL PE1950 TBA Xen VMs Lustre / Storm MDT01 SE001 … SE010 Virtualization Andromeda01.. 16 NFS servers stlip02 stlip03 stcalo02 stcosmo02 stcomp02 Backups Amanda Interactive lnlip01 lnlip02 lnlip03 lnpet01 lncms01 lncalo01 comp01 comp02 lncosmo01 lfams01 OLD Xeon pool Sabrina Margot Otello www2 DMZ MAIL CA WWW AFNET01 Network ATHENA HERA Monitoring Ganglia Monica Alpha aflip01 afams01 afna5001 ADMIN sec primavera GRID services LCG-CE cream StoRM WMS bdii Myproxy UI Squid VO-box RAS VOMS Force10 C300 Nortel CISCO 7600 Nortel iSCSI Appollo Zaria

14. LIP workshop 2010 14 Main Node for Grid Computing Built by a consortium for the housing of the National Grid Initiative core services: –LIP, FCCN, LNEC Located: –LNEC campus in Lisboa –Near the FCCN Network Operations Centre Objective: –House core services for the Portuguese NGI –House grid resources for sharing –House grid resources for other organizations Project started in 2007: –Civil engineering and architecture –Electrical Power and cooling –Networks and Computing

15. LIP workshop 2010 15 Main Node for Grid Computing

16. LIP –Core grid services Integration services –Grid cluster Shared resources –Grid storage Shared resources –Local Area Network 10 GbE FCCN –Data repositories –VOIP –Services Other –LNEC grid cluster LIP workshop 2010 16 Main Node for Grid Computing

17. Complex Middleware LIP workshop 2010 17 UI JDL Logging & Book-keeping ResourceBroker Job Submission ServiceStorageElementInformationService Job Status LFCCatalog DataSets info Author. &Authen. Job Submit Event Job Query Job Status Input “sandbox” Input “sandbox” + Broker Info Globus RSL Output “sandbox” Job Status Publish voms-proxy-init Expanded JDL SE & CE info

18. LIP computing services –Management of LIP systems, services and networks –User support –Web development and design –Coimbra computing services are being restructured Authentication Authorization and Security –LIP CA grid computing authentication for Portugal –Member of EUgridPMA / IGTF –Security team for Portuguese grid sites New domains –Voluntary computing –Clouding computing –High performance computing More systematically got into –Benchmarking and tuning (processors, networks and storage) –Virtualization and fault tolerance Other Activities LIP workshop 2010 18

19. LIP workshop 2010 19 European Grid Initiative (EGI) The European Grid Initiative (EGI) will replace EGEE –Ensure long term sustainability for grid computing infrastructures in Europe Grid infrastructures are really needed and their future must be guaranteed Moving away from the model based on short term projects and individual research institutes –New organizational model with two layers: National Grid Initiatives managed and funded by the governments European Grid Initiative as a top integration layer (country + EU funded) EGI headquarters established in Amsterdam Transition already taking place this year overlapping with EGEE-III Several funding projects submitted to the EU to complement funding

20. EGI design project –Policy board chairman –Portuguese representative in the policy board EGI council –Portuguese representative EGI InSPIRE –Integrated Sustainable Pan-European Infrastructure for Researchers in Europe –Submitted to the EU in last November –Main EGI project for infrastructure integration and operations –LIP as partner representing the Portuguese NGI EGI International bids –LIP together with IFCA/CSIC won the bid for coordinating the EGI middleware rollout at European level European Grid Initiative (EGI) LIP workshop 2010 20

21. LIP workshop 2010 21 Announcement TCP/IP and networking training Aimed at the LIP computing group personnel But open to everybody that will be willing to attend/suffer It will be organized as two training sessions per week It will take several weeks... It will start in January More details to be announced next week