 Contributing >30% of throughput to ATLAS and CMS in Worldwide LHC Computing Grid  Reliant on production and advanced networking from ESNET, LHCNET and Internet2.  Virtual Data Toolkit: Common software developed between Computer Science & applications used by OSG and others. OSG Today

2 OSG Job Throughput  29 VOs  ~75 sites (19 SE & 82 CE)  ~400,000 wall clock hours per day (peaks over 500,000)  25-30% opportunistic use  ~15% is non-physics  >20,000 cores used per day  >43,000 cores accessible US-CMS, US-ATLAS and OSG ready for LHC startup

3 OSG Data Throughput Petabytes a month distributed from CERN to Tier-1s, between Tier-1s and to/from Tier-2s. Transfers bursts of >10Gb/sec. Relies on ESNET, LHCNet and Internet2 in the US.

Are These Estimates Realistic? Yes. Slide Courtesy ESNET: FNAL outbound CMS traffic for 4 months, to Sept. 1, 2007 Max= 8.9 Gb/s ( 1064 MBy/s of data ), Average = 4.1 Gb/s ( 493 MBy/s of data ) Gigabits/sec of network traffic Megabytes/sec of data traffic Destinations:

Known LHC Tier 2+3 Sites Drive Many of the ESnet Peering Point Location and Design Decisions Slide Courtesy Internet2:

background slides

7 7 OSG Platform for the US-LHC Collaborations Software/Middleware a)Support the movement, storage and management of the petabyte LHC data sets. b)Support of job workflow, scheduling and execution at the Tier-1, Tier-2 and Tier-3 sites, that supports transparent access across the European and US grids Services a)Information, accounting and monitoring Services publishing to the WLCG b)Reliability and Availability monitoring used by the experiments to determine the availability of sites and the WLCG to match to the MOU. Support a)Security monitoring, incident response, notification and mitigation b)Operational support including centralized Ticket Handling, with automated bi-directional communication between the systems in Europe and the USA c)Collaboration with ESNET and Internet2 network projects for the integration and monitoring of the underlying network fabric. d)Site Coordination and common support for Tier 3 sites (>8 now on OSG) e)End-to-end support for simulation, production, analysis and focused data challenges; enabling USLHC readiness for real data taking.

8 8 OSG Reporting to WLCG on behalf of US-LHC (Example) US LHC Tier2 Activity for September 2008 Long path to success, and there remains fragility in end-to-end process

9 9 US-ATLAS Production on OSG

10 US-CMS Production on OSG

11 US-LHC Benefits from OSG Common to US-ATLAS and US-CMS 1.Serves as integration and delivery point for core middleware components including compute and storage elements (VDT) 2.Cyber Security operations support within OSG and across Grids (e.g. WLCG) in case of security incidents 3.Cyber Security infrastructure including site-level authorization service, operational service for updating certificates and revocation lists 4.Service availability monitoring of critical site infrastructure services, i.e. Computing and Storage Elements (RSV) 5.Service availability monitoring and forwarding of results to WLCG 6.Site level accounting services and forwarding accumulated results to WLCG 7.Consolidation of Grid client utilities incl. incorporation of LCG client suite, resolving Globus library inconsistencies 8.dCache packaging through VDT and support through OSG-Storage 9.Integration testbed for new releases of the OSG software, pre-production deployment testing 10.Continuous support of the distributed Computing Facility and production services through the weekly OSG facility phone meetings

12 US-LHC Benefits from OSG (continued) Specific to US-ATLAS 1.LCG File Catalog (LFC) server and client packaging – needed in support of the ATLAS global Distributed Data Management system (DDM) 2.Bestman and xrootd: SRM and file system support for Tier 2 and Tier 3 facilities 3.Support for integration and extension of security services in the PanDA workload management system and the GUMS grid identity mapping service, for compliance with OSG security policies and requirements Specific to US-CMS 1.Bestman: SRM support for Tier 3 facilities 2.lcg-utils tools for data management 3.Scalability testing of OSG services, incl. BDII, CE, SE, and work with developers to improve the underlying middleware.