Presentation is loading. Please wait.

Presentation is loading. Please wait.

Internet2 Presentation (Oct. 11, 2007)Paul Avery 1 Paul Avery University of Florida Internet2 Meeting San Diego, CA October 11, 2007.

Published byJunior Dennis Modified over 9 years ago

Similar presentations

Presentation on theme: "Internet2 Presentation (Oct. 11, 2007)Paul Avery 1 Paul Avery University of Florida Internet2 Meeting San Diego, CA October 11, 2007."— Presentation transcript:

1 Internet2 Presentation (Oct. 11, 2007)Paul Avery 1 Paul Avery University of Florida avery@phys.ufl.edu Internet2 Meeting San Diego, CA October 11, 2007 www.opensciencegrid.org High Energy & Nuclear Physics Experiments and Advanced Cyberinfrastructure

2 Internet2 Presentation (Oct. 11, 2007)Paul Avery 2 Context: Open Science Grid  Consortium of many organizations (multiple disciplines)  Production grid cyberinfrastructure  75+ sites, 30,000+ CPUs: US, UK, Brazil, Taiwan

3 Internet2 Presentation (Oct. 11, 2007)Paul Avery 3 OSG Science Drivers  Experiments at Large Hadron Collider  New fundamental particles and forces  100s of petabytes2008 - ?  High Energy & Nuclear Physics expts  Top quark, nuclear matter at extreme density  ~10 petabytes 1997 – present  LIGO (gravity wave search)  Search for gravitational waves  ~few petabytes2002 – present Data growth Community growth 2007 2005 2003 2001 2009 Future Grid resources  Massive CPU (PetaOps)  Large distributed datasets (>100PB)  Global communities (1000s)  International optical networks

4 Internet2 Presentation (Oct. 11, 2007)Paul Avery 4 OSG History in Context Primary Drivers: LHC and LIGO 1999200020012002200520032004200620072008 2009 PPDG GriPhyN iVDGL TrilliumGrid3 OSG (DOE) (DOE+NSF) (NSF) European Grid + Worldwide LHC Computing Grid Campus, regional grids LHC Ops LHC construction, preparation, commissioning LIGO operation LIGO preparation

5 Internet2 Presentation (Oct. 11, 2007)Paul Avery 5 Search for  Origin of Mass  New fundamental forces  Supersymmetry  Other new particles  2008 – ? TOTEM LHCb ALICE  27 km Tunnel in Switzerland & France CMS ATLAS LHC Experiments at CERN

6 Internet2 Presentation (Oct. 11, 2007)Paul Avery 6 Particle Proton  Proton 2835 bunch/beam Protons/bunch10 11 Beam energy7 TeV x 7 TeV Luminosity10 34 cm  2 s  1 Crossing rate every 25 nsec  Collision rate ~10 9 Hz  New physics rate ~10  5 Hz  Selection: 1 in 10 14 Parton (quark, gluon) Proton l l jet Bunch Collisions at LHC (2008  ?) (~20 Collisions/Crossing)

7 Internet2 Presentation (Oct. 11, 2007)Paul Avery 7 CMS ATLAS LHCb Storage  Raw recording rate 0.2 – 1.5 GB/s  Large Monte Carlo data samples  100 PB by ~2012  1000 PB later in decade? Processing  PetaOps (> 600,000 3 GHz cores) Users  100s of institutes  1000s of researchers LHC Data and CPU Requirements

8 Internet2 Presentation (Oct. 11, 2007)Paul Avery 8 ATLAS CMS LHC Global Collaborations  2000 – 3000 physicists per experiment  USA is 20–31% of total

9 Internet2 Presentation (Oct. 11, 2007)Paul Avery 9 CMS Experiment LHC Global Grid Online System CERN Computer Center FermiLab Korea Russia UK Maryland 200 - 1500 MB/s >10 Gb/s 10-40 Gb/s 2.5-10 Gb/s Tier 0 Tier 1 Tier 3 Tier 2 Physics caches PCs Iowa UCSDCaltech U Florida  5000 physicists, 60 countries  10s of Petabytes/yr by 2009  CERN / Outside = 10-20% FIU Tier 4 OSG

10 Internet2 Presentation (Oct. 11, 2007)Paul Avery 10 LHC Global Grid  11 Tier-1 sites  112 Tier-2 sites (growing)  100s of universities J. Knobloch

11 Internet2 Presentation (Oct. 11, 2007)Paul Avery 11 LHC Cyberinfrastructure Growth: CPU CERN Tier-1 Tier-2 ~100,000 cores  Multi-core boxes  AC & power challenges

12 Internet2 Presentation (Oct. 11, 2007)Paul Avery 12 LHC Cyberinfrastructure Growth: Disk 100 Petabytes Disk CERN Tier-1 Tier-2

13 Internet2 Presentation (Oct. 11, 2007)Paul Avery 13 LHC Cyberinfrastructure Growth: Tape 100 Petabytes Tape CERN Tier-1

14 Internet2 Presentation (Oct. 11, 2007)Paul Avery 14 HENP Bandwidth Roadmap for Major Links (in Gbps) Paralleled by ESnet roadmap 

15 Internet2 Presentation (Oct. 11, 2007)Paul Avery 15 HENP Collaboration with Internet2 www.internet2.edu HENP SIG

16 Internet2 Presentation (Oct. 11, 2007)Paul Avery 16  UltraLight and other networking initiatives  Spawning state-wide and regional networks (FLR, SURA, LONI, …) HENP Collaboration with NLR www.nlr.net

17 Internet2 Presentation (Oct. 11, 2007)Paul Avery 17 US LHCNet, ESnet Plan 2007-2010: 30  80 Gbps US-CERN DEN ELP ALB ATL Metropolitan Area Rings Aus. Europe SDG AsiaPac SEA Major DOE Office of Science Sites High-speed cross connects with Internet2/Abilene New ESnet hubs ESnet hubs SNV Europe Japan Science Data Network core, 40-60 Gbps circuit transport Lab supplied Major international Production IP ESnet core, 10 Gbps enterprise IP traffic Japan Aus. Metro Rings ESnet4 SDN Core: 30-50Gbps ESnet IP Core ≥10 Gbps 10Gb/s 30Gb/s 2 x 10Gb/s NYC CHI US-LHCNet Network Plan (3 to 8 x 10 Gbps US-CERN ) LHCNet Data Network DC GEANT2 SURFNet IN2P3 NSF/IRNC circuit; GVA-AMS connection via Surfnet or Geant2 CERN FNAL BNL US-LHCNet: NY-CHI-GVA-AMS 2007-10: 30, 40, 60, 80 Gbps ESNet MANs to FNAL & BNL; Dark Fiber to FNAL; Peering With GEANT

18 Internet2 Presentation (Oct. 11, 2007)Paul Avery 18 CSA06 Tier1–Tier2 Data Transfers: 2006–07 1 GB/sec Sep. 2006 Sep. 2007 Mar. 2007

19 Internet2 Presentation (Oct. 11, 2007)Paul Avery 19 Computing, Offline and CSA07 Nebraska One well configured site. But ~10 such sites in near future  network challenge US: FNAL Transfer Rates to Tier-2 Universities 1 GB/s June 2007

20 Internet2 Presentation (Oct. 11, 2007)Paul Avery 20 Current Data Transfer Experience  Transfers are generally much slower than expected  Or stop altogether  Potential causes difficult to diagnose  Configuration problem? Loading? Queuing?  Database errors, experiment S/W error, grid S/W error?  End-host problem? Network problem? Application failure?  Complicated recovery  Insufficient information  Too slow to diagnose and correlate at the time the error occurs  Result  Lower transfer rates, longer troubleshooting times  Need intelligent services, smart end-host systems

21 Internet2 Presentation (Oct. 11, 2007)Paul Avery 21 UltraLight 10 Gb/s+ network Caltech, UF, FIU, UM, MIT SLAC, FNAL Int’l partners Level(3), Cisco, NLR http://www.ultralight.org Funded by NSF Integrating Advanced Networking in Applications

22 Internet2 Presentation (Oct. 11, 2007)Paul Avery 22 UltraLight Testbed www.ultralight.org Funded by NSF

23 Internet2 Presentation (Oct. 11, 2007)Paul Avery 23 Many Near-Term Challenges  Network  Bandwidth, bandwidth, bandwidth  Need for intelligent services, automation  More efficient utilization of network (protocols, NICs, S/W clients, pervasive monitoring)  Better collaborative tools  Distributed authentication?  Scalable services: automation  Scalable support

24 Internet2 Presentation (Oct. 11, 2007)Paul Avery 24 END

25 Internet2 Presentation (Oct. 11, 2007)Paul Avery 25 Extra Slides

26 Internet2 Presentation (Oct. 11, 2007)Paul Avery 26 The Open Science Grid Consortium Open Science Grid U.S. grid projects LHC experiments Laboratory centers Education communities Science projects & communities Technologists (Network, HPC, …) Computer Science University facilities Multi-disciplinary facilities Regional and campus grids

27 Internet2 Presentation (Oct. 11, 2007)Paul Avery 27 CMS: “Compact” Muon Solenoid Inconsequential humans

28 Internet2 Presentation (Oct. 11, 2007)Paul Avery 28 All charged tracks with pt > 2 GeV Reconstructed tracks with pt > 25 GeV (+30 minimum bias events) 10 9 collisions/sec, selectivity: 1 in 10 13 Collision Complexity: CPU + Storage

29 Internet2 Presentation (Oct. 11, 2007)Paul Avery 29 LHC Data Rates: Detector to Storage Level 1 Trigger: Special Hardware 40 MHz 75 KHz 75 GB/sec 5 KHz 5 GB/sec Level 2 Trigger: Commodity CPUs 100 Hz 0.15 – 1.5 GB/sec Level 3 Trigger: Commodity CPUs Raw Data to storage (+ simulated data) Physics filtering ~TBytes/sec

30 Internet2 Presentation (Oct. 11, 2007)Paul Avery 30 LIGO: Search for Gravity Waves  LIGO Grid  6 US sites  3 EU sites (UK & Germany) * LHO, LLO: LIGO observatory sites * LSC: LIGO Scientific Collaboration  Cardiff AEI/Golm Birmingham

31 Internet2 Presentation (Oct. 11, 2007)Paul Avery 31 Is HEP Approaching Productivity Plateau? Padova 2000 Beijing 2001 San Diego 2003 Interlachen 2004 Mumbai 2006 Victoria 2007 Expectations From Les Robertson Gartner Group (CHEP Conferences) The Technology Hype Cycle Applied to HEP Grids

32 Internet2 Presentation (Oct. 11, 2007)Paul Avery 32 Challenges from Diversity and Growth  Management of an increasingly diverse enterprise  Sci/Eng projects, organizations, disciplines as distinct cultures  Accommodating new member communities (expectations?)  Interoperation with other grids  TeraGrid  International partners (EGEE, NorduGrid, etc.)  Multiple campus and regional grids  Education, outreach and training  Training for researchers, students  … but also project PIs, program officers  Operating a rapidly growing cyberinfrastructure  25K  100K CPUs, 4  10 PB disk  Management of and access to rapidly increasing data stores (slide)  Monitoring, accounting, achieving high utilization  Scalability of support model (slide)

33 Internet2 Presentation (Oct. 11, 2007)Paul Avery 33 Collaborative Tools: EVO Videoconferencing End-to-End Self Managed Infrastructure

34 Internet2 Presentation (Oct. 11, 2007)Paul Avery 34 REDDnet: National Networked Storage  NSF funded project  Vanderbilt  8 initial sites  Multiple disciplines  Satellite imagery  HENP  Terascale Supernova Initative  Structural Biology  Bioinformatics  Storage  500TB disk  200TB tape Brazil?

35 Internet2 Presentation (Oct. 11, 2007)Paul Avery 35 OSG Operations Model Distributed model  Scalability!  VOs, sites, providers  Rigorous problem tracking & routing  Security  Provisioning  Monitoring  Reporting Partners with EGEE operations

Download ppt "Internet2 Presentation (Oct. 11, 2007)Paul Avery 1 Paul Avery University of Florida Internet2 Meeting San Diego, CA October 11, 2007."

Similar presentations

International Grid Communities Dr. Carl Kesselman Information Sciences Institute University of Southern California.

International Grid Communities Dr. Carl Kesselman Information Sciences Institute University of Southern California.
Introduction to CMS computing CMS for summer students 7/7/09 Oliver Gutsche, Fermilab.

Introduction to CMS computing CMS for summer students 7/7/09 Oliver Gutsche, Fermilab.
Highest Energy e + e – Collider LEP at CERN 1989-2000 200 GeV ~4km radius First e + e – Collider ADA in Frascati 1961 0.2 GeV ~1m radius e + e – Colliders.

Highest Energy e + e – Collider LEP at CERN GeV ~4km radius First e + e – Collider ADA in Frascati GeV ~1m radius e + e – Colliders.
Randall Sobie The ATLAS Experiment Randall Sobie Institute for Particle Physics University of Victoria Large Hadron Collider (LHC) at CERN Laboratory ATLAS.

Randall Sobie The ATLAS Experiment Randall Sobie Institute for Particle Physics University of Victoria Large Hadron Collider (LHC) at CERN Laboratory ATLAS.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
1 Global Grid Efforts Richard Cavanaugh University of Florida.

1 Global Grid Efforts Richard Cavanaugh University of Florida.
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.

The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
HEP Prospects, J. Yu LEARN Strategy Meeting Prospects on Texas High Energy Physics Network Needs LEARN Strategy Meeting University of Texas at El Paso.

HEP Prospects, J. Yu LEARN Strategy Meeting Prospects on Texas High Energy Physics Network Needs LEARN Strategy Meeting University of Texas at El Paso.
CERN/IT/DB Multi-PB Distributed Databases Jamie Shiers IT Division, DB Group, CERN, Geneva, Switzerland February 2001.

CERN/IT/DB Multi-PB Distributed Databases Jamie Shiers IT Division, DB Group, CERN, Geneva, Switzerland February 2001.
RIT Colloquium (May 23, 2007)Paul Avery 1 Paul Avery University of Florida Physics Colloquium RIT (Rochester, NY) May 23, 2007 Open.

RIT Colloquium (May 23, 2007)Paul Avery 1 Paul Avery University of Florida Physics Colloquium RIT (Rochester, NY) May 23, 2007 Open.
Open Science Ruth Pordes Fermilab, July 17th 2006 What is OSG Where Networking fits Middleware Security Networking & OSG Outline.

Open Science Ruth Pordes Fermilab, July 17th 2006 What is OSG Where Networking fits Middleware Security Networking & OSG Outline.
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.

GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
CANS Meeting (December 1, 2004)Paul Avery1 University of Florida UltraLight U.S. Grid Projects and Open Science Grid Chinese American.

CANS Meeting (December 1, 2004)Paul Avery1 University of Florida UltraLight U.S. Grid Projects and Open Science Grid Chinese American.
1 ESnet Planning for the LHC T0-T1 Networking William E. Johnston ESnet Manager and Senior Scientist Lawrence Berkeley National Laboratory.

1 ESnet Planning for the LHC T0-T1 Networking William E. Johnston ESnet Manager and Senior Scientist Lawrence Berkeley National Laboratory.
Particle Physics and the Grid Randall Sobie Institute of Particle Physics University of Victoria Motivation Computing challenge LHC Grid Canadian requirements.

Particle Physics and the Grid Randall Sobie Institute of Particle Physics University of Victoria Motivation Computing challenge LHC Grid Canadian requirements.
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.

Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
HEP and Data Grids (Aug. 4-5, 2001)Paul Avery1 High Energy Physics and Data Grids Paul Avery University of Florida

HEP and Data Grids (Aug. 4-5, 2001)Paul Avery1 High Energy Physics and Data Grids Paul Avery University of Florida
CERN TERENA Lisbon The Grid Project Fabrizio Gagliardi CERN Information Technology Division May, 2000

CERN TERENA Lisbon The Grid Project Fabrizio Gagliardi CERN Information Technology Division May, 2000
1 Open Science Grid.. An introduction Ruth Pordes Fermilab.

1 Open Science Grid.. An introduction Ruth Pordes Fermilab.
1 Kittikul Kovitanggoon*, Burin Asavapibhop, Narumon Suwonjandee, Gurpreet Singh Chulalongkorn University, Thailand July 23, 2015 Workshop on e-Science.

1 Kittikul Kovitanggoon*, Burin Asavapibhop, Narumon Suwonjandee, Gurpreet Singh Chulalongkorn University, Thailand July 23, 2015 Workshop on e-Science.

Similar presentations

Ads by Google