Presentation is loading. Please wait.

Presentation is loading. Please wait.

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computing Update Tom Engel Scientific.

Similar presentations


Presentation on theme: "Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computing Update Tom Engel Scientific."— Presentation transcript:

1 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computing Update Tom Engel Scientific Computing Division National Center for Atmospheric Research Computing in the Atmospheric Sciences Workshop 11 September 2003

2 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Managed by UCAR Established 1959 66 Member & 20 Academic Affiliate Institutions

3 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Member Institutions University Corporation for Atmospheric Research Board of Trustees President Richard Anthes Finance & Administration Katy Schmoll, VP Corporate Affairs Jack Fellows, VP UCAR Office of Programs Jack Fellows, Director NCAR Tim Killeen, Director Larry Winter, Deputy Director Education & Outreach Roberta Johnson Constellation Observing System for Meteorology Ionosphere Climate (COSMIC) Cooperative Program For Operational Meteorology Education and Training (COMET) GPS Science & Technology Program (GST) Unidata Visiting Scientists Programs (VSP) Environmental & Societal Impacts Group (ESIG) High Altitude Observatory (HAO) Mesoscale & Microscale Meteorological Division (MMM) Scientific Computing Division (SCD) Research Application s Programs (RAP) Joint Office for Science Support (JOSS) Timothy Spangler Bill Kuo Mary Marlin o Rober t Harris s Michael Knölker Bob Gall Brant Foote Al Kellie Randolph Ware Mohan Ramamurthy Meg Austin Karyn Sawyer Atmospheric Chemistry Division (ACD) Atmospheric Technology Division (ATD) Advanced Study Program (ASP) Climate & Global Dynamics Division (CGD) Maurice Blackmon Al Cooper David Carlson Daniel McKenna Nat’l Science Digital Library (NSDL) David Fulker 6/03 Digital Library for Earth System Educatio n (DLESE ) Global Learning and Observation to Benefit the Environment (GLOBE) Jack Fellows UCAR

4 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Scientific Computing Division (SCD) enable the best atmospheric research in the world by providing and advancing high-performance computing technologies offer computing, research datasets, data storage, networking, and data analysis tools to advance NCAR's scientific research agenda Purpose Facility

5 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation SCD’s Computational Facilities Two Computational Facilities One Infrastructure Climate Simulation Laboratory Community Facility

6 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † Community Facility Computational Resource Usage by Discipline † To date: Oct’02-Aug’03

7 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † CSL Facility Computational Resource Usage by Discipline † To date: Oct’02-Aug’03

8 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † Total Computational Resource Usage by Discipline † To date: Oct’02-Aug’03

9 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Advanced Research Computing System At last CAS... Al Kellie announced the award of the ARCS Contract to IBM: –Fall ’01: 1.1 TFLOP upgrade to POWER3 system (blackforest)... was underway during last CAS –Fall ’02: 4.8 TFLOP † POWER4 system (bluesky) –Fall ’03: Federation switch upgrade –Fall ’04: 8.75 TFLOP † system (bluesky upgrade) A few things have changed... –Fall ’02 POWER4 capability short of contract commitment additional initiative funding from NCAR –bluesky: 38-frame, p690 (Regatta) system, 6.3 TF † capability performance commitments

10 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computational Facility

11 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Peak Computing Capacity at NCAR

12 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Bluesky diurnal workload distribution

13 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Production Workload Distribution - bluesky

14 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Production Workload Distribution - blackforest

15 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation August ’03 queue-wait times - bluesky 8-way LPARs CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:240:594220:060:22519 Regular0:351:2313660:131:312412 Economy1:494:242960:341:301059 Stand-by2:148:191160:091:061932 32-way LPARs CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:261:29250:270:4548 Regular0:291:091520:320:48116 Economy0:542:021310:411:23164 Stand-by1:002:192870:070:2346

16 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation August ’03 queue-wait times - blackforest Winterhawk-2 Nodes CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:130:305090:000:015892 Regular0:110:2922580:020:187290 Economy0:371:3116440:130:411397 Stand-by0:592:501300:221:18912 Nighthawk-2 Nodes CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs _nh0:000:024530:00 114

17 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR MSS Net Growth

18 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR MSS Growth vs. Sustained Computing

19 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation HPM Statistics HPM Statistics gathered between 07/28/03and09/03/03 bluesky 8-way bluesky 32-way blackforest WH-2 blackforest NH-2 Average % Efficiency of User Application Code 3.94.35.49.2 Average MFLOPs per CPU 143.7141.954.963.2 Average Daily Peak MFLOPS per CPU 600.2337.7238.5160.3 Average Loads per TLB miss 1491.01063.41476.163.2 Average Data TLB miss rate (/sec) 204475.5117412.6-- Average Instruction TLB miss rate (/sec) 1931.92110.8-- Average L1 cache hit rate (%) 88.789.8-- Average L2 cache miss rate (%) 6.15.0-- Average L3 cache miss rate (%) 32.931.1-- Average L2 load bandwidth (MB/sec) 1020.9869.2-- Average L3 load bandwidth (MB/sec) 38.830.8-- Average memory load bandwidth (MB/sec) 116.492.8--

20 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation bluesky workload computation rate

21 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation ARCS Status – Fall ‘03 We thought we had our future planned... Federation IPCC

22 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Commitment IPCC Scenarios Extra extra

23 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation “bluesky upgrade” IBM p690 augmentation to bluesky (Sep ’03) –+448 1.3 GHz POWER4 processors (in 14 node x 32 processor configuration) – 2.3 TFLOPs peak –+.896 TB memory, +10.5 TB disk Maintenance, Federation Switch, 2-year ARCS extension renegotiated –Federation now 2H04 option reduces risk during critical IPCC runs –Federation ECIP participation 3+4Q03 –10 TFLOP POWER5 option

24 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Peak TFLOPs at NCAR

25 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Sustained GFLOPs at NCAR

26 Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Thank You Questions?


Download ppt "Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computing Update Tom Engel Scientific."

Similar presentations


Ads by Google