Download presentation
Presentation is loading. Please wait.
Published byMadeline Pierce Modified over 8 years ago
1
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computing Update Tom Engel Scientific Computing Division National Center for Atmospheric Research Computing in the Atmospheric Sciences Workshop 11 September 2003
2
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Managed by UCAR Established 1959 66 Member & 20 Academic Affiliate Institutions
3
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Member Institutions University Corporation for Atmospheric Research Board of Trustees President Richard Anthes Finance & Administration Katy Schmoll, VP Corporate Affairs Jack Fellows, VP UCAR Office of Programs Jack Fellows, Director NCAR Tim Killeen, Director Larry Winter, Deputy Director Education & Outreach Roberta Johnson Constellation Observing System for Meteorology Ionosphere Climate (COSMIC) Cooperative Program For Operational Meteorology Education and Training (COMET) GPS Science & Technology Program (GST) Unidata Visiting Scientists Programs (VSP) Environmental & Societal Impacts Group (ESIG) High Altitude Observatory (HAO) Mesoscale & Microscale Meteorological Division (MMM) Scientific Computing Division (SCD) Research Application s Programs (RAP) Joint Office for Science Support (JOSS) Timothy Spangler Bill Kuo Mary Marlin o Rober t Harris s Michael Knölker Bob Gall Brant Foote Al Kellie Randolph Ware Mohan Ramamurthy Meg Austin Karyn Sawyer Atmospheric Chemistry Division (ACD) Atmospheric Technology Division (ATD) Advanced Study Program (ASP) Climate & Global Dynamics Division (CGD) Maurice Blackmon Al Cooper David Carlson Daniel McKenna Nat’l Science Digital Library (NSDL) David Fulker 6/03 Digital Library for Earth System Educatio n (DLESE ) Global Learning and Observation to Benefit the Environment (GLOBE) Jack Fellows UCAR
4
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Scientific Computing Division (SCD) enable the best atmospheric research in the world by providing and advancing high-performance computing technologies offer computing, research datasets, data storage, networking, and data analysis tools to advance NCAR's scientific research agenda Purpose Facility
5
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation SCD’s Computational Facilities Two Computational Facilities One Infrastructure Climate Simulation Laboratory Community Facility
6
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † Community Facility Computational Resource Usage by Discipline † To date: Oct’02-Aug’03
7
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † CSL Facility Computational Resource Usage by Discipline † To date: Oct’02-Aug’03
8
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † Total Computational Resource Usage by Discipline † To date: Oct’02-Aug’03
9
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Advanced Research Computing System At last CAS... Al Kellie announced the award of the ARCS Contract to IBM: –Fall ’01: 1.1 TFLOP upgrade to POWER3 system (blackforest)... was underway during last CAS –Fall ’02: 4.8 TFLOP † POWER4 system (bluesky) –Fall ’03: Federation switch upgrade –Fall ’04: 8.75 TFLOP † system (bluesky upgrade) A few things have changed... –Fall ’02 POWER4 capability short of contract commitment additional initiative funding from NCAR –bluesky: 38-frame, p690 (Regatta) system, 6.3 TF † capability performance commitments
10
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computational Facility
11
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Peak Computing Capacity at NCAR
12
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Bluesky diurnal workload distribution
13
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Production Workload Distribution - bluesky
14
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Production Workload Distribution - blackforest
15
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation August ’03 queue-wait times - bluesky 8-way LPARs CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:240:594220:060:22519 Regular0:351:2313660:131:312412 Economy1:494:242960:341:301059 Stand-by2:148:191160:091:061932 32-way LPARs CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:261:29250:270:4548 Regular0:291:091520:320:48116 Economy0:542:021310:411:23164 Stand-by1:002:192870:070:2346
16
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation August ’03 queue-wait times - blackforest Winterhawk-2 Nodes CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:130:305090:000:015892 Regular0:110:2922580:020:187290 Economy0:371:3116440:130:411397 Stand-by0:592:501300:221:18912 Nighthawk-2 Nodes CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs _nh0:000:024530:00 114
17
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR MSS Net Growth
18
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR MSS Growth vs. Sustained Computing
19
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation HPM Statistics HPM Statistics gathered between 07/28/03and09/03/03 bluesky 8-way bluesky 32-way blackforest WH-2 blackforest NH-2 Average % Efficiency of User Application Code 3.94.35.49.2 Average MFLOPs per CPU 143.7141.954.963.2 Average Daily Peak MFLOPS per CPU 600.2337.7238.5160.3 Average Loads per TLB miss 1491.01063.41476.163.2 Average Data TLB miss rate (/sec) 204475.5117412.6-- Average Instruction TLB miss rate (/sec) 1931.92110.8-- Average L1 cache hit rate (%) 88.789.8-- Average L2 cache miss rate (%) 6.15.0-- Average L3 cache miss rate (%) 32.931.1-- Average L2 load bandwidth (MB/sec) 1020.9869.2-- Average L3 load bandwidth (MB/sec) 38.830.8-- Average memory load bandwidth (MB/sec) 116.492.8--
20
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation bluesky workload computation rate
21
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation ARCS Status – Fall ‘03 We thought we had our future planned... Federation IPCC
22
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Commitment IPCC Scenarios Extra extra
23
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation “bluesky upgrade” IBM p690 augmentation to bluesky (Sep ’03) –+448 1.3 GHz POWER4 processors (in 14 node x 32 processor configuration) – 2.3 TFLOPs peak –+.896 TB memory, +10.5 TB disk Maintenance, Federation Switch, 2-year ARCS extension renegotiated –Federation now 2H04 option reduces risk during critical IPCC runs –Federation ECIP participation 3+4Q03 –10 TFLOP POWER5 option
24
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Peak TFLOPs at NCAR
25
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Sustained GFLOPs at NCAR
26
Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Thank You Questions?
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.