Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computing Update Tom Engel Scientific.

Slides:

Advertisements

Similar presentations

O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY Center for Computational Sciences Cray X1 and Black Widow at ORNL Center for Computational.

Advertisements

Review of NCAR Al Kellie SCD Director November 01, 2001.

Supercomputing Challenges at the National Center for Atmospheric Research Dr. Richard Loft Computational Science Section Scientific Computing Division.

Tim Spangler 16 October 2009 Where is My Tie? Or, My Personal Journey with Unidata.

GENI: Global Environment for Networking Innovations Larry Landweber Senior Advisor NSF:CISE Joint Techs Madison, WI July 17, 2006.

Office of the Vice President for Research Research Trends Richard O. Buckius Vice President for Research Academic Leadership Forum March 31, 2010.

SDSC Computing the 21st Century Talk Given to the NSF Sugar Panel May 27, 1998.

IBM RS6000/SP Overview Advanced IBM Unix computers series Multiple different configurations Available from entry level to high-end machines. POWER (1,2,3,4)

The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.

BERAC Charge A recognized strength of the Office of Science, and BER is no exception, is the development of tools and technologies that enable science.

1 Cooperative Institute for Research in the Atmosphere CIRA Colorado State University An Overview Prepared by: Mary McInnis-Efaw Department Manager, CIRA.

Training and Education for NOAA Space-based Remote Sensing Programs – FY06 to FY10 Anthony Mostek NWS – OCWWS – Training Division – VISIT Anthony Mostek.

Overview of the National Science Foundation (NSF) and the Major Research Instrumentation (MRI) Program Office of Integrative Activities National Science.

HSRP Spring Meeting May 4, 2011 David M. Kennedy.

Jordan G. Powers Mesoscale and Microscale Meteorology Division NCAR Earth System Laboratory National Center for Atmospheric Research Space Weather Workshop.

So I am graduating soon…Now what 1 Marla Meehl Manager of the Network Engineering and Telecommunications Section (NETS) Computational & Information Systems.

October 16-18, Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.

Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.

The Interactive Ensemble Coupled Modeling Strategy Ben Kirtman Center for Ocean-Land-Atmosphere Studies And George Mason University.

Software Engineering Committee Status Report to the Community: Preliminary Recommendations Richard Loft and Gerry Wiener SE Committee Co-chairs National.

© Crown copyright Met Office Open Platform and ACRE

UCAR Office of Programs Status Report URC Meeting April 2007 Jack Fellows Vice President of Corporate Affairs and Director of UOP Director of UOP.

2005 UCAR Office of Program Annual Report Jack Fellows,UOP Director Open House. Not going over the Annual Report -- I’ll be summarizing UOP and its programs.

Basic Energy Sciences Advisory Committee Meeting March 3, 2010 Overview of the DOE Office of Science Graduate Fellowship Program Julie Carruthers, Ph.D.

Unidata Policy Committee Meeting Bernard M. Grant, Assistant Program Coordinator for the Atmospheric and Geospace Sciences Division May 2012 NSF.

The University Corporation for Atmospheric Research UCAR an overview.

Tempe-Feb The National Science Foundation CISE –ANIR Infrastructure programs THOMAS J. GREENE, Ph.D. Senior Program Director, Advanced Networking.

Computing Environment in Chinese Academy of Sciences Dr. Xue-bin Dr. Zhonghua Supercomputing Center Computer Network.

NCAR Annual Budget Review October 8, 2007 Tim Killeen NCAR Director.

Disaster Dynamics Five Year Plan 03-Dec Scientific Goals Disaster Dynamics transform descriptive case studies of natural hazard events into interactive.

Office of the Federal Coordinator for Meteorology OFCM Opening Remarks and WG/WIST Activities Update Paul Pisano Mike Campbell WG/WIST Cochairs June 6,

Outline IT Organization SciComp Update CNI Update

“A Library outranks any other one thing a community can do to benefit its people.” Andrew Carnegie Mary R. Marlino, Ed.D. DLESE Program Center Presentation.

PRESENTATION TO FACILITIES INFORMATION SYSTEM USERS OCTOBER 2013 CORPORATE CONTROLLER’S OFFICE JODY MURAWSKI COST ANALYSIS BEVERLY LIPSKI, BILL RIDGWAY.

Angèle Simard Canadian Meteorological Center Meteorological Service of Canada MSC Computing Update.

Welcome to the National Center for Atmospheric Research Kyle Ham Education and Outreach July 8, 2010.

NSF Programs and Possibilities Research Linkages EU-US 23 September 2004 Sylvia Spengler US National Science Foundation.

NCAR Supercomputing ‘Data Center’ Project An NCAR-led computing ‘facility’ for the study of the Earth system May 30, 2006.

14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.

Software Engineering Committee Status Report: Preliminary Findings and Recommendations Richard Loft and Gerry Wiener SE Committee Co-chairs National Center.

ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.

SCD Update Tom Bettge Deputy Director Scientific Computing Division National Center for Atmospheric Research Boulder, CO USA User Forum May 2005.

NCAR Undergraduate Leadership Workshop. What is NCAR?  National Center for Atmospheric Research  Located in Boulder Colorado  Managed by University.

1 UCAR 2009 Community Survey and Comparison with 2000 and 2004 surveys PACUR 27 April 2009 Rick Anthes.

Science Advisory Board Public Session 1 1 Peter Schultz, Ph.D. Associate Director for Science Integration Climate Change Science Program Office CCSP Update.

Computing Environment The computing environment rapidly evolving ‑ you need to know not only the methods, but also How and when to apply them, Which computers.

Center for Advanced Energy Studies Harold S. Blackman Interim Director, CAES July 18, 2007.

Africa Initiative: An Update UMC Meeting 19 December, 2006.

NCAR Realignment. What is UCAR? Structure: Non-profit consortium formed in 1959 to focus on scientific problems that are beyond the scale of a few universities.

11 January 2005 High Performance Computing at NCAR Tom Bettge Deputy Director Scientific Computing Division National Center for Atmospheric Research Boulder,

TeraGrid Quarterly Meeting Arlington, VA Sep 6-7, 2007 NCSA RP Status Report.

UCAR and NCAR at is UCAR and NCAR’s 50 th Anniversary HAO’s 70 th Anniversary COMET’s 20 th Anniversary Unidata’s 25 th Anniversary

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE Capability Computing: Performance, Usage, Tflops Peter R. Taylor San Diego Supercomputer.

NCAR RP Update Rich Loft NCAR RPPI May 7, NCAR Teragrid RP Developments Current Cyberinfrastructure –5.7 TFlops/2048 core Blue Gene/L system –100.

National Center for Atmospheric Research Boulder, Colorado USA.

SCD User Briefing The Community Data Portal and the Earth System Grid Don Middleton with presentation material developed by Luca Cinquini, Mary Haley,

NICS Update Bruce Loftis 16 December National Institute for Computational Sciences University of Tennessee and ORNL partnership  NICS is the 2.

For Presentation at 28 th APEC Transportation Working Group Meeting Vancouver, Canada Walter Kulyk Director, Office of Mobility Innovation Federal Transit.

Support to scientific research on seasonal-to-decadal climate and air quality modelling Pierre-Antoine Bretonnière Francesco Benincasa IC3-BSC - Spain.

High Risk 1. Ensure productive use of GRID computing through participation of biologists to shape the development of the GRID. 2. Develop user-friendly.

1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.

Phoenix Convention Center Phoenix, Arizona The Next Network: Lighting, Controls and the Internet of Things Track 3: Energy Technologies August 12, 2015.

INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.

Strategic Planning Update

DOE Facilities - Drivers for Science: Experimental and Simulation Data

NSF facilities User Workshop

Africa Initiative Dave Burridge Visit.

SPACE II Presentation to Facilities Information System Users Fall 2005

Comeaux and Worley, NSF/NCAR/SCD

Presentation transcript:

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computing Update Tom Engel Scientific Computing Division National Center for Atmospheric Research Computing in the Atmospheric Sciences Workshop 11 September 2003

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Managed by UCAR Established Member & 20 Academic Affiliate Institutions

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Member Institutions University Corporation for Atmospheric Research Board of Trustees President Richard Anthes Finance & Administration Katy Schmoll, VP Corporate Affairs Jack Fellows, VP UCAR Office of Programs Jack Fellows, Director NCAR Tim Killeen, Director Larry Winter, Deputy Director Education & Outreach Roberta Johnson Constellation Observing System for Meteorology Ionosphere Climate (COSMIC) Cooperative Program For Operational Meteorology Education and Training (COMET) GPS Science & Technology Program (GST) Unidata Visiting Scientists Programs (VSP) Environmental & Societal Impacts Group (ESIG) High Altitude Observatory (HAO) Mesoscale & Microscale Meteorological Division (MMM) Scientific Computing Division (SCD) Research Application s Programs (RAP) Joint Office for Science Support (JOSS) Timothy Spangler Bill Kuo Mary Marlin o Rober t Harris s Michael Knölker Bob Gall Brant Foote Al Kellie Randolph Ware Mohan Ramamurthy Meg Austin Karyn Sawyer Atmospheric Chemistry Division (ACD) Atmospheric Technology Division (ATD) Advanced Study Program (ASP) Climate & Global Dynamics Division (CGD) Maurice Blackmon Al Cooper David Carlson Daniel McKenna Nat’l Science Digital Library (NSDL) David Fulker 6/03 Digital Library for Earth System Educatio n (DLESE ) Global Learning and Observation to Benefit the Environment (GLOBE) Jack Fellows UCAR

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Scientific Computing Division (SCD) enable the best atmospheric research in the world by providing and advancing high-performance computing technologies offer computing, research datasets, data storage, networking, and data analysis tools to advance NCAR's scientific research agenda Purpose Facility

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation SCD’s Computational Facilities Two Computational Facilities One Infrastructure Climate Simulation Laboratory Community Facility

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † Community Facility Computational Resource Usage by Discipline † To date: Oct’02-Aug’03

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † CSL Facility Computational Resource Usage by Discipline † To date: Oct’02-Aug’03

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation FY2003 † Total Computational Resource Usage by Discipline † To date: Oct’02-Aug’03

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Advanced Research Computing System At last CAS... Al Kellie announced the award of the ARCS Contract to IBM: –Fall ’01: 1.1 TFLOP upgrade to POWER3 system (blackforest)... was underway during last CAS –Fall ’02: 4.8 TFLOP † POWER4 system (bluesky) –Fall ’03: Federation switch upgrade –Fall ’04: 8.75 TFLOP † system (bluesky upgrade) A few things have changed... –Fall ’02 POWER4 capability short of contract commitment additional initiative funding from NCAR –bluesky: 38-frame, p690 (Regatta) system, 6.3 TF † capability performance commitments

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR Computational Facility

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Peak Computing Capacity at NCAR

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Bluesky diurnal workload distribution

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Production Workload Distribution - bluesky

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Production Workload Distribution - blackforest

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation August ’03 queue-wait times - bluesky 8-way LPARs CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:240:594220:060:22519 Regular0:351: :131: Economy1:494:242960:341: Stand-by2:148:191160:091: way LPARs CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:261:29250:270:4548 Regular0:291:091520:320:48116 Economy0:542:021310:411:23164 Stand-by1:002:192870:070:2346

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation August ’03 queue-wait times - blackforest Winterhawk-2 Nodes CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs Premium0:130:305090:000: Regular0:110: :020: Economy0:371: :130: Stand-by0:592:501300:221:18912 Nighthawk-2 Nodes CSLCommunity Average Job Wait Time (min) Standard Deviation# Jobs Average Job Wait Time (min) Standard Deviation# Jobs _nh0:000:024530:00 114

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR MSS Net Growth

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation NCAR MSS Growth vs. Sustained Computing

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation HPM Statistics HPM Statistics gathered between 07/28/03and09/03/03 bluesky 8-way bluesky 32-way blackforest WH-2 blackforest NH-2 Average % Efficiency of User Application Code Average MFLOPs per CPU Average Daily Peak MFLOPS per CPU Average Loads per TLB miss Average Data TLB miss rate (/sec) Average Instruction TLB miss rate (/sec) Average L1 cache hit rate (%) Average L2 cache miss rate (%) Average L3 cache miss rate (%) Average L2 load bandwidth (MB/sec) Average L3 load bandwidth (MB/sec) Average memory load bandwidth (MB/sec)

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation bluesky workload computation rate

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation ARCS Status – Fall ‘03 We thought we had our future planned... Federation IPCC

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Commitment IPCC Scenarios Extra extra

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation “bluesky upgrade” IBM p690 augmentation to bluesky (Sep ’03) – GHz POWER4 processors (in 14 node x 32 processor configuration) – 2.3 TFLOPs peak –+.896 TB memory, TB disk Maintenance, Federation Switch, 2-year ARCS extension renegotiated –Federation now 2H04 option reduces risk during critical IPCC runs –Federation ECIP participation 3+4Q03 –10 TFLOP POWER5 option

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Peak TFLOPs at NCAR

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Sustained GFLOPs at NCAR

Copyright © 2003 University Corporation for Atmospheric ResearchSponsored by the National Science Foundation Thank You Questions?