Earth System Modelling: an HPC perspective Mike Ashworth & Rupert Ford Scientific Computing Department and STFC Hartree Centre STFC Daresbury Laboratory.

Slides:

Advertisements

Similar presentations

Research Councils ICT Conference Welcome Malcolm Atkinson Director 17 th May 2004.

Advertisements

HPCx Power for the Grid Dr Alan D Simpson HPCx Project Director EPCC Technical Director.

SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.

Founded in 2010: UCL, Southampton, Oxford and Bristol Key Objectives of the Consortium: Prove the concept of shared, regional e-infrastructure services.

STFC and the UK e-Infrastructure Initiative The Hartree Centre Prof. John Bancroft Project Director, the Hartree Centre Member, e-Infrastructure Leadership.

Science City Hydrogen Energy project Robert Hudson 22 nd Jan 2010.

ARCHER: The next generation of UK National High Performance Computing Facility Dr Lorna Smith, EPCC. ARCHER CSE Deputy Director Thanks to Alan Simpson.

High-Performance Computing

The Hartree Centre & The Daresbury Research Collaboratory in association with IBM Jonathan Follows HPC activities at STFC Daresbury Laboratory.

Grid Infrastructure in the UK Neil Geddes. Why this talk ? LHC to 2020 –GridPP to 2011 –SRIF3 to 2010 ? Who was successful in SRIF3? –Thereafter ? PPARC.

Towards Better Exploitation and Economic Impact: Developing the EPSRC Partnership with the University Vince Osgood Associate Director, Economic Impact.

VO Sandpit, November 2009 NERC Big Data And what’s in it for NCEO? June 2014 Victoria Bennett CEDA (Centre for Environmental Data Archival)

Particle Physics, Nuclear Physics and Particle Astrophysics meeting October 2010 John Womersley Director, Science Programmes, STFC.

LinkSCEEM-2: A computational resource for the development of Computational Sciences in the Eastern Mediterranean Mostafa Zoubi SESAME SESAME – LinkSCEEM.

FP6 Thematic Priority 2: Information Society Technologies Dr. Neil T. M. Hamilton Executive Director.

What’s New in the Cambridge High Performance Computer Service? Mike Payne Cavendish Laboratory Director - Dr. Paul Calleja.

1 Ideas About the Future of HPC in Europe “The views expressed in this presentation are those of the author and do not necessarily reflect the views of.

Results Matter. Trust NAG. Numerical Algorithms Group Mathematics and technology for optimized performance Andrew Jones IDC HPC User Forum, Imperial College.

Information Technology Research Areas Alberto Di Meglio – CERN openlab Data acquisition and filteringComputing platforms, data analysis, simulationData.

Computational Science at STFC and the Exploitation of Novel HPC Architectures Mike Ashworth Scientific Computing Department and STFC Hartree Centre STFC.

IBM Higher Education & Research IBM Public Sector Business Using HPC as the Engine for Economic Growth Janis Landry-Lane, World-wide HPC June 1, 2012.

Kick-off University Partners Meeting September 18, 2012 Michael Owen, VP Research, Innovation & International, UOIT on behalf of Consortium partners Southern.

GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.

EPSRC Mathematical Sciences Programme David Harman – Head of Programme Katharine Bowes – Pure Mathematics Mark Bambury – Applied Mathematics Janet Edwards.

GridPP Tuesday, 23 September 2003 Tim Phillips. 2 Bristol e-Science Vision National scene Bristol e-Science Centre Issues & Challenges.

CEMS: The Facility for Climate and Environmental Monitoring from Space Victoria Bennett, ISIC/CEDA/NCEO RAL Space.

Shaping Future Science Introducing the National Science and Innovation Campuses.

1 The Strategic Research Agenda from 2014 to 2020 BDEC Wednesday, January 28 th,

Physics Steven Gottlieb, NCSA/Indiana University Lattice QCD: focus on one area I understand well. A central aim of calculations using lattice QCD is to.

Heads of Departments of Mathematical Sciences in the UK Friday 3 rd April 2009 by David Harman Head of Mathematical Sciences Programme.

John Womersley John Womersley Director, Science Programmes Science and Technology Facilities Council Technology Gateway Centres.

1 ETP4HPC Background and Future ‘Building a Globally Competitive HPC Technology Industry in Europe’

Cray Innovation Barry Bolding, Ph.D. Director of Product Marketing, Cray September 2008.

EPSRC Chemistry Grand Challenges ENGINEERING AND PHYSICAL SCIENCES RESEARCH COUNCIL Alex Berry, Physical Sciences Portfolio Manager

SEEK Welcome Malcolm Atkinson Director 12 th May 2004.

1 Overview of EPSRC Strategy The Future of HCI in the UK 14 th June 2007 Claire Hinchliffe.

STFC Strategy and Accelerators John Womersley STFC Director, Science Programmes Institute of Physics Particle Accelerators and Beams Group July 2009.

1 NSF/TeraGrid Science Advisory Board Meeting July 19-20, San Diego, CA Brief TeraGrid Overview and Expectations of Science Advisory Board John Towns TeraGrid.

Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.

HP-SEE High-Performance Computing Infrastructure for South East Europe’s Research Communities 8th e-Infrastructure Concertation Meeting,

Comprehensive Scientific Support Of Large Scale Parallel Computation David Skinner, NERSC.

Steve Worm – Gateway CentresApril 25, The Gateway Centres and their context in the STFC Strategy Steve Worm Rutherford Appleton Laboratory.

Stephen Kemp PROGRAMME GRANTS ENGINEERING AND PHYSICAL SCIENCES RESEARCH COUNCIL.

DiRAC-3 – The future Jeremy Yates, STFC DiRAC HPC Facility.

NICS Update Bruce Loftis 16 December National Institute for Computational Sciences University of Tennessee and ORNL partnership  NICS is the 2.

Professor Arthur Trew Director, EPCC EPCC: KT in novel computing.

Science Support for Phase 4 Dr Alan D Simpson HPCx Project Director EPCC Technical Director.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI strategy and Grand Vision Ludek Matyska EGI Council Chair EGI InSPIRE.

Introduction to Hartree Centre Resources: IBM iDataPlex Cluster and Training Workstations Rob Allan Scientific Computing Department STFC Daresbury Laboratory.

Sensors and Instrumentation Computational and Data Challenges in Environmental Modelling Dr Peter M Allan Director, Hartree Centre, STFC.

1 Kostas Glinos European Commission - DG INFSO Head of Unit, Géant and e-Infrastructures "The views expressed in this presentation are those of the author.

UK X-FEL National Laboratory Perspective Susan Smith STFC ASTeC IoP PAB/STFC Workshop Towards a UK XFEL 16 th February 2016.

Petascale Computing Resource Allocations PRAC – NSF Ed Walker, NSF CISE/ACI March 3,

1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.

STFC’s National Laboratories Round Table on Synergies and Complementarity among Laboratories John Womersley Chief Executive, STFC 13 th Pisa meeting on.

NERC Innovation Oil & Gas Challenging Environments Workshop 17 th October 2014.

European Perspective on Distributed Computing Luis C. Busquets Pérez European Commission - DG CONNECT eInfrastructures 17 September 2013.

Profiling and Characterising Software Application Energy Consumption Ian Osborne ICT KTN and EEC SIG.

Driving Innovation Technology Strategy Board The UK’s agency for business innovation –Business benefit –Economic growth –Quality of life.

Research Councils UK and the research funding landscape Name Job title Research Councils UK.

Challenge Led Applied Systems Programme (CLASP) Energy and Environment Call Information and Networking day 5 July 2016 Professor John Lees University of.

Centre of Excellence in Physics at Extreme Scales Richard Kenway.

H2020, COEs and PRACE.

LinkSCEEM-2: A computational resource for the development of Computational Sciences in the Eastern Mediterranean Mostafa Zoubi SESAME Outreach SESAME,

FET Plans FET - Proactive 1.

National e-Infrastructure Vision

UK Status and Plans Scientific Computing Forum 27th Oct 2017

ICT NCP Infoday Brussels, 23 June 2010

The Hartree Centre STFC’s high performance computing, data analytics and cognitive computing (or AI) research centre Provides businesses and researchers.

Brian Matthews STFC EOSCpilot Brian Matthews STFC

Presentation transcript:

Earth System Modelling: an HPC perspective Mike Ashworth & Rupert Ford Scientific Computing Department and STFC Hartree Centre STFC Daresbury Laboratory

The Hartree Centre and other STFC developments Mike Ashworth Head of Division Scientific Computing Department STFC Daresbury Laboratory

STFC’s Scientific Computing Department

Major funded activities 160 staff supporting over 7500 users Applications development and support Compute and data facilities and services Research: over 100 publications per annum Deliver over 3500 training days per annum Systems administration, data services, high-performance computing, numerical analysis & software engineering. Major science themes and capabilities Expertise across the length and time scales from processes occurring inside atoms to environmental modelling Scientific Computing Department Director: Adrian Wander Appointed 24th July 2012

STFC’s Hartree Centre

Hartree Centre Mission Hartree Centre at the STFC Daresbury Science and Innovation Campus will be an International Centre of Excellence for Computational Science and Engineering. It will bring together academic, government and industry communities and focus on multi-disciplinary, multi-scale, efficient and effective computation. The goal is to provide a step-change in modelling capabilities for strategic themes including energy, life sciences, the environment, materials and security.

Opportunities Political Opportunity Business Opportunity Scientific Opportunity Technical Opportunity Demonstrate growth through economic and societal impact from investments in HPC Engage industry in HPC simulation for competitive advantage Exploit multi-core Exploit new Petascale and Exascale architectures Adapt to multi-core and hybrid architectures Build multi-scale, multi- physics coupled apps Tackle complex Grand Challenge problems

Government Investment in e-infrastructure 17 th Aug 2011: Prime Minister David Cameron confirmed £10M investment into STFC's Daresbury Laboratory. £7.5M for computing infrastructure 3 rd Oct 2011: Chancellor George Osborne announced £145M for e-infrastructure at the Conservative Party Conference 4 th Oct 2011: Science Minister David Willetts indicated £30M investment in Hartree Centre 30 th Mar 2012: John Womersley CEO STFC and Simon Pendlebury IBM signed major collaboration at the Hartree Centre Clockwise from top left

Tildesley Report BIS commissioned a report on the strategic vision for a UK e-Infrastructure for Science and Business. Prof Dominic Tildesley led the team including representatives from Universities, Research Councils, industry and JANET. The scope included compute, software, data, networks, training and security. Mike Ashworth, Richard Blake and John Bancroft from STFC provided input. Published in December Google the title to download from the BIS website

Hartree Centre capital spend 2011/12 approximate capital spend £M Total £37.5M

TOP500 #16in the Nov 2012 list #5 in Europe #1 system in UK 6 racks 98,304 cores 6144 nodes 16 cores & 16 GB per node 1.26 Pflop/s peak 1 rack of BGAS (Blue Gene Advanced Storage) 16,384 cores Up to 1PB Flash memory Hartree Centre IBM BG/Q Blue Joule

Hartree Centre IBM iDataPlex Blue Wonder TOP500 #158in the Nov 2012 list 8192 cores, 196 Tflop/s peak node has 16 cores, 2 sockets Intel Sandy Bridge (AVX etc.) 252 nodes with 32 GB 4 nodes with 256 GB 12 nodes with X3090 GPUs 256 nodes with 128 GB ScaleMP virtualization software up to 4TB virtual shared memory

Hartree Centre Datastore Storage: 5.76 PB usable disk storage 15 PB tape store

Hartree Centre Visualization Four major facilities: Hartree Vis-1:a large visualization “wall” supporting stereo Hartree Vis-2:a large surround and immersive visualization system Hartree ISIC: a large visualization “wall” supporting stereo at ISIC Hartree Atlas:a large visualization “wall” supporting stereo in the Atlas Building at RAL, part of the Harwell Imaging Partnership (HIP) Virtalis is the hardware supplier

The Hartree Centre and HECToR/ ARCHER Hartree Centre is complementary to the UK National Super- computing Services, managed by EPSRC on behalf of the UK academic communities HECToR is the current system HECToR Phase3 90,112 cores Cray XT6 (800 Tflop/s) ARCHER is the new service, due for installation around Nov/Dec 2013, service starting in early 2014 HECToR/ARCHER provide cycles with limited science support Hartree focuses on next generation software development

Early Access programme: Access to BlueGene/Q and/or iDataPlex Three months duration Typical resources up to 20 million CPU hours BlueGene/Q Basic system with editors, compilers, batch system No guarantee of access No guarantee of software support Started in November 2012 Contact us for an application form Hartree Centre Early Access

Hartree Centre Typical Project “External”: research councils, industry, government PSREs “IBM”:also OCF, Intel, nVIDIA, Mellanox, DDN, ScaleMP “STFC”: includes system time and staff effort Focus on software development for next generation applications, with Grand Challenge science objectives and/or industrial/government impact

Hartree Centre Contacts Mike Ashworth Rupert

If you have been … … thank you for listening Mike Ashworth