Recent developments at DMI Jacob Brock Weather, climate and sea.

Slides:



Advertisements
Similar presentations
1 National Institute of Meteorology Brazil - INMET The NWP System at INMET COSMO Model Gilberto Ricardo Bonatti Antônio Cardoso Neto REUNIÓN DE EXPERTOS.
Advertisements

EUM/SEP/VWG/13/ Issue 1 21/05/2013 Product Visualisation & Analysis Tool EUMETSAT presentation to EGOWS 2013 Richard Bosworth.
Open data based RWIS for mobile devices Mikael Holmström, Intrinsic Oy.
Information Technology Center Introduction to High Performance Computing at KFUPM.
1 Presented by: Dave Bresson & Eric Hermann, Kishwaukee College May 21, 2013 The Migration An Unexpected Journey (from Oracle to SQL)
ASKAP Central Processor: Design and Implementation Calibration and Imaging Workshop 2014 ASTRONOMY AND SPACE SCIENCE Ben Humphreys | ASKAP Software and.
A short demo …. VejVejr is an internetbased surveillance and forecasting system, developed by DMI and Vejdirektoratet. VejVejr provides any tools needed.
Novell Server Linux vs. windows server 2008 By: Gabe Miller.
HELICS Petteri Johansson & Ilkka Uuhiniemi. HELICS COW –AMD Athlon MP 1.4Ghz –512 (2 in same computing node) –35 at top500.org –Linpack Benchmark 825.
Supercomputers Daniel Shin CS 147, Section 1 April 29, 2010.
1 PSC update July 3, 2008 Ralph Roskies, Scientific Director Pittsburgh Supercomputing Center
Computing Resources Joachim Wagner Overview CNGL Cluster MT Group Cluster School Cluster Desktop PCs.
Earth Simulator Jari Halla-aho Pekka Keränen. Architecture MIMD type distributed memory 640 Nodes, 8 vector processors each. 16GB shared memory per node.
DMI Update Leif Laursen ( ) Jan Boerhout ( ) CAS2K3, September 7-11, 2003 Annecy, France.
Plans for Exploitation of the ORNL Titan Machine Richard P. Mount ATLAS Distributed Computing Technical Interchange Meeting May 17, 2013.
Overview of the ODP Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal technology, Buenos.
NCEP Central Operations Capabilities “Where America’s Climate, Weather, Ocean, and Space Prediction Services Begin” Brent Gordon NCEP/NCO/Systems Integration.
Loris Giovannini, Mauro Giacchini Epics Collaboration Meeting
ICT in Weather Forecasting
SDSC RP Update TeraGrid Roundtable Reviewing Dash Unique characteristics: –A pre-production/evaluation “data-intensive” supercomputer based.
Is Apache CouchDB for you?
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Introduction to the HPCC Jim Leikert System Administrator High Performance Computing Center.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Service Review and Plans Carmine Cioffi Database Administrator and Developer 3D Workshop, Barcelona (ES), April 2009.
These materials are prepared only for the students enrolled in the course Distributed Software Development (DSD) at the Department of Computer.
Introduction to the HPCC Dirk Colbry Research Specialist Institute for Cyber Enabled Research.
Z-Geoinfo Inc. Capability Briefing June 21, 2011.
The Cray XC30 “Darter” System Daniel Lucio. The Darter Supercomputer.
Sun Fire™ E25K Server Keith Schoby Midwestern State University June 13, 2005.
NWP Activities at INM Bartolomé Orfila Estrada Area de Modelización - INM 28th EWGLAM & 13th SRNWP Meetings Zürich, October 2005.
The Red Storm High Performance Computer March 19, 2008 Sue Kelly Sandia National Laboratories Abstract: Sandia National.
Business Intelligence Appliance Powerful pay as you grow BI solutions with Engineered Systems.
Experience with COSMO MPI/OpenMP hybrid parallelization Matthew Cordery, William Sawyer Swiss National Supercomputing Centre Ulrich Schättler Deutscher.
Jaguar Super Computer Topics Covered Introduction Architecture Location & Cost Bench Mark Results Location & Manufacturer Machines in top 500 Operating.
Angèle Simard Canadian Meteorological Center Meteorological Service of Canada MSC Computing Update.
HPC system for Meteorological research at HUS Meeting the challenges Nguyen Trung Kien Hanoi University of Science Melbourne, December 11 th, 2012 High.
Cray XT3 Experience so far Horizon Grows Bigger Richard Alexander 24 January 2006
1 Monday, 26 October 2015 © Crown copyright Met Office Computing Update Paul Selwood, Met Office.
ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
2009/4/21 Third French-Japanese PAAP Workshop 1 A Volumetric 3-D FFT on Clusters of Multi-Core Processors Daisuke Takahashi University of Tsukuba, Japan.
Chapter 9: Weather Forecasting Surface weather maps 500mb weather maps Satellite Images Radar Images.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
Rob Allan Daresbury Laboratory NW-GRID Training Event 25 th January 2007 Introduction to NW-GRID R.J. Allan CCLRC Daresbury Laboratory.
1 Cray Inc. 11/28/2015 Cray Inc Slide 2 Cray Cray Adaptive Supercomputing Vision Cray moves to Linux-base OS Cray Introduces CX1 Cray moves.
Computing Environment The computing environment rapidly evolving ‑ you need to know not only the methods, but also How and when to apply them, Which computers.
Parallel Computing With High Performance Computing Clusters (HPCs) By Jeremy Cathey.
Cray Environmental Industry Solutions Per Nyberg Earth Sciences Business Manager Annecy CAS2K3 Sept 2003.
PSC’s CRAY-XT3 Preparation and Installation Timeline.
NWP Activities at INM José A. García-Moya SMNT – INM 27th EWGLAM & 12th SRNWP Meetings Ljubljana, October 2005.
2011/08/23 國家高速網路與計算中心 Advanced Large-scale Parallel Supercluster.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
1 SAFNWC/MSG User Survey Results & WORKSHOP DISCUSSION AND OUTPUT 18 th October 2005 Madrid Marcelino Manso Rejón Instituto Nacional de Meteorología.
Presented by NCCS Hardware Jim Rogers Director of Operations National Center for Computational Sciences.
Parallel Computers Today Oak Ridge / Cray Jaguar > 1.75 PFLOPS Two Nvidia 8800 GPUs > 1 TFLOPS Intel 80- core chip > 1 TFLOPS  TFLOPS = floating.
Scheduling a 100,000 Core Supercomputer for Maximum Utilization and Capability September 2010 Phil Andrews Patricia Kovatch Victor Hazlewood Troy Baer.
Linux Operating System By: Julie Dunbar. Overview Definitions History and evolution of Linux Current development In reality ◦United States  Business.
Architecture of a platform for innovation and research Erik Deumens – University of Florida SC15 – Austin – Nov 17, 2015.
Page : 1 SC2004 Pittsburgh, November 12, 2004 DEISA : integrating HPC infrastructures in Europe DEISA : integrating HPC infrastructures in Europe Victor.
Creating Grid Resources for Undergraduate Coursework John N. Huffman Brown University Richard Repasky Indiana University Joseph Rinkovsky Indiana University.
Scientific Linux Inventory Project (SLIP) Troy Dawson Connie Sieh.
FusionCube At-a-Glance. 1 Application Scenarios Enterprise Cloud Data Centers Desktop Cloud Database Application Acceleration Midrange Computer Substitution.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
Plans for the National NERC HPC services UM vn 6.1 installations and performance UM vn 6.6 and NEMO(?) plans.
Installing Windows 7 Lesson 2.
SMHI operational HIRLAM EWGLAM October , OSLO Lars Meuller SMHI
Super Computing By RIsaj t r S3 ece, roll 50.
Cray Announces Cray Inc.
Refactoring Meteorology's Online Weather Center Software Suite
Presentation transcript:

Recent developments at DMI Jacob Brock Weather, climate and sea

Recent developments at DMI An administrative change NinJo: Operational introduction and continued development A new supercomputer Road Weather Information System Graphical Production System

An administrative change

NinJo

Deployed operationally Dec data types: -Observations -Model data (HIRLAM) -Radar -Satellite In parallel with old system

NinJo Lightning data, more models added Experiences (subjective) –Younger users more likely to use NinJo –Good super users gives better acceptance –Don’t try to limit the users

AalOprSkpOprResOpr KarupOpr LyvOpr LyvTreLyvDevLyvTest LyvLocal

New supercomputer

Supercomputer Replacing the current NEC SX6 with a Cray in 4 steps: –An XT4 as an ”early migration system” in parallel with the NEC has been installed –The XT4 takes over all applications and the NEC is closed down (scheduled 16 July) –The NEC is disassembled and a Cray XT5 put in instead –The XT5 to be turned on late october and take over all applications before the end of the year

Cray XT: Homogenous Architecture, scalable nodes XT4 2.6 Ghz AMD Opteron DualCore 1 cabinet MPP 4 login nodes 76 compute nodes = 152 compute cores 336 Gb RAM 790 Gflops peak perf. 9 Tb disk XT5 2.4 Ghz AMD Opteron QuadCore 6 cabinets MPP ? login nodes 912 compute nodes = 3648 compute cores 7.3 Tb RAM 35 Tflops peak perf 110 Tb disk

Supercomputer Software - loginnodes have full SuSE Enterprise Linux - compute nodes have Compute Node Linux (speciel kernel and version of SuSE) - third party compilers, amongst others PGI, PathScale, Gnu GCC Cost - Cray XT4/5, 6 million € - refurbishing of machine hall ~ € - other costs ~ €

XT4 ”Odin”

Road Weather Information System

Road Weather Information System Once it was MFC C++ Then it became JavaScript But that was too slow so… Now reimplemented in pure Java, using Java WebStart for updgrading

The Challenge: Provide complex meteorological information in a non-complex format The Construction Syndicate: Road People Weather People IT People The Users: Basicly everyone with interests in slippery road conditions…

The Users: Basicly everyone with interests in slippery road conditions :  Road authorities, State, Region, Community, City….  Entrepreneurs  Airports  Harbours  Hospitals  Other authorities… User spectre : Owner of truck or shovel, may have drivers license Engineer, who is a full time computer- and weathernerd

Current conditionForecast status 5 hours Local map

Long forecast ~330 stations !

Area forecast Comments from meteorologist

Radar images (Precipitation) Rain Mix Snow FRZ precip

Web-cams

The system is continously improved Feed-back from users Performance continuously verified Day seminar every year Next season: Exchanging data with Schleswig – Holstein (Northern Germany)

Graphical Production System

Graphical Production System So far based on a locally developed program Written in MFC C++, no further development Can only generate pixel-based images Does not scale very well New product = new extraction + new graphics + new dissemination

Graphical Production System Requirements for new system –Based on common standards –Deliver both pixel and vector graphics Illustrator CS-series chosen –Be scalable –Common products for many customers

Graphical Production System Database Production application Data + prod. Req. Illustrator CS Post processing Product

Graphical production

Recent developments at DMI Jacob Brock Weather, climate and sea