NCAS Unified Model Introduction Part 4a: UM tools and facilities University of Reading, 3-5 December 2014.

Slides:



Advertisements
Similar presentations
Guy Griffiths. General purpose interpreted programming language Widely used by scientists and programmers of all stripes Supported by many 3 rd -party.
Advertisements

NCAS Unified Model Introduction Part 6: Finale University of Reading, March 2015.
WRF Modeling System V2.0 Overview
Part 2: UM Data Files University of Reading, 3-5 December 2014.
NCAS Unified Model Introduction Part 1b: Running the UM University of Reading, 3-5 December 2014.
Part 1a: Overview of the UM system
NCAS Unified Model Introduction Part 5: Finale University of Reading, 3-5 December 2014.
NCAS Unified Model Introduction Part 1a: Overview of the UM system University of Reading, 3-5 December 2014.
© Crown copyright Met Office SRNWP Interoperability Workshop, ECMWF, January 2008 SRNWP Interoperability Terry Davies Met Office.
This is the footer WRF Basics Weather Research and Forecasting.
Programming Introduction November 9 Unit 7. What is Programming? Besides being a huge industry? Programming is the process used to write computer programs.
NCAS Unified Model Introduction Part 2: UM Data Files University of Reading, March 2015.
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
This is the footer Running WRF on HECToR Ralph Burton, NCAS (Leeds) Alan Gadian, NCAS (Leeds) With thanks to Paul Connolly, Hector.
To run the program: To run the program: You need the OS: You need the OS:
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research 2013/1/8 The National Center for Atmospheric.
EGU 2011 TIGGE, TIGGE LAM and the GIFS T. Paccagnella (1), D. Richardson (2), D. Schuster(3), R. Swinbank (4), Z. Toth (3), S.
Introduction to the WRF Modeling System Wei Wang NCAR/MMM.
Introduction to Hands On Training in CORDEX South Asia Data Analysis
Tools Developed For AVHRR Data Production and Analysis The AVHRR modular framework can produce three output datasets in NetCDF format when AVHRR NetCDF.
Page 1 Status of HDF-EOS, Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009.
© Crown copyright Met Office An Introduction to Linux, PP utilities, CDO and NCL Bangkok Workshop, 26 th February– 1 st March 2013.
Installing and Running the WPS Michael Duda 2006 WRF-ARW Summer Tutorial.
HDF-EOS at NOAA/NESDIS NOAA / NESDIS / ORA orbit-net.nesdis.noaa.gov/arad2/MSPPS Huan Meng, Doug Moore, Limin Zhao, Ralph Ferraro NOAA / NESDIS.
Climate Data Formats Deniz Bozkurt
Page 1 TOOLKIT / HDF-EOS Status and Development Abe Taaheri, Raytheon IIS Aura DSWG meeting October 2007.
CKD Workshop  30 March 2011  Jim Kinter  Data Lessons from Project Athena GrADS Station Data Model Used for in situ observational data Individual reports.
Regional Climate Model Evaluation System based on satellite and other observations for application to CMIP/AR downscaling Peter Lean 1, Jinwon Kim 1,3,
CESD 1 SAGES Scottish Alliance for Geoscience, Environment & Society The challenges of geo-simulation data Centre For Earth System Dynamics
Data Storage System, Model Output and Analysis Tools PRECIS Workshop Tanzania Meteorological Agency 29 th June – 3 rd July 2015.
Post Processing Tools Sylvia Murphy National Center for Atmospheric Research.
Part 6: UM tools and facilities
00/XXXX 1 Data Processing in PRISM Introduction. COCO (CDMS Overloaded for CF Objects) What is it. Why is COCO written in Python. Implementation Data Operations.
Interoperability Summary of Key Technical Issues.
Introduction to the WRF Modeling System
An introduction to CDO, NCL and PRECIS utilities
NCAS Computational Modelling Service (CMS) Group providing services to the UK academic modelling community Output of UM Diagnostics Directly in CF NetCDF;
Welcome to the PRECIS training workshop
___________________________________________________________________________WRF-SI ___________________________________________________Community Modeling.
NCAS Unified Model Introduction Part 4b: UM Limited Area Models University of Reading, 3-5 December 2014.
NCAS Unified Model Introduction Part 7: Finale University of Reading, December 2015.
Installing and Running the WPS Michael Duda 2006 WRF-ARW Summer Tutorial.
Agreements on... Interim ELDAS Data coordination meeting Time schedule for soil moisture production –Submission of results for two month period –Preparation,
ECMWF LandSea Mask Group meeting 17 September 2015 Delrosso Clementi.
Deutscher Wetterdienst Consolidation of software for the generation of External Parameters and extension with new raw data sets Hermann Asensio.
Update on Unidata Technologies for Data Access Russ Rew
March 2014 NCAS Unified Model Introduction Finale York – March 2014.
Accessing EURO4M and UERRA data in ECMWF MARS archive Richard Mládek, Manuel Fuentes (ECMWF)
Verify WRF Forecast using MET
March 2014 UM Limited Area Models What constitutes a LAM How to set one up in the UM How to start a LAM How to keep a LAM going Nesting LAMS Cascade example.
Python data visualization
Central Ancillary Program (CAP)
Visualisation in climate modelling
Cryptography Sage Interlude 1.
SRNWP Interoperability Workshop
Topics Introduction Hardware and Software How Computers Store Data
Introduction to Nesting suite
TIGGE Archives and Access
RCM workshop, Meteo Rwanda, Kigali
National Scientific Library at Tbilisi State University
The cf-python software library
CERES Data Management Team Science Data Processing Workshop 2002
gWRF Workflow and Input Data Requirements
Topics Introduction Hardware and Software How Computers Store Data
National Center for Atmospheric Research
MIT MSEAS Software Software reads and displays any model output for MOOS-IVP Provides ocean images on which vehicle simulations are superimposed Snapshots.
Satellite data that we’ve acquired
Reanalyses – A sharing of juicy tidbits* and gory details**
Presentation transcript:

NCAS Unified Model Introduction Part 4a: UM tools and facilities University of Reading, 3-5 December 2014

UM GRIB ASCI UM PP GRIB UM PP ASCI netcdf UM Tools should provide a full range of input and output format possibilities File formats 2

Model 64-bit UM GRIB ECMWF data reconfiguration DECODE netcdf 64-bit PP pptoanc 32-bit PP (from UKMO) IDL/ Fortran 32-bit UM um32to64 GRIB Metview Fortran 64-bit PP 32-bit PP Met Office graphics netcdf Python, idl Ferret, Grads cdat convpp fftopp xconv ieee convpp 32-bit wconv.pl Conversion tools 3

ToolInputOutput pptoancPPUM (ancillary) xancilnetCDFUM (ancillary) convppUMPP ff2ppUM (fields format)32-bit PP ieeeUM32-bit UM bigendUMbyte-swapped UM xconvUM and PPnetcdf cf-pythonPPCF-netcdf All tools and output 64-bit unless otherwise stated Data conversion UM tools (i) 4

ToolPurpose cumfCompares UM format files pumfPrints out header information for PP files uminfoHeader information UM ppinfoHeader information PP Data information Data manipulation ToolPurpose umpackRemoves spare headers and extra buffers from UM files fieldopAdds, subtracts, multiplies, divides UM (fields files) format UM tools (ii) 5

Xconv Xconv can be used to see what fields are contained within a data file and to look at the data values, either directly at the numerical values or at a gridbox fill plot of the data. It can also convert model output into netCDF. Supported input formats: – Data output from the UKMO Unified Model – UKMO PP format – GRIB format – netcdf format Data manipulations available: – Spectral to gridpoint – Interpolation (bilinear or area-weighted) – Conversion to and from rotated grids 6

7

Making ancillary files (i) For creating standard ancillary files can use the Central Ancillary Program (CAP) – Orography – Land-sea mask – Soil moistue, snow – Vegetation – Aerosol – Sea surface temperatue, sea-ice – Ozone Typically used for running the LAM Contact the CMS helpdesk for more information: 8

Making ancillary files (ii) 9 netCDF data file on the UM grid with land-sea mask PP-format file Create using a tool of your choice (python, idl, …) This can also be done with xancil For creation of ancillary files from your own data. Conversion tool UM ancillary file pptoanc

10 xancil

ff2pp NDdiag xconv Ferret grads Jplot Python, idl MATLAB etc UKMO library (midl) Visualisation and analysis 11 cf-python cfplot Iris UM fields files UM run

Jasmin Analysis Platform (JAP) Collection of tools commonly used for atmospheric and Earth observation science, including: – NetCDF and nco tools – Cf-python, cfplot and Iris – Xconv, CDAT and lots more Installed on all the Jasmin systems (at BADC, Bristol, Reading and Leeds). Can download as: – Virtual Machine, which will work on any system running VirtualBox – RPMs for RHEL/CentOS Linux 12