Verification of Numerical Weather Prediction systems employed by the Australian Bureau of Meteorology over East Antarctica during the 2009-10 summer season.

Slides:



Advertisements
Similar presentations
Slide 1ECMWF forecast User Meeting -- Reading, June 2006 Verification of weather parameters Anna Ghelli, ECMWF.
Advertisements

Slide 1ECMWF forecast products users meeting – Reading, June 2005 Verification of weather parameters Anna Ghelli, ECMWF.
Chapter 13 – Weather Analysis and Forecasting
Regional Modelling Prepared by C. Tubbs, P. Davies, Met Office UK Revised, delivered by P. Chen, WMO Secretariat SWFDP-Eastern Africa Training Workshop.
Introduction to data assimilation in meteorology Pierre Brousseau, Ludovic Auger ATMO 08,Alghero, september 2008.
Willem A. Landman & Francois Engelbrecht.  Nowcasting: A description of current weather parameters and 0 to 2 hours’ description of forecast weather.
C ontacts: Marit Helene Jensen, Norwegian Meteorological Institute, P.O.Box 43 Blindern, N-0313 OSLO, NORWAY. HIRLAM at met.no.
Atmospheric Reanalyses Update Mike Bosilovich. ReanalysisHoriz.ResDatesVintageStatus NCEP/NCAR R1T present1995ongoing NCEP-DOE R2T present2001ongoing.
Gridded OCF Probabilistic Forecasting For Australia For more information please contact © Commonwealth of Australia 2011 Shaun Cooper.
Mechanistic crop modelling and climate reanalysis Tom Osborne Crops and Climate Group Depts. of Meteorology & Agriculture University of Reading.
Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Institut für Physik der Atmosphäre On the Value of.
Recent performance statistics for AMPS real-time forecasts Kevin W. Manning – National Center for Atmospheric Research NCAR Earth System Laboratory Mesoscale.
Ocean-atmosphere simulations of the Eastern Mediterranean using COAMPS TM /NCOM Objectives  Simulate Mediterranean and subregional (e.g., Adriatic and.
Application of Numerical Model Verification and Ensemble Techniques to Improve Operational Weather Forecasting. Northeast Regional Operational Workshop.
Huang et al: MTG-IRS OSSEMMT, June MTG-IRS OSSE on regional scales Xiang-Yu Huang, Hongli Wang, Yongsheng Chen and Xin Zhang National Center.
Chapter 13 – Weather Analysis and Forecasting. The National Weather Service The National Weather Service (NWS) is responsible for forecasts several times.
Comparison of hybrid ensemble/4D- Var and 4D-Var within the NAVDAS- AR data assimilation framework The 6th EnKF Workshop May 18th-22nd1 Presenter: David.
MDSS Challenges, Research, and Managing User Expectations - Weather Issues - Bill Mahoney & Kevin Petty National Center for Atmospheric Research (NCAR)
Data assimilation of polar orbiting satellites at ECMWF
COSMO General Meeting Zurich, 2005 Institute of Meteorology and Water Management Warsaw, Poland- 1 - Verification of the LM at IMGW Katarzyna Starosta,
Model Verification of Short Range High Impact Weather in Central Florida Christopher Hicks Department of Marine and Environmental Systems Florida Institute.
Performance of the MOGREPS Regional Ensemble
Dr Mark Cresswell Model Assimilation 69EG6517 – Impacts & Models of Climate Change.
Ensemble-variational sea ice data assimilation Anna Shlyaeva, Mark Buehner, Alain Caya, Data Assimilation and Satellite Meteorology Research Jean-Francois.
Forecasting and Numerical Weather Prediction (NWP) NOWcasting Description of atmospheric models Specific Models Types of variables and how to determine.
Details for Today: DATE:18 th November 2004 BY:Mark Cresswell FOLLOWED BY:Literature exercise Model Assimilation 69EG3137 – Impacts & Models of Climate.
1 On the use of radar data to verify mesoscale model precipitation forecasts Martin Goeber and Sean Milton Model Diagnostics and Validation group Numerical.
The National Environmental Agency of Georgia L. Megrelidze, N. Kutaladze, Kh. Kokosadze NWP Local Area Models’ Failure in Simulation of Eastern Invasion.
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
Earth Science Division National Aeronautics and Space Administration 18 January 2007 Paper 5A.4: Slide 1 American Meteorological Society 21 st Conference.
June, 2003EUMETSAT GRAS SAF 2nd User Workshop. 2 The EPS/METOP Satellite.
How can LAMEPS * help you to make a better forecast for extreme weather Henrik Feddersen, DMI * LAMEPS =Limited-Area Model Ensemble Prediction.
A Comparison of the Northern American Regional Reanalysis (NARR) to an Ensemble of Analyses Including CFSR Wesley Ebisuzaki 1, Fedor Mesinger 2, Li Zhang.
The Australian Community Climate Earth-System Simulator The Australian Community Climate and Earth System Simulator Kamal Puri (ACCESS Group Leader)
Météo-France / CNRM – T. Bergot 1) Introduction 2) The methodology of the inter-comparison 3) Phase 1 : cases study Inter-comparison of numerical models.
Polar Prediction The Scientific Challenges - Antarctica John Turner British Antarctic Survey Cambridge, UK.
Latest results in verification over Poland Katarzyna Starosta, Joanna Linkowska Institute of Meteorology and Water Management, Warsaw 9th COSMO General.
Polar prediction services provided by the Bureau of Meteorology in support of the Australian Antarctic program. Dr Neil Adams, Centre for Australian Weather.
Modern Era Retrospective-analysis for Research and Applications: Introduction to NASA’s Modern Era Retrospective-analysis for Research and Applications:
Justin Glisan Iowa State University Department of Geological and Atmospheric Sciences RACM Project Update: ISU Atmospheric Modeling Component: Part 1 3rd.
26 th EWGLAM & 11 th SRNWP meetings, Oslo, Norway, 4 th - 7 th October 2004 Stjepan Ivatek-Šahdan RC LACE Data Manager Croatian Meteorological and Hydrological.
Operational ALADIN forecast in Croatian Meteorological and Hydrological Service 26th EWGLAM & 11th SRNWP meetings 4th - 7th October 2004,Oslo, Norway Zoran.
Weather forecasting by computer Michael Revell NIWA
A Numerical Study of Early Summer Regional Climate and Weather. Zhang, D.-L., W.-Z. Zheng, and Y.-K. Xue, 2003: A Numerical Study of Early Summer Regional.
Advanced interpretation and verification of very high resolution models National Meteorological Administration Rodica Dumitrache, Aurelia LUPASCU,
Page 1© Crown copyright 2004 SRNWP Lead Centre Report on Data Assimilation 2005 for EWGLAM/SRNWP Annual Meeting October 2005, Ljubljana, Slovenia.
By Dr. H. Kabelwa. What is WRF? Is the Weather Research and Forecasting Model Is a next-generation meso-scale numerical weather prediction system Is designed.
Diurnal Water and Energy Cycles over the Continental United States from three Reanalyses Alex Ruane John Roads Scripps Institution of Oceanography / UCSD.
Modeling and Evaluation of Antarctic Boundary Layer
One-year re-forecast ensembles with CCSM3.0 using initial states for 1 January and 1 July in Model: CCSM3 is a coupled climate model with state-of-the-art.
Alan F. Hamlet Andy Wood Dennis P. Lettenmaier JISAO Center for Science in the Earth System Climate Impacts Group and the Department.
NWP models. Strengths and weaknesses. Morten Køltzow, met.no NOMEK
NCAR April 1 st 2003 Mesoscale and Microscale Meteorology Data Assimilation in AMPS Dale Barker S. Rizvi, and M. Duda MMM Division, NCAR
Trials of a 1km Version of the Unified Model for Short Range Forecasting of Convective Events Humphrey Lean, Susan Ballard, Peter Clark, Mark Dixon, Zhihong.
Page 1 Andrew Lorenc WOAP 2006 © Crown copyright 2006 Andrew Lorenc Head of Data Assimilation & Ensembles Numerical Weather Prediction Met Office, UK Data.
Page 1© Crown copyright 2005 DEVELOPMENT OF 1- 4KM RESOLUTION DATA ASSIMILATION FOR NOWCASTING AT THE MET OFFICE Sue Ballard, September 2005 Z. Li, M.
10th COSMO General Meeting, Cracow, Poland Verification of COSMOGR Over Greece 10 th COSMO General Meeting Cracow, Poland.
Verification of operational seasonal forecasts at RA-VI Regional Climate Center South East European Virtual Climate Change Centre Goran Pejanović Marija.
Global vs mesoscale ATOVS assimilation at the Met Office Global Large obs error (4 K) NESDIS 1B radiances NOAA-15 & 16 HIRS and AMSU thinned to 154 km.
Antarctica Steve Colwell British Antarctic Survey.
Roger A. Stocker 1 Jason E. Nachamkin 2 An overview of operational FNMOC mesoscale cloud forecast support 1 FNMOC: Fleet Numerical Meteorology & Oceanography.
IASC Workshop Potsdamr, Germany Polar Meteorology Group, Byrd Polar Research Center, The Ohio State University, Columbus, Ohio, USA The Arctic System Reanalysis.
Exploring and Validating LM Performances at Very High Resolution M. Didone, D. Lüthi, H.C Davies Institute for Atmospheric and Climate Science, ETH Zürich.
AMPS Update – July 2010 Kevin W. Manning Jordan G. Powers Mesoscale and Microscale Meteorology Division NCAR Earth System Laboratory National Center for.
Systematic timing errors in km-scale NWP precipitation forecasts
Daniel Leuenberger1, Christian Keil2 and George Craig2
Naval Research Laboratory
ECMWF activities: Seasonal and sub-seasonal time scales
Rita Roberts and Jim Wilson National Center for Atmospheric Research
2007 Mei-yu season Chien and Kuo (2009), GPS Solutions
Presentation transcript:

Verification of Numerical Weather Prediction systems employed by the Australian Bureau of Meteorology over East Antarctica during the summer season. Neil Adams CAWCR, Tasmania-Antarctica Region Bureau of Meteorology, Hobart, Australia.

1. Model performance over the 2009/10 summer. 2. Precipitation forecasting during an extreme event at Casey. 3. The future of polar prediction within Australia.

Where: and: Verification - The S1 skill Score. X f : Forecast field, X o : Observed field, : zonal resolution, : meridional resolution. The S1 score measures the agreement between both the forecast and observed data and the gradient of the forecast and observed data. A score of 0 implies a perfect forecast and a score of 100 implies no skill in the forecast.

S1 skill scores from PolarLAPS were compared with those from the available ECMWF forecasts. Both ECMWF and PolarLAPS were verified against ERA-Interim analyses at resolution. ECMWF domain – data at resolution. PolarLAPS domain – data at resolution.

The comparison was done on reduced domains to maximise the coincidence of the two forecast systems. [ERA analyses interpolated to the PolarLAPS domain using a lagrangian bicubic formulation]. Reduced PolarLAPS domain. Reduced ECMWF domain.

Note the strong seasonal variation in the S1 score – most pronounced with polarLAPS.

Time-StepECMWFPolarLAPS +024HR HR HR HR HR Time-StepECMWFPolarLAPS +024HR HR HR HR HR ECMWF and PolarLAPS average S1 skill scores. (I January April 2010). ECMWF and PolarLAPS average summer season skill scores. 2006/07, 2007/08, 2008/09, 2009/10 (1 November – 31 March)

Mean summer season S1 scores – ECMWF and PolarLAPS (verified against ERA-Interim).

Points to note: S1 scores calculated at the analysis resolution of 1.5 o, PolarLAPS initialised off NCEP-GFS at 1.0 o (last few months at 0.5 o ), Only capturing ability of ECMWF and PolarLAPS to model the synoptic scale features – not meso-scale. (Australia only has access to 1.5 o ECMWF), PolarLAPS has no data assimilation so no high resolution information in the initial state or lateral boundary conditions, Artefact of the cold-start initialisation are spin-up errors causing phase shifts and timing errors in system movements. So – S1 score doesn't validate the high resolution information contained within the PolarLAPS forecasts and penalises the timing/phase errors.

Phase errors degrade S1Skill score, however long lead time on significant events still highly useful guidance.

Bias Corrected RMS Error: Forecast Period: 25 January to 25 April Temperature Pressure

As with the S1 skill score, the single station statistics such as RMSE or bias corrected RMSE don't necessarily convey how useful an NWP system is in supporting weather forecasting. Another verification method is based around model climatology.

Long term data set present.

January 25 to April

120 km

Precipitation forecasting. In the 24 hours to 11 am (0300 UTC) on 20 April 2010 Casey measured 34.2 mm of water equivalent snow – a record for Casey Station !!!. Model accumulated precipitation in the 24 hours to 0300 UTC: ACCESS-G : 2.9 mm, NCEP-GFS : 5.0 mm, PolarLAPS : 12.8 mm, ECMWF : 16.0 mm. AMPS : 5.3 mm (8.0 mm from previous run). (data from runs made 1200 UTC 18 April 2010).

PolarLAPS +

Model verification still unsatisfactory but does guide future development: Antarctic forecasting is dominated by: the wind field, snowfall, cloud cover, base and thickness, Modelling requires adequate resolution, appropriate physical schemes, and the best possible initial conditions.

The Australian Polar Prediction System (APPS). A business case was submitted to the Bureau Executive in June 2010 for the APPS to include: A polar NWP system built around the Australian Community Climate Earth System Simulator (ACCESS) atmospheric model (UKMO-UM) – ACCESS-P, A sea-ice forecasting system based on CICEv4 using ACCESS-P output as forcing, A 30 year re-analysis using ACCESS-P.

The Australian Polar Prediction System (APPS) - cont. The executive meeting held in late June met to discuss the business case and has agreed to support the NWP component. A polar NWP system built around the Australian Community Climate Earth System Simulator (ACCESS) atmospheric model (UKMO-UM) – ACCESS-P,  A sea-ice forecasting system based on CICEv4 using ACCESS-P output as forcing,  A 30 year re-analysis using ACCESS-P. The Executive are interested in the idea of a sea-ice analysis and forecasting system and will revisit funding of this initiative in the 2011/12 financial year. No mention at all was made of the bid for a re-analysis project !

The Australian Polar Prediction System (APPS) – approximate time-line: 2010: ACCESS-P running over the same domain as PolarLAPS – initialised from ACCESS-G output, 2011: Optimising paramaterisation schemes for polar prediction, 2011: Porting of the ACCESS 4-Dimensional Variational Assimilation (4DVar) to the rotated ACCESS-P grid, 2012: Resolution increase, 2013: partial coupling of sea-ice forecast system.

Thank you.