F. Prates/Grazzini, Data Assimilation Training Course March Error Tracking F. Prates/ F. Grazzini
F. Prates/Grazzini, Data Assimilation Training Course March Monitoring of the forecasting system is carried out on daily basis by a meteorologist at ECMWF. The main reason of this activity is to investigate bad or very inconsistent forecast trying to detect deficiencies in the analysis and in the forecasting system. Investigations are covering all aspects of the system, often dealing with initial conditions (data availability) and data assimilation problems. INTRODUCTION ERROR TRACKING BY MEANS OF SYNOPTIC-DIAGNOSIS
F. Prates/Grazzini, Data Assimilation Training Course March Every day we summarize our findings in the MetOps Daily Report. The daily report is posted on our internal web site where can be accessed by people in RD and OD. Every four months there is a special meeting (OD/RD meeting) in which OD present a summary of the daily reports of the previous months. Daily Report
F. Prates/Grazzini, Data Assimilation Training Course March Investigations can be divided in the following main steps: Spot the problem Find out when the error enter in the system Where did it happen What caused the error TROUBLESHOOTING PROCEDURES
F. Prates/Grazzini, Data Assimilation Training Course March WHEN? Verification statistics would tell which forecast had a bad performance
F. Prates/Grazzini, Data Assimilation Training Course March ANALYSISECMWF D+6 FC WHEN ?
F. Prates/Grazzini, Data Assimilation Training Course March WHERE? Different techniques are used to identify the origin of forecast error 1) Error maps: A sequence of maps shows how initial errors will move downstream. Focus on the evolution of the most amplified error wave train. because … Error patterns become more complex as the forecast range increases. The energy associated to the wave train is transmitted by their group velocity which is different of phase speed of the individual perturbations.
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March Winter track Summer track The most likely areas for errors(energy) to rapidly amplify(release) are baroclinic regions and developing cyclones They provide the most efficient mechanism for the “spread of influence” in mid-latitude upper- tropospheric westerlies. Theoretical and observational studies indicate that the energy associated to the wave packets travel at 30˚/day in midlatitudes. ERROR PROPAGATION / DOWNSTREAM DEVELOPMENT (Anders Persson)
F. Prates/Grazzini, Data Assimilation Training Course March WHERE? 2) EPS perturbations: The perturbation fields computed by EPS can help to identify where the atmosphere is sensitive to possible errors growth. These perturbations are generated using singular vectors of a linear version of ECMWF, which maximize the total energy norm (phase space) over a 48- hour time interval with a energy peaking at around 700 hPa in regions of strong barotropic and baroclinic energy conversion, at initial time. Thus we expected that small errors in initial conditions will amplify most rapidly affecting the forecast.
F. Prates/Grazzini, Data Assimilation Training Course March WHERE?
F. Prates/Grazzini, Data Assimilation Training Course March Zoom on wind sensitivity: is suggesting a reshaping of the Jet streak west of Alaska SENSITIVITY MAPS: KEY ANALYSIS ERROR
F. Prates/Grazzini, Data Assimilation Training Course March COMPARISON WITH OTHERS MODELS ANALYSISD+6 ECMWF D+6 UKMOD+6 T255/UKMO ANA
F. Prates/Grazzini, Data Assimilation Training Course March ANALYSIS DIFFERENCE AT 500 hPa Z
F. Prates/Grazzini, Data Assimilation Training Course March WHERE? –Part 2
F. Prates/Grazzini, Data Assimilation Training Course March WHERE? 3) Extracting envelope of packets of synoptic waves (Rossby): Locate wave packets in atmospheric data (wave velocity group). This method is applied to the field difference between to successive forecast runs. We do expect … that local differences in the beginning would propagate in a form of Rossby waves packets in upper troposphere
F. Prates/Grazzini, Data Assimilation Training Course March DIFFERENCE TRACKING: streamfunction+envelope of the difference
F. Prates/Grazzini, Data Assimilation Training Course March DIFFERENCE TRACKING: streamfunction+envelope of the difference
F. Prates/Grazzini, Data Assimilation Training Course March DIFFERENCE TRACKING: streamfunction+envelope of the difference
F. Prates/Grazzini, Data Assimilation Training Course March DIFFERENCE TRACKING: streamfunction+envelope of the difference
F. Prates/Grazzini, Data Assimilation Training Course March DIFFERENCE TRACKING: streamfunction+envelope of the difference
F. Prates/Grazzini, Data Assimilation Training Course March DIFFERENCE TRACKING: streamfunction+envelope of the difference
F. Prates/Grazzini, Data Assimilation Training Course March DIFFERENCE TRACKING: streamfunction+envelope of the difference
F. Prates/Grazzini, Data Assimilation Training Course March
F. Prates/Grazzini, Data Assimilation Training Course March ANALYSIS INCREMENTS : utc 850hPa
F. Prates/Grazzini, Data Assimilation Training Course March WHAT DATA? After “when” and “where” has been answered… ECMWF data base provides records and statistics of available observations in the area The cause/effect relation between increments and obs is not always trivial But we can… Assess the impact of different obs data in the analysis comparing the obs departures from the first-guess and analysis. With 4DVAR the increments no longer have a local interpretation- the errors may come from other regions as a consequence of the assimilation window. Other causes… If one or several observations are wrong → quality control is applied If the obs errors turn out to be systematic → blacklisting is produced
F. Prates/Grazzini, Data Assimilation Training Course March DROPSONDES and TEMPs at 850 hPa – 23-03utc Dropsondes Analysis mass and wind increments at 850 hPa
F. Prates/Grazzini, Data Assimilation Training Course March OBSERVATIONS STATISTICS UTC 3D view of the increments isosurfaces: utc Profile of mass increments at cursor location
F. Prates/Grazzini, Data Assimilation Training Course March DROPSONDES DEPARTURES from First-Guess and Analysis The analysis(solid) shows a significant reduction of the departure from Obs -> strong impact of the observation
F. Prates/Grazzini, Data Assimilation Training Course March AIRCRAFT DEPARTURES from First-Guess and Analysis Fairly strong impact also from aircraft
F. Prates/Grazzini, Data Assimilation Training Course March ATOVS RADIANCES DEPARTURES from the First-Guess Weak impact from polar satellite radiances due to very small departure from the First-Guess Not Used
F. Prates/Grazzini, Data Assimilation Training Course March QSCAT DEPARTURES from First-Guess and Analysis Moderate positive impact from Qscat
F. Prates/Grazzini, Data Assimilation Training Course March SUMMARY Synoptic diagnosis of NWP forecast is a necessary complement to the usual statistical verifications. Diagnostic tools allow to identify complex problems that often do not show up in objective scores. Through this type of monitoring we have been able to identify several problems successively taken under consideration by the RD department.
F. Prates/Grazzini, Data Assimilation Training Course March To find out more: Persson, A, 2000: Synoptic-dynamic diagnosis of medium range weather forecast systems, ECMWF Seminar on diagnosis of models and data assimilation systems, 6-10 September 1999.pp Zimin A. V. et al., May 2003: Extracting Envelopes of Rossby Wave Packets, Monthly Weather Review, 131, pp