Report from DAOS-WG Roger Saunders and Ron Gelaro with input from WG members.

Slides:



Advertisements
Similar presentations
DAOS-WG: Data Assimilation and Observing Systems Working Group Pierre Gauthier Department of Earth and Atmospheric Sciences Université du Québec à Montréal.
Advertisements

1 October 26, th COPS Workshop, Cambridge, UK COPS (Convective and Orographically-induced Precipitation Study) Goal: Advance the quality of forecasts.
© The Aerospace Corporation 2014 Observation Impact on WRF Model Forecast Accuracy over Southwest Asia Michael D. McAtee Environmental Satellite Systems.
Proposed Predictability, Dynamics & Ensemble Forecasting Expert Team Richard Swinbank, with Heini Wernli, Masayuki Kyouda and Istvan Szunyogh, and thanks.
The impact of targeted observations from 2011 Winter Storms Reconnaissance on deterministic forecast accuracy Tom Hamill NOAA Earth System Research Lab,
Actions from DAOS-4 Action 2: WMO to set up the DAOS web pages and implement appropriate links to other projects and monitoring sites (T. Nakazawa) Action.
Targeted observations and Observing System simulation Experiments Within THORPEX Yucheng Song IMSG/EMC/NCEP/NOAA Camp Springs, MD THORPEX Review, Feb 25.
DIAMET Second project meeting, 9/6/11 NERC Storm Risk Mitigation Programme DIAMET - Lead PI, Geraint Vaughan, Manchester TEMPEST - Lead PI, Len Shaffrey,
1 THE WINTER STORM RECONNESSAINCE PROGRAM OF THE US NATIONAL WEATHER SERVICE Zoltan Toth GSD/ESRL/OAR/NOAA Formerly at EMC/NCEP/NWS/NOAA Acknowledgements:
T-PARC (Summer Phase) Sharanya J. Majumdar (RSMAS/U. Miami) Christopher S. Velden (CIMSS / U. Wisconsin) Section 4.7, THORPEX/DAOS WG Fourth Meeting
Slide 1 Evaluation of observation impact and observation error covariance retuning Cristina Lupu, Carla Cardinali, Tony McNally ECMWF, Reading, UK WWOSC.
1 FY14 JCSDA AMV PROJECT COPC Action Item : Coordinate an update to be briefed to the next COPC by the JCSDA describing collaborative efforts to.
NSF Hurricane Research National Science Foundation Pamela Stephens Geosciences Directorate.
Kick-Off-Treffen SPP, Bonn October 2006 Improved Water Vapour and Wind Initialisation for Precipitation Forecasts: Impact Studies with the ECMWF.
Impact study with observations assimilated over North America and the North Pacific Ocean at MSC Stéphane Laroche and Réal Sarrazin Environment Canada.
Impact of Targeted Dropsonde Data on Mid-latitude Numerical Weather Forecasts during the 2011 Winter Storms Reconnaissance Program Presented by Tom Hamill.
AMDAR Global Status, Benefits and Development Plans* WMO CBS ET Aircraft Based Observations Bryce Ford * Adapted from Presentation at WMO Congress XVII,
Data assimilation and observing systems strategies Pierre Gauthier Data Assimilation and Satellite Meteorology Division Meteorological Service of Canada.
Adaptive targeting in OSSE Outline Adaptive observing / data processing techniques in OSSE Addition to OSSE Link with THORPEX Link with T-PARC.
1 Precipitation verification Precipitation verification is still in a testing stage due to the lack of station observation data in some regions
Observation Impact Workshop, Geneva, May 2008 Intercomparison of sensitivity to observations in the context of THORPEX and the THORPEX Pacific-Asia.
Perspectives on Targeting Sharanya J. Majumdar (RSMAS/U. Miami) Session 3.1, THORPEX/DAOS WG Fourth Meeting June 2011.
© Crown copyright Met Office Plans for Met Office contribution to SMOS+STORM Evolution James Cotton & Pete Francis, Satellite Applications, Met Office,
T-NAWDEX THORPEX - North Atlantic Waveguide and Downstream Impact Experiment Outline of scientific background Heini Wernli, Andreas Dörnbrack, George Craig,
1 Rolf Langland Naval Research Laboratory – Monterey, CA Uncertainty in Operational Atmospheric Analyses.
© Crown copyright Met Office WGNE activities and future directions Andy Brown and Jean-Noël Thépaut (WGNE co-chairs)
WWRP The THORPEX Mid-Term Review David Burridge Of no particular abode.
Upgraded Russian Radiosonde Network for IPY U.S. (NOAA) Winter NOAA G-4 and Air Force C-130s JapanPalau Typhoon Landfall U.S.(NSF/ONR), EU, Japan, Korea,
© Crown copyright 2007 Optimal distribution of polar-orbiting sounding missions John EyreMet Office, UK CGMS-40; Lugano, Switzerland;5-9 Nov 2012.
1 The Assessment of the DAOS WG on Observation Targeting Talk presented by Rolf Langland (NRL-Monterey) DAOS Working Group THIRD THORPEX International.
WWRP THORPEX Alan Dickinson Chair THORPEX ICSC and David Burridge THORPEX IPO.
1 A Pacific Predictability Experiment - Targeted Observing Issues and Strategies Rolf Langland Pacific Predictability Meeting Seattle, WA June 6, 2005.
Report from DAOS-WG Presented by Richard Swinbank Prepared by Roger Saunders with input from WG members.
1 Results from Winter Storm Reconnaissance Program 2008 Yucheng SongIMSG/EMC/NCEP Zoltan TothEMC/NCEP/NWS Sharan MajumdarUniv. of Miami Mark ShirleyNCO/NCEP/NWS.
1 Results from Winter Storm Reconnaissance Program 2007 Yucheng SongIMSG/EMC/NCEP Zoltan TothEMC/NCEP/NWS Sharan MajumdarUniv. of Miami Mark ShirleyNCO/NCEP/NWS.
© Crown copyright Met Office Data Assimilation Developments at the Met Office Recent operational changes, and plans Andrew Lorenc, DAOS, Montreal, August.
1 Rolf Langland NRL-Monterey Plans for Evaluation of Lidar Wind Observations at NRL-Monterey Working Group on Space-Based Lidar Winds 05 Feb 2008.
Lennart Bengtsson ESSC, Uni. Reading THORPEX Conference December 2004 Predictability and predictive skill of weather systems and atmospheric flow patterns.
Yucheng Song & Zoltan Toth 1 Yucheng Song and Zoltan Toth EMC/NCEP/NWS/NOAA Update on the Winter Storm Reconnaissance Program Meeting of the working group.
3 rd THORPEX DAOS Working Group meeting Objective * Review the issue of adaptive observations * Results from T-PARC (winter phase and TCS-08) * Update.
Munehiko Yamaguchi, Sharanya J. Majumdar (RSMAS/U. Miami) and multiple collaborators 3 rd THORPEX International Science Symposium 14 Sep Coordinated.
DAOS WG 5 th Meeting University of Wisconsin, Madison Sept Items 2.1 and 2.2 Jim Caughey THORPEX IPO.
DAOS report to WWRP/JSC Feb 2011 Roger Saunders and Pierre Gauthier.
AMS Annual Meeting - January NRL Global Model Adaptive Observing During TPARC/TCS-08 Carolyn Reynolds Naval Research Laboratory, Monterey, CA OUTLINE:
OSSEs and NOAA’s Quantitative Observing Systems Assessment Program (QOSAP) Bob Atlas, Craig MacLean, Lidia Cucurull (NOAA, USA) Sharan Majumdar, Tom Hamill.
Slide 1 7th Session of the THORPEX International Core Steering Committee WMO Headquarters, Geneva, 19 November 2008 T-NAWDEX THORPEX- North Atlantic Waveguide.
Concordiasi Satellite data assimilation at high latitudes F. Rabier, A. Bouchard, F. Karbou, V. Guidard, S. Guedj, A. Doerenbecher, E. Brun, D. Puech +
NOAA G-IV AIRCRAFT TRACK AROUND HURRICANE IVAN. ETKF PLANNED FLIGHT ACTUAL G-IV FLIGHT.
Page 1 Developments in regional DA Oct 2007 © Crown copyright 2007 Mark Naylor, Bruce Macpherson, Richard Renshaw, Gareth Dow Data Assimilation and Ensembles,
Doppler Lidar Winds & Tropical Cyclones Frank D. Marks AOML/Hurricane Research Division 7 February 2007.
Page 1 Andrew Lorenc WOAP 2006 © Crown copyright 2006 Andrew Lorenc Head of Data Assimilation & Ensembles Numerical Weather Prediction Met Office, UK Data.
Adaptive Observations at NWS Lacey Holland, SAIC at EMC/NCEP/NWS Zoltan Toth, EMC/NCEP/NWS Acknowledgements:
Examination of Observation Impacts Derived from OSEs and Adjoint Models Ron Gelaro and Yanqiu Zhu NASA Global Modeling and Assimilation Office Ricardo.
© Crown copyright Met Office Report to 22 nd NAEDEX Meeting Roger Saunders + many others, Met Office, Exeter.
1 The Concordiasi Project Additional observations over Antarctica for NWP F. Rabier, V. Guidard, S. Noton-Haurot, A. Doerenbecher, D. Puech, P. Brunel,
OSEs with HIRLAM and HARMONIE for EUCOS Nils Gustafsson, SMHI Sigurdur Thorsteinsson, IMO John de Vries, KNMI Roger Randriamampianina, met.no.
Forecast Sensitivity - Observation Impact (FSOI)
Plans for Met Office contribution to SMOS+STORM Evolution
Ron Gelaro and Yanqiu Zhu NASA Global Modeling and Assimilation Office
Daniel Leuenberger1, Christian Keil2 and George Craig2
Stéphane Laroche Judy St-James Iriola Mati Réal Sarrazin
Steps towards evaluating the cost-benefit of observing systems
Impact of observations in the Southern Polar Area
T-NAWDEX THORPEX - North Atlantic Waveguide
Science Objectives contained in three categories
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Status Report of T-PARC/TCS-08
Results from the THORPEX Observation Impact Inter-comparison Project
Recent Forecast Impact Results from WSR and ATREC
(NRL Base-funded project)
Presentation transcript:

Report from DAOS-WG Roger Saunders and Ron Gelaro with input from WG members

Overview WG Matters (meeting, membership,..) Highlights from Exeter meeting Paper on targeted observations

Mission statement To achieve its mission the DAOS WG, in collaboration with the CBS OPAG-IOS: Addresses Data Assimilation issues including the development of improved understanding of the sources and growth of errors in analyses and forecasts Promotes research activities that lead to a better use of observations and the understanding of their value Provides input and guidance for THORPEX regional campaigns for the deployment of observations to achieve scientific objectives.

Current proposed membership Ron Gelaro(D), Co-chair NASA, USA Roger Saunders(O), Co-chair Met Office, UK Stefan Klink(O) DWD, Germany Carla Cardinali(D) ECMWF Chris Velden(O) Univ Wisconsin-CIMSS, USA Tom Hamill(D) NOAA, USA Tom Keenan(O) CAWCR, Australia Rolf Langland(D) NRL, USA Bertrand Calpini (O) MeteoSwiss, Switzerland Andrew Lorenc(D) MetOffice, UK Florence Rabier(D/O) Météo-France Prof. Bin Wang(D), Chinese Academy of Sciences, China Michael Tsyroulnikov(D) HydroMet Centre, Russia Mark Buehner (D) Environment Canada Sharan Majumdar (D) RSMAS, Univ Miami, USA Needs approval by ICSC-9 O=Observations D=Data Assimilation

3 rd THORPEX DAOS Working Group meeting Université du Québec à Montréal 8-9 July 2010 Montréal (Québec) CANADA *

DAOS-4 WG meeting Exeter June 2011 Review targetting paper Updates on THORPEX campaigns Review observing systems Review developments in data assimilation WG matters

The intercomparison experiment on the impact of observations  A goal of THORPEX is to improve our understanding of the ‘value’ of observations provided by the current global network  In 2007, DAOS-WG proposed a comparison of observation impacts in several forecast systems, facilitated by the emergence of new (adjoint-based) techniques  Experiments for a baseline observation set were designed by DAOS members from NRL, GMAO, EC, ECMWF, Météo-France …so far, results obtained for 4 systems: NRL, EC, GMAO, UKMO optimize the use of current observations inform the design/deployment of new obs systems

 AMSU-A,  Raob,  Satwind and  Aircraft have largest impact in all systems GMAO GEOS-5NRL NOGAPS EC GDPS         8 Global domain: UTC assimilations Jan 2007 Daily average observation impacts

METOP : MetOp ATOVS,MetOp IASI, MetOp ASCAT NOAA : NOAA15 ATOVS AMSUA, NOAA17 ATOVS HIRS, NOAA18 ATOVS, NOAA19 ATOVS OTHER LEO: EOS AIRS, F16 SSMIS, ERS, WINDSAT GEO : GOES, MTSAT, MSG Aircraft : AMDAR, AIREP SONDE : PILOT, TEMP SFC Land : SYNOP, BOGUS SFC Sea : BUOY,SHIP Total Impact = Number of soundings/profiles * mean observation Impact of each sounding/profile Impact of different observation platforms

10 The Concordiasi Project Additional observations over Antarctica for NWP F. Rabier, V. Guidard, S. Noton-Haurot, A. Doerenbecher, D. Puech, P. Brunel, A. Vincensini, H. Bénichou, Météo-France Ph Cocquerez, CNES A.Hertzog, F. Danis, IPSL/LMD T. Hock, S. Cohn, J. WangNCAR C. Sahin, A. Garcia-Mendez, J-N Thépaut ECMWF A. Cress, U. Pfluger, DWD R. Langland, NRL G. Verner, P. Koclas, CMC R. Gelaro, NASA/GMAO C. Parrett, R. SaundersMet Office Y. Sato JMA

11 CONCORDIASI Flights overview Sept 2010-January , a stable Austral Winter Polar Vortex

12 Sea-Ice limit 640 Dropsondes ( )

13 Sensitivity to obs performed by NRL Rolf Langland, NRL

DROP SHIP/BUOY RAOB DROP GEOS-5 Observation Impacts for Concordiasi Time Series of All Drop Cases − 60°S-90°S Observations Improved cases: RAOB-79%, SHIP/BUOY-72%, DROP-67%

Participants CMC DWD ECMWF GMAO Météo-France Met Office JMA Data Assimilation Monitoring Statistics over the Antarctic RMS(O-F) Raob T Obs Count Raob T Radiosonde Background Temperature Departures (O-F) Courtesy F. Rabier, Météo-France All models have difficulty predicting lowest-level temperatures

16 Concluding remarks on ConcordIASI Concordiasi provided an unprecedented data coverage of meteorological observations over Antarctica Both dropsonde and gondola information seem to have a positive impact on forecast performance (preliminary results from NRL, DWD and MF) Gondola temperature data at 60hPa shows the largest model errors in areas of strong gravity-wave activity Dropsonde information confirms statistics obtained with radiosondes and provide a more global view Most models have problems predicting the lowest level temperatures

DIAMET DIAbatic influences on MEsoscale structures in extratropical sTorms Geraint Vaughan, Manchester PI John Methven, Reading PI Doug Parker, Leeds PI Ian Renfrew, East Anglia PI

Relation to T-NAWDEX THORPEX-North Atlantic Waveguide and Downstream Impact Experiment T-NAWDEX originally proposed by PDP WG in 2008 (Heini Wernli, Andreas Dörnbrack, Sarah Jones, George Craig). Its overarching scientific goal is to investigate in detail the physical processes that are primarily responsible for degradation in 1-7 day forecast skill in global prediction systems and of their representation in NWP models. Was to be a HALO aircraft demonstration mission. Still aiming for August/September 2012 with DLR Falcon in conjunction with HYMEX - the Hydrological Cycle in the Mediterranean Experiment. DIAMET focusses on forecasts for lead times < 2 days using convection-permitting models and high resolution data.

DIAMET flying programme Autumn 2011 –14-30 September, flying from Cranfield –detachment to Exeter 24 Nov – 14 Dec –8 IOPs planned, 4 double and 4 single flights July-August 2012 –Cranfield-based –Focus on high-impact rainfall –2 double, 3 single flights

T-NAWDEX plans Andreas Dörnbrack, Heini Wernli, Andreas Schaefler and Ulrich Corsmeier Bidding for DLR Falcon time in August/September 2012: –August link with DIAMET conducting quasi-Lagrangian experiment to examine diabatic air mass modification –September link with HYMEX on water vapour fluxes into the Med region. –Only wind LIDAR will be available (not water vapour LIDAR) T-NAWDEX international experiment as originally envisaged: aiming for 2014/2015 including aircraft from Germany, UK, France and USA (HIAPER)

Ground-based GPS on GTS Observations available from E-GVAP

ASCAT winds for Irene and model background Only one scat now used for NWP Trials using scatterometer on Oceansat-2 Importance of Scatterometer winds

ISRO L2B vs ECMWF SDs of differences given Outliers reason for degradation w.r.t. OWDP ?  Bias at low speeds  Vector RMS difference of 2.6 m/s (>2 m/s) 1.56 m/s 1.87 m/s 1.76 m/s deg v2010

Weather Radar Global Extent ASSESS THE CURRENT AND POTENTIAL CAPABILITIES OF WEATHER RADARS FOR THE USE IN WMO INTEGRATED GLOBAL OBSERVERING SYSTEM (WIGOS ) by Ercan Büyükbaş, Turkish State Meteorological Service (TSMS) Radars now used to Verify NWP model Precipitation forecasts

Observational issues  Transition to BUFR for radiosondes provide new opportunities  GPS total zenith delay gobal coverage  Contribution to GOS by nations increasing (e.g. FY-3, Oceansat-2) to fill future gaps in GOS.  Further delay in ESA wind lidar  In-situ soil moisture and temp  Common format for rain radar data.  To improve estimates of solid precipitation and develop guidance on the accuracy and temporal resolution of solid precipitation parameters.  New observations needed for convective scale models

There is increasing evidence based upon results from A-TREC, TPARC, AMMA (in the form of OSEs, adjoint-based observation impact studies, and analysis uncertainty estimates) to recommend, if feasible, increases in observations from: Commercial aircraft over the N. Pacific, N. Atlantic, and the S. Hemisphere in general. Additional soundings from certain coastal radiosondes, including those in eastern Siberia, and perhaps selected stations in polar regions, Africa, and South America. to improve NWP forecasts in the 2-5 day timeframe. DAOS-WG statement on need for additional in-situ observations

4D error covariances Temporal covariance evolution (explicit vs. implicit evolution) EnKF and 4D-Ens-Var: 4D-Var and Ens 4D-Var: -3h0h+3h 96 NLM integrations 55 TL/AD integrations, 2 outer loop iterations

Forecast Results: En-4D-Var vs. 4D-Var-Bnmc Difference in stddev relative to radiosondes: Positive  En-4D-Var better Negative  4D-Var-Bnmc better zonal wind temp. height north tropics south

Targeted Observations for Improving Numerical Weather Prediction: An Overview S. J. Majumdar (RSMAS/U. Miami) R. Saunders, P. Gauthier (DAOS WG Co-Chairs) S. Aberson, C. Bishop, C. Cardinali, J. Caughey, A. Doerenbecher, R. Gelaro, T. Hamill, R. Langland, A. Lorenc, T. Nakazawa, F. Rabier, C. Reynolds, Y. Song, Z. Toth, C. Velden, M. Weissmann, C.-C. Wu plus contributions from past and present DAOS WG members Manuscript in preparation for WMO Report and BAMS

A. Doerenbecher, Météo France The targeting procedure

Impact of dropsonde data 5 day NCEP forecasts No dropsonde With T-PARC Dropsondes Verifying analysis

Impact of dropsonde data for Irene

Comparison of different models Tropical cyclone track forecast errors during the Summer T-PARC period for four assimilation-forecast systems. The solid (dashed) lines represent parallel analysis-forecast cycles excluding (including) T-PARC dropwindsonde data.

DAOS-WG Statement on impact of targeted data Mid-Latitude Systems For extratropical systems, the value of targeted data is found to be positive but small on average when evaluated over continental or hemispheric areas. In observing system experiments using aircraft data from field experiments, the results are mixed; while the Atlantic A-TReC study found very little impact from targeted observations, the ongoing Winter Storms Reconnaissance (WSR) programme has found that targeting results in some improvement in 2-3 day forecasts over N. America. Observations that sample dynamically sensitive areas have a bigger average impact per observation than those deployed randomly. However, unless these observations cover the entirety of the sensitive regions regularly, which is rarely the case, they cannot be expected to have a large systematic impact on the forecasts. The cumulative benefit of a small number of targeted aircraft observations to forecast accuracy over broad verification regions is smaller than that of other observing systems that provide observations with a more complete coverage. The justification of significant expenditure, for instance for a dedicated aircraft system dropping sondes, requires statistically significant results from well designed experiments. These do not currently exist in published papers for mid- latitude synoptic-scale NWP.

DAOS-WG Statement on impact of targeted data Tropical Cyclones For forecasts of the track of TCs targeted observations have proven to be beneficial statistically. The benefit to society is also more straightforward to define than for mid-latitude weather. A simple sampling strategy of observing uniformly around the TC has been shown to be effective, with most models exhibiting an improvement. However, the quantitative benefit differs from model to model, due in part to their respective treatment of routinely-available satellite and aircraft observations in their assimilation schemes. Recent studies have demonstrated that observations targeted for TCs can also improve the skill of forecasts in distant regions. The mechanisms behind how TC forecasts are improved, and can be improved further, by targeted observations are still being investigated.

DAOS-WG Statement on impact of targeted data Future Directions There is a need to assess the impact of targeted observations with more user-focused measures of the value of forecast improvements to society, while retaining the ability to get significant results from relatively short experiments. The ongoing move away from deterministic forecasts toward probabilistic forecasts means the scores should reflect reductions in initial condition uncertainty introduced through targeted observations, and the subsequent impact of these reductions on forecast uncertainty. Targeting has mostly been to improve short-range forecasts. A few studies for medium and long-range forecasts have given mixed results. In some studies, targeted observations made negligible differences to forecasts downstream, while others gave positive impacts in both mid- latitudes and tropics. More research is needed.

DAOS-WG Statement on impact of targeted data Future Directions (2) Given that we depend on the cumulative effect from many observations to have a positive average impact, broader-scale, regime-based sampling (e.g. adaptive use of satellite data) may be an effective method for ameliorating the sampling issue and increasing the impact of targeted observations on both short- and extended-range forecasts. The development of a better theoretical basis for quantitatively predicting and evaluating the error variance reduction due to any potential deployment of targeted observations should result in their more effective use. Targeting for the mesoscale with mobile observational systems is still in its infancy and needs further development. Potential examples include targeting a mobile mesonet for forecasts of severe weather, and airborne Doppler radar for forecasts of TC structure and intensity.

DAOS-WG Future Directions Leading group for DA in WMO together with WGNE. Future role in WWRP? Links with ET-EGOS, SPARC, GLASS Joint meeting with MFWR under discussion DAOS remains a global focus not mesoscale Continue mix of Observations and DA