Predictive Skill, Predictive Capability and Predictability in Ocean Forecasting Allan R. Robinson Patrick J. Haley, Jr. Pierre F.J. Lermusiaux Wayne G.

Slides:



Advertisements
Similar presentations
Predictable Chaotic Exhibits memory Equilibrium Towards non-equilibrium Acknowledgements LD is supported by NERC CASE award NER/S/A/2004/ Conclusions.
Advertisements

OSE meeting GODAE, Toulouse 4-5 June 2009 Interest of assimilating future Sea Surface Salinity measurements.
© The Aerospace Corporation 2014 Observation Impact on WRF Model Forecast Accuracy over Southwest Asia Michael D. McAtee Environmental Satellite Systems.
Polly Smith, Alison Fowler, Amos Lawless School of Mathematical and Physical Sciences, University of Reading Exploring coupled data assimilation using.
Motivation The Carolinas has had a tremendous residential and commercial investment in coastal areas during the past 10 years. However rapid development.
Predictability of Japan / East Sea (JES) System to Uncertain Initial / Lateral Boundary Conditions and Surface Winds LCDR. Chin-Lung Fang LCDR. Chin-Lung.
Aspects of the physical and physical-biogeochemical dynamics of Massachusetts Bay and Stellwagen Bank Pierre F.J. Lermusiaux Division of Engineering and.
Dennis P. Lettenmaier Alan F. Hamlet JISAO Center for Science in the Earth System Climate Impacts Group and Department of Civil and Environmental Engineering.
Real-Time ROMS Ensembles and adaptive sampling guidance during ASAP Sharanya J. Majumdar RSMAS/University of Miami Collaborators: Y. Chao, Z. Li, J. Farrara,
THE PHYSICAL BASIS OF SST MEASUREMENTS Validation and evaluation of derived SST products 1.To develop systematic approaches to L4 product intercomparison.
1 Modelled Meteorology - Applicability to Well-test Flaring Assessments Environment and Energy Division Alex Schutte Science & Community Environmental.
The Four Candidate Earth Explorer Core Missions consultative Workshop October 1999, Granada, Spain, Revised by CCT GOCE S 23 The gravity.
The Calibration Process
Objective: Test Acoustic Rapid Environmental Assessment mechanisms. Construct an adaptive AUV path control. Predict ocean in real-time. Optimize control.
A Forecasting system for the Southern California Current Emanuele Di Lorenzo Arthur Miller Bruce Cornuelle Scripps Institution of Oceanography, UCSD.
Advances in Adaptive, Interdisciplinary, Multiscale, Distributed, Web-Based, Ocean Prediction P.J. Haley, Jr. 1, A.R. Robinson 1, P.F.J. Lermusiaux 1,
Ensemble-variational sea ice data assimilation Anna Shlyaeva, Mark Buehner, Alain Caya, Data Assimilation and Satellite Meteorology Research Jean-Francois.
“IDEALIZED” WEST COAST SIMULATIONS Numerical domain Boundary conditions Forcings Wind stress: modeled as a Gaussian random process - Statistics (i.e.,
Hydrologic Modeling: Verification, Validation, Calibration, and Sensitivity Analysis Fritz R. Fiedler, P.E., Ph.D.
The Importance of Atmospheric Variability for Data Requirements, Data Assimilation, Forecast Errors, OSSEs and Verification Rod Frehlich and Robert Sharman.
Oceanic and Atmospheric Modeling of the Big Bend Region Steven L. Morey, Dmitry S. Dukhovksoy, Donald Van Dyke, and Eric P. Chassignet Center for Ocean.
1 NOS Coastal Ocean Operational Forecast Systems Presented By: Patrick Burke (NOS/CO-OPS) Contributors: Aijun Zhang (CO-OPS), Peter Stone (CO-OPS), Edward.
Harvard UniversityP.F.J. Lermusiaux et al. ADVANCED INTERDISCIPLINARY DATA ASSIMILATION: FILTERING AND SMOOTHING VIA ESSE P.F.J. Lermusiaux, A.R. Robinson,
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High-resolution data assimilation in COSMO: Status and.
CDC Cover. NOAA Lab roles in CCSP Strategic Plan for the U.S. Climate Change Science Program: Research Elements Element 3. Atmospheric Composition Aeronomy.
Potential benefits from data assimilation of carbon observations for modellers and observers - prerequisites and current state J. Segschneider, Max-Planck-Institute.
Where the Research Meets the Road: Climate Science, Uncertainties, and Knowledge Gaps First National Expert and Stakeholder Workshop on Water Infrastructure.
Data assimilation and observing systems strategies Pierre Gauthier Data Assimilation and Satellite Meteorology Division Meteorological Service of Canada.
1 CUTTING-EDGE CLIMATE SCIENCE AND SERVICES Geoff Love.
“Toward a GOOS glider programme: Tools and methods” General Assembly.
The Rutgers IMCS Ocean Modeling Group Established in 1990, the Ocean Modeling Group at Rutgers has as one of it foremost goals the development and interdisciplinary.
Modeling the upper ocean response to Hurricane Igor Zhimin Ma 1, Guoqi Han 2, Brad deYoung 1 1 Memorial University 2 Fisheries and Oceans Canada.
Polar Prediction The Scientific Challenges - Antarctica John Turner British Antarctic Survey Cambridge, UK.
AN ENHANCED SST COMPOSITE FOR WEATHER FORECASTING AND REGIONAL CLIMATE STUDIES Gary Jedlovec 1, Jorge Vazquez 2, and Ed Armstrong 2 1NASA/MSFC Earth Science.
Towards a regional rapid response multi-disciplinary system for the Adriatic Sea A. RUSSO 1, N. Pinardi 2, C.J. Lozano 3, A.R. Robinson 3, E. Paschini.
Validation of decadal simulations of mesoscale structures in the North Sea and Skagerrak Jon Albretsen and Lars Petter Røed.
Georgia Institute of Technology Initial Application of the Adaptive Grid Air Quality Model Dr. M. Talat Odman, Maudood N. Khan Georgia Institute of Technology.
Optimization & Control Optimal predetermined path — 1 stage of adaptivity  Network optimization algorithm  Non-linear programming Optimal adaptive sampling.
Modeling the biological response to the eddy-resolved circulation in the California Current Arthur J. Miller SIO, La Jolla, CA John R. Moisan NASA.
“Very high resolution global ocean and Arctic ocean-ice models being developed for climate study” by Albert Semtner Extremely high resolution is required.
W.G. Leslie, P.J. Haley, Jr., Pierre F.J. Lermusiaux (PI), MIT Multidisciplinary Simulation, Estimation, and Assimilation Systems (MSEAS) OOI Cyberinfrastructure:
Wayne G. Leslie 13 November 2002 Harvard Ocean Prediction System (HOPS) Operational Forecasting and Adaptive Sampling.
National Weather Service Water Science and Services John J. Kelly, Jr. Director, National Weather Service NOAA Science Advisory Board November 6, 2001.
Modeling the Gulf of Alaska using the ROMS three-dimensional ocean circulation model Yi Chao 1,2,3, John D. Farrara 2, Zhijin Li 1,2, Xiaochun Wang 2,
Core Theme 5: Technological Advancements for Improved near- realtime data transmission and Coupled Ocean-Atmosphere Data Assimilation WP 5.2 Development.
Coastal Process Modeling US Army Corps of Engineers Jeff Hanson Research Oceanographer MORPHOS Program Manager US Army Engineer Research and Development.
Evaluation of the Real-Time Ocean Forecast System in Florida Atlantic Coastal Waters June 3 to 8, 2007 Matthew D. Grossi Department of Marine & Environmental.
Surface Water Virtual Mission Dennis P. Lettenmaier, Kostas Andreadis, and Doug Alsdorf Department of Civil and Environmental Engineering University of.
Multidisciplinary Ocean Dynamics and Engineering Laboratory: Simulation, Estimation and Assimilation Systems Massachusetts Institute of Technology, Department.
Potential for estimation of river discharge through assimilation of wide swath satellite altimetry into a river hydrodynamics model Kostas Andreadis 1,
VERIFICATION OF A DOWNSCALING SEQUENCE APPLIED TO MEDIUM RANGE METEOROLOGICAL PREDICTIONS FOR GLOBAL FLOOD PREDICTION Nathalie Voisin, Andy W. Wood and.
The application of ensemble Kalman filter in adaptive observation and information content estimation studies Junjie Liu and Eugenia Kalnay July 13th, 2007.
Global vs mesoscale ATOVS assimilation at the Met Office Global Large obs error (4 K) NESDIS 1B radiances NOAA-15 & 16 HIRS and AMSU thinned to 154 km.
Indicators for Climate Change over Mauritius Mr. P Booneeady Pr. SDDV Rughooputh.
Ocean Monitoring and Forecasting A Commercial Perspective Dr Ralph Rayner Ocean Numerics/Fugro GEOS.
1 C. “Nick” Arge Space Vehicles Directorate/Air Force Research Laboratory Kirtland AFB Magnetogram Mini-Workshop UCLA, CA April 2-3, 2009 The ADAPT Model.
RTOFS Monitoring and Evaluation Metrics Avichal Mehra MMAB/EMC/NCEP/NWS.
Carbon Cycle Data Assimilation with a Variational Approach (“4-D Var”) David Baker CGD/TSS with Scott Doney, Dave Schimel, Britt Stephens, and Roger Dargaville.
Climate and Global Dynamics Laboratory, NCAR
Nathalie Voisin, Andy W. Wood and Dennis P. Lettenmaier
Naval Research Laboratory
Decadal Climate Forecasting Project
Ensemble simulations and the ocean’s mesoscale
Surface Water Virtual Mission
NOAA Objective Sea Surface Salinity Analysis P. Xie, Y. Xue, and A
Modeling, Predictions and Adaptive Sampling Team
Adjoint Sensitivity Studies on the US East Coast
Seasonal Forecasting Using the Climate Predictability Tool
P2.5 Sensitivity of Surface Air Temperature Analyses to Background and Observation Errors Daniel Tyndall and John Horel Department.
Presentation transcript:

Predictive Skill, Predictive Capability and Predictability in Ocean Forecasting Allan R. Robinson Patrick J. Haley, Jr. Pierre F.J. Lermusiaux Wayne G. Leslie Division of Engineering and Applied Sciences Department of Earth and Planetary Sciences Harvard University 29 October 2002

Ocean Prediction Ocean prediction for science and operational applications has been initiated on basin and regional scales. Evaluation is now essential. Predictability limit is the time for two slightly different ocean states to evolve into realistic but entirely different states Predictive capability is ultimately limited by predictability but errors in data, models and methodology now limit prediction capability to shorter times

Predictive Skill Qualitative and quantitative evaluation of ocean forecasts by generic and regional-specific skill metrics is essential Phase errors/structural errors, initial/BC/model errors and their sources need to be identified Simple metrics from meteorology (root-mean square error, anomaly pattern correlation coefficient) used now but more sophisticated statistical metrics and quantitative measures associated with underlying dynamical processes are required.

CPSE/REA Coastal Predictive Skill Experiment (CPSE) measures the ability of a forecast system to combine model results and observations in coastal domains or regimes and to accurately define the present state and predict the future state –oversampling is required for rigorous quantitative verification –provides the basis for optimal, efficient sampling for required accuracies Rapid Environmental Assessment (REA) defined in the NATO naval environment as "the acquisition, compilation and release of tactically relevant environmental information in a tactically relevant time frame"

Assessment of Skill for Coastal Ocean Transients – 6-26 June 2001 – Massachusetts Bay and Gulf of Maine – Predictive Skill Experiment – quantitative skill evaluation – forecast system development – real-time at-sea forecasting – real-time adaptive sampling Coupled Physical-Biological Experiment – initialization surveys of Mass. Bay and Gulf of Maine – wind-induced events, e.g. upwelling and buoyancy circulations – Gulf of Maine inflow to Mass. Bay – Mass. Bay outflow to Gulf of Maine – MWRA diffuser dispersion – verification survey of Mass. May Multiple vessels – NRV Alliance – SACLANTCEN – La Spezia,Italy – RV Gulf Challenger – UNH – Portsmouth, NH – RV Lucky Lady – UMass-Dartmouth – New Bedford, MA – RV Neritic – UMass-Boston – Boston, MA ASCOT-01

ASCOT-01 Data and Modeling Domains 6-26 June 2001

Forecast Skill Metrics Skill of the operational forecasts is measured using the metrics, Root-Mean-Square Error (RMSE) and Pattern Correlation Coefficient (PCC). These numbers are computed model level by model level (1 to 16), and as a volume average. Perfect values of the RMSE and PCC are, respectively, zero and one. The metrics RSME and PCC are respectively defined by: where denotes the true ocean, its forecast, a background field vector (e.g. large-scale field, climatological field, etc.), and ||. || 2 the vector l 2 norm. A classic measure of skill is to compare the RMS and PCC of the forecast with that of the initial conditions (IC) (persistence). If the RMSE of the forecast is smaller than that of the IC, the forecast has RMS-skill or beats persistence. Similarly, if the PCC of the forecast is larger than that of the IC, the forecast has PCC-skill or has better patterns than persistence.

Observation Errors – ASCOT June 2001

ASCOT-01 Skill Metrics RMS (Temperature - Left; Salinity - Right) PCC (Temperature - Left; Salinity - Right)

Assessment of Skill for Coastal Ocean Transients – 7-17 May 2002 – Tyhrrenian Sea, Ligurian Sea, Corsican Channel, Elba – Predictive Skill Experiment – quantitative skill evaluation – forecast system development – real-time at-sea forecasting – real-time adaptive sampling – rigorous test of distributed ocean prediction system – AUV exercise support Physics Experiment – initialization survey of Corsican Channel and Elba island region – flow between Corsica and Elba – anticyclone north of Elba – flow between Elba and the coast of Italy – reduce multi-variate forecast errors Multiple vessels – NRV Alliance – SACLANTCEN – La Spezia,Italy – AUVs – SACLANTCEN – La Spezia,Italy – AUVs – MIT – Cambridge, MA ASCOT-02

ASCOT-02 Data and Modeling Domains 7-17 May 2002

Observation Errors – ASCOT May16 May

ASCOT-02 Skill Metrics RMS (Temperature - Left; Salinity - Right) PCC (Temperature - Left; Salinity - Right)

General Adaptive Sampling Objectives Go to dynamical “hotspots” Reduce error variance  Reduce errors for tomorrow  Maintain accurate forecast Maintain accurate synoptic picture Optimal sampling issues  Automate all 3 above quantitatively  Nonlinear and interdisciplinary impacts on the sampling  Optimal sampling can be highly dependent on objectives and metrics  Reducing error in analysis differs from reducing error in forecast  Minimal final time error differs from minimal time-averaged error  Minimize cost function containing 3 terms based on:  forecasted model errors (ESSE),  forecasted significant dynamical events (MS-EVA, pattern recognition)  maximum length of time an area can be left without updating

Motivations for Adaptive Sampling Tracks – ASCOT-02/GOATS Sample in regions not yet covered to locate local structures Sample in regions not recently covered to understand evolution of structures Determine strength and structure of anticyclone north of Elba Determine general nature of flow in vicinity of Procchio Bay (e.g.. is it from north or result of flow through Corsican Channel from Tyrrhenian turning around island?) Evaluate structure and evolution of flow between Corsica and Elba Determine impact of flow between Elba and coast of Italy

Adaptive sampling tracks designed on a real-time basis. AUV - Procchio BayNRV Alliance - Channel Domain

(Top left) Surface temperature after 4 days of model run. Overlaid on the temperature field are the 50, 200 and 500m isobaths. (Right) Satellite sea surface temperature. (Bottom Left) Surface current from the ocean model. All fields are from 3 October.

Currents measured by NRV Alliance with the ship-borne ADCP during the first update surveys. Data of 4 consecutive nights are merged. The SE current in the south-eastern corner is due to high winds. Currents measured by NRV Alliance with the ship-borne ADCP during update surveys in early October. The anti-cyclonic eddy has shifted towards the north.

HOPS ASCOT-01 Simulations (5 meters), SeaWiFS Composite Imagery and in situ data 13 June 20 June June June

Conclusions It is critically important to interpret and evaluate regional forecasts in order to establish usefulness to scientific and applied communities Results from ASCOT highlight the dual use of data for assimilation and skill evaluation and demonstrate quantitative forecast skill Real-time forecast experiments can lead to discoveries of regional features Multi-scale adaptive sampling is a fundamental component of forecast systems

Issues in Multiscale Adaptive Sampling Uniformly sampled observations for initialization and assimilation as forecasts advance in time  sampled uniformly over a predetermined space-time grid, adequate to resolve scales of interest  only a small subset of observations have significant impact on the accuracy of the forecasts  impact subset is related to intermittent energetic synoptic dynamical events Adaptively sampled observations for initialization and assimilation as forecasts advance in time  sampling scheme tailored to the ocean state to be observed  knowledge of ocean state from ongoing observations, nowcasts and forecasts  adaptive sampling targets observations of greatest impact  efficient adaptive sampling reduce observational requirements by one or two orders of magnitude Subjective adaptive sampling and objective adaptive sampling  sampling can be based on environmental forecasts or error forecasts  forecast information combined with a priori experience to intuitively choose future sampling  objectively, forecast serves as input to a quantitative sampling criterion whose optimization predicts the adapted sampling  automated objective adaptive sampling