Power Regression & Regression estimation of event probabilities (REEP)

Slides:



Advertisements
Similar presentations
Sociology 680 Multivariate Analysis Logistic Regression.
Advertisements

ECMWF long range forecast systems
Logistic Regression Psy 524 Ainsworth.
Willem A. Landman & Francois Engelbrecht.  Nowcasting: A description of current weather parameters and 0 to 2 hours’ description of forecast weather.
Willem A. Landman Ruth Park Stephanie Landman Francois Engelbrecht.
Week 3. Logistic Regression Overview and applications Additional issues Select Inputs Optimize complexity Transforming Inputs.
Potential Predictability and Extended Range Prediction of Monsoon ISO’s Prince K. Xavier Centre for Atmospheric and Oceanic Sciences Indian Institute of.
Creating probability forecasts of binary events from ensemble predictions and prior information - A comparison of methods Cristina Primo Institute Pierre.
Tropical Cyclone Forecasts Dr. Richard J. Murnane Risk Prediction Initiative Bermuda Biological Station for Research, Inc.
Analyzing quantitative data – section III Week 10 Lecture 1.
How Climate Can Be Predicted Why Some Predictability Exists, and How Predictions Can Be Made.
© Crown copyright Met Office Andrew Colman presentation to EuroBrisa Workshop July Met Office combined statistical and dynamical forecasts for.
¿How sensitive are probabilistic precipitation forecasts to the choice of the ensemble generation method and the calibration algorithm? Juan J. Ruiz 1,2.
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
A Regression Model for Ensemble Forecasts David Unger Climate Prediction Center.
Discriminant Analysis Testing latent variables as predictors of groups.
Summer 2010 Forecast. Outline Review seasonal predictors Focus on two predictors: ENSO Soil moisture Summer forecast Look back at winter forecast Questions.
AMS Short Course on Probabilistic Forecasting, 9th January Statistical Models for Probabilistic Forecasting Ian Jolliffe
The Long Journey of Medium-Range Climate Prediction Ed O’Lenic, NOAA-NWS-Climate Prediction Center.
SIO 210: ENSO conclusion Dec. 2, 2004 Interannual variability (end of this lecture + next) –Tropical Pacific: El Nino/Southern Oscillation –Southern Ocean.
Marshall University School of Medicine Department of Biochemistry and Microbiology BMS 617 Lecture 12: Multiple and Logistic Regression Marshall University.
Multi-Model Ensembling for Seasonal-to-Interannual Prediction: From Simple to Complex Lisa Goddard and Simon Mason International Research Institute for.
Approaches to Seasonal Drought Prediction Bradfield Lyon CONAGUA Workshop Nov, 2014 Mexico City, Mexico.
FORECAST SST TROP. PACIFIC (multi-models, dynamical and statistical) TROP. ATL, INDIAN (statistical) EXTRATROPICAL (damped persistence)
Model validation Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015.
Latest results in verification over Poland Katarzyna Starosta, Joanna Linkowska Institute of Meteorology and Water Management, Warsaw 9th COSMO General.
Verification of IRI Forecasts Tony Barnston and Shuhua Li.
Regression. Types of Linear Regression Model Ordinary Least Square Model (OLS) –Minimize the residuals about the regression linear –Most commonly used.
Forecasting in CPT Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015.
Probabilistic Forecasting. pdfs and Histograms Probability density functions (pdfs) are unobservable. They can only be estimated. They tell us the density,
Model Post Processing. Model Output Can Usually Be Improved with Post Processing Can remove systematic bias Can produce probabilistic information from.
Linear Regression Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015.
An Examination Of Interesting Properties Regarding A Physics Ensemble 2012 WRF Users’ Workshop Nick P. Bassill June 28 th, 2012.
One-year re-forecast ensembles with CCSM3.0 using initial states for 1 January and 1 July in Model: CCSM3 is a coupled climate model with state-of-the-art.
Alan F. Hamlet Andy Wood Dennis P. Lettenmaier JISAO Center for Science in the Earth System Climate Impacts Group and the Department.
ECMWF Training course 26/4/2006 DRD meeting, 2 July 2004 Frederic Vitart 1 Predictability on the Monthly Timescale Frederic Vitart ECMWF, Reading, UK.
Details for Today: DATE:13 th January 2005 BY:Mark Cresswell FOLLOWED BY:Practical Dynamical Forecasting 69EG3137 – Impacts & Models of Climate Change.
Description of the IRI Experimental Seasonal Typhoon Activity Forecasts Suzana J. Camargo, Anthony G. Barnston and Stephen E.Zebiak.
DISCRIMINANT ANALYSIS. Discriminant Analysis  Discriminant analysis builds a predictive model for group membership. The model is composed of a discriminant.
Marshall University School of Medicine Department of Biochemistry and Microbiology BMS 617 Lecture 13: Multiple, Logistic and Proportional Hazards Regression.
Coupled Initialization Experiments in the COLA Anomaly Coupled Model
IRI Climate Forecasting System
Skillful Arctic climate predictions
LONG RANGE FORECAST SW MONSOON
Using teleconnections from the Pacific and Indian oceans for short-
Chapter 7. Classification and Prediction
Logistic Regression APKC – STATS AFAC (2016).
Challenges of Seasonal Forecasting: El Niño, La Niña, and La Nada
LONG RANGE FORECAST SW MONSOON
Generalized Linear Models
IRI Multi-model Probability Forecasts
LONG RANGE FORECAST SW MONSOON
Verifying and interpreting ensemble products
Chapter 4: Seasonal Series: Forecasting and Decomposition
Question 1 Given that the globe is warming, why does the DJF outlook favor below-average temperatures in the southeastern U. S.? Climate variability on.
Makarand A. Kulkarni Indian Institute of Technology, Delhi
Seasonal prediction of South Asian summer monsoon 2010: Met Office
Improving forecasts through rapid updating of temperature trajectories and statistical post-processing Nina Schuhen, Thordis L. Thorarinsdottir and Alex.
Post Processing.
Progress in Seasonal Forecasting at NCEP
The Importance of Reforecasts at CPC
N. Voisin, J.C. Schaake and D.P. Lettenmaier
Soc 3306a Lecture 11: Multivariate 4
IRI forecast April 2010 SASCOF-1
Case Studies in Decadal Climate Predictability
2. Natural Climate Variability
GloSea4: the Met Office Seasonal Forecasting System
Seasonal Forecasting Using the Climate Predictability Tool
Can we distinguish wet years from dry years?
Short Range Ensemble Prediction System Verification over Greece
Presentation transcript:

Power Regression & Regression estimation of event probabilities (REEP) APKC – AFAC (2016)

Power Regression Another non-linear regression model is the power regression model, which is based on the following equation: Taking the natural log of both sides of the equation, we have the following equivalent equation: This equation has the form of a linear regression model (where I have added an error termε):

A model of the form ln y = β ln x + δ is referred to as a log-log regression model. Since if this equation holds, we have it follows that any such model can be expressed as a power regression model of form y =αxβ by setting α = eδ.

to artificial skill and poor forecasts of independent data to artificial skill and poor forecasts of independent data. Given the social and economic importance of monsoon forecasts, it is of interest to examine this model more closely.

Regression Estimation of Event Probabilities

AMS Short Course on Probabilistic Forecasting, 9th January 2005 We have concentrated on binary forecasts, though continuous data have been mentioned briefly. Another major data type is categorical with 3 or more categories, where we want probability forecasts for each category We can use linear regression separately for each category (REEP – regression estimation of event probabilities) We can use other techniques for binary forecasts (logistic regression, discriminant analysis etc.) for each category There are extensions of logistic regression for ordered categories (the most usual case) or unordered (nominal) categories Discriminant analysis can also be extended to more than 2 groups (any ordering is not taken into account). AMS Short Course on Probabilistic Forecasting, 9th January 2005

Readings I – Gahrs et al. (2003) Data – 24-hour precipitation amounts above various thresholds. 234 potential predictors – reduced to 20, then fewer. Methods – linear regression, logistic regression, ‘binning’ (a contingency table approach). Methods for variable selection and parameter estimation discussed. Results – logistic regression outperforms linear regression. ‘Binning’ is competitive at some, but not all, thresholds. AMS Short Course on Probabilistic Forecasting, 9th January 2005

Readings II – Hamill et al. (2004) Data – 6-10 day and week 2 forecasts of surface temperature and precipitation over thresholds, corresponding to terciles, for 484 stations. 15-member ensembles of forecasts are available. Method – logistic regression using as a single predictor, ensemble mean forecast (precipitation) or forecast anomaly (temperature). A MOS approach. Results – method outperforms operational NCEP forecasts for data set examined. AMS Short Course on Probabilistic Forecasting, 9th January 2005

Readings III – Hennon & Hobgood (2003) Data – properties of tropical cloud clusters during Atlantic hurricane seasons, and whether they develop into tropical depressions(DV) or not – 8 predictors. Method – linear discriminant analysis giving a probability, p, of DV. DV is unlikely if p < 0.7, likely if p > 0.9. AMS Short Course on Probabilistic Forecasting, 9th January 2005

Readings IV – Mason & Mimmack (2002) Data – monthly ENSO anomalies (Niño-3.4) grouped into 5 equiprobable categories. Predictors are 5 leading principal components of tropical Pacific sea surface temperatures in an earlier month. Methods – various methods for two categories implemented separately for each category: linear regression (two variants including a ‘contingency table’ approach), two forms of discriminant analysis, 3 GLMs including logistic regression. Also extensions of GLMs to more than two categories. Results – the main comparison is models vs. (damped) persistence, not between the models themselves – see next slide. AMS Short Course on Probabilistic Forecasting, 9th January 2005

AMS Short Course on Probabilistic Forecasting, 9th January 2005                                                                      FIG. 2. Ranked probability skill scores for retroactive forecasts at increasing lead times of monthly Niño-3.4 sea surface temperature anomaly categories for the 20-yr period Jan 1981–Dec 2000. The skill scores are calculated with reference to a strategy of random guessing. The black bars represent the scores for the models, and the dark (light) gray bars are for forecasts of persisted anomaly categories (damped toward climatology).    [previous] [next] Example with several groups/categories From Mason and Mimmack (2002) - compares various methods when there are 5 categories to forecast. Their ‘canonical variate’ method produces probabilities equivalent to our ‘discriminant analysis; their discriminant analysis (predictive) is slightly different. Figure 2. Ranked probability skill scores for retroactive forecasts at increasing lead times of monthly Niño-3.4 sea surface temperature anomaly categories for the 20-yr period Jan 1981–Dec 2000. The skill scores are calculated with reference to a strategy of random guessing. The black bars represent the scores for the models, and the dark (light) gray bars are for forecasts of persisted anomaly categories (damped toward climatology). AMS Short Course on Probabilistic Forecasting, 9th January 2005