Mathematics of PCR and CCA Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January.

Slides:



Advertisements
Similar presentations
Computing in Archaeology Session 12. Multivariate statistics © Richard Haddlesey
Advertisements

Overview of Techniques Case 1 Independent Variable is Groups, or Conditions Dependent Variable is continuous ( ) One sample: Z-test or t-test Two samples:
1 G Lect 4M Interpreting multiple regression weights: suppression and spuriousness. Partial and semi-partial correlations Multiple regression in.
Regression analysis Relating two data matrices/tables to each other Purpose: prediction and interpretation Y-data X-data.
Niamey, Niger, 1 st June 2007 La prevision saisonniere avec l’outil CPT By: Ousmane NDIAYE.
CanSISE East meeting, CIS, 10 February 2014 Seasonal forecast skill of Arctic sea ice area Michael Sigmond (CCCma) Sigmond, M., J. Fyfe, G. Flato, V. Kharin,
Prediction, Correlation, and Lack of Fit in Regression (§11. 4, 11
Climate Predictability Tool (CPT)
Combining Predictors and Predictands in CPT
Clim.pact – a tool for empirical-statistical downscaling Monika Cahynová cas.cz Institute of Atmospheric Physics & Faculty of Science, Charles.
Predicting indices of climate extremes using eigenvectors of SST and MSLP Malcolm Haylock, CRU.
Principal Components. Karl Pearson Principal Components (PC) Objective: Given a data matrix of dimensions nxp (p variables and n elements) try to represent.
Functional Data Analysis T Chapters 10,11,12 Markus Kuusisto.
Two adaptive radiation parameterisations Annika Schomburg 1), Victor Venema 1), Felix Ament 2), Clemens Simmer 1) 1) Department of Meteorology, University.
Data mining and statistical learning - lecture 11 Neural networks - a model class providing a joint framework for prediction and classification  Relationship.
Statistical Methods for long-range forecast By Syunji Takahashi Climate Prediction Division JMA.
How do you simplify? Simple Complicated.
Dr Mark Cresswell Statistical Forecasting [Part 1] 69EG6517 – Impacts & Models of Climate Change.
A Brief Introduction to Statistical Forecasting Kevin Werner.
Multi-Model Ensembling for Seasonal-to-Interannual Prediction: From Simple to Complex Lisa Goddard and Simon Mason International Research Institute for.
Seasonal Forecasting Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015.
Extensions of PCA and Related Tools
Climate Predictability Tool (CPT) Ousmane Ndiaye and Simon J. Mason International Research Institute for Climate and Society The Earth.
Canonical Correlation Analysis and Related Techniques Simon Mason International Research Institute for Climate Prediction The Earth Institute of Columbia.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
Contacts: Werapol Bejranonda and Manfred Koch
What is Modeling?. Simplifying Complex Phenomena v We live in a complex world v Most of the scientific relationships we study are very complex v Understanding.
Model validation Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015.
Forecasting in CPT Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015.
Climate Predictability Tool (CPT) Ousmane Ndiaye and Simon J. Mason International Research Institute for Climate and Society The Earth.
Principal Components: A Mathematical Introduction Simon Mason International Research Institute for Climate Prediction The Earth Institute of Columbia University.
Can we distinguish wet years from dry years? Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand,
Carlos H. R. Lima - Depto. of Civil and Environmental Engineering, University of Brasilia. Brazil. Upmanu Lall - Water Center, Columbia.
Linear Regression Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015.
Review Use data table from Quiz #4 to forecast sales using exponential smoothing, α = 0.2 What is α called? We are weighting the error associated with.
Module III Multivariate Analysis Techniques- Framework, Factor Analysis, Cluster Analysis and Conjoint Analysis Research Report.
Advanced Correlation D/RS 1013 Research Questions and Associated Techniques.
1 Forecasting/ Causal Model MGS Forecasting Quantitative Causal Model Trend Time series Stationary Trend Trend + Seasonality Qualitative Expert.
Principle Components Analysis A method for data reduction.
Multivariate Transformation. Multivariate Transformations  Started in statistics of psychology and sociology.  Also called multivariate analyses and.
Multivariate statistical methods. Multivariate methods multivariate dataset – group of n objects, m variables (as a rule n>m, if possible). confirmation.
Chapter 12 REGRESSION DIAGNOSTICS AND CANONICAL CORRELATION.
Regression Chapter 6 I Introduction to Regression
Multiple Linear Regression
What is Correlation Analysis?
Factor analysis Advanced Quantitative Research Methods
Quantitative Methods
Quantitative Methods
Quantitative Methods
Quantitative Methods
Quantitative Methods
Quantitative Methods
9/19/2018 ST3131, Lecture 6.
Multiple Regression.
Simple Linear Regression
Eco 6380 Predictive Analytics For Economists Spring 2014
Constructing and Validating the statistical regression model
Relative Operating Characteristics
REGRESSION.
Multivariate Statistics
Cross-validation for the selection of statistical models
Variable Selection - Accelerator
Seasonal Forecasting Using the Climate Predictability Tool
Can we distinguish wet years from dry years?
Seasonal Forecasting Using the Climate Predictability Tool
Canonical Correlation Analysis and Related Techniques
Cases. Simple Regression Linear Multiple Regression.
Principal Component Analysis
Seasonal Forecasting Using the Climate Predictability Tool
Regression and Correlation of Data
Presentation transcript:

Mathematics of PCR and CCA Simon Mason Seasonal Forecasting Using the Climate Predictability Tool Bangkok, Thailand, 12 – 16 January 2015

2 Seasonal Forecasting Using the Climate Predictability Tool Principal Components Regression Instead of using the original data as predictors, we can use the principal components as predictors in the same simple linear regression (SLR) model. The PCR option contains the information in many of the original predictors, and so a complex MLR model can be simplified considerably:

3 Seasonal Forecasting Using the Climate Predictability Tool

4

5

6

7 Canonical Correlation Analysis (CCA) The weights V X and V Y are defined so that Z X and Z Y have maximum correlation. R is diagonal matrix of correlations. The current SSTs are represented by x. In CPT, the CCA is performed using principal components of X and Y to avoid over-fitting. Suitable for multiple predictors, and multiple predictands. Predictions are spatially consistent.