Christina Bonfanti University of Miami- RSMAS MPO 524.

Slides:



Advertisements
Similar presentations
Face Recognition Sumitha Balasuriya.
Advertisements

Krishna Rajan Data Dimensionality Reduction: Introduction to Principal Component Analysis Case Study: Multivariate Analysis of Chemistry-Property data.
Principal Component Analysis for SPAT PG course Joanna D. Haigh.
Tensors and Component Analysis Musawir Ali. Tensor: Generalization of an n-dimensional array Vector: order-1 tensor Matrix: order-2 tensor Order-3 tensor.
III-1 WMO course - “Statistics and Climatology” - Lecture III Dr. Bertrand Timbal Regional Meteorological Training Centre, Tehran, Iran December 2003.
1er. Escuela Red ProTIC - Tandil, de Abril, 2006 Principal component analysis (PCA) is a technique that is useful for the compression and classification.
The Effects of El Niño-Southern Oscillation on Lightning Variability over the United States McArthur “Mack” Jones Jr. 1, Jeffrey M. Forbes 1, Ronald L.
Response Surface Method Principle Component Analysis
Lecture 7: Principal component analysis (PCA)
1 Multivariate Statistics ESM 206, 5/17/05. 2 WHAT IS MULTIVARIATE STATISTICS? A collection of techniques to help us understand patterns in and make predictions.
Principal Components Analysis Babak Rasolzadeh Tuesday, 5th December 2006.
Principal Components An Introduction Exploratory factoring Meaning & application of “principal components” Basic steps in a PC analysis PC extraction process.
Face Recognition Using Eigenfaces
Microarray analysis Algorithms in Computational Biology Spring 2006 Written by Itai Sharon.
Exploring Microarray data Javier Cabrera. Outline 1.Exploratory Analysis Steps. 2.Microarray Data as Multivariate Data. 3.Dimension Reduction 4.Correlation.
1 Econometric Load Forecasting Peak and Energy Forecast 06/14/2005 Econometric Load Forecasting Peak and Energy Forecast 06/14/2005.
What is EOF analysis? EOF = Empirical Orthogonal Function Method of finding structures (or patterns) that explain maximum variance in (e.g.) 2D (space-time)
Tables, Figures, and Equations
Principal Component Analysis. Consider a collection of points.
Techniques for studying correlation and covariance structure
Principal Component Analysis. Philosophy of PCA Introduced by Pearson (1901) and Hotelling (1933) to describe the variation in a set of multivariate data.
Extreme Events and Climate Variability. Issues: Scientists are telling us that global warming means more extreme weather. Every year we seem to experience.
The Tutorial of Principal Component Analysis, Hierarchical Clustering, and Multidimensional Scaling Wenshan Wang.
Summarized by Soo-Jin Kim
Principle Component Analysis Presented by: Sabbir Ahmed Roll: FH-227.
Chapter 2 Dimensionality Reduction. Linear Methods
Principal Components Analysis BMTRY 726 3/27/14. Uses Goal: Explain the variability of a set of variables using a “small” set of linear combinations of.
PCA Example Air pollution in 41 cities in the USA.
Extensions of PCA and Related Tools
What is it? Principal Component Analysis (PCA) is a standard tool in multivariate analysis for examining multidimensional data To reveal patterns between.
Principal Component Analysis Bamshad Mobasher DePaul University Bamshad Mobasher DePaul University.
Canonical Correlation Analysis and Related Techniques Simon Mason International Research Institute for Climate Prediction The Earth Institute of Columbia.
Descriptive Statistics vs. Factor Analysis Descriptive statistics will inform on the prevalence of a phenomenon, among a given population, captured by.
A B S T R A C T The study presents the application of selected chemometric techniques to the pollution monitoring dataset, namely, cluster analysis,
Slicing and dicing the 153-year record of monthly sea level at San Francisco, California using singular spectrum analysis Larry Breaker Moss Landing Marine.
Quantifying the Link Between Climate and Fire In Alaska.
Central limit theorem revisited
Principal Components: A Mathematical Introduction Simon Mason International Research Institute for Climate Prediction The Earth Institute of Columbia University.
Principal Components Analysis. Principal Components Analysis (PCA) A multivariate technique with the central aim of reducing the dimensionality of a multivariate.
Carlos H. R. Lima - Depto. of Civil and Environmental Engineering, University of Brasilia. Brazil. Upmanu Lall - Water Center, Columbia.
Reduces time complexity: Less computation Reduces space complexity: Less parameters Simpler models are more robust on small datasets More interpretable;
EIGENSYSTEMS, SVD, PCA Big Data Seminar, Dedi Gadot, December 14 th, 2014.
Principle Component Analysis and its use in MA clustering Lecture 12.
Principal Component Analysis (PCA)
Principal Component Analysis (PCA)
Principal Component Analysis Zelin Jia Shengbin Lin 10/20/2015.
Feature Extraction 主講人:虞台文. Content Principal Component Analysis (PCA) PCA Calculation — for Fewer-Sample Case Factor Analysis Fisher’s Linear Discriminant.
D/RS 1013 Discriminant Analysis. Discriminant Analysis Overview n multivariate extension of the one-way ANOVA n looks at differences between 2 or more.
3 “Products” of Principle Component Analysis
Feature Extraction 主講人:虞台文.
Central limit theorem revisited Throw a dice twelve times- the distribution of values is not Gaussian Dice Value Number Of Occurrences.
Principal Components Analysis ( PCA)
Central limit theorem - go to web applet. Correlation maps vs. regression maps PNA is a time series of fluctuations in 500 mb heights PNA = 0.25 *
Multivariate statistical methods. Multivariate methods multivariate dataset – group of n objects, m variables (as a rule n>m, if possible). confirmation.
Methods of multivariate analysis Ing. Jozef Palkovič, PhD.
PRINCIPAL COMPONENT ANALYSIS(PCA) EOFs and Principle Components; Selection Rules LECTURE 8 Supplementary Readings: Wilks, chapters 9.
Principal Component Analysis (PCA)
Slicing and dicing the 153-year record of monthly
Exploring Microarray data
Correlations between Atlantic SST and drought conditions
Question 1 Given that the globe is warming, why does the DJF outlook favor below-average temperatures in the southeastern U. S.? Climate variability on.
Principal Component Analysis
Techniques for studying correlation and covariance structure
Descriptive Statistics vs. Factor Analysis
Fig. 1 The temporal correlation coefficient (TCC) skill for one-month lead DJF prediction of 2m air temperature obtained from 13 coupled models and.
Multivariate Analysis of a Carbonate Chemistry Time-Series Study
PCA of Waimea Wave Climate
Principal Component Analysis
Marios Mattheakis and Pavlos Protopapas
Outline Variance Matrix of Stochastic Variables and Orthogonal Transforms Principle Component Analysis Generalized Eigenvalue Decomposition.
Presentation transcript:

Christina Bonfanti University of Miami- RSMAS MPO 524

* How does the Arctic Oscillation and El Nino/Southern Oscillation interact to affect weather over the United States?

Winter ENSO trends Expect to see some correlation between wetter/dryer or hotter/colder anomalies Time scale is pretty yearly Oscillation period very variable on its own 2-7 years

Much shorter “mean” cycle of about 60 days Negative phase well linked to colder eastern USA winters

* Collected monthly mean temperature and moisture totals from seven cities across the country over 60 years * * Multivariate data * Removed the annual cycle * Standardized the Data * Naked Eyeball test * Quite messy * Correlations * Ruled out FFT’s for this particular study * Empirical Orthogonal Functions (EOF’s) analysis * Ran on all variables, not just between two

* EOF analysis * Uses PCA * Unlike a linear regression, it doesn’t know if data are independent or dependent * Goal is to find a coordinate system that maximizes variance of each variable in the dataset * SVD constructs the correlation matrix * For multivariate data, data must be standardized (phew!) and the covariant matrix becomes the correlation matrix * Find eignevalues/vectors of correlation matrix * Then calculate principle components * Calculate orthogonal eigenvalues/vectors to obtain PC’s (eigenvalues) and EOF’s (eigenvectors) * Based on the eigenvalues/eigenvectors, can see which variables eigenvalues contribute most to which principle component(s) * Matlab gave us pca and princomp!

* Checked to make sure correlation between standardized values and non-standardized were same * They were * Simply looking at correlation between ENSO/AO and Temp/Moist * Why such low correlation values when we know that ENSO and AO both have an impact on temperature and moisture in the USA?

* EOF will take all three data variables and create new principle components, a linear combo of the original variables, each orthogonal to each other, to form an orthogonal basis for the space data * Graphs * The first principal component is a single axis in space. Project each observation on that axis and the resulting values form a new variable. The variance of this variable is the maximum among all possible choices of the first axis * The second principal component is another axis in space, perpendicular to the first. * Each point is an observation with coordinates indicting the “score” for each PC * Reading: points nearer to left edge have lowest score for PC1 * They’re scaled with respect to the maximum score value and coefficient length * Notice later when I compress data that there are less of these data points since less observations

* Did a matlab EOF analysis/SVD decomposition to see which principle components drive which variables * Look at Austin temperature that had negative correlation with ENSO and positive with AO

* Projected observations on axis of Principle Components to obtain a newly defined variable * Direction/length indicate how each variable contributes to PC’s and PC1 is able to distinguish between AO and Temp variable from the ENSO variable

* Didn’t understand why something we know that impacts the country wasn’t showing up * Idea: look at seasonal aspect (winter and summer) * Recall from ENSO and AO trends that even the cities with which we expect to have biggest impact have highest correlation values!

* AO in same direction and both influence PC1 and PC2 but ENSO only influences PC1 and hardly PC2 * Recall ENSO has negative correlation with Moist and AO has a positive higher correlation * Could explain why they’re in same direction? Yes except not sure about when they are in 3 different quadrants. BUT even then, they agreed in direction for PC1. INTERESTING.

* All three variables contributed to PC1 and PC2 * All positively contributed to PC2 * Again recall that ENSO has a negative correlation and AO has a positive correlation

* Same behavior as before except unlike Seattle that had all vectors influence both PC’s, AO and temp don’t contribute to PC1 that much

* Summer anomalies for Colorado Springs * Small positive correlation to both AO and ENSO and produced this * I think most interesting feature is the lack of ENSO contributing to PC2 at all

* Need to look at the seasonal versus monthly data * Even if AO is a more monthly period, ENSO doesn’t * Observed that AO and ENSO vectors never in same quadrant except on case with Chicago yearly moisture * Observed that AO and ENSO vectors are rarely in same direction * EOF’s are a good way to start understanding which components drive the three variables * Both negatively and positively * Still question on how both AO and ENSO’s peaks influence (or don’t) the temperatures and moisture totals of certain US regions * Especially Colorado Springs…

* Bet if looked at ENSO on a yearly timescale, even more time than seasonal, correlation values will increase * Explore to see if there is possibly a time lag * ENSO and AO on two different time scales * Literature suggests that there are teleconnections between the two * Impact of the Arctic Oscillation on ENSO- precipitation teleconnections across the eastern USA by Dagmar Budikova, Illinois State University, Normal, IL * Other methods of Analysis such as a linear regression

* * Wikle, Christopher K. "Spatio-temporal methods in climatology." Encyclopedia of Life Support Systems (EOLSS) (2002). * * age age * 2/united-states-and-canada/ 2/united-states-and-canada/ * nusually-cold-spring-in-europe-and-the-southeast- us-due-to-the-arct nusually-cold-spring-in-europe-and-the-southeast- us-due-to-the-arct * m/paper_ htm m/paper_ htm * html html