Paper review EOF: the medium is the message 報告人:沈茂霖 (Mao-Lin Shen) 2015/11/10 Seminar report.

Slides:



Advertisements
Similar presentations
STATISTICS Joint and Conditional Distributions
Advertisements

3D Geometry for Computer Graphics
CHAPTER 2 Building Empirical Model. Basic Statistical Concepts Consider this situation: The tension bond strength of portland cement mortar is an important.
Dimension reduction (1)
Makassar Strait throughflow, 2004 to 2006 報告人:沈茂霖 (Mao-Lin Shen) 2015/5/12 Seminar report.
The formation and dynamics of cold-dome northeast of Taiwan 報告人:沈茂霖 (Mao-Lin Shen) 2015/5/17 Seminar report.
An introduction to Principal Component Analysis (PCA)
Correlation and Autocorrelation
Principal Component Analysis
The Hidden Message Some useful techniques for data analysis Chihway Chang, Feb 18’ 2009.
Dimensional reduction, PCA
Principle Component Analysis What is it? Why use it? –Filter on your data –Gain insight on important processes The PCA Machinery –How to do it –Examples.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Independent Component Analysis (ICA) and Factor Analysis (FA)
CS Pattern Recognition Review of Prerequisites in Math and Statistics Prepared by Li Yang Based on Appendix chapters of Pattern Recognition, 4.
Chapter 11 Multiple Regression.
Visual Recognition Tutorial1 Random variables, distributions, and probability density functions Discrete Random Variables Continuous Random Variables.
ICA Alphan Altinok. Outline  PCA  ICA  Foundation  Ambiguities  Algorithms  Examples  Papers.
A Unifying Review of Linear Gaussian Models
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Diffusion Maps and Spectral Clustering
Survey on ICA Technical Report, Aapo Hyvärinen, 1999.
Review of Probability.
Latent Variable Models Christopher M. Bishop. 1. Density Modeling A standard approach: parametric models  a number of adaptive parameters  Gaussian.
Cristóbal López IMEDEA, Palma de Mallorca, Spain From microscopic dynamics to macroscopic evolution.
Extensions of PCA and Related Tools
Empirical Financial Economics Asset pricing and Mean Variance Efficiency.
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
1 The Venzke et al. * Optimal Detection Analysis Jeff Knight * Venzke, S., M. R. Allen, R. T. Sutton and D. P. Rowell, The Atmospheric Response over the.
3-2 Random Variables In an experiment, a measurement is usually denoted by a variable such as X. In a random experiment, a variable whose measured.
A study of relations between activity centers of the climatic system and high-risk regions Vladimir Penenko & Elena Tsvetova.
Improved ensemble-mean forecast skills of ENSO events by a zero-mean stochastic model-error model of an intermediate coupled model Jiang Zhu and Fei Zheng.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: ML and Simple Regression Bias of the ML Estimate Variance of the ML Estimate.
CHAPTER 5 SIGNAL SPACE ANALYSIS
General ideas to communicate Dynamic model Noise Propagation of uncertainty Covariance matrices Correlations and dependencs.
Blind Information Processing: Microarray Data Hyejin Kim, Dukhee KimSeungjin Choi Department of Computer Science and Engineering, Department of Chemical.
Random Variables (1) A random variable (also known as a stochastic variable), x, is a quantity such as strength, size, or weight, that depends upon a.
Question paper 1997.
Principal Manifolds and Probabilistic Subspaces for Visual Recognition Baback Moghaddam TPAMI, June John Galeotti Advanced Perception February 12,
EE4-62 MLCV Lecture Face Recognition – Subspace/Manifold Learning Tae-Kyun Kim 1 EE4-62 MLCV.
Information Geometry and Model Reduction Sorin Mitran 1 1 Department of Mathematics, University of North Carolina, Chapel Hill, NC, USA Reconstruction.
CSC2515: Lecture 7 (post) Independent Components Analysis, and Autoencoders Geoffrey Hinton.
STATISTICS Joint and Conditional Distributions Professor Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering National Taiwan University.
PCA vs ICA vs LDA. How to represent images? Why representation methods are needed?? –Curse of dimensionality – width x height x channels –Noise reduction.
Principal Component Analysis (PCA)
Principal Component Analysis Zelin Jia Shengbin Lin 10/20/2015.
September 28, 2000 Improved Simultaneous Data Reconciliation, Bias Detection and Identification Using Mixed Integer Optimization Methods Presented by:
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Kinematics of eddy–mean-flow interaction in an idealized atmospheric model Sergey Kravtsov and Sergey K. Gulev University of Wisconsin-Milwaukee Department.
3 “Products” of Principle Component Analysis
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
Central limit theorem revisited Throw a dice twelve times- the distribution of values is not Gaussian Dice Value Number Of Occurrences.
Central limit theorem - go to web applet. Correlation maps vs. regression maps PNA is a time series of fluctuations in 500 mb heights PNA = 0.25 *
Unsupervised Learning II Feature Extraction
EMPIRICAL ORTHOGONAL FUNCTIONS 2 different modes SabrinaKrista Gisselle Lauren.
Principal Component Analysis
EMPIRICAL ORTHOGONAL FUNCTIONS
STATISTICS Joint and Conditional Distributions
Application of Independent Component Analysis (ICA) to Beam Diagnosis
PCA vs ICA vs LDA.
Principal Component Analysis
Lecture 14 PCA, pPCA, ICA.
3-2 Random Variables denoted by a variable such as X. In an experiment, a measurement is usually denoted by a variable such as X. In a random experiment,
ALL the following plots are subject to the filtering :
Principal Component Analysis
Marios Mattheakis and Pavlos Protopapas
NOISE FILTER AND PC FILTERING
Outline Variance Matrix of Stochastic Variables and Orthogonal Transforms Principle Component Analysis Generalized Eigenvalue Decomposition.
Presentation transcript:

Paper review EOF: the medium is the message 報告人:沈茂霖 (Mao-Lin Shen) 2015/11/10 Seminar report

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 A. H. Monahan, J. C. Fyfe, M. H. P. Ambaum, D. B. Stephenson, and G. R. North (2009) “Empirical Orthogonal Functions: The Medium is the Message,” Journal of Climate. To demonstrate the care that must be taken in the interpretation of individual modes in order to distinguish the medium from the message.

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 Outline EOF analysis EOFs and dynamical modes EOFs and kinematic degrees of freedom EOFs of non-gaussian fields Non-locality of EOFs Conclusions

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOF Analysis (1/2) Some relevant facts Empirical Orthogonal Function (EOF) analysis (also known as Principal Component Analysis (PCA), or Proper Orthogonal Decomposition ) A N-dimensional vector time series x(t), as a continuous field sampled at N discrete points in space. The covariance matrix of x is given by The brackets denote probabilistic expectation: if p(x) is the probability density function of x, then

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOF Analysis (2/2) The EOFs can be defined as the eigenvectors e k of C: In particular, we can write where the expansion coefficient time series are the principal components.

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs and Dynamical Modes (1/5) Sustained small-amplitude variability in a broad range of physical situations in the atmosphere and ocean can be described by linear dynamics subject to random forcing representing the effects of unresolved physical scales: is a vector of independent white noise processes (uncorrelated in both space and time)

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs and Dynamical Modes (2/5) Consider the simple two-dimensional system (Farrel and Ioannou) normal for. The eigenvector of the dynamical matrix are

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs and Dynamical Modes (3/5)

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs and Dynamical Modes (4/5)

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs and Dynamical Modes (5/5)

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs and kinematic degrees of freedom (1/3) A simple model of a fluctuating jet in zonal-mean wind for which the EOF problem is analytically solvable. The model with Gaussian profile and fluctuating in strength and position: The jet strength and position are the natural kinematic variables, what we will call the kinematic degrees of freedom

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs and kinematic degrees of freedom (2/3) Base on observations of the extratropical zonal-mean eddy-driven jet, we will assume that From the expansions the leading EOFs can be determined in terms of the normalised basis vectors

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs and kinematic degrees of freedom (3/3) If fluctuations in position are relatively large compared to those of strength, then the leading EOF is the dipole.The leading PC time series is given by The spatial pattern of the second EOF is a monopole/tripole hybrid where the degree of hybridization is determined by the quantity

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs of non-gaussian fields (1/3)

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs of non-gaussian fields (2/3)

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 EOFs of non-gaussian fields (3/3)

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 Non-locality of EOFs The scale of the EOF spatial structures will be determined by the size of the domain. In particular, the leading EOF mode will be the gravest mode with a wavelength determined not by the properties of the field but by the size of the domain. Dommenget (2007) uses this fact to suggest a “stochastic null hypothesis” for determining if EOF structures more reflect the variability of the field or the geometry of the domain.

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 Conclusions EOF analysis is a powerful and versatile tool for dimensionality reduction, but it is not free from this “bias”. In general EOF modes cannot be expected to be of individual dynamical, kinematic, or statistical meaning. ICA, NLPCA, SVD, etc.

Mao-Lin Shen, Dept. of Atmospheric Sciences, NTU Page /11/10 Thank you for your attention.