ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition:

Slides:



Advertisements
Similar presentations
Shapelets Correlated with Surface Normals Produce Surfaces Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
Advertisements

Figures for Chapter 7 Advanced signal processing Dillon (2001) Hearing Aids.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series A new application of HHT.
Wavelets Fast Multiresolution Image Querying Jacobs et.al. SIGGRAPH95.
An Introduction to HHT: Instantaneous Frequency, Trend, Degree of Nonlinearity and Non-stationarity Norden E. Huang Research Center for Adaptive Data Analysis.
ACHIZITIA IN TIMP REAL A SEMNALELOR. Three frames of a sampled time domain signal. The Fast Fourier Transform (FFT) is the heart of the real-time spectrum.
Quantification of Nonlinearity and Nonstionarity Norden E. Huang With collaboration of Zhaohua Wu; Men-Tzung Lo; Wan-Hsin Hsieh; Chung-Kang Peng; Xianyao.
Digital Signal Processing
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The FIR Adaptive Filter The LMS Adaptive Filter Stability and Convergence.
Algebra Problems… Solutions Algebra Problems… Solutions © 2007 Herbert I. Gross Set 4 By Herb I. Gross and Richard A. Medeiros next.
Nonstationary Signal Processing Hilbert-Huang Transform Joseph DePasquale 22 Mar 07.
A Plea for Adaptive Data Analysis: An Introduction to HHT for Nonlinear and Nonstationary Data Norden E. Huang Research Center for Adaptive Data Analysis.
The Hilbert Transform and Empirical Mode Decomposition: Suz Tolwinski University of Arizona Program in Applied Mathematics Spring 2007 RTG Powerful Tools.
Stationarity and Degree of Stationarity
G O D D A R D S P A C E F L I G H T C E N T E R Upconversion Study with the Hilbert-Huang Transform Jordan Camp Kenji Numata John Cannizzo Robert Schofield.
CO 2 Data Analysis Filter : Wavelet vs. EMD. EMD as Filter.
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
A Confidence Limit for Hilbert Spectrum Through stoppage criteria.
Paradoxes on Instantaneous Frequency a la Leon Cohen Time-Frequency Analysis, Prentice Hall, 1995 Chapter 2: Instantaneous Frequency, P. 40.
MAE 552 Heuristic Optimization
Environmental Data Analysis with MatLab Lecture 24: Confidence Limits of Spectra; Bootstraps.
Basic Concepts and Definitions Vector and Function Space. A finite or an infinite dimensional linear vector/function space described with set of non-unique.
On the Marginal Hilbert Spectrum. Outline Definitions of the Hilbert Spectra (HS) and the Marginal Hilbert Spectra (MHS). Computation of MHS The relation.
1 Concatenated Trial Based Hilbert-Huang Transformation on Mismatch Negativity Fengyu Cong 1, Tuomo Sipola1, Xiaonan Xu2, Tiina Huttunen-Scott3, Tapani.
Zhaohua Wu and N. E. Huang:
End Spreading Sifting might spread signal into quiescent region.
MATH 3290 Mathematical Modeling
On the Marginal Hilbert Spectrum. Outline Definitions of the Hilbert Spectrum (HS) and the Marginal Hilbert Spectrum (MHS). Computation of MHS The relation.
Frequency and Instantaneous Frequency A Totally New View of Frequency.
The Analytic Function from the Hilbert Transform and End Effects Theory and Implementation.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series.
ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition:
Frequency and Instantaneous Frequency A Totally New View of Frequency.
Discrete Time Periodic Signals A discrete time signal x[n] is periodic with period N if and only if for all n. Definition: Meaning: a periodic signal keeps.
Ensemble Empirical Mode Decomposition
Chapter 15 Fourier Series and Fourier Transform
Lecture 1 Signals in the Time and Frequency Domains
El Niño-Southern Oscillation in Tropical Column Ozone and A 3.5-year signal in Mid-Latitude Column Ozone Jingqian Wang, 1* Steven Pawson, 2 Baijun Tian,
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
On the relationship between C n 2 and humidity Carlos O. Font, Mark P. J. L. Chang, Erick A. Roura¹, Eun Oh and Charmaine Gilbreath² ¹Physics Department,
E MPIRICAL M ODE D ECOMPOSITION BASED T ECHNIQUE APPLIED IN EXPERIMENTAL BIOSIGNALS Alexandros Karagiannis Mobile Radio Communications Laboratory School.
An introduction to Empirical Mode Decomposition. The simplest model for a signal is given by circular functions of the type Such “Fourier modes” are of.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series Norden E. Huang Research Center for Adaptive Data Analysis National.
 System of Equations › Solutions to a two equation system › Solutions to a three equation system › Solutions to a system of inequalities  Break Even.
TIME SERIES ANALYSIS Time series – collection of observations in time: x( t i ) x( t i ) discrete time series with Δt Deterministic process: Can be predicted.
LEAST MEAN-SQUARE (LMS) ADAPTIVE FILTERING. Steepest Descent The update rule for SD is where or SD is a deterministic algorithm, in the sense that p and.
Wavelet Spectral Analysis Ken Nowak 7 December 2010.
Ensemble Empirical Mode Decomposition Zhaohua Wu Center for Ocean-Land-Atmosphere Studies And Norden E Huang National Central University.
 To define and explain frequency modulation (FM) and phase modulation (PM)  To analyze the FM in terms of Mathematical analysis  To analyze the Bessel.
Part 1 Principles of Frequency Modulation (FM)
A Random Subgrouping Scheme for Ensemble Kalman Filters Yun Liu Dept. of Atmospheric and Oceanic Science, University of Maryland Atmospheric and oceanic.
Detecting Signal from Data with Noise Xianyao Chen Meng Wang, Yuanling Zhang, Ying Feng Zhaohua Wu, Norden E. Huang Laboratory of Data Analysis and Applications,
The Empirical Mode Decomposition Method Sifting. Goal of Data Analysis To define time scale or frequency. To define energy density. To define joint frequency-energy.
Central limit theorem - go to web applet. Correlation maps vs. regression maps PNA is a time series of fluctuations in 500 mb heights PNA = 0.25 *
Frequency and Instantaneous Frequency A Totally New View of Frequency.
PERFORMANCE OF A WAVELET-BASED RECEIVER FOR BPSK AND QPSK SIGNALS IN ADDITIVE WHITE GAUSSIAN NOISE CHANNELS Dr. Robert Barsanti, Timothy Smith, Robert.
Paradoxes on Instantaneous Frequency
Lecture 16: Hilbert-Huang Transform Background:
A Conjecture & a Theorem
Wu, Z. , N. E. Huang, S. R. Long and C. K
Fourier Analyses Time series Sampling interval Total period
Contrasts & Statistical Inference
TIME SERIES ANALYSIS Time series – collection of observations in time: x( ti ) x( ti ) discrete time series with Δt Deterministic process: Can be predicted.
The Fourier Series for Continuous-Time Periodic Signals
Contrasts & Statistical Inference
TIME SERIES ANALYSIS Time series – collection of observations in time: x( ti ) x( ti ) discrete time series with Δt Deterministic process: Can be predicted.
Geology 491 Spectral Analysis
16. Mean Square Estimation
Contrasts & Statistical Inference
Presentation transcript:

ENSEMBLE EMPIRICAL MODE DECOMPOSITION Noise Assisted Signal Analysis (nasa) Part II EEMD Zhaohua Wu and N. E. Huang: Ensemble Empirical Mode Decomposition: A Noise Assisted Data Analysis Method. Advances in Adaptive Data Analysis, 1, 1-41, 2009

The Ensemble Effects The true answer is not the one without perturbation of noise.

EXAMPLE : ORIGINAL DATA

“LOCAL” -> “LOCAL”

Ensemble EMD Solves the mode mixing problem utilizing the uniformly distributed reference frame based on the white noise

EXAMPLE : ORIGINAL DECOMP.

Procedures for EEMD Add a white noise series to the targeted data; Decompose the data with added white noise into IMFs; Repeat step 1 and step 2 again and again, but with different white noise series each time; and Obtain the (ensemble) means of corresponding IMFs of the decompositions as the final result.

Definition of Signal in EEMD The signal used in EEMD is given by :

Definition of IMF in EEMD The truth defined by EEMD is given by the number of the ensemble approaching infinite:

The Standard Deviation of EEMD With the truth defined, the discrepancy, Δ, should be in which E{ } is the expected value as given in Equation.

Effect of the White Noise The effects of the added white noise should decrease following the well established statistical rule:

Data of the Noise Effects: Dotted line = theoretical; solid line = high frequency components; dashed line = low frequency components.

Procedure for EEMD Illustration

EXAMPLE : E1 DECOMP.

EXAMPLE : E10 DECOMP.

EXAMPLE : E100 DECOMP.

EXAMPLE : Intermittence DECOMP.

EXAMPLE : Difference Main IMF.

EXAMPLE : Difference Intermittent Signal.

EXAMPLE : Difference Intermittent Signal Details.

EXAMPLE : Instantaneous Frequency from Main Signal.

Summary: Numerical Data From the intermittency Example, we see that the Ensemble EMD can generate IMFs with comparable quality as the ones through the Intermittence test. More ensemble in the average will improve confidence in the EMD results. The main advantage of Ensemble EMD is that we do not need to determine the ‘ Intermittence test criteria ’ subjectively, which could become impossible for complicated data.

Example I : Geophysical Data Surface Temperature Data from Two Difference Satellite Radiometer channels

EXAMPLE I: ORIGINAL DATA

EXAMPLE I: DECOMPOSITION (I)

EXAMPLE I: DECOMPOSITION (II)

EXAMPLE I: NOISY DATA (added noise std=0.1)

NOISY DATA DECOMPOSITION (I) (added noise std=0.1)

NOISY DATA DECOMPOSITION (II) (added noise std=0.1)

EXAMPLE I: NOISY DATA (added noise std=0.2)

NOISY DATA DECOMPOSITION (I) (added noise std=0.2)

NOISY DATA DECOMPOSITION (II) (added noise std=0.2)

NOISY DATA DECOMPOSITION (II) (RSS_T2)

NOISY DATA DECOMPOSITION (II) (UAH_T2)

EXAMPLE I: CORR. COEF.’s

Summary: Radiometer Data Data from the two different channels should reflect a similar overall structure, especially for medium and long wave length. Straightforward sifting will have severe mode mixing for medium scale IMFs. It is impossible to select the proper scales for the ‘ Intermittence test ’ to separate the modes. Ensemble EMD provided an automatic dyadic filter to separate the modes. Ensemble EMD especially effective when the data contain intermittent signal as in UAH case as shown by the correlation coefficients between RSS and UAH series.

Example II : Geophysical Data SOI and the Sea Surface Temperature at Nino 34

EXAMPLE II: ORIGINAL DATA

EXAMPLE II: DECOMPOSITION (I)

EXAMPLE II: DECOMPOSITION (II)

EXAMPLE II: DECOMPOSITION (III)

EXAMPLE II: NOISY DATA (added noise std=0.4)

EXAMPLE II: DECOMPOSITION (I) (added noise std=0.4)

EXAMPLE II: DECOMPOSITION (II) (added noise std=0.4)

EXAMPLE II: DECOMPOSITION (III) (added noise std=0.4)

CTI: DECOMPOSITION (I)

CTI: DECOMPOSITION (II)

CTI: DECOMPOSITION (III)

SOI: DECOMPOSITION (I)

SOI: DECOMPOSITION (II)

SOI: DECOMPOSITION (III)

EXAMPLE II: CORR. COEF.’s

Summary : CTI and SOI Straightforward sift produced low correlated IMFs from the two difference time series. Correlation test indicates that the Ensemble EMD can separate the time scales in the IMFs, and improve the correlation significantly.

Application of EEMD to Sound March 30, 2005

Data : Hello

Data : Hello c3y

Data : IMF100

Hilbert Spectrum : IMF100 (500, 12000; 7x7^3)

Hilbert Spectrum : c3y (500, 12000; 7x7^3)

Hilbert Spectrum : IMF100 (500, 12000; 7x7^3)

Hilbert Spectrum : c3y (500, 12000; 7x7^3)

Summary True IMFs can be derived from adding finite amplitude of noise, rather than the case with infinitesimal noises. Ensemble EMD indeed enables the signals of similar scale collated together. No need for a priori criteria for intermittency.

Summary Sum of IMFs may not be an IMF. As the components produced by EEMD are the averaged values of many IMFs, they might not be IMFs: some of the component might have multi-extrema. More stringent stoppage criteria and/or trials in the ensemble can improve the situation.

Data

Stoppage Criteria : S=1

Stoppage Criteria : S=10

Stoppage Criteria : S=1 Detail

Stoppage Criteria : S=10 Detail

OI vs. Noise Level

OI vs. Stoppage Criteria

Orthogonal Index of S-Number & Noise Level

Same as last slide, but with log2 x-axis

Observations Is orthogonality index a good measure of the EEMD results? What if we use the excessive of extrema instead?

Observations It looks like the fixed-sifting number method can give better orthogonal index for the same noise-level. Fixed sifting number method requires un- adaptive IMF’s number. This must be determined by user. Too much computations. For the same case, the fixed sifting number method requires extremely more computations.

Observations Not all EEM produced components are IMFs for two reasons: –Sum of IMFs may not be IMF. –Leakage in the decomposition. There is no problem in re-constructing the data. We do need rectification to compute the instantaneous frequency and the time- frequency spectral representations.

Fourier Spectra of IMFs

Latest Development It has been noted that the EEMD could implemented with the added noise used in pairs: once with plus sign, and once with minus sign. (Yeh, et al, 2010) This pair-wise noise addition could reduce the noise in the final re-constitution of the signal.

Conclusions Ensemble EMD enables the EMD method to be a truly dyadic filter bank. By adding finite noise, the Ensemble EMD eliminates mode mixing in most cases automatically. Ensemble EMD, utilized the scale separation principle of EMD, represents a major improvement of the EMD method. The true IMF components should be the results of the Ensemble EMD rather than from the raw data. Sum of IMF is not necessarily an IMF; therefore, the ensemble EMD results might not be IMFs.

EEMD Is equivalent to an artificial ensemble mean of EMDs.