What are the dominant frequencies? Fourier transforms decompose a data sequence into a set of discrete spectral estimates – separate the variance of a.

Slides:



Advertisements
Similar presentations
Environmental Data Analysis with MatLab Lecture 8: Solving Generalized Least Squares Problems.
Advertisements

Digital Kommunikationselektronik TNE027 Lecture 5 1 Fourier Transforms Discrete Fourier Transform (DFT) Algorithms Fast Fourier Transform (FFT) Algorithms.
Lecture 15 Orthogonal Functions Fourier Series. LGA mean daily temperature time series is there a global warming signal?
Thursday, October 12, Fourier Transform (and Inverse Fourier Transform) Last Class How to do Fourier Analysis (IDL, MATLAB) What is FFT?? What about.
FilteringComputational Geophysics and Data Analysis 1 Filtering Geophysical Data: Be careful!  Filtering: basic concepts  Seismogram examples, high-low-bandpass.
DFT/FFT and Wavelets ● Additive Synthesis demonstration (wave addition) ● Standard Definitions ● Computing the DFT and FFT ● Sine and cosine wave multiplication.
Chap 4 Image Enhancement in the Frequency Domain.
Let’s go back to this problem: We take N samples of a sinusoid (or a complex exponential) and we want to estimate its amplitude and frequency by the FFT.
Fourier series With coefficients:. Complex Fourier series Fourier transform (transforms series from time to frequency domain) Discrete Fourier transform.
Rotary Spectra Separate vector time series (e.g., current or wind data) into clockwise and counter-clockwise rotating circular components. Instead of having.
Page 0 of 34 MBE Vocoder. Page 1 of 34 Outline Introduction to vocoders MBE vocoder –MBE Parameters –Parameter estimation –Analysis and synthesis algorithm.
Filtering Filtering is one of the most widely used complex signal processing operations The system implementing this operation is called a filter A filter.
Digital Signal Processing
1 Hough transform Some Fourier basics: –Nyquist frequency: 1/2 , with  the difference between time samples. If signal is bandwidth limited below Nyquist.
LFPs 1: Spectral analysis Kenneth D. Harris 11/2/15.
Techniques in Signal and Data Processing CSC 508 Fourier Analysis.
Curve-Fitting Regression
General Functions A non-periodic function can be represented as a sum of sin’s and cos’s of (possibly) all frequencies: F(  ) is the spectrum of the function.
Course 2007-Supplement Part 11 NTSC (1) NTSC: 2:1 interlaced, 525 lines per frame, 60 fields per second, and 4:3 aspect ratio horizontal sweep frequency,
Environmental Data Analysis with MatLab Lecture 24: Confidence Limits of Spectra; Bootstraps.
Lecture 18 advanced topics is spectral analysis Parsival’s Theorem Multi-taper spectral analysis Auto- and Cross- Correlation Phase spectra.
Fourier Analysis D. Gordon E. Robertson, PhD, FCSB School of Human Kinetics University of Ottawa.
Principal Component Analysis Principles and Application.
Environmental Data Analysis with MatLab Lecture 7: Prior Information.
Correlation and spectral analysis Objective: –investigation of correlation structure of time series –identification of major harmonic components in time.
Introduction To Signal Processing & Data Analysis
Goals For This Class Quickly review of the main results from last class Convolution and Cross-correlation Discrete Fourier Analysis: Important Considerations.
Outline 2-D Fourier transforms The sampling theorem Sampling Aliasing
Lecture 1 Signals in the Time and Frequency Domains
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
The Discrete Fourier Transform. The Fourier Transform “The Fourier transform is a mathematical operation with many applications in physics and engineering.
1 Enviromatics Environmental time series Environmental time series Вонр. проф. д-р Александар Маркоски Технички факултет – Битола 2008 год.
Ping Zhang, Zhen Li,Jianmin Zhou, Quan Chen, Bangsen Tian
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Chapter 19.
Sundermeyer MAR 550 Spring Laboratory in Oceanography: Data and Methods MAR550, Spring 2013 Miles A. Sundermeyer Additional Topics - Rotary Spectra.
Curve-Fitting Regression
Part I: Image Transforms DIGITAL IMAGE PROCESSING.
Speech Signal Representations I Seminar Speech Recognition 2002 F.R. Verhage.
Chapter 6 Spectrum Estimation § 6.1 Time and Frequency Domain Analysis § 6.2 Fourier Transform in Discrete Form § 6.3 Spectrum Estimator § 6.4 Practical.
Spatial Frequencies Spatial Frequencies. Why are Spatial Frequencies important? Efficient data representation Provides a means for modeling and removing.
Part 4 Chapter 16 Fourier Analysis PowerPoints organized by Prof. Steve Chapra, University All images copyright © The McGraw-Hill Companies, Inc. Permission.
Signal: a supplementary material Taekyoung Kwon. signal A signal is a time-varying event that conveys information from a source to a destination (more.
8-1 Chapter 8: Image Restoration Image enhancement: Overlook degradation processes, deal with images intuitively Image restoration: Known degradation processes;
Basic Time Series Analyzing variable star data for the amateur astronomer.
7- 1 Chapter 7: Fourier Analysis Fourier analysis = Series + Transform ◎ Fourier Series -- A periodic (T) function f(x) can be written as the sum of sines.
The observed flow u’ may be represented as the sum of M harmonics:
Lecture#10 Spectrum Estimation
ECE 8443 – Pattern Recognition EE 3512 – Signals: Continuous and Discrete Objectives: Eigenfunctions Fourier Series of CT Signals Trigonometric Fourier.
Least Squares Fit to Main Harmonics The observed flow u’ may be represented as the sum of M harmonics: u’ = u 0 + Σ j M =1 A j sin (  j t +  j ) For.
Fourier transform.
Digital Image Processing Lecture 8: Fourier Transform Prof. Charlene Tsai.
Chapter 4 Discrete-Time Signals and transform
Fourier series With coefficients:.
Spectral Analysis Spectral analysis is concerned with the determination of the energy or power spectrum of a continuous-time signal It is assumed that.
MECH 373 Instrumentation and Measurements
Outline 2-D Fourier transforms The sampling theorem Sampling Aliasing
Fourier Series FIR About Digital Filter Design
The observed flow u’ may be represented as the sum of M harmonics:
Filtering Geophysical Data: Be careful!
Image Analysis Image Restoration.
Laboratory in Oceanography: Data and Methods
Least Squares Fit to Main Harmonics
Rotary Spectra Separate vector time series (e.g., current or wind data) into clockwise and counter-clockwise rotating circular components. Instead of having.
Least Squares Fit to Main Harmonics
Lecture 35 Wave spectrum Fourier series Fourier analysis
MMSE Optimal Design: The Least Squares method
Ideal Filters One of the reasons why we design a filter is to remove disturbances Filter SIGNAL NOISE We discriminate between signal and noise in terms.
Least Squares Fit to Main Harmonics
Laboratory in Oceanography: Data and Methods
Lecture 4 Image Enhancement in Frequency Domain
Presentation transcript:

What are the dominant frequencies? Fourier transforms decompose a data sequence into a set of discrete spectral estimates – separate the variance of a time series as a function of frequency. A common use of Fourier transforms is to find the frequency components of a signal buried in a time domain signal.

FAST FOURIER TRANSFORM (FFT) In practice, if the time series f(t) is not a power of 2, it should be padded with zeros

What is the statistical significance of the peaks? Each spectral estimate has a confidence limit defined by a chi-squared distribution

Spectral Analysis Approach 1. Remove mean and trend of time series 2. Pad series with zeroes to a power of 2 3. To reduce end effect (Gibbs’ phenomenon) use a window (Hanning, Hamming, Kaiser) to taper the series 4. Compute the Fourier transform of the series, multiplied times the window 5. Rescale Fourier transform by multiplying times 8/3 for the Hanning Window 6. Compute band-averages or block-segmented averages 7. Incorporate confidence intervals to spectral estimates

Sea level at Mayport, FL July 1, 2007 (day “0” in the abscissa) to September 1, 2007 m m Raw data and Low-pass filtered data High-pass filtered data 1. Remove mean and trend of time series (N = 1512) 2. Pad series with zeroes to a power of 2 (N = 2048)

Cycles per day m 2 /cpd Spectrum of raw data Spectrum of high-pass filtered data

Day from July 1, 2007 Value of the Window Hanning Window Hamming Window 3. To reduce end effect (Gibbs’ phenomenon) use a window (Hanning, Hamming, Kaiser) to taper the series

Day from July 1, 2007 Value of the Window Hanning Window Hamming Window Kaiser-Bessel, α = 2 Kaiser-Bessel, α = 3 3. To reduce end effect (Gibbs’ phenomenon) use a window (Hanning, Hamming, Kaiser) to taper the series

m m Raw series x Hanning Window (one to one) Raw series x Hamming Window (one to one) Day from July 1, 2007 To reduce side-lobe effects 4. Compute the Fourier transform of the series, multiplied times the window

m m High-pass series x Hanning Window (one to one) High pass series x Hamming Window (one to one) Day from July 1, 2007 To reduce side-lobe effects 4. Compute the Fourier transform of the series, multiplied times the window

High pass series x Kaiser-Bessel Window α=3 (one to one) m Day from July 1, Compute the Fourier transform of the series, multiplied times the window

Cycles per day m 2 /cpd Original from Raw Data with Hanning window with Hamming window Windows reduce noise produced by side-lobe effects Noise reduction is effected at different frequencies

Cycles per day m 2 /cpd with Hanning window with Hamming and Kaiser- Bessel (α=3) windows

5. Rescale Fourier transform by multiplying: times 8/3 for the Hanning Window times for the Hamming Window times ~8/3 for the Kaiser-Bessel (Depending on alpha)

6. Compute band-averages or block-segmented averages 7. Incorporate confidence intervals to spectral estimates Upper limit: Lower limit: 1-alpha is the confidence (or probability) nu are the degrees of freedom gamma is the ordinate reference value

Probability Degrees of freedom

Includes low frequency N=1512

Excludes low frequency N=1512

Least Squares Fit to Main Harmonics The observed flow u’ may be represented as the sum of M harmonics: u’ = u 0 + Σ j M =1 A j sin (  j t +  j ) For M = 1 harmonic (e.g. a diurnal or semidiurnal constituent): u’ = u 0 + A 1 sin (  1 t +  1 ) With the trigonometric identity: sin (A + B) = cosBsinA + cosAsinB u’ = u 0 + a 1 sin (  1 t ) + b 1 cos (  1 t ) taking: a 1 = A 1 cos  1 b 1 = A 1 sin  1

The squared errors between the observed current u and the harmonic representation may be expressed as  2 :  2 = Σ N [u - u’ ] 2 = u 2 - 2uu’ + u’ 2 Then:  2 = Σ N {u 2 - 2uu 0 - 2ua 1 sin (  1 t ) - 2ub 1 cos (  1 t ) + u u 0 a 1 sin (  1 t ) + 2u 0 b 1 cos (  1 t ) + 2a 1 b 1 sin (  1 t ) cos (  1 t ) + a 1 2 sin 2 (  1 t ) + b 1 2 cos 2 (  1 t ) } Using u’ = u 0 + a 1 sin (  1 t ) + b 1 cos (  1 t ) Then, to find the minimum distance between observed and theoretical values we need to minimize  2 with respect to u 0 a 1 and b 1, i.e., δ  2 / δu 0, δ  2 / δa 1, δ  2 / δb 1 : δ  2 / δ u 0 = Σ N { -2u +2u 0 + 2a 1 sin (  1 t ) + 2b 1 cos (  1 t ) } = 0 δ  2 / δ a 1 = Σ N { -2u sin (  1 t ) +2u 0 sin (  1 t ) + 2b 1 sin (  1 t ) cos (  1 t ) + 2a 1 sin 2 (  1 t ) } = 0 δ  2 / δ b 1 = Σ N {-2u cos (  1 t ) +2u 0 cos (  1 t ) + 2a 1 sin (  1 t ) cos (  1 t ) + 2b 1 cos 2 (  1 t ) } = 0

Σ N { -2u +2u 0 + 2a 1 sin (  1 t ) + 2b 1 cos (  1 t ) } = 0 Σ N {-2u sin (  1 t ) +2u 0 sin (  1 t ) + 2b 1 sin (  1 t ) cos (  1 t ) + 2a 1 sin 2 (  1 t ) } = 0 Σ N { -2u cos (  1 t ) +2u 0 cos (  1 t ) + 2a 1 sin (  1 t ) cos (  1 t ) + 2b 1 cos 2 (  1 t ) } = 0 Rearranging: Σ N { u = u 0 + a 1 sin (  1 t ) + b 1 cos (  1 t ) } Σ N { u sin (  1 t ) = u 0 sin (  1 t ) + b 1 sin (  1 t ) cos (  1 t ) + a 1 sin 2 (  1 t ) } Σ N { u cos (  1 t ) = u 0 cos (  1 t ) + a 1 sin (  1 t ) cos (  1 t ) + b 1 cos 2 (  1 t ) } And in matrix form: Σ N u cos (  1 t ) Σ N cos (  1 t ) Σ N sin (  1 t ) cos (  1 t ) Σ N cos 2 (  1 t ) b 1 Σ N u N Σ N sin (  1 t ) Σ N cos (  1 t ) u 0 Σ N u sin (  1 t ) = Σ N sin (  1 t ) Σ N sin 2 (  1 t ) Σ N sin (  1 t ) cos (  1 t ) a 1 B = A X X = A -1 B

Finally... The residual or mean is u 0 The phase of constituent 1 is:  1 = atan ( b 1 / a 1 ) The amplitude of constituent 1 is: A 1 = ( b a 1 2 ) ½ Pay attention to the arc tangent function used. For example, in IDL you should use atan (b 1,a 1 ) and in MATLAB, you should use atan2

For M = 2 harmonics (e.g. diurnal and semidiurnal constituents): u’ = u 0 + A 1 sin (  1 t +  1 ) + A 2 sin (  2 t +  2 ) Σ N cos (  1 t ) Σ N sin (  1 t ) cos (  1 t ) Σ N cos 2 (  1 t ) Σ N cos (  1 t ) sin (  2 t ) Σ N cos (  1 t ) cos (  2 t ) N Σ N sin (  1 t ) Σ N cos (  1 t ) Σ N sin (  2 t ) Σ N cos (  2 t ) Σ N sin (  1 t ) Σ N sin 2 (  1 t ) Σ N sin (  1 t ) cos (  1 t ) Σ N sin (  1 t ) sin (  2 t ) Σ N sin (  1 t ) cos (  2 t ) Matrix A is then: Σ N sin (  2 t ) Σ N sin (  1 t ) sin (  2 t ) Σ N cos (  1 t ) sin (  2 t ) Σ N sin 2 (  2 t ) Σ N sin (  2 t ) cos (  2 t ) Σ N cos (  2 t ) Σ N sin (  1 t ) cos (  2 t ) Σ N cos (  1 t ) cos (  2 t ) Σ N sin (  2 t ) cos (  2 t ) Σ N cos 2 (  2 t ) Remember that: X = A -1 B and B = Σ N u cos (  1 t ) Σ N u sin (  2 t ) Σ N u cos (  2 t ) Σ N u Σ N u sin (  1 t ) u0a1b1a2b2u0a1b1a2b2 X =

Goodness of Fit: Σ [ - u pred ] Σ [ - u obs ] 2 Root mean square error: [1/N Σ (u obs - u pred ) 2 ] ½

Fit with M 2 only

Fit with M 2, K 1

Fit with M 2, S 2, K 1

Fit with M 2, S 2, K 1, M 4, M 6

Tidal Ellipse Parameters u a, v a, u p, v p are the amplitudes and phases of the east-west and north-south components of velocity amplitude of the clockwise rotary component amplitude of the counter-clockwise rotary component phase of the clockwise rotary componentphase of the counter-clockwise rotary component The characteristics of the tidal ellipses are: Major axis = M = Q cc + Q c minor axis = m = Q ac - Q c ellipticity = m / M Phase = -0.5 (theta cc - theta c ) Orientation = 0.5 (theta cc + theta c ) Ellipse Coordinates:

M2S2K1M2S2K1

Fit with M2 only (dotted) and M2 + M4 (continuous)

Fit with M2 only (dotted) and M2 + M6 (continuous)