CARMA Models for Stochastic Variability (or how to read a PSD)

Slides:



Advertisements
Similar presentations
Sequential learning in dynamic graphical model Hao Wang, Craig Reeson Department of Statistical Science, Duke University Carlos Carvalho Booth School of.
Advertisements

The Spectral Representation of Stationary Time Series.
Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room A;
ELG5377 Adaptive Signal Processing
1 / 13 Fourier, bandwidth, filter. 2 / 13 The important roles of Fourier series and Fourier transforms: –To analysis and synthesis signals in frequency.
Lecture 7 Linear time invariant systems
Statistical properties of Random time series (“noise”)
Spectral analysis Kenneth D. Harris 18/2/15. Continuous processes A continuous process defines a probability distribution over the space of possible signals.
EE322 Digital Communications
Sep 22, 2005CS477: Analog and Digital Communications1 Random Processes and PSD Analog and Digital Communications Autumn
Statistics 350 Lecture 14. Today Last Day: Matrix results and Chapter 5 Today: More matrix results and Chapter 5 Please read Chapter 5.
An Optimal Learning Approach to Finding an Outbreak of a Disease Warren Scott Warren Powell
Environmental Data Analysis with MatLab Lecture 24: Confidence Limits of Spectra; Bootstraps.
X-ray Variability of AGN
The Baryon Acoustic Peak Nick Cowan UW Astronomy May 2005 Nick Cowan UW Astronomy May 2005.
Review of Probability and Random Processes
Lecture 16 Random Signals and Noise (III) Fall 2008 NCTU EE Tzu-Hsien Sang.
Review of Probability.
Probability Theory and Random Processes
Random Process The concept of random variable was defined previously as mapping from the Sample Space S to the real line as shown below.
Review for Exam I ECE460 Spring, 2012.
Week 2ELE Adaptive Signal Processing 1 STOCHASTIC PROCESSES AND MODELS.
Random Processes ECE460 Spring, Power Spectral Density Generalities : Example: 2.
1 Part 5 Response of Linear Systems 6.Linear Filtering of a Random Signals 7.Power Spectrum Analysis 8.Linear Estimation and Prediction Filters 9.Mean-Square.
Spectral Analysis AOE March 2011 Lowe 1. Announcements Lectures on both Monday, March 28 th, and Wednesday, March 30 th. – Fracture Testing –
Probabilistic Robotics Bayes Filter Implementations.
Approximate Analytical Solutions to the Groundwater Flow Problem CWR 6536 Stochastic Subsurface Hydrology.
Functional Brain Signal Processing: EEG & fMRI Lesson 5 Kaushik Majumdar Indian Statistical Institute Bangalore Center M.Tech.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
Week 21 Stochastic Process - Introduction Stochastic processes are processes that proceed randomly in time. Rather than consider fixed random variables.
General ideas to communicate Dynamic model Noise Propagation of uncertainty Covariance matrices Correlations and dependencs.
Statistics. A two-dimensional random variable with a uniform distribution.
ارتباطات داده (883-40) فرآیندهای تصادفی نیمسال دوّم افشین همّت یار دانشکده مهندسی کامپیوتر 1.
Chapter 3 Foundation of Mathematical Analysis § 3.1 Statistics and Probability § 3.2 Random Variables and Magnitude Distribution § 3.3 Probability Density.
Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room ;
Lecture#10 Spectrum Estimation
Chapter 1 Random Process
Wavelet Spectral Analysis Ken Nowak 7 December 2010.
Geology 6600/7600 Signal Analysis 02 Sep 2015 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
ENEE631 Digital Image Processing (Spring'04) Basics on 2-D Random Signal Spring ’04 Instructor: Min Wu ECE Department, Univ. of Maryland, College Park.
Discrete-time Random Signals
1 Estimating Structured Vector Autoregressive Models Igor Melnyk and Arindam Banerjee.
Noise and Data Errors Nominal Observation for “1” Nominal Observation for “0” Probability density for “0” with Noise Probability density for “1” with Noise.
Geology 6600/7600 Signal Analysis 09 Sep 2015 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
Random Processes Gaussian and Gauss-Markov processes Power spectrum of random processes and white processes.
Geology 5600/6600 Signal Analysis 14 Sep 2015 © A.R. Lowry 2015 Last time: A stationary process has statistical properties that are time-invariant; a wide-sense.
1 Review of Probability and Random Processes. 2 Importance of Random Processes Random variables and processes talk about quantities and signals which.
Geology 6600/7600 Signal Analysis 05 Oct 2015 © A.R. Lowry 2015 Last time: Assignment for Oct 23: GPS time series correlation Given a discrete function.
Geology 6600/7600 Signal Analysis 04 Sep 2014 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
CARMA Models for Stochastic Variability (or how to read a PSD) Jim Barrett University of Birmingham.
Outline Random variables –Histogram, Mean, Variances, Moments, Correlation, types, multiple random variables Random functions –Correlation, stationarity,
Random Signals Basic concepts Bibliography Oppenheim’s book, Appendix A. Except A.5. We study a few things that are not in the book.
디지털통신 Random Process 임 민 중 동국대학교 정보통신공학과 1.
E&CE 358: Tutorial-4 Instructor: Prof. Xuemin (Sherman) Shen TA: Miao Wang 1.
Properties of the power spectral density (1/4)
Stochastic Process - Introduction
HST 583 fMRI DATA ANALYSIS AND ACQUISITION
National Mathematics Day
Time Series Analysis and Its Applications
Outline Introduction Signal, random variable, random process and spectra Analog modulation Analog to digital conversion Digital transmission through baseband.
Lecture 26 Modeling (1): Time Series Prediction
Random Process The concept of random variable was defined previously as mapping from the Sample Space S to the real line as shown below.
Additional notes on random variables
Lecture 2: Frequency & Time Domains presented by David Shires
Additional notes on random variables
Correlation, Energy Spectral Density and Power Spectral Density
copyright Robert J. Marks II
16. Mean Square Estimation
CH2 Time series.
Basic descriptions of physical data
Presentation transcript:

CARMA Models for Stochastic Variability (or how to read a PSD) Jim Barrett School of Physics and Astronomy

Contents What is Stochastic Variabilty? What is a PSD (Power Spectral Density)? How do you read a PSD? What is a CARMA Model? What's the point?

Stochastic Variability Random perturbations to a set of observations (noise) Highly Complex or Poorly Understood systems can also appear stochastic. Almost all modern statistical treatments rely on evenly sampled data

Stochastic Variability – White Noise

Stochastic Variability – AR1 Noise

Power Spectral Density (PSD) A bit like a Fourier Transform... Shows the 'power' in a signal as a function of frequency

How to Read a PSD - Knees

How to Read a PSD - Peaks

How to Read a PSD – Both

Noise Models Model noise as a Multivariate Gaussian Process, and writing down the statistics is easy! This is great but computationally expensive We can transform the covariance matrix using a Continuous, Auto-Regressive, Moving Average (CARMA) model.

(Continuous Auto-Regressive Moving Average) CARMA (in a nut shell) (Continuous Auto-Regressive Moving Average) Any observation can be described in terms of the most recent observations and some 'series wide' properties. Parametrised in terms of the mean and variance of the series, and a number of correlation timescales. The more timescales used, the more complex (and powerful) the model.

Example 1 - XB158

Example 1 - XB158 Barnard et al. (arXiv:1501.01978)

Example 1 - XB158

Example 1 – XB158

Example 2 – A Companion for Aldebaran http://www.armaghplanet.com

Example 2 – A Companion for Aldebaran

Example 2 – A Companion for Aldebaran

Conclusions It is important (and difficult) to understand and characterise stochastic variability We can significantly speed up the characterisation process using CARMA models. This method is very general!

Bonus – Variability of ζ Puppis

Bonus – Variability of ζ Puppis

Bonus – Variability of ζ Puppis

Bonus – Variability of ζ Puppis