CARMA Models for Stochastic Variability (or how to read a PSD) Jim Barrett University of Birmingham.

Slides:



Advertisements
Similar presentations
Principles of the Global Positioning System Lecture 12 Prof. Thomas Herring Room A;
Advertisements

1 / 13 Fourier, bandwidth, filter. 2 / 13 The important roles of Fourier series and Fourier transforms: –To analysis and synthesis signals in frequency.
Statistical properties of Random time series (“noise”)
Lecture 6 Power spectral density (PSD)
Spectral analysis Kenneth D. Harris 18/2/15. Continuous processes A continuous process defines a probability distribution over the space of possible signals.
EE322 Digital Communications
Sep 22, 2005CS477: Analog and Digital Communications1 Random Processes and PSD Analog and Digital Communications Autumn
SUMS OF RANDOM VARIABLES Changfei Chen. Sums of Random Variables Let be a sequence of random variables, and let be their sum:
Time Series Basics Fin250f: Lecture 3.1 Fall 2005 Reading: Taylor, chapter
X-ray Variability of AGN
The Baryon Acoustic Peak Nick Cowan UW Astronomy May 2005 Nick Cowan UW Astronomy May 2005.
Review of Probability and Random Processes
Chapter 5. Operations on Multiple R. V.'s 1 Chapter 5. Operations on Multiple Random Variables 0. Introduction 1. Expected Value of a Function of Random.
Lecture 16 Random Signals and Noise (III) Fall 2008 NCTU EE Tzu-Hsien Sang.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
Sep 20, 2005CS477: Analog and Digital Communications1 Random variables, Random processes Analog and Digital Communications Autumn
Introduction To Signal Processing & Data Analysis
(1) A probability model respecting those covariance observations: Gaussian Maximum entropy probability distribution for a given covariance observation.
Review of Probability.
EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Probability Theory and Random Processes
Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 6.2: Kalman Filter Jürgen Sturm Technische Universität München.
Review for Exam I ECE460 Spring, 2012.
Week 2ELE Adaptive Signal Processing 1 STOCHASTIC PROCESSES AND MODELS.
1 Part 5 Response of Linear Systems 6.Linear Filtering of a Random Signals 7.Power Spectrum Analysis 8.Linear Estimation and Prediction Filters 9.Mean-Square.
Spectral Analysis AOE March 2011 Lowe 1. Announcements Lectures on both Monday, March 28 th, and Wednesday, March 30 th. – Fracture Testing –
NASSP Masters 5003F - Computational Astronomy Lecture 3 First, a bit more python. Then some noise statistics.
Probabilistic Robotics Bayes Filter Implementations.
Binary Stochastic Fields: Theory and Application to Modeling of Two-Phase Random Media Steve Koutsourelakis University of Innsbruck George Deodatis Columbia.
Vibrationdata 1 Unit 9 White Noise FFT. Vibrationdata 2 Fourier Transform, Sine Function A Fourier transform will give the exact magnitude and frequency.
Fundamentals of Data Analysis Lecture 3 Basics of statistics.
2. Stationary Processes and Models
Week 21 Stochastic Process - Introduction Stochastic processes are processes that proceed randomly in time. Rather than consider fixed random variables.
General ideas to communicate Dynamic model Noise Propagation of uncertainty Covariance matrices Correlations and dependencs.
Introduction to Digital Signals
ارتباطات داده (883-40) فرآیندهای تصادفی نیمسال دوّم افشین همّت یار دانشکده مهندسی کامپیوتر 1.
Chapter 3 Foundation of Mathematical Analysis § 3.1 Statistics and Probability § 3.2 Random Variables and Magnitude Distribution § 3.3 Probability Density.
IE 300, Fall 2012 Richard Sowers IESE. 8/30/2012 Goals: Rules of Probability Counting Equally likely Some examples.
Additional Topics in Prediction Methodology. Introduction Predictive distribution for random variable Y 0 is meant to capture all the information about.
Lecture#10 Spectrum Estimation
Chapter 1 Random Process
Wavelet Spectral Analysis Ken Nowak 7 December 2010.
ENEE631 Digital Image Processing (Spring'04) Basics on 2-D Random Signal Spring ’04 Instructor: Min Wu ECE Department, Univ. of Maryland, College Park.
+ Chapter Scientific Method variable is the factor that changes in an experiment in order to test a hypothesis. To test for one variable, scientists.
Discrete-time Random Signals
Noise and Data Errors Nominal Observation for “1” Nominal Observation for “0” Probability density for “0” with Noise Probability density for “1” with Noise.
Geology 6600/7600 Signal Analysis 09 Sep 2015 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
Random Processes Gaussian and Gauss-Markov processes Power spectrum of random processes and white processes.
Geology 5600/6600 Signal Analysis 14 Sep 2015 © A.R. Lowry 2015 Last time: A stationary process has statistical properties that are time-invariant; a wide-sense.
Stats Term Test 4 Solutions. c) d) An alternative solution is to use the probability mass function and.
Introduction to Probability and Bayesian Decision Making Soo-Hyung Kim Department of Computer Science Chonnam National University.
1 Review of Probability and Random Processes. 2 Importance of Random Processes Random variables and processes talk about quantities and signals which.
Geology 6600/7600 Signal Analysis 05 Oct 2015 © A.R. Lowry 2015 Last time: Assignment for Oct 23: GPS time series correlation Given a discrete function.
Geology 6600/7600 Signal Analysis 04 Sep 2014 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
Outline Random variables –Histogram, Mean, Variances, Moments, Correlation, types, multiple random variables Random functions –Correlation, stationarity,
Random Signals Basic concepts Bibliography Oppenheim’s book, Appendix A. Except A.5. We study a few things that are not in the book.
디지털통신 Random Process 임 민 중 동국대학교 정보통신공학과 1.
Mail Call Us: , , Data Science Training In Ameerpet
Biointelligence Laboratory, Seoul National University
Stochastic Process - Introduction
Unit 9 White Noise FFT.
National Mathematics Day
CARMA Models for Stochastic Variability (or how to read a PSD)
Why Stochastic Hydrology ?
Probability Theory and Parameter Estimation I
Outline Introduction Signal, random variable, random process and spectra Analog modulation Analog to digital conversion Digital transmission through baseband.
Special Topics In Scientific Computing
Lecture 2: Frequency & Time Domains presented by David Shires
Correlation, Energy Spectral Density and Power Spectral Density
copyright Robert J. Marks II
Presentation transcript:

CARMA Models for Stochastic Variability (or how to read a PSD) Jim Barrett University of Birmingham

Contents What is Stochastic Variabilty? What is a PSD? How do you read a PSD? What is a CARMA Model? What's the point?

Stochastic Variability Random perturbations to a set of observations (noise) Highly Complex or Poorly Understood systems can also appear stochastic. Almost all modern statistical treatments rely on evenly sampled data

Stochastic Variability – White Noise

Power Spectral Density (PSD) A bit like a Fourier Transform... Shows the 'power' in a signal as a function of frequency Serves as an excellent visual tool when investigating stochastic variability

How to Read a PSD - Knees

How to Read a PSD - Peaks

How to Read a PSD – Both

Noise Models Model noise as a Multivariate Gaussian Process, and writing down the statistics is easy! This is great but computationally expensive We can transform the covariance matrix using a Continuous, Auto-Regressive, Moving Average (CARMA) model.

CARMA (in a nut shell) Any observation can be described in terms of the most recent observations and some 'series wide' properties. Parametrised in terms of the mean and variance of the series, and a number of correlation timescales. The more timescales used, the more complex (and powerful) the model.

The Pipeline Use the banded, CARMA representation of the covariance matrix to write down a Likelihood function Baye's Theorem! Use posterior distributions on the various noise characteristics to perform (and inform) whatever science you want to do

Example 1 - XB158

Barnard et al. (arXiv: )

Example 1 - XB158

Example 1 – XB158

Example 2 – Variability of ζ Puppis

Conclusions It can be important (and difficult) to understand stochastic variability Modelling noise as a multivariate Gaussian is an excellent way to go, but its expensive Using CARMA, we can render these problems computationally tractable