From

Slides:



Advertisements
Similar presentations
Design of Experiments Questions Network Inference Working Group October 8, 2008.
Advertisements

Time-Series Analysis J. C. (Clint) Sprott
COMM 472: Quantitative Analysis of Financial Decisions
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
Neural chaos (Chapter 11 of Wilson 1999) Klaas Enno Stephan Laboratory for Social & Neural Systems Research Dept. of Economics University of Zurich Wellcome.
Chapter 7 – K-Nearest-Neighbor
2005/11/101 KOZ Scalable Audio Speaker: 陳繼大 An Introduction.
Introduction to chaotic dynamics
R C Ball, Physics Theory Group and Centre for Complexity Science University of Warwick R S MacKay, Maths M Diakonova, Physics&Complexity Emergence in Quantitative.
Deterministic Chaos PHYS 306/638 University of Delaware ca oz.
Course AE4-T40 Lecture 5: Control Apllication
Admin stuff. Questionnaire Name Math courses taken so far General academic trend (major) General interests What about Chaos interests you the most?
Statistical Methods for long-range forecast By Syunji Takahashi Climate Prediction Division JMA.
Decision analysis and Risk Management course in Kuopio
Chapter 15 Forecasting Copyright © 2011 Pearson Addison-Wesley. All rights reserved. Slides by Niels-Hugo Blunch Washington and Lee University.
STATISTICS: BASICS Aswath Damodaran 1. 2 The role of statistics Aswath Damodaran 2  When you are given lots of data, and especially when that data is.
Chaos Identification For the driven, damped pendulum, we found chaos for some values of the parameters (the driving torque F) & not for others. Similarly,
Reconstructed Phase Space (RPS)
BsysE595 Lecture Basic modeling approaches for engineering systems – Summary and Review Shulin Chen January 10, 2013.
A toolbox for continuous time series analysis.. Why continuous time? a) If you can handle continuous time, you can handle discrete observations also,
1 Statistical Distribution Fitting Dr. Jason Merrick.
Probabilistic Robotics Bayes Filter Implementations.
Introduction to Quantum Chaos
Ch 9.8: Chaos and Strange Attractors: The Lorenz Equations
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
Intro. ANN & Fuzzy Systems Lecture 26 Modeling (1): Time Series Prediction.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
Applications of Neural Networks in Time-Series Analysis Adam Maus Computer Science Department Mentor: Doctor Sprott Physics Department.
Simple Linear Regression ANOVA for regression (10.2)
Low-Dimensional Chaotic Signal Characterization Using Approximate Entropy Soundararajan Ezekiel Matthew Lang Computer Science Department Indiana University.
Some figures adapted from a 2004 Lecture by Larry Liebovitch, Ph.D. Chaos BIOL/CMSC 361: Emergence 1/29/08.
EEG analysis during hypnagogium Petr Svoboda Laboratory of System Reliability Faculty of Transportation Czech Technical University
Introduction to Chaos by: Saeed Heidary 29 Feb 2013.
Introduction: Brain Dynamics Jaeseung Jeong, Ph.D Department of Bio and Brain Engineering, KAIST.
ECE-7000: Nonlinear Dynamical Systems Overfitting and model costs Overfitting  The more free parameters a model has, the better it can be adapted.
Chapter 6 – Three Simple Classification Methods © Galit Shmueli and Peter Bruce 2008 Data Mining for Business Intelligence Shmueli, Patel & Bruce.
Distinctive Image Features from Scale-Invariant Keypoints David Lowe Presented by Tony X. Han March 11, 2008.
A Simple Chaotic Circuit Ken Kiers and Dory Schmidt Physics Department, Taylor University, 236 West Reade Ave., Upland, Indiana J.C. Sprott Department.
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
S. Srinivasan, S. Prasad, S. Patil, G. Lazarou and J. Picone Intelligent Electronic Systems Center for Advanced Vehicular Systems Mississippi State University.
1 Challenge the future Chaotic Invariants for Human Action Recognition Ali, Basharat, & Shah, ICCV 2007.
Control and Synchronization of Chaos Li-Qun Chen Department of Mechanics, Shanghai University Shanghai Institute of Applied Mathematics and Mechanics Shanghai.
1/18/2016Atomic Scale Simulation1 Definition of Simulation What is a simulation? –It has an internal state “S” In classical mechanics, the state = positions.
Signal Processing in Neuroinformatics EEG Signal Processing Yongnan Ji.
Predictability of daily temperature series determined by maximal Lyapunov exponent Jan Skořepa, Jiří Mikšovský, Aleš Raidl Department of Atmospheric Physics,
September 28, 2000 Improved Simultaneous Data Reconciliation, Bias Detection and Identification Using Mixed Integer Optimization Methods Presented by:
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Controlling Chaos Journal presentation by Vaibhav Madhok.
6/11/2016Atomic Scale Simulation1 Definition of Simulation What is a simulation? –It has an internal state “S” In classical mechanics, the state = positions.
MODEL DIAGNOSTICS By Eni Sumarminingsih, Ssi, MM.
[Chaos in the Brain] Nonlinear dynamical analysis for neural signals Jaeseung Jeong, Ph.D Department of Bio and Brain Engineering, KAIST.
L’Aquila 1 of 26 “Chance or Chaos?” Climate 2005, PIK, Jan 2005 Gabriele Curci, University of L’Aquila
Nonlinear time series analysis Delay embedding technique –reconstructs dynamics from single variable Correlation sum –provides an estimator of fractal.
ANALYSES OF THE CHAOTIC BEHAVIOR OF THE ELECTRICITY PRICE SERIES
Chaos Analysis.
National Mathematics Day
Why Stochastic Hydrology ?
Linear Regression.
Dimension Review Many of the geometric structures generated by chaotic map or differential dynamic systems are extremely complex. Fractal : hard to define.
Uncertain, High-Dimensional Dynamical Systems
Handout #21 Nonlinear Systems and Chaos Most important concepts
Introduction to chaotic dynamics
Introduction of Chaos in Electric Drive Systems
Introduction to chaotic dynamics
Nearest Neighbors CSC 576: Data Mining.
Lecturer Dr. Veronika Alhanaqtah
CH2 Time series.
BOX JENKINS (ARIMA) METHODOLOGY
Finding the Popular Frequency!
Presentation transcript:

From

Time series analysis – ‘standard’ techniques Mean, variance – entire series, or windowed Autocorrelation ARMA – autoregressive moving average Spectral analysis – Fast Fourier Transform EEGs as Time Series

Chaos theory Formulated in 1960s Lorenz model (1961) Mathematically simple… …but behaviorally (dynamically) complex EEGs as Chaotic Time Series

Chaos theory Formulated in 1960s Multiple definitions – all include some form of Aperiodicity – output never returns exactly to starting conditions Boundedness EEGs as Chaotic Time Series

Chaos theory, cont. Termed low-dimensional, deterministic chaos 3 equations sufficed to produce “chaotic dynamics” No stochastic input (“noise”) was required to produce complicated behavior Extreme sensitivity to initial conditions (starting point)  Can’t predict outcome, no matter how accurately initial conditions are specified. EEGs as Chaotic Time Series

Chaos adherents noted that EEGs were Complex time series Bounded Seemingly aperiodic  Hypothesis that EEGs represented low-dimensional chaotic dynamics EEGs as Chaotic Time Series

Historically, two parameters from chaos theory have dominated the EEG/HRV literature: Lyapunov exponent ( 1 or L1) Correlation Dimension (D2) Nonlinear Analysis of Time Series

Lyapunov exponent ( 1 or L1) Measures rate of divergence of two nearby points = ‘unpredictability’ Said to measure “degree of chaos” Meaning of that is unclear… Positive L1 is necessary condition for chaotic dynamics L1 for Lorenz system is 1.5 – 2+, depending on values for , , and  Nonlinear Analysis of Time Series

Correlation Dimension (D2) Measures number of independent variables required to produce dynamics of time series > 2  6-ish for low-dimensional chaotic dynamics Infinite for a pure noise time series Nonlinear Analysis of Time Series

Algorithms for computing L1 & D2 from time series developed in early 1980s Developed for time series based on solutions of chaos-producing systems of differential equations (e.g., Lorenz model) Applied to EEG and HRV data soon after Early authors overlooked or neglected to mention that their algorithms require time series of (almost) infinite length don’t work when noise is present in time series Nonlinear Analysis of Time Series

Algorithms for computing L1 & D2 from time series developed in early 1980s Developed for time series based on solutions of chaos-producing systems of differential equations (e.g., Lorenz model) Applied to EEG and HRV data soon after Early authors overlooked or neglected to mention that their algorithms require time series of (almost) infinite length don’t work when noise is present in time series Nonlinear Analysis of Time Series

Suitable(?) algorithm developed by Rosenstein et al. in 1993 Relatively easy implementation, in contrast with earlier algorithms Averages behavior of a sample of points in a time series Divergence through time of two nearby points is the datum N = 5000 appears sufficient for estimation of L1 and D2 Not yet applied as extensively to EEG & HRV analysis as it should be Nonlinear Analysis of Time Series

We developed software that allowed us to ‘section out’ eye-blink and other artifacts: Nonlinear Analysis of EEGs

We then modified the Rosenstein et al. algorithm slightly Select points from time series Locate nearest neighbor in m–dimensional phase space Allow distance between nearest neighbors to evolve through time Apply algorithm to successive point chunks of the sectioned time series Calculate L1 from L1 = ln(divergence)/  t Nonlinear Analysis of Time Series

Calculate L1 from L1 = ln(divergence)/  t Lyapunov Exponent (L1) Calculation

Calculate D2 from distribution of nearest neighbor distances Correlation Dimension (D2) Calculation

Nearest neighbor distances ‘partitioned’ into “shells” of increasing (m–dimensional) size Cumulative proportion of nearest neighbor distances computed as function of shell size Termed Correlation Sum, or Cmr Log-log plot of Cmr vs. shell size yields D2 Correlation Dimension (D2) Calculation

Calculate D2 from proportion of nearest neighbor distances that are within successively larger distances Correlation Dimension (D2) Calculation

Calculate D2 from proportion of nearest neighbor distances that are within successively larger distances Correlation Dimension (D2) Calculation 

The time (lag) when the autocorrelation function drops below (1 – 1/e) is important Estimates the period of the m–dimensional time series. Autocorrelation Function

Results of ANOVA L1D2Period F P0.027n.s.<0.001 Control0.80 a a PTSD0.62 a a PS & F1.56 b b L1 and Period significantly increased by therapy Increase persists until follow-up EEG May be decreased by PTSD; possible sample size problem. D2 unaffected by PTSD or therapy

Nonlinear Analysis of EEGs Next step is to apply L1,D2(?), the autocorrelation function, and other nonlinear time series analysis techniques Goal is an algorithm that allows early discrimination of responders from non-responders Our index must therefore exhibit a high degree of sensitivity specificity

FIN