Frequency Domain Causality Analysis Method for Multivariate Systems in Hypothesis Testing Framework Hao Ye Department of Automation, Tsinghua University.

Slides:



Advertisements
Similar presentations
A Brief Introduction to Spatial Regression
Advertisements

A small taste of inferential statistics
Simple Linear Regression and Correlation by Asst. Prof. Dr. Min Aung.
Permutation Tests Hal Whitehead BIOL4062/5062.
Towards Twitter Context Summarization with User Influence Models Yi Chang et al. WSDM 2013 Hyewon Lim 21 June 2013.
Review You run a t-test and get a result of t = 0.5. What is your conclusion? Reject the null hypothesis because t is bigger than expected by chance Reject.
Prediction, Correlation, and Lack of Fit in Regression (§11. 4, 11
Environmental Data Analysis with MatLab Lecture 23: Hypothesis Testing continued; F-Tests.
Correlation Chapter 9.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 14 Using Multivariate Design and Analysis.
Chapter18 Determining and Interpreting Associations Among Variables.
1 Indirect Estimation of the Parameters of Agent Based Models of Financial Markets Peter Winker Manfred Gilli.
PSY 307 – Statistics for the Behavioral Sciences
The Analysis of Variance
Chapter 11: Inference for Distributions
Biologically Inspired Robotics Group,EPFL Associative memory using coupled non-linear oscillators Semester project Final Presentation Vlad TRIFA.
Today Concepts underlying inferential statistics
Chapter 9: Introduction to the t statistic
Statistical hypothesis testing – Inferential statistics II. Testing for associations.
Review I volunteer in my son’s 2nd grade class on library day. Each kid gets to check out one book. Here are the types of books they picked this week:
Two and a half problems in homogenization of climate series concluding remarks to Daily Stew Ralf Lindau.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Hypothesis Testing:.
Overview G. Jogesh Babu. Probability theory Probability is all about flip of a coin Conditional probability & Bayes theorem (Bayesian analysis) Expectation,
Bayesian Hierarchical Models of Individual Differences in Skill Acquisition Dr Jeromy Anglim Deakin University 22 nd May 2015.
Copyright © 2010, 2007, 2004 Pearson Education, Inc Lecture Slides Elementary Statistics Eleventh Edition and the Triola Statistics Series by.
Correlation.
STOCHASTIC DOMINANCE APPROACH TO PORTFOLIO OPTIMIZATION Nesrin Alptekin Anadolu University, TURKEY.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
The Argument for Using Statistics Weighing the Evidence Statistical Inference: An Overview Applying Statistical Inference: An Example Going Beyond Testing.
Comparing two sample means Dr David Field. Comparing two samples Researchers often begin with a hypothesis that two sample means will be different from.
Integrated Development Environment for Policies Anjali B Shah Department of Computer Science and Electrical Engineering University of Maryland Baltimore.
CHAPTER 14 Introduction to Inference BPS - 5TH ED.CHAPTER 14 1.
Biostatistics Class 6 Hypothesis Testing: One-Sample Inference 2/29/2000.
Copyright (C) 2002 Houghton Mifflin Company. All rights reserved. 1 Understandable Statistics S eventh Edition By Brase and Brase Prepared by: Lynn Smith.
CHAPTER 17: Tests of Significance: The Basics
Chapter 10: Analyzing Experimental Data Inferential statistics are used to determine whether the independent variable had an effect on the dependent variance.
C M Clarke-Hill1 Analysing Quantitative Data Forming the Hypothesis Inferential Methods - an overview Research Methods.
RDPStatistical Methods in Scientific Research - Lecture 41 Lecture 4 Sample size determination 4.1 Criteria for sample size determination 4.2 Finding the.
Detecting Group Differences: Mining Contrast Sets Author: Stephen D. Bay Advisor: Dr. Hsu Graduate: Yan-Cheng Lin.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Chapter 16 Data Analysis: Testing for Associations.
Application control chart concepts of designing a pre-alarm system Sheue-Ling Hwang, Jhih-Tsong Lin, Guo-Feng Liang, Yi-Jan Yau, Tzu-Chung Yenn, Chong-Cheng.
Describing Relationships Using Correlations. 2 More Statistical Notation Correlational analysis requires scores from two variables. X stands for the scores.
Academic Research Academic Research Dr Kishor Bhanushali M
CHAPTER 15: Tests of Significance The Basics ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Lecture PowerPoint Slides Basic Practice of Statistics 7 th Edition.
Statistics in Applied Science and Technology Supplemental: Elaborating Crosstabs: Adding a Third Variable.
NURHIKMAH OLA LAIRI (LAILUOLA) Ph.D International Trade Student Id :
1 Probability and Statistics Confidence Intervals.
Descriptive and Inferential Statistics Descriptive statistics The science of describing distributions of samples or populations Inferential statistics.
Hypothesis Testing Steps for the Rejection Region Method State H 1 and State H 0 State the Test Statistic and its sampling distribution (normal or t) Determine.
Statistics Josée L. Jarry, Ph.D., C.Psych. Introduction to Psychology Department of Psychology University of Toronto June 9, 2003.
CHAPTER 15: Tests of Significance The Basics ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Spearman’s Rho Correlation
CHAPTER 9 Testing a Claim
CORRELATION.
Non-Parametric Tests 12/1.
Statistical Quality Control, 7th Edition by Douglas C. Montgomery.
Review You run a t-test and get a result of t = 0.5. What is your conclusion? Reject the null hypothesis because t is bigger than expected by chance Reject.
Non-Parametric Tests 12/1.
Non-Parametric Tests 12/6.
Statistical Data Analysis
Non-Parametric Tests.
CHAPTER 14: Confidence Intervals The Basics
CHAPTER 7 Sampling Distributions
CHAPTER 7 Sampling Distributions
Inferential Statistics
CHAPTER 7 Sampling Distributions
Multiple Regression Berlin Chen
Presentation transcript:

Frequency Domain Causality Analysis Method for Multivariate Systems in Hypothesis Testing Framework Hao Ye Department of Automation, Tsinghua University

Outline A Brief Introduction to Causal Analysis A Brief Introduction to Causal Analysis Two Problems of PDC Two Problems of PDC Frequency Domain Causal Analysis Methods Based on Two Statistics Frequency Domain Causal Analysis Methods Based on Two Statistics Simulation Examples Simulation Examples Concluding Remarks Concluding Remarks

A Brief Introduction to Causal Analysis Causal relationship among the time series of an industrial process is of great use for fault detection, alarm management, synthesis design, and modeling, etc. Causal relationship among the time series of an industrial process is of great use for fault detection, alarm management, synthesis design, and modeling, etc. But it is often complicated and unknown in case of lack of a perfect knowledge of system structure But it is often complicated and unknown in case of lack of a perfect knowledge of system structure Causality Analysis methods Causality Analysis methods Time domain Time domain Frequency domain Frequency domain Wiener(1956): Concept based on data Granger(1963): Granger causality Geweke(1982): Conditional Granger causality Kaminski(1991): Frequency domain Granger causality Baccala(2001) : Partial directed coherence (PDC) Wide application Some issues still need further discussions

, A Brief Introduction to Causal Analysis

Two Problems of PDC, Baccala and Sameshima (2001) : PDC has the ability to rank the relative interaction strength with respect to a given signal source because of the normalization. Reference: (Barrett and Seth, 2009): Granger causality can measure the strength Problem 1: PDC cannot correctly rank the causal strength

Two Problems of PDC Few conclusions about what information the distribution of PDC in frequency domain can further offer. It is natural to guess that it represent how the strength of causal influence changes with ω. monotonically decreases as ω grows monotonically increases as ω grows Can be extended to a general first order multivariate system Problem 2: PDC cannot describe how the causal strength changes with frequency Only affects the dynamics of x 5 Does not affect the qualitative causal relationship

Frequency domain Causal Analysis Methods based on Two Statistics Schelter et al. (2009): Renormalized PDC (RPDC) Schelter et al. (2009): Renormalized PDC (RPDC) Schelter et al. (2009): Statistical property of RPDC Schelter et al. (2009): Statistical property of RPDC Schelter et al. (2009): Detection rule Schelter et al. (2009): Detection rule How to measure the strength of causality from x j to x i at ω was not discussed Baccala and Sameshima (2001) : Due to the normalization, PDC(x j →x i ) may change if more (or less) signals are influenced by x j, reflects the relative rather than the absolute strength of influence

Smaller probability under null hypothesis Greater probability under null hypothesis Stronger causal strength Weaker causal strength RPDC can be directly used to measure the strength of causality from x j to x i at ω measure the strength of the causality between each pair of time series Frequency domain Causal Analysis Methods based on Two Statistics

Schelter et al. (2005): Schelter et al. (2005): Statistical property Statistical property Measure the strength of causality from x j to x i at ω Measure the strength (and the existence) of the causality between each pair of time series Frequency domain Causal Analysis Methods based on Two Statistics (Schelter et al.,2005) : To solve the over fitting problems in model estimation Lower computation load compared with RPDC

Simulation Examples

, Granger causality S PRDC SϒSϒ The calculated strengths based on S PRDC and S ϒ are consistent with those given by Granger causality

Simulation Examples monotonically decreases as ω grows monotonically increases as ω grows The distributions of RPDC or of these two processes are roughly similar as expected

Frequency ω/0.01 π (0 to π ) Granger causality The distribution of Granger causality in the frequency domain is consistent with those given by PRDC and ϒ -statistics Simulation Examples

Concluding Remarks Discussion of Problem 1: PDC cannot correctly rank the causal strength (contribution) Discussion of Problem 2: PDC cannot describe how the causal strength changes with frequency (contribution ) Baccala and Sameshima (2001) : PDC reflects the relative rather than the absolute strength of influence Solve the two problems respectively (clear physical meaning in the hypothesis testing framework, simulation examples ) Complex computation (Schelter et al.,2005) : To solve the over fitting problems in model estimation Similar advantages to PRDC Simpler computation

Concluding Remarks 1.Zhang J, Yang F, Ye H. Frequency domain causality analysis method for multivariate systems in hypothesis testing framework. The 19 th IFAC World Progress, 2014