1 Detection and Analysis of Impulse Point Sequences on Correlated Disturbance Phone G. Filaretov, A. Avshalumov Moscow Power Engineering Institute, Moscow.

Slides:



Advertisements
Similar presentations
Sampling: Final and Initial Sample Size Determination
Advertisements

N.D.GagunashviliUniversity of Akureyri, Iceland Pearson´s χ 2 Test Modifications for Comparison of Unweighted and Weighted Histograms and Two Weighted.
STAT 497 APPLIED TIME SERIES ANALYSIS
Visual Recognition Tutorial
Error Propagation. Uncertainty Uncertainty reflects the knowledge that a measured value is related to the mean. Probable error is the range from the mean.
Point estimation, interval estimation
Maximum likelihood Conditional distribution and likelihood Maximum likelihood estimations Information in the data and likelihood Observed and Fisher’s.
Simulation Modeling and Analysis
Statistical Inference Chapter 12/13. COMP 5340/6340 Statistical Inference2 Statistical Inference Given a sample of observations from a population, the.
9-1 Hypothesis Testing Statistical Hypotheses Statistical hypothesis testing and confidence interval estimation of parameters are the fundamental.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Evaluating Hypotheses
8-1 Quality Improvement and Statistics Definitions of Quality Quality means fitness for use - quality of design - quality of conformance Quality is.
Lec 6, Ch.5, pp90-105: Statistics (Objectives) Understand basic principles of statistics through reading these pages, especially… Know well about the normal.
Linear and generalised linear models
Inferences About Process Quality
Lehrstuhl für Informatik 2 Gabriella Kókai: Maschine Learning 1 Evaluating Hypotheses.
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 7 Statistical Intervals Based on a Single Sample.
Regression Model Building Setting: Possibly a large set of predictor variables (including interactions). Goal: Fit a parsimonious model that explains variation.
Generalized Linear Models
Chapter 9 Title and Outline 1 9 Tests of Hypotheses for a Single Sample 9-1 Hypothesis Testing Statistical Hypotheses Tests of Statistical.
EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Component Reliability Analysis
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
Gaussian process modelling
Isolated-Word Speech Recognition Using Hidden Markov Models
Simple Linear Regression Models
STAT 497 LECTURE NOTES 2.
1 Least squares procedure Inference for least squares lines Simple Linear Regression.
Population All members of a set which have a given characteristic. Population Data Data associated with a certain population. Population Parameter A measure.
Random Sampling, Point Estimation and Maximum Likelihood.
9-1 Hypothesis Testing Statistical Hypotheses Definition Statistical hypothesis testing and confidence interval estimation of parameters are.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
1 Statistical Distribution Fitting Dr. Jason Merrick.
Modern Navigation Thomas Herring
The Examination of Residuals. Examination of Residuals The fitting of models to data is done using an iterative approach. The first step is to fit a simple.
Various topics Petter Mostad Overview Epidemiology Study types / data types Econometrics Time series data More about sampling –Estimation.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
Multiple Regression Petter Mostad Review: Simple linear regression We define a model where are independent (normally distributed) with equal.
Detection and estimation of abrupt changes in Gaussian random processes with unknown parameters By Sai Si Thu Min Oleg V. Chernoyarov National Research.
HY436: Mobile Computing and Wireless Networks Data sanitization Tutorial: November 7, 2005 Elias Raftopoulos Ploumidis Manolis Prof. Maria Papadopouli.
Selecting Input Probability Distribution. Simulation Machine Simulation can be considered as an Engine with input and output as follows: Simulation Engine.
Week 21 Stochastic Process - Introduction Stochastic processes are processes that proceed randomly in time. Rather than consider fixed random variables.
Copyright © 2014 by McGraw-Hill Higher Education. All rights reserved. Essentials of Business Statistics: Communicating with Numbers By Sanjiv Jaggia and.
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
Statistics 300: Elementary Statistics Sections 7-2, 7-3, 7-4, 7-5.
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
Sampling and estimation Petter Mostad
Diversity Loss in General Estimation of Distribution Algorithms J. L. Shapiro PPSN (Parallel Problem Solving From Nature) ’06 BISCuit 2 nd EDA Seminar.
September 28, 2000 Improved Simultaneous Data Reconciliation, Bias Detection and Identification Using Mixed Integer Optimization Methods Presented by:
Lecture №4 METHODS OF RESEARCH. Method (Greek. methodos) - way of knowledge, the study of natural phenomena and social life. It is also a set of methods.
CHAPTER 4 ESTIMATES OF MEAN AND ERRORS. 4.1 METHOD OF LEAST SQUARES I n Chapter 2 we defined the mean  of the parent distribution and noted that the.
Fundamentals of Data Analysis Lecture 10 Correlation and regression.
Ondrej Ploc Part 2 The main methods of mathematical statistics, Probability distribution.
Modeling and Simulation CS 313
Doc.RNDr.Iveta Bedáňová, Ph.D.
STATISTICS POINT ESTIMATION
ASEN 5070: Statistical Orbit Determination I Fall 2014
Modeling and Simulation CS 313
Task: It is necessary to choose the most suitable variant from some set of objects by those or other criteria.
Generalized Linear Models
CHAPTER 29: Multiple Regression*
9 Tests of Hypotheses for a Single Sample CHAPTER OUTLINE
Discrete Event Simulation - 4
EE513 Audio Signals and Systems
Lecture # 2 MATHEMATICAL STATISTICS
Berlin Chen Department of Computer Science & Information Engineering
CH2 Time series.
Threshold Autoregressive
Presentation transcript:

1 Detection and Analysis of Impulse Point Sequences on Correlated Disturbance Phone G. Filaretov, A. Avshalumov Moscow Power Engineering Institute, Moscow Research Institute of Cybernetic Medicine

2 Setting of Problem Let the observable discrete process z is the sum: z = x + i x (disturbance) - the discrete correlated Gaussian process with standard autocorrelation function, r(k)= 0, 1, 2,….; k=0,1,2,…; i - the Poisson impulse sequence with distribution function of intervals between impulses.

3 Additional conditions Distribution function of impulses amplitudes is known up to parameters. Impulses number M is too small in comparison with common discrete observations N (not more, than 10 – 15 %). The main task: with help of observable realization z - to detect impulses i and to estimate unknown intensity of impulse point sequence; - to estimate parameters distribution function of impulses amplitudes. Proposed method for detection and parameters estimation of Poisson impulse sequence includes two stages: Stage 1 intended for detection and position localization of impulse sequence points. Stage 2 intended for estimation of all unknown parameters.

4 Stage 1 - detection and position localization of impulses sequence points. Algorithm is based on detection of statistically significant deviation observable value z t from point z t*, which is found by linear interpolation in two neighbour points z t-1 and z t+1 Presence of impuls in point z t, if: Here - Gaussian distribution quantile, appropriated to confidence probability P. The equivalent formula:, where - the second order difference for time moment t+1.

5 In common form this algorithm of detection includes next sequence of operations: Computing of the first order, and the second order differences, for time series Estimating of variance for time series. Choice of confidence probability P (usually P = 0,90 - 0,99). Fixing of impulses with help of criteria. Elimination of fixed impulses from time series : all these points are replaced by new values, which are computed with help of linear interpolation in two neighbour points. Practically it is necessary to organize iterative regime of this algorithm work. The iterative process is lasted until new anomalous points will not find out during the latest iteration. As a result position of all found impulses on discrete time scale is fixed.

6 Stage 2 - estimation of all unknown parameters  For every found point the impulse amplitude is computed as deviation of observation in this point from value, which is found by linear interpolation in two neighbour points: ; j = 1, 2,…, m. After this the amplitudes distribution function histogram with ordinates ; i = 1, 2,… is built.  Extracting of subset I, which contains substantively warped values of histogram ordinates on account of limited sensitivity of the detection anomalous observations algorithm. This extraction can be made or visual with help of histogram, or by formal exception of histogram intervals from zone. Value is computed for corrected z t after last iteration.

7  Estimation of distribution function parameters, using values, which not belong subset I.  Determination of ordinates for histogram intervals, which belong subset I, using function building of corrected histogram.  Computing of loss coefficient K I in fixation of impulses, connected with limited sensitivity of the detection algorithm K I = This coefficient defines the relativity decrease of impulses numbering comparison with its real value.

8  Determination of time intervals between neighbor detection points ; j = 1, 2,…, m. As impulses with amplitudes near zero cannot be detected, selected point process differs from real: it is more rare. However on account of random location of nondetected points, this process remains Poisson impulse process, but with another intensity <.  Estimating of intensity parameter with help of maximum likelihood method:  Determination of corrected estimation for intensity parameter. Proposed algorithm works out the formulated above problem in full volume.

9 MODEL EXAMPLE Process is formed by quadruple passing of discrete white noise through inertia element ( constant time – 10 discrete time units). The observed realization length - N= discrete volumes. Poisson impulse point process includes 917 points. Model (empirical) volume of intensity. Distribution function of impulse amplitudes – exponential –

10 Stage 1 The first iteration - were detected 565 points (critical value =1,28). The second iteration - were detected 158 points (critical value = 3,09). The third iteration was not fulfilled. In total 723 points from 917 were detected. Stage 2 Amplitudes are estimated and the appropriate distribution histogram is built:

11 As the subset I we choose points, belonging to the first histogram interval (number of these point is equal 164). Using the all other histogram intervals with help of nonlinear estimation method we find approximation for dependence of histogram ordinates from interval centers and also unknown parameter of exponential (under condition) amplitude distribution : ; With help of the last formula we define the estimation for points number in the first grouping interval or another words – for subset I : = 359. Corrected histogram with using of practically the same as the initial histogram for A. The loss coefficient K I in fixation of anomalous points was computed: K I = 0,788.

12 Time intervals between detected points were established. How it was waited, we have distribution of exponential type with the intensity parameter estimation for this distribution : =0,0361. Corrected estimation of intensity parameter is computed: Summing up, it is possible to say, that proposed method of detection and analysis is very effective. The relative error for amplitude mean estimation is less than 1%, аnd for intensity parameter of Poisson impulse point process – about 2%. It is substantively that impulse point process capacity is less 0,1% from capacity of correlated stochastic process, on phone which this point process is detected and analyzed.

13 CONCLUSION It is necessary to underline that quality of end result depends on peculiarities of concrete applied task (what kind are characteristics of process, impulse component, function 13and so on). Areas of possible application proposed method can be various. In particular, it was used for aims of medical diagnostic as means of heart rhythm infringements.