Smoothing Serial Data.

Slides:



Advertisements
Similar presentations
It is very difficult to measure the small change in volume of the mercury. If the mercury had the shape of a sphere, the change in diameter would be very.
Advertisements

Kin 304 Regression Linear Regression Least Sum of Squares
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
Statistics for the Social Sciences
Curve-Fitting Regression
Class 5: Thurs., Sep. 23 Example of using regression to make predictions and understand the likely errors in the predictions: salaries of teachers and.
Tracking using the Kalman Filter. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )
Chapter Topics Types of Regression Models
Business Statistics - QBM117 Statistical inference for regression.
1 Chapter 17: Introduction to Regression. 2 Introduction to Linear Regression The Pearson correlation measures the degree to which a set of data points.
Correlation and Regression Analysis
Introduction to Regression Analysis, Chapter 13,
Math 116 Chapter 12.
Inference for regression - Simple linear regression
1 Demand Planning: Part 2 Collaboration requires shared information.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
1 Least squares procedure Inference for least squares lines Simple Linear Regression.
Dr. Richard Young Optronic Laboratories, Inc..  Uncertainty budgets are a growing requirement of measurements.  Multiple measurements are generally.
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
Review of Statistical Models and Linear Regression Concepts STAT E-150 Statistical Methods.
Least-Squares Regression Section 3.3. Why Create a Model? There are two reasons to create a mathematical model for a set of bivariate data. To predict.
Statistical Methods Statistical Methods Descriptive Inferential
Curve-Fitting Regression
Signals CY2G2/SE2A2 Information Theory and Signals Aims: To discuss further concepts in information theory and to introduce signal theory. Outcomes:
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Mathematical Modeling of Serial Data Modeling Serial Data Differs from simple equation fitting in that the parameters of the equation must have meaning.
Our Week at Math Camp Abridged Group 2π = [Erin Groark, Sarah Lynn Joyner, Dario Varela, Sean Wilkoff]
Analysis of Residuals ©2005 Dr. B. C. Paul. Examining Residuals of Regression (From our Previous Example) Set up your linear regression in the Usual manner.
Simple & Multiple Regression 1: Simple Regression - Prediction models 1.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Model Validation 1. Introduction Model validation is a crucial step to evaluate the quality of estimated models. If validation is unsuccessful, previous.
V Bandi and R Lahdelma 1 Forecasting. V Bandi and R Lahdelma 2 Forecasting? Decision-making deals with future problems -Thus data describing future must.
Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)
Dept of Bioenvironmental Systems Engineering National Taiwan University Lab for Remote Sensing Hydrology and Spatial Modeling STATISTICS Linear Statistical.
Marshall University School of Medicine Department of Biochemistry and Microbiology BMS 617 Lecture 11: Models Marshall University Genomics Core Facility.
Residual Analysis Purposes –Examine Functional Form (Linear vs. Non- Linear Model) –Evaluate Violations of Assumptions Graphical Analysis of Residuals.
CY3A2 System identification Input signals Signals need to be realisable, and excite the typical modes of the system. Ideally the signal should be persistent.
CHAPTER 12 FORECASTING. THE CONCEPTS A prediction of future events used for planning purpose Supply chain success, resources planning, scheduling, capacity.
Team 5 Binge Thinkers (formerly known as People doing Math) Statistical Analysis of Vibrating Beam Peter Gross Keri Rehm Regal Ferrulli Anson Chan.
BUSINESS MATHEMATICS & STATISTICS. Module 6 Correlation ( Lecture 28-29) Line Fitting ( Lectures 30-31) Time Series and Exponential Smoothing ( Lectures.
Demand Management and Forecasting Chapter 11 Portions Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
MODEL DIAGNOSTICS By Eni Sumarminingsih, Ssi, MM.
Introduction Many problems in Engineering, Management, Health Sciences and other Sciences involve exploring the relationships between two or more variables.
Chapter 11 – With Woodruff Modications Demand Management and Forecasting Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
26134 Business Statistics Week 4 Tutorial Simple Linear Regression Key concepts in this tutorial are listed below 1. Detecting.
Multiple Regression.
Chapter 4: Basic Estimation Techniques
Operations Management Contemporary Concepts and Cases
SUR-2250 Error Theory.
Chapter 4 Basic Estimation Techniques
Part 5 - Chapter
Part 5 - Chapter 17.
Linear Regression.
Smoothing Serial Data.
3.1 Examples of Demand Functions
Kin 304 Regression Linear Regression Least Sum of Squares
BPK 304W Regression Linear Regression Least Sum of Squares
BA 275 Quantitative Business Methods
Part 5 - Chapter 17.
Multiple Regression.
Dealing with Noisy Data
Regression Models - Introduction
Descriptive and Inferential
Product moment correlation
Learning Theory Reza Shadmehr
Mathematical Foundations of BME
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

Smoothing Serial Data

Serial Data Data collected over time Digitized Analog Signals longitudinal serial Digitized Analog Signals Data points are not independent Serial Data

Smoothing Serial Data: Moving Average 3 point moving average Serial Data

Simulated Signal Signal simulated by sine wave data produced with sin() function in EXCEL Serial Data

Simulated Noisy Signal Original Sinusoid plus random error Serial Data

7-point Moving Average 7 adjacent points are averaged Smoothed but still noisy Serial Data

21-point Moving Average Smoother Amplitude is reduced Serial Data

Weighted Moving Averaging Central points given more importance Arbitrary weighting scheme e.g 1 3 5 3 1 Serial Data

Weighted Moving Average e.g. 5 data points 10, 9, 13, 12, 16 average = 12 with a weighting scheme of 1 3 5 3 1 weighted average: = [(1x10)+(3x9)+(5x13)+(3x12)+(1x16)]/13 = 11.8

Mathematical Modeling of Serial Data

Signal Averaging of ECG ECG + Noise ECG Identified QRS Peaks Serial Data & Modeling

Mathematical Modeling of Serial Data Signal Averaging (a) (b) and (c) are QRS peak aligned ECG signal epochs (d) is the result of averaging 100 such epochs This works because noise tends to be random whereas signal has a consistent pattern Mathematical Modeling of Serial Data

Smoothing Serial Data: Fitting Mathematical Equations Often used to smooth noisy data You can find an equation to fit most data Can also be used for imputing (estimating) missing values Serial Data

Mathematical Modeling of Serial Data

Mathematical Modeling of Serial Data Modeling Serial Data Differs from simple equation fitting in that the parameters of the equation must have meaning Can be used to smooth Can explain phenomena Can be used to predict Mathematical Modeling of Serial Data

Steps in Mathematical Modeling Identification of the mechanism Translation of that phenomenon into a mathematical equation Testing the fit of the model to actual data Modification of the model according to the results of the experimental evaluation Mathematical Modeling of Serial Data

Criteria of Fit of the Model Least Sum of Squares Shape of the curve Mathematical Modeling of Serial Data

Examination of Residuals Residual = Actual Y - Predicted Y Ideally there is no pattern to the residuals. In this case there would be a horizontal normal distribution of residuals about a mean of zero. However there is a clear pattern indicating the lack of fit of the model. Mathematical Modeling of Serial Data

Ideal Characteristics of a Model Simple Fits the experimental data well Has biologically meaningful parameters Mathematical Modeling of Serial Data

Modeling Growth Data

Mathematical Modeling of Serial Data Clinical Growth Charts National Centre for Health Statistics (N.C.H.S.)1970’s revamped as Center for Disease Control C.D.C. charts, 2001 Most often used clinical norms for height and weight Cross-sectional Mathematical Modeling of Serial Data

Mathematical Modeling of Serial Data Preece-Baines model I where h is height at time t, h1 is final height, s0 and s1 are rate constants, q is a time constant and hq is height at t = q. Mathematical Modeling of Serial Data

Smooth curves are the result of fitting Preece-Baines Model 1 to raw data This was achieved using MS EXCEL rather than custom software

Examination of Residuals

Caribbean Growth Data n =1697