Budapest University of Technology &Econ. 1 Summer school on ADC & DAC June-July 2006 Testing of A/D Converters II. Improvement of Sine Fit István Kollár.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

©2005 Brooks/Cole - Thomson Learning FIGURES FOR CHAPTER 2 STATISTICAL INFERENCE Click the mouse or use the arrow keys to move to the next page. Use the.
Pattern Recognition and Machine Learning
Chapter 6 Sampling and Sampling Distributions
CHAPTER 13 M ODELING C ONSIDERATIONS AND S TATISTICAL I NFORMATION “All models are wrong; some are useful.”  George E. P. Box Organization of chapter.
Estimation  Samples are collected to estimate characteristics of the population of particular interest. Parameter – numerical characteristic of the population.
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 10: The Bayesian way to fit models Geoffrey Hinton.
Continuous Time Signals A signal represents the evolution of a physical quantity in time. Example: the electric signal out of a microphone. At every time.
EE 472 – Senior Project Hang B. Lee, Applied Physics & EE Advisor: Prof. Robert Grober “Noise Characterization of A/D Converter on PIC Microcontroller”
Chapter 7 Introduction to Sampling Distributions
8.4 Weighted Least Squares Estimation Before the existence of heteroskedasticity-robust statistics, one needed to know the form of heteroskedasticity -Het.
The Simple Linear Regression Model: Specification and Estimation
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem, random variables, pdfs 2Functions.
AGC DSP AGC DSP Professor A G Constantinides© Estimation Theory We seek to determine from a set of data, a set of parameters such that their values would.
Chapter 7 Sampling and Sampling Distributions
Tracking using the Kalman Filter. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )
2. Point and interval estimation Introduction Properties of estimators Finite sample size Asymptotic properties Construction methods Method of moments.
7. Least squares 7.1 Method of least squares K. Desch – Statistical methods of data analysis SS10 Another important method to estimate parameters Connection.
5. Estimation 5.3 Estimation of the mean K. Desch – Statistical methods of data analysis SS10 Is an efficient estimator for μ ?  depends on the distribution.
Probability Review (many slides from Octavia Camps)
7-1 Introduction The field of statistical inference consists of those methods used to make decisions or to draw conclusions about a population. These.
Introduction To Signal Processing & Data Analysis
Random Processes and LSI Systems What happedns when a random signal is processed by an LSI system? This is illustrated below, where x(n) and y(n) are random.
PATTERN RECOGNITION AND MACHINE LEARNING
Error Analysis Accuracy Closeness to the true value Measurement Accuracy – determines the closeness of the measured value to the true value Instrument.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Lab 3b: Distribution of the mean
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Definitions Random Signal Analysis (Review) Discrete Random Signals Random.
FE8113 ”High Speed Data Converters”. Course outline Focus on ADCs. Three main topics:  1: Architectures ”CMOS Integrated Analog-to-Digital and Digital-to-
Testing of A/D Converters István Kollár Budapest University of Technology and Economics Dept. of Measurement and Information Systems Budapest, Hungary.
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Principles of Parameter Estimation.
Introduction to Digital Signals
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
Chapter 7 Point Estimation of Parameters. Learning Objectives Explain the general concepts of estimating Explain important properties of point estimators.
EE 3220: Digital Communication
Digital Communications Chapeter 3. Baseband Demodulation/Detection Signal Processing Lab.
Electronic Noise Noise phenomena Device noise models
Chapter 5 Sampling Distributions. The Concept of Sampling Distributions Parameter – numerical descriptive measure of a population. It is usually unknown.
Autoregressive (AR) Spectral Estimation
CLASSICAL NORMAL LINEAR REGRESSION MODEL (CNLRM )
ES 07 These slides can be found at optimized for Windows)
Noise and Data Errors Nominal Observation for “1” Nominal Observation for “0” Probability density for “0” with Noise Probability density for “1” with Noise.
R. Kass/W03 P416 Lecture 5 l Suppose we are trying to measure the true value of some quantity (x T ). u We make repeated measurements of this quantity.
Learning Theory Reza Shadmehr Distribution of the ML estimates of model parameters Signal dependent noise models.
CHAPTER 4 ESTIMATES OF MEAN AND ERRORS. 4.1 METHOD OF LEAST SQUARES I n Chapter 2 we defined the mean  of the parent distribution and noted that the.
Digital Communications I: Modulation and Coding Course Spring Jeffrey N. Denenberg Lecture 3c: Signal Detection in AWGN.
Computacion Inteligente Least-Square Methods for System Identification.
Week 21 Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Presentation : “ Maximum Likelihood Estimation” Presented By : Jesu Kiran Spurgen Date :
Locating a Shift in the Mean of a Time Series Melvin J. Hinich Applied Research Laboratories University of Texas at Austin
Stat 223 Introduction to the Theory of Statistics
HST 583 fMRI DATA ANALYSIS AND ACQUISITION
ELG5377 Adaptive Signal Processing
(5) Notes on the Least Squares Estimate
Probability Theory and Parameter Estimation I
Chapter 7 Sampling and Sampling Distributions
The Simple Linear Regression Model: Specification and Estimation
Fundamentals of estimation and detection in signals and images
Outline Introduction Signal, random variable, random process and spectra Analog modulation Analog to digital conversion Digital transmission through baseband.
Ch3: Model Building through Regression
Special Topics In Scientific Computing
Basic Estimation Techniques
Wavelet-Based Denoising Using Hidden Markov Models
10701 / Machine Learning Today: - Cross validation,
مدلسازي تجربي – تخمين پارامتر
Electronic Noise Noise phenomena Device noise models
Stat 223 Introduction to the Theory of Statistics
Parametric Methods Berlin Chen, 2005 References:
Presentation transcript:

Budapest University of Technology &Econ. 1 Summer school on ADC & DAC June-July 2006 Testing of A/D Converters II. Improvement of Sine Fit István Kollár Budapest University of Technology and Economics Dept. of Measurement and Information Systems Budapest, Hungary

Budapest University of Technology &Econ. 2 Summer school on ADC & DAC June-July 2006 Outline ADC testing: standards, sine wave fitting Problem: improper fit of low-noise sine at low level numbers (<25) Cause: LS fit is used for deterministic error pattern Solution: elimination of “pathological” data Suggestion for modification of standard

Budapest University of Technology &Econ. 3 Summer school on ADC & DAC June-July 2006 Quantized Sine Wave

Budapest University of Technology &Econ. 4 Summer school on ADC & DAC June-July 2006 Probability Density Function

Budapest University of Technology &Econ. 5 Summer school on ADC & DAC June-July 2006 Properties LS is maximum likelihood if noise Gaussian, zero-mean and white Therefore it is (asymptotically) unbiased and has (asymptotically) minimum variance (effective) It is quite good also if noise is uniform, zero-mean and white NONE IS TRUE! ADC errors are, even in the ideal case: deterministic, interrelated if statistically treated correlated (interdependence of samples) non-Gaussian, non-uniform

Budapest University of Technology &Econ. 6 Summer school on ADC & DAC June-July 2006 Algorithm Minimize a)vs. , A, B, C, or b)vs. A, B, C the following sum (LS criterion):

Budapest University of Technology &Econ. 7 Summer school on ADC & DAC June-July 2006 Effective Number of Bits B: nominal number of bits RMS: root mean square of error q: nominal quantum size (LSB)

Budapest University of Technology &Econ. 8 Summer school on ADC & DAC June-July 2006 Probability Density Function

Budapest University of Technology &Econ. 9 Summer school on ADC & DAC June-July 2006 Fitting the Samples

Budapest University of Technology &Econ. 10 Summer school on ADC & DAC June-July 2006 ENOB as function of dc and A

Budapest University of Technology &Econ. 11 Summer school on ADC & DAC June-July 2006 Corrected ENOB

Budapest University of Technology &Econ. 12 Summer school on ADC & DAC June-July 2006 Corrected ENOB, Noisy Input

Budapest University of Technology &Econ. 13 Summer school on ADC & DAC June-July 2006 The Fitted Sine is Still Smaller than True One

Budapest University of Technology &Econ. 14 Summer school on ADC & DAC June-July 2006 Weight of the Considered Samples

Budapest University of Technology &Econ. 15 Summer school on ADC & DAC June-July 2006 The Fitted Sine is Smaller than True One

Budapest University of Technology &Econ. 16 Summer school on ADC & DAC June-July 2006 Re-weighting by the Reciprocal of the PDF

Budapest University of Technology &Econ. 17 Summer school on ADC & DAC June-July 2006 Proper Handling of Noise: Corrected Re-weighting by the Reciprocal of the PDF, with Elimination of Samples Around Zero

Budapest University of Technology &Econ. 18 Summer school on ADC & DAC June-July 2006 The “Best” Fitted Sine

Budapest University of Technology &Econ. 19 Summer school on ADC & DAC June-July 2006 Algorithm 1.Eliminate the ‘pathological’ bins, that is, samples which are at the maximum histogram bins or outside these, 2.Eliminate the ‘central’ samples which yield zero at the quantized output, 3.Make an estimation of the parameters of the sine wave, by an LS fit (3- or 4-parameter method), 4.Determine the corrected reciprocal weighting, 5.Make a WLS fit with these weights, 6.If the correction is important, return to 4.

Budapest University of Technology &Econ. 20 Summer school on ADC & DAC June-July 2006 Summary Error in sine fit (and also in the error sequence) for small noise and small bit number Robust elimination of the error source is possible (not affecting other calculations) It could be built into the standards