ECEN4503 Random Signals Lecture #24 10 March 2014 Dr. George Scheets n Read 8.1 n Problems 7.1 - 7.3, 7.5 (1 st & 2 nd Edition) n Next Quiz on 28 March.

Slides:



Advertisements
Similar presentations
Time to failure Probability, Survival,  the Hazard rate, and the Conditional Failure Probability.
Advertisements

Chapter 3 Properties of Random Variables
ELEN 5346/4304 DSP and Filter Design Fall Lecture 15: Stochastic processes Instructor: Dr. Gleb V. Tcheslavski Contact:

Ch 4 & 5 Important Ideas Sampling Theory. Density Integration for Probability (Ch 4 Sec 1-2) Integral over (a,b) of density is P(a
1 Def: Let and be random variables of the discrete type with the joint p.m.f. on the space S. (1) is called the mean of (2) is called the variance of (3)
Time Series Basics Fin250f: Lecture 3.1 Fall 2005 Reading: Taylor, chapter
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
Tch-prob1 Chapter 4. Multiple Random Variables Ex Select a student’s name from an urn. S In some random experiments, a number of different quantities.
ECEN5533 Modern Communications Theory Lecture #119 August 2014 Dr. George Scheets n Review Chapter
The joint probability distribution function of X and Y is denoted by f XY (x,y). The marginal probability distribution function of X, f X (x) is obtained.
1 ECE310 – Lecture 23 Random Signal Analysis 04/27/01.
Random Variable and Probability Distribution
1 10. Joint Moments and Joint Characteristic Functions Following section 6, in this section we shall introduce various parameters to compactly represent.
Prof. SankarReview of Random Process1 Probability Sample Space (S) –Collection of all possible outcomes of a random experiment Sample Point –Each outcome.
Probability Theory and Random Processes
ECEN5633 Radar Theory Lecture #16 5 March 2015 Dr. George Scheets n Read 12.1 n Problems 11.1, 3, & 4 n Corrected.
Density Curves Normal Distribution Area under the curve.
Definition of Covariance The covariance of X & Y, denoted Cov(X,Y), is the number where  X = E(X) and  Y = E(Y). Computational Formula:
ELEC 303, Koushanfar, Fall’09 ELEC 303 – Random Signals Lecture 11 – Derived distributions, covariance, correlation and convolution Dr. Farinaz Koushanfar.
Physics 114: Lecture 10 PDFs Part Deux Dale E. Gary NJIT Physics Department.
TELECOMMUNICATIONS Dr. Hugh Blanton ENTC 4307/ENTC 5307.
Statistics for Data Miners: Part I (continued) S.T. Balke.
ECEN4503 Random Signals Lecture #39 21 April 2014 Dr. George Scheets n Read 10.1, 10.2 n Problems: 10.3, 5, 7, 12,14 n Exam #2 this Friday: Mappings →
ECEN3713 Network Analysis Lecture #25 11 April 2006 Dr. George Scheets Exam 2 Results: Hi = 89, Lo = 30, Ave. = Standard Deviation = Quiz 8.
Normal Distribution Introduction. Probability Density Functions.
Uniform Quantization It was discussed in the previous lecture that the disadvantage of using uniform quantization is that low amplitude signals are drastically.
ECEN4533 Data Communications Lecture #1511 February 2013 Dr. George Scheets n Review C.1 - C.3 n Problems: Web 7, 8, & 9 n Quiz #1 < 11 February (Async.
1 Lecture 14: Jointly Distributed Random Variables Devore, Ch. 5.1 and 5.2.
ECEN4523 Commo Theory Lecture #10 9 September 2015 Dr. George Scheets n Read Chapter 3.6 – n Problems:
1 G Lect 2M Examples of Correlation Random variables and manipulated variables Thinking about joint distributions Thinking about marginal distributions:
Lecture 11 Pairs and Vector of Random Variables Last Time Pairs of R.Vs. Marginal PMF (Cont.) Joint PDF Marginal PDF Functions of Two R.Vs Expected Values.
ECEN4503 Random Signals Lecture #6 26 January 2014 Dr. George Scheets n Read: 3.2 & 3.3 n Problems: 2.28, 3.3, 3.4, 3.7 (1 st Edition) n Problems: 2.61,
Introduction to Digital Signals
ECEN5633 Radar Theory Lecture #17 10 March 2015 Dr. George Scheets n Read 12.2 n Problems 11.5, 8, & 12.5 n Corrected.
ECEN5633 Radar Theory Lecture #3 20 January 2015 Dr. George Scheets n Read 2.1 & 2.5 n Problems 1.11, 14, & 16.
Geology 6600/7600 Signal Analysis 02 Sep 2015 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
1 Probability and Statistical Inference (9th Edition) Chapter 4 Bivariate Distributions November 4, 2015.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
ECEN4503 Random Signals Lecture #18 24 February 2014 Dr. George Scheets n Read 5.3 & 5.5 n Problems 5.1, 5.4, 5.11 n Exam #1 Friday n Quiz 4 Results Hi.
EE354 : Communications System I
ECEN5633 Radar Theory Lecture #13 24 February 2015 Dr. George Scheets n Read 11.1 – 11.4 n Problems 3.14, 18,
Joint Moments and Joint Characteristic Functions.
ECEN4503 Random Signals Lecture #39 15 April 2013 Dr. George Scheets n Read: 10.3, 11.1 n Problems: 11.1, 11.4, 11.15, (1 st Edition) n Problems:
Lecture 5,6,7: Random variables and signals Aliazam Abbasfar.
ELEC 303, Koushanfar, Fall’09 ELEC 303 – Random Signals Lecture 8 – Continuous Random Variables: PDF and CDFs Farinaz Koushanfar ECE Dept., Rice University.
ECE4270 Fundamentals of DSP Lecture 8 Discrete-Time Random Signals I School of Electrical and Computer Engineering Center for Signal and Image Processing.
1 Review of Probability and Random Processes. 2 Importance of Random Processes Random variables and processes talk about quantities and signals which.
Copyright © Cengage Learning. All rights reserved. 5 Joint Probability Distributions and Random Samples.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
Learning Theory Reza Shadmehr Distribution of the ML estimates of model parameters Signal dependent noise models.
Pattern Recognition Mathematic Review Hamid R. Rabiee Jafar Muhammadi Ali Jalali.
ECEN3513 Signal Analysis Lecture #4 28 August 2006 n Read section 1.5 n Problems: 1.5-2a-c, 1.5-4, & n Quiz Friday (Chapter 1 and/or Correlation)
ECEN4523 Commo Theory Lecture #38 16 November 2015 Dr. George Scheets n Read 8.6 & 8.7 n Problems: 8.6-1, 3,
6 vector RVs. 6-1: probability distribution A radio transmitter sends a signal to a receiver using three paths. Let X1, X2, and X3 be the signals that.
Function of a random variable Let X be a random variable in a probabilistic space with a probability distribution F(x) Sometimes we may be interested in.
Random Variables By: 1.
Continuous Random Variables. Probability Density Function When plotted, continuous treated as discrete random variables can be “binned” form “bars” A.
ECEN4523 Commo Theory Lecture #42 30 November 2015 Dr. George Scheets n Read 11.3 n Problems: & 4 n Final.
ECEN4503 Random Signals Lecture #30 31 March 2014 Dr. George Scheets n Problems 8.7a & b, 8.11, 8.12a-c (1st Edition) n Problems 8.11a&b, 8.15, 8.16 (2nd.
ECEN5533 Modern Commo Theory Lesson # February 2016 Dr
Random signals Honza Černocký, ÚPGM.
MECH 373 Instrumentation and Measurements
Statistical Methods Michael J. Watts
Random Variable 2013.
Statistical Methods Michael J. Watts
ECEN5533. Modern Communications Theory Lecture #12. 8 February 2016 Dr
ECEN5533. Modern Communications Theory Lecture #6. 25 January 2016 Dr
MEGN 537 – Probabilistic Biomechanics Ch.3 – Quantifying Uncertainty
Presentation transcript:

ECEN4503 Random Signals Lecture #24 10 March 2014 Dr. George Scheets n Read 8.1 n Problems , 7.5 (1 st & 2 nd Edition) n Next Quiz on 28 March n Exam #1 Results Hi = 94, Low = 36, Average = 69.53, σ = A > 88, B > 78, C > 64, D > 51

ECEN4503 Random Signals Lecture #25 12 March 2014 Dr. George Scheets n Read 8.3 & 8.4 n Problems 5.5, 5.7, 5.20 (1st Edition) n Problems 5.10, 5.21, 5.49 (2nd Edition)

Random Number Generator n Uniform over [0,1] n Theoretical E[X] = 0.5 σ X = (1/12) 0.5 = n Actual E[X] = σ X =

Random Number Generator n Addition of 2 S.I. Uniform Random Numbers → Triangular PDF n Each Uniform over [0,1] n Theoretical E[X] = 1.0 σ X = (2/12) 0.5 = n Actual E[X] = σ X =

Random Number Generator n Addition of 3 S.I. Uniform Random Numbers → PDF starting to look Bell Shaped n Each Uniform over [0,1] n Theoretical E[X] = 1.5 σ X = (3/12) 0.5 = 0.5 n Actual E[X] = σ X =

R XY for age & weight X = Age Y = Weight R XY ≡ E[XY] = 4322 (85 data points)

R XY for age & middle finger length X = Age Y = Finger Length (cm) R XY ≡ E[XY] = (54 data points)

Cov(X,Y) for age & weight X = Age Y = Weight R XY ≡ E[XY] = 4322 E[Age] = E[Weight] = E[X]E[Y] = 4309 Cov(X,Y) = (85 data points)

Cov(X,Y) for age & middle finger length X = Age Y = Finger Length R XY ≡ E[XY] = E[Age] = E[Length] = E[X]E[Y] = Cov(X,Y) = (54 data points)

Age & Weight Correlation Coefficient ρ X = Age Y = Weight Cov(X,Y) = σ Age = years σ Weight = ρ = (81 data points)

Age & Weight Correlation Coefficient ρ X = Age Y = Weight Cov(X,Y) = σ Age = years σ Weight = ρ = (85 data points)

Age & middle finger length Correlation Coefficient ρ X = Age Y = Finger Length Cov(X,Y) = σ Age = years σ Length = ρ = (54 data points)

SI versus Correlation n ρ ≡ Correlation Coefficient Allows head-to-head comparisons (Values normalized) ≡ E[XY] – E[X]E[Y] σ X σ Y = 0? → We say R.V.'s are Uncorrelated = 0 < ρ < 1 → X & Y tend to behave similarly = -1 < ρ < 0 → X & Y tend to behave dissimilarly n X & Y are S.I.? → ρ = 0 → X & Y are Uncorrelated n X & Y uncorrelated? → E[XY] = E[X]E[Y] u Example Y = X 2 ; f X (x) symmetrical about 0 u Here X & Y are dependent, but uncorrelated u See Quiz 6, 2012, problem 1e

Two sample functions of bit streams.

Random Bit Stream. Each bit S.I. of others. P(+1 volt) = P(-1 volt) = 0.5 x volts f X (x) +1 1/2

Bit Stream. Average burst length of 20 bits. P(+1 volt) = P(-1 volt) = 0.5 x volts f X (x) +1 1/2 Voltage Distribution of this signal & previous are the same, but time domain behavior different.

Review of PDF's & Histograms n Probability Density Functions (PDF's), of which a Histogram is an estimate of shape, frequently (but not always!) deal with the voltage likelihoods Time Volts

Discrete Time Noise Waveform 255 point, 0 mean, 1 watt Uniformly Distributed Voltages Time Volts 0

15 Bin Histogram (255 points of Uniform Noise) Volts Bin Count 0

15 Bin Histogram (2500 points of Uniform Noise) Volts Bin Count When bin count range is from zero to max value, a histogram of a uniform PDF source will tend to look flatter as the number of sample points increases.

15 Bin Histogram (2500 points of Uniform Noise) Volts Bin Count But there will still be variation if you zoom in.

15 Bin Histogram (25,000 points of Uniform Noise) Volts Bin Count 0 0 2,000

Volts Bin Count Time Volts 0 The histogram is telling us which voltages were most likely in this experiment. A histogram is an estimate of the shape of the underlying PDF.

Discrete Time Noise Waveform 255 point, 0 mean, 1 watt Exponentially Distributed Voltages Time Volts 0

15 bin Histogram (255 points of Exponential Noise) Volts Bin Count 0

Discrete Time Noise Waveform 255 point, 0 mean, 1 watt Gaussian Distributed Voltages Time Volts 0

15 bin Histogram (255 points of Gaussian Noise) Volts Bin Count 0

15 bin Histogram (2500 points of Gaussian Noise) Volts Bin Count 0 400