2.1 Random Variable Concept Given an experiment defined by a sample space S with elements s, we assign a real number to every s according to some rule.

Slides:



Advertisements
Similar presentations
MOMENT GENERATING FUNCTION AND STATISTICAL DISTRIBUTIONS
Advertisements

Random Variables ECE460 Spring, 2012.
Random Variable A random variable X is a function that assign a real number, X(ζ), to each outcome ζ in the sample space of a random experiment. Domain.
ฟังก์ชั่นการแจกแจงความน่าจะเป็น แบบไม่ต่อเนื่อง Discrete Probability Distributions.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 5-1 Chapter 5 Some Important Discrete Probability Distributions Statistics.
Lec 18 Nov 12 Probability – definitions and simulation.
Review of Basic Probability and Statistics
Chapter 1 Probability Theory (i) : One Random Variable
Probability Densities
Discrete Random Variables and Probability Distributions
Probability Distributions Finite Random Variables.
Chapter 5: Probability Concepts
Probability and Statistics Review
Discrete Probability Distributions
3-1 Introduction Experiment Random Random experiment.
Continuous Random Variables and Probability Distributions
Copyright © 2014 by McGraw-Hill Higher Education. All rights reserved.
Ya Bao Fundamentals of Communications theory1 Random signals and Processes ref: F. G. Stremler, Introduction to Communication Systems 3/e Probability All.
C4: DISCRETE RANDOM VARIABLES CIS 2033 based on Dekking et al. A Modern Introduction to Probability and Statistics Longin Jan Latecki.
Review of Probability and Random Processes
QMS 6351 Statistics and Research Methods Probability and Probability distributions Chapter 4, page 161 Chapter 5 (5.1) Chapter 6 (6.2) Prof. Vera Adamchik.
Lecture 7. Markov Model with Matrixes
Probability Distributions and Frequentist Statistics “A single death is a tragedy, a million deaths is a statistic” Joseph Stalin.
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Continuous Probability Distribution  A continuous random variables (RV) has infinitely many possible outcomes  Probability is conveyed for a range of.
Prof. SankarReview of Random Process1 Probability Sample Space (S) –Collection of all possible outcomes of a random experiment Sample Point –Each outcome.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 4 and 5 Probability and Discrete Random Variables.
Chapter 5 Discrete Random Variables and Probability Distributions ©
Week 41 Continuous Probability Spaces Ω is not countable. Outcomes can be any real number or part of an interval of R, e.g. heights, weights and lifetimes.
Tch-prob1 Chap 3. Random Variables The outcome of a random experiment need not be a number. However, we are usually interested in some measurement or numeric.
TELECOMMUNICATIONS Dr. Hugh Blanton ENTC 4307/ENTC 5307.
Statistics for Engineer Week II and Week III: Random Variables and Probability Distribution.
Theory of Probability Statistics for Business and Economics.
 Review Homework Chapter 6: 1, 2, 3, 4, 13 Chapter 7 - 2, 5, 11  Probability  Control charts for attributes  Week 13 Assignment Read Chapter 10: “Reliability”
Random Variables. A random variable X is a real valued function defined on the sample space, X : S  R. The set { s  S : X ( s )  [ a, b ] is an event}.
Probability & Statistics I IE 254 Summer 1999 Chapter 4  Continuous Random Variables  What is the difference between a discrete & a continuous R.V.?
Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Chapter 5 Discrete Random Variables.
2.1 Introduction In an experiment of chance, outcomes occur randomly. We often summarize the outcome from a random experiment by a simple number. Definition.
Week 21 Conditional Probability Idea – have performed a chance experiment but don’t know the outcome (ω), but have some partial information (event A) about.
STA347 - week 31 Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5’s in the 6 rolls. Let X = number of.
Exam 2: Rules Section 2.1 Bring a cheat sheet. One page 2 sides. Bring a calculator. Bring your book to use the tables in the back.
Review of Chapter
Random Variables Example:
President UniversityErwin SitompulPBST 3/1 Dr.-Ing. Erwin Sitompul President University Lecture 3 Probability and Statistics
Discrete Random Variables. Introduction In previous lectures we established a foundation of the probability theory; we applied the probability theory.
Chapter 5 Discrete Random Variables Probability Distributions
Random Variables. Numerical Outcomes Consider associating a numerical value with each sample point in a sample space. (1,1) (1,2) (1,3) (1,4) (1,5) (1,6)
TELECOMMUNICATIONS Dr. Hugh Blanton ENTC 4307/ENTC 5307.
1 Probability: Introduction Definitions,Definitions, Laws of ProbabilityLaws of Probability Random VariablesRandom Variables DistributionsDistributions.
One Function of Two Random Variables
1 Review of Probability and Random Processes. 2 Importance of Random Processes Random variables and processes talk about quantities and signals which.
Engineering Probability and Statistics - SE-205 -Chap 3 By S. O. Duffuaa.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 5-1 Chapter 5 Some Important Discrete Probability Distributions Business Statistics,
Fractiles Given a probability distribution F(x) and a number p, we define a p-fractile x p by the following formulas.
Probability & Random Variables
Random Variables By: 1.
APPENDIX A: A REVIEW OF SOME STATISTICAL CONCEPTS
MECH 373 Instrumentation and Measurements
3. Random Variables (Fig.3.1)
Random variables (r.v.) Random variable
CHAPTER 2 RANDOM VARIABLES.
Engineering Probability and Statistics - SE-205 -Chap 3
Appendix A: Probability Theory
Outline Introduction Signal, random variable, random process and spectra Analog modulation Analog to digital conversion Digital transmission through baseband.
3.1 Expectation Expectation Example
Chapter 3 : Random Variables
Random Variables and Probability Distributions
Discrete Random Variables and Probability Distributions
Presentation transcript:

2.1 Random Variable Concept Given an experiment defined by a sample space S with elements s, we assign a real number to every s according to some rule as follows; –X : a function that maps all elements of the sample space into points on the real line

Example Rolling a die and flipping a coin –Sample space {H,T} x {1,2,..., 6} –Let the r.v. be a function X as follows 1.A coin head (H) outcome -> positive value shown up on the die 2.A coin tail (T) outcome -> negative and twice value shown up on the die

2.1 Random Variable Concept

Example The pointer on a wheel of chance is spun –The possible outcomes are the numbers from 0 to 12 marked on the wheel –Sample space {0 < s  12} –Define a r.v. by the function –Points in S map onto the real line as the set {0 < x  144}

2.1 Random Variable Concept Conditions for a Function to be a Random Variable –Every point in S must correspond to only one value of the r.v. –The set { X  x } shall be an event for any real number x The set {X(s)  x} corresponds to those points s in the sample space for which the X(s) does not exceed the number x  This means that the set is not a set of numbers but a set of experimental outcomes –The probabilities of the events {X=  } and {X=-  } shall be 0: This condition does not prevent X from being either -  or  for some values of s; it only requires that the prob. of the set of those s be zero -- The function that maps outcomes in the following manner can not be a r.v.

2.1 Random Variable Concept Discrete and Continuous Random Variables –Discrete r.v.:Having only discrete values Example : discrete r.v. defined on a discrete sample space –Continuous r.v. : Having a continuous range of values Example : continuous r.v. defined on a continuous sample space –Mixed r.v. : Some of its values are discrete and some are continuous

2.2 Distribution Function Cumulative Probability Distribution Function – CDF –The probability of the event {X  x } : –Depend on x –A function of x –Distribution function of X –Properties ; consider a discrete distribution

2.2 Distribution Function Discrete Random Variable –If X is a discrete r.v., : stair-step form –Amplitude of a step : probability of occurrence of the value of X where the step occurs –If the values of X are denoted x i, we may write where u(·) is the unit-step function –Using

2.2 Distribution Function F x (3)=F x (3 + )=1 by the property (6)

Example Let X have the discrete values in the set {-1, -0.5, 0.7, 1.5, 3} The corresponding probabilities {0.1, 0.2, 0.1, 0.4, 0.2}

Example Wheel-of-chance experiment

2.3 Density Function Probability Density Function (PDF) of r.v. X Existence –If the derivative of F X (x) exists, then f X (x) exists –If there may be places where dF X (x)/dx is not defined (abrupt change in slope), F X (x) is a function with step-type discontinuities such as in ex

2.3 Density Function –Discrete r.v. Stair-step form distribution function Description of the derivative of F X (x) at stairstep points –Unit-impulse function,  (t), used

2.3 Density Function Unit-Impulse Function  (t) –Definition by its integral property  (x) : any continuous function at the point x = x 0  (t) –Can be integrated as a “function” with infinite amplitude, area of unity, and zero duration The relationship of unit-impulse and unit-step functions The general impulse function –Shown symbolically as a vertical arrow occurring at the point x=x 0 and having an amplitude equal to the amplitude of the step function for which it is the derivative

2.3 Density Function A discrete r.v. –The density function for a discrete r.v. exists –Using impulse functions to describe the derivative of F X (x) at its stair step points

2.3 Density Function Properties of Density Functions

Example Test the function g X (x) if it can be a valid density function –Property 1 : nonnegative –Property 2: Its area a  =1  a=1/ 

Example Find its density function

2.4 Gaussian r.v. A r.v. X is called Gaussian if its density function has the form

2.4 Gaussian r.v. Numerical or approximation methods for Gaussian r.v. –Tables  many tables according to various –Only one table according to normalized – Consider –For a negative value of x ; –From F X (x), consider

Example Find the probability of the event {X  5.5} for Gaussian r.v. having a X = 3 and  X = 2

Example Assume that the height of clouds at some location is Gaussian r.v. X with a X = 1830m and  X = 460m Find the probability that clouds will be higher than 2750m

2.4 Gaussian r.v. Evaluations of F(X) by approximation Ex) Gaussian r.v. with a X = 7,  X = 0.5 Table B-1 : F(0.6)=0.7257

2.5 Other Distribution and Density Binomial distribution –Density function & distribution function –Bernoulli trial –For N=6 and p=0.25

2.5 Other Distribution and Density Poisson distribution –Density function & distribution function –Quite similar to those for the binomial r.v. –If N  and p  0 for the binomial case in such a way that Np=b, the Poisson case results –Applications 1.The number of defective units in sample taken from a production line 2.The number of telephone calls made during a period of time 3.The number of electrons emitted from a small section of cathode in a given time interval –If the time interval of interest has duration T, and the events being counted are known to occur at an average rate and have a Poisson distribution, then b = T.

2.5 Other Distribution and Density Uniform distribution –The quantization of signal samples prior to encoding in digital communication systems  The error introduced in the round-off process  uniform distributed –Figure 2.5-2

2.5 Other Distribution and Density Exponential

2.5 Other Distribution and Density Rayleigh –The envelope of one type of noise when passed through a bandpass filter

2.6 Conditional Distribution and Density Functions Conditional Probability –For two events A and B where P(B)  0, the conditional probability of A given B Conditional Distribution –A : identified as the event {X  x} for the r.v. x –Conditional distribution function of X – = the joint event –This joint event consists of all outcomes s such that –The conditional distribution : discrete, continuous, or mixed random variables

2.6 Conditional Distribution and Density Functions Properties of Conditional Distribution

2.6 Conditional Distribution and Density Functions Conditional Density –Conditional density function of the r.v. x The derivative of the conditional distribution function If F X (x|B) contains discontinuities, impulse response are present in f X (x|B) to account for the derivatives at the discontinuities –Properties

2.6 Conditional Distribution and Density Functions Example –Red, green, and blue balls in two boxes as shown in the following table –Select a box first, and then take a ball from the selected box –The 2nd box is larger than the 1st box  causing the 2 nd box to be selected more frequently –Event selecting the 2nd box : B 2, P(B 2 )=8/10 –Event selecting the 1st box : B 1, P(B 1 )=2/10 –Event selecting a red ball : r.v. x 1 –Event selecting a green ball : r.v. x 2 –Event selecting a blue ball : r.v. x 3 Box XiXi Ball color12Totals 1Red Green Blue Totals

2.6 Conditional Distribution and Density Functions Box XiXi Ball color12Totals 1Red Green Blue Totals

2.6 Conditional Distribution and Density Functions –total probability

2.6 Conditional Distribution and Density Functions Event B : Case 1. b  x : Case 2. b>x :

2.6 Conditional Distribution and Density Functions –Conditional distribution –From the assumption that the conditioning event has nonzero prob., –Similarly,

2.6 Conditional Distribution and Density Functions Example –Sky divers try to land within a target circle –Miss-distance from the point has the Rayleigh distribution withb=800m 2 and a=0 –Target : a circle of 50m radius with a bull’s eye of 10m radius –The prob. of sky diver hitting the bull’s eye, given that the landing is on the target ? Sol) x = 10, b = 50

Random Poisson Points Papoulis pp. 117 –Points in nonoverlapping intervals P{ka in ta, kb in tb} where A = {ka in ta}, B = {kb in tb} ta tb 0T

Random Poisson Points

Homework Prob , 2.3-5, 2.3-9, , , 2.4-3, 2.4-4, Due : next Tuesday