Tch-prob1 Chap 3. Random Variables The outcome of a random experiment need not be a number. However, we are usually interested in some measurement or numeric.

Slides:



Advertisements
Similar presentations
MOMENT GENERATING FUNCTION AND STATISTICAL DISTRIBUTIONS
Advertisements

Random Variables ECE460 Spring, 2012.
Important Random Variables Binomial: S X = { 0,1,2,..., n} Geometric: S X = { 0,1,2,... } Poisson: S X = { 0,1,2,... }
Random Variable A random variable X is a function that assign a real number, X(ζ), to each outcome ζ in the sample space of a random experiment. Domain.
Flipping an unfair coin three times Consider the unfair coin with P(H) = 1/3 and P(T) = 2/3. If we flip this coin three times, the sample space S is the.
Review of Basic Probability and Statistics
Chapter 1 Probability Theory (i) : One Random Variable
Probability Theory Part 2: Random Variables. Random Variables  The Notion of a Random Variable The outcome is not always a number Assign a numerical.
1 Chap 5 Sums of Random Variables and Long-Term Averages Many problems involve the counting of number of occurrences of events, computation of arithmetic.
Prof. Bart Selman Module Probability --- Part d)
1 Review of Probability Theory [Source: Stanford University]
Tch-prob1 Chapter 4. Multiple Random Variables Ex Select a student’s name from an urn. S In some random experiments, a number of different quantities.
A random variable that has the following pmf is said to be a binomial random variable with parameters n, p The Binomial random variable.
2. Random variables  Introduction  Distribution of a random variable  Distribution function properties  Discrete random variables  Point mass  Discrete.
Probability Review ECS 152A Acknowledgement: slides from S. Kalyanaraman & B.Sikdar.
Week 51 Relation between Binomial and Poisson Distributions Binomial distribution Model for number of success in n trails where P(success in any one trail)
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Probability Distributions: Finite Random Variables.
Joint Distribution of two or More Random Variables
CMPE 252A: Computer Networks Review Set:
Prof. SankarReview of Random Process1 Probability Sample Space (S) –Collection of all possible outcomes of a random experiment Sample Point –Each outcome.
1 Performance Evaluation of Computer Systems By Behzad Akbari Tarbiat Modares University Spring 2009 Introduction to Probabilities: Discrete Random Variables.
Standard Statistical Distributions Most elementary statistical books provide a survey of commonly used statistical distributions. The reason we study these.
Week 41 Continuous Probability Spaces Ω is not countable. Outcomes can be any real number or part of an interval of R, e.g. heights, weights and lifetimes.
Chapter 5 Statistical Models in Simulation
Winter 2006EE384x1 Review of Probability Theory Review Session 1 EE384X.
Random Variables & Probability Distributions Outcomes of experiments are, in part, random E.g. Let X 7 be the gender of the 7 th randomly selected student.
PROBABILITY & STATISTICAL INFERENCE LECTURE 3 MSc in Computing (Data Analytics)
Statistics for Engineer Week II and Week III: Random Variables and Probability Distribution.
CHAPTER 4 Multiple Random Variable
MTH3003 PJJ SEM I 2015/2016.  ASSIGNMENT :25% Assignment 1 (10%) Assignment 2 (15%)  Mid exam :30% Part A (Objective) Part B (Subjective)  Final Exam:
Random Variables. A random variable X is a real valued function defined on the sample space, X : S  R. The set { s  S : X ( s )  [ a, b ] is an event}.
STA347 - week 51 More on Distribution Function The distribution of a random variable X can be determined directly from its cumulative distribution function.
Chapter 2 Random variables 2.1 Random variables Definition. Suppose that S={e} is the sampling space of random trial, if X is a real-valued function.
One Random Variable Random Process.
STA347 - week 31 Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5’s in the 6 rolls. Let X = number of.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
1 Lecture 9: The Poisson Random Variable and its PMF Devore, Ch. 3.6.
Random Variables an important concept in probability.
1 3. Random Variables Let ( , F, P) be a probability model for an experiment, and X a function that maps every to a unique point the set of real numbers.
1 3. Random Variables Let ( , F, P) be a probability model for an experiment, and X a function that maps every to a unique point the set of real numbers.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
Expectation. Let X denote a discrete random variable with probability function p(x) (probability density function f(x) if X is continuous) then the expected.
Exam 2: Rules Section 2.1 Bring a cheat sheet. One page 2 sides. Bring a calculator. Bring your book to use the tables in the back.
Random Variable The outcome of an experiment need not be a number, for example, the outcome when a coin is tossed can be 'heads' or 'tails'. However, we.
Probability (outcome k) = Relative Frequency of k
Review of Chapter
Probability and Distributions. Deterministic vs. Random Processes In deterministic processes, the outcome can be predicted exactly in advance Eg. Force.
Continuous Random Variables
ELEC 303, Koushanfar, Fall’09 ELEC 303 – Random Signals Lecture 9 – Continuous Random Variables: Joint PDFs, Conditioning, Continuous Bayes Farinaz Koushanfar.
ELEC 303, Koushanfar, Fall’09 ELEC 303 – Random Signals Lecture 8 – Continuous Random Variables: PDF and CDFs Farinaz Koushanfar ECE Dept., Rice University.
Engineering Probability and Statistics - SE-205 -Chap 3 By S. O. Duffuaa.
Lecture 21 Dr. MUMTAZ AHMED MTH 161: Introduction To Statistics.
Random Variables By: 1.
Discrete Random Variable Random Process. The Notion of A Random Variable We expect some measurement or numerical attribute of the outcome of a random.
Week 61 Poisson Processes Model for times of occurrences (“arrivals”) of rare phenomena where λ – average number of arrivals per time period. X – number.
3. Random Variables (Fig.3.1)
ONE DIMENSIONAL RANDOM VARIABLES
Random variables (r.v.) Random variable
The Exponential and Gamma Distributions
Engineering Probability and Statistics - SE-205 -Chap 3
Appendix A: Probability Theory
3.1 Expectation Expectation Example
Multinomial Distribution
3. Random Variables Let (, F, P) be a probability model for an experiment, and X a function that maps every to a unique point.
Dept. of Electrical & Computer engineering
Chapter 3 : Random Variables
Continuous Random Variables: Basics
Presentation transcript:

tch-prob1 Chap 3. Random Variables The outcome of a random experiment need not be a number. However, we are usually interested in some measurement or numeric attribute of the outcome. For example, toss a coin n times, total number of heads = ? What is the prob. of the resulting numerical values ? A random variable X is a function that assigns a real number,, to each outcome.

tch-prob2 Ex.3.1 : HHH HHT HTH THH HTT THT TTH TTT : Let B be some subset of Sx Event B in Sx occurs whenever event A in S occurs. Events A and B are equivalent events.

tch-prob3 HHH HHT HTH THH HTT THT TTH TTT

tch-prob4 3.2 Cumulative Distribution Function Cumulative distribution function (cdf) of a random variable X is defined as a convenient way of specifying the probability of all semi-infinite intervals of the real line of the form.

tch-prob5 Cdf has the following properties: i. cdf is a prob., axiom 1 & corollary 2. ii. is the entire sample space & Axiom II. iii. is an empty set. Corollary 3. iv. nondecreasing function, corollary 7. v. continuous from the right. h>0

tch-prob6 vi. vii. if cdf is continuous at b. viii. Corollary 1.

tch-prob7 Ex.3.4. Fig 3.3 toss a coin 3 times. Count Heads. probability mass function (pmf) For discrete random variable, cdf is right-continuous, staircase function of x.

tch-prob8 Ex.3.5. The transmission time X of messages obeys the exponential probability law with parameter. is continuous for all x, its derivative exists everywhere except at x=0. pdf.

tch-prob9 Continuous random variable cdf is continuous everywhere, and smooth enough. can be written as an integral of some nonnegative function f(x) property (vii)

tch-prob10 Random variable of mixed type Ex. 3.6 The waiting time X of a customer in a queueing system is zero if he finds the system idle (p), and an exponentially distributed random length of time if he finds the system busy (prob. 1-p).

tch-prob Probability Density Function (pdf) The pdf of X, if it exists, is defined as density

tch-prob12 i. ii. iii. iv. since is nondecreasing pdf completely specifies the behavior of continuous random variables.

tch-prob13 Ex. 3.7 uniform random variable ab 1/(b-a)

tch-prob14 The derivative of the cdf does not exist at points where the cdf is not continuous. To generalize pdf for discrete random variable. Define delta function

tch-prob15 Ex

tch-prob16 Conditional cdf’s and pdf’s The conditional cdf of X given A is satisfies all the properties of a cdf. The conditional pdf. of X given A is

tch-prob17 Ex.3.10 The lifetime X of a machine has a continuous cdf. Find the conditional cdf and pdf given A={X>t}.

tch-prob Some important random variables - Discrete Random Variables 1. Bernoulli r.v. 2. Binomial Random variable X: number of times a certain event occurs in n independent trials. Indicator function for A

tch-prob19 3. Geometric r.v. M indep. Bernoulli trials until the first success or M’=M-1, number of failures before a success the only discrete r.v. that satisfies the memoryless property:

tch-prob20 4. Poisson r.v. counting the number of occurrences of an event in a time period. average number of event occurrences in a time interval t. Figure 3.10.

tch-prob21 Binomial prob. Poisson prob. As

tch-prob22

tch-prob23 - Continuous r.v. 1. uniform r.v. 2. Exponential r.v. model the time between event occurrences.

tch-prob24 Exponential r.v. is limiting form of the geometric r.v. - An interval of duration T is divided into subintervals of length - Perform a Bernoulli trial on each subinterval with prob. of success - The number of subintervals until the occurrence of a successful event is a geometric r.v. M. - Thus, the time until the occurrence of the first successful event is X=M (T/n) 0 T

tch-prob25 For a Poisson r.v., the time between events is an exponentially distributed r.v. with parameter events/sec. Exponential r.v. also has the memoryless property The probability of having to wait at least h additional seconds given that one has already been waiting t seconds = The probability of waiting at least h seconds when one first begin to wait.

tch-prob26 3. Gaussian (Normal) r.v. Sum of a large number of small r.v.s p.d.f cdf. change of variable where

tch-prob27 Ex Show that Gaussian pdf integrates to one.

tch-prob28 Ex Q-function Table 3.3 It is sometimes convenient to work with Q(x).

tch-prob29 Q(x) x E E E E E-10 k

tch-prob30 4. Gamma r.v. Pdf where is the gamma function m non negative integer m-Erlang r.v. exponential r.v. Figure 3.14

tch-prob31 ※ : the time until the occurrence of the mth event Assume the times between events are exponential r.v., (Poisson r.v. limiting case) Let N(t) be the Poisson r.v. for the number of events in t seconds. ※ iff m th event occurs before t m or more events occur in t second. m-Erlang

tch-prob Functions of a Random Variable X: r. v. g(x): real-valued function Y=g(X) is also a r.v. Event C in Y equivalent event B in X

tch-prob33 Ex X: # of active speakers in a group of N indep. speakers p: Prob. that a speaker is active A Voice transmission system can transmit up to M voice signals at a time Y: # of Signals discarded

tch-prob34 Y=aX+b, where a is nonzero. Suppose X is continuous and has cdf, Find. pdf.

tch-prob35 Ex.3.24 X: Gaussian If has n solutions,, then will have n terms.

tch-prob36 Consider a nonlinear function Y=g(X) event Its equivalent event dx2 is negative Ex.3.27.

tch-prob37 Ex Y=cos(X), X: uniformly distributed in for –1< y <1, y has two solutions

tch-prob38

tch-prob The Expected Value of R.V.s c.d.f. or p.d.f provides complete description of a r.v. Sometimes interested in a few parameters that summarize the information Expected value of X or mean of X is defined by for discrete r.v. The expected value is defined if

tch-prob40 When the pdf is symmetric about a point m, i.e., If Ex..Gasussian uniform

tch-prob41 X continuous X integer-valued When X is a non-negative r.v. 1

tch-prob42 Ex. Exponential r.v. Expected value of Y=g(X)

tch-prob43 Ex.3.33 constant uniform r.v. in

tch-prob44 If c is a constant If

tch-prob45 Variance of X Expected value provides limited info., also want to know variation magnitude Ex Var. of Gaussian (x-m) dx

tch-prob46 Var [c]=0 Var [X+c]= Var [X] Var [cX]= nth moment of the random variable X

tch-prob Markov and Chebyshev Inequalities Suppose X is a non-negative r.v., Markov inequality 1 a

tch-prob48 Suppose are known. Let and use Markov inequality, we obtain Chebyshev inequality

tch-prob49 Ex Suppose Then the Chebeshev inequality for gives Now suppose that we know that X is a Gaussian r.v., then for k=2

tch-prob Transform Methods useful computational aids in the solution of equations that involves derivatives and integrals of functions. A. Characteristic Function Expected value of Fourier Transform of Ex Exponential r.v. check p.101.

tch-prob51 If X is a discrete r.v.. If X is a discrete integer-valued r.v., A periodic function of with period Fourier series coefficients of

tch-prob52 If f(x) is a periodic function of period, then f(x) can be represented as

tch-prob53 Moments of X can be obtained from by

tch-prob54 Ex.3.49exponential Check p.101

tch-prob55 B. Probability Generating Function For nonnegative r.v. a. if N is nonnegative integer-valued r.v. prob. Generating Function of N

tch-prob56

tch-prob57 b. if X is a non-negative continuous r.v. Laplace transform of the Ex Laplace transform of the gamma

tch-prob58