Probability Review ECS 152A Acknowledgement: slides from S. Kalyanaraman & B.Sikdar.

Slides:



Advertisements
Similar presentations
Discrete Uniform Distribution
Advertisements

Acknowledgement: Thanks to Professor Pagano
Random Variable A random variable X is a function that assign a real number, X(ζ), to each outcome ζ in the sample space of a random experiment. Domain.
Economics 105: Statistics Any questions? Go over GH2 Student Information Sheet.
Lecture 10 – Introduction to Probability Topics Events, sample space, random variables Examples Probability distribution function Conditional probabilities.
Section 7.4 (partially). Section Summary Expected Value Linearity of Expectations Independent Random Variables.
Shivkumar Kalyanaraman Rensselaer Polytechnic Institute 1 Basic Ideas in Probability and Statistics for Experimenters: Part I: Qualitative Discussion Shivkumar.
Continuous Random Variables. For discrete random variables, we required that Y was limited to a finite (or countably infinite) set of values. Now, for.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Discrete random variables Probability mass function Distribution function (Secs )
Introduction to Probability and Statistics
Probability Distributions Finite Random Variables.
Prof. Bart Selman Module Probability --- Part d)
Chapter 2: Probability.
Probability Distributions
TDC 369 / TDC 432 April 2, 2003 Greg Brewster. Topics Math Review Probability –Distributions –Random Variables –Expected Values.
1 Review of Probability Theory [Source: Stanford University]
Rensselaer Polytechnic Institute © Shivkumar Kalvanaraman & © Biplab Sikdar1 ECSE-4730: Computer Communication Networks (CCN) Network Layer Performance.
Summarizing Measured Data Part I Visualization (Chap 10) Part II Data Summary (Chap 12)
Probability and Statistics Review
Probability Distributions Random Variables: Finite and Continuous A review MAT174, Spring 2004.
Probability Distributions Random Variables: Finite and Continuous Distribution Functions Expected value April 3 – 10, 2003.
C4: DISCRETE RANDOM VARIABLES CIS 2033 based on Dekking et al. A Modern Introduction to Probability and Statistics Longin Jan Latecki.
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Joint Distribution of two or More Random Variables
Review of Probability Theory. © Tallal Elshabrawy 2 Review of Probability Theory Experiments, Sample Spaces and Events Axioms of Probability Conditional.
Lecture 10 – Introduction to Probability Topics Events, sample space, random variables Examples Probability distribution function Conditional probabilities.
Prof. SankarReview of Random Process1 Probability Sample Space (S) –Collection of all possible outcomes of a random experiment Sample Point –Each outcome.
1 Performance Evaluation of Computer Systems By Behzad Akbari Tarbiat Modares University Spring 2009 Introduction to Probabilities: Discrete Random Variables.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 4 and 5 Probability and Discrete Random Variables.
QA in Finance/ Ch 3 Probability in Finance Probability.
Chapter 1 Probability and Distributions Math 6203 Fall 2009 Instructor: Ayona Chatterjee.
Tch-prob1 Chap 3. Random Variables The outcome of a random experiment need not be a number. However, we are usually interested in some measurement or numeric.
Winter 2006EE384x1 Review of Probability Theory Review Session 1 EE384X.
TELECOMMUNICATIONS Dr. Hugh Blanton ENTC 4307/ENTC 5307.
Modeling and Simulation CS 313
Theory of Probability Statistics for Business and Economics.
Chapter 7 Lesson 7.5 Random Variables and Probability Distributions
Random Variables. A random variable X is a real valued function defined on the sample space, X : S  R. The set { s  S : X ( s )  [ a, b ] is an event}.
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Review of Exam I Sections Jiaping Wang Department of Mathematical Science 02/18/2013, Monday.
STA347 - week 51 More on Distribution Function The distribution of a random variable X can be determined directly from its cumulative distribution function.
Computer Performance Modeling Dirk Grunwald Spring ‘96 Jain, Chapter 12 Summarizing Data With Statistics.
Week 21 Conditional Probability Idea – have performed a chance experiment but don’t know the outcome (ω), but have some partial information (event A) about.
Computing Fundamentals 2 Lecture 6 Probability Lecturer: Patrick Browne
STA347 - week 31 Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5’s in the 6 rolls. Let X = number of.
1 3. Random Variables Let ( , F, P) be a probability model for an experiment, and X a function that maps every to a unique point the set of real numbers.
Probability Review-1 Probability Review. Probability Review-2 Probability Theory Mathematical description of relationships or occurrences that cannot.
EEE Probability and Random Variables Huseyin Bilgekul EEE 461 Communication Systems II Department of Electrical and Electronic Engineering Eastern.
Exam 2: Rules Section 2.1 Bring a cheat sheet. One page 2 sides. Bring a calculator. Bring your book to use the tables in the back.
Probability (outcome k) = Relative Frequency of k
Copyright © 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Review of Statistics I: Probability and Probability Distributions.
Random Variables Example:
Discrete Random Variables. Introduction In previous lectures we established a foundation of the probability theory; we applied the probability theory.
Chapter 2: Probability. Section 2.1: Basic Ideas Definition: An experiment is a process that results in an outcome that cannot be predicted in advance.
1 Review of Probability and Random Processes. 2 Importance of Random Processes Random variables and processes talk about quantities and signals which.
Shivkumar Kalyanaraman Rensselaer Polytechnic Institute 1 Basic Ideas in Probability and Statistics for Experimenters: Part I: Qualitative Discussion Shivkumar.
Probability & Random Variables
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Review of Final Part I Sections Jiaping Wang Department of Mathematics 02/29/2013, Monday.
Random Variables By: 1.
3.1 Discrete Random Variables Present the analysis of several random experiments Discuss several discrete random variables that frequently arise in applications.
3. Random Variables (Fig.3.1)
Random variables (r.v.) Random variable
Random Variables.
Business Statistics Topic 4
Lecture 10 – Introduction to Probability
Chapter 5 Statistical Models in Simulation
Probability Review for Financial Engineers
Useful Discrete Random Variable
Welcome to the wonderful world of Probability
Distribution Function of Random Variables
Presentation transcript:

Probability Review ECS 152A Acknowledgement: slides from S. Kalyanaraman & B.Sikdar

2 Overview Network Layer Performance Modeling & Analysis –Part I: Essentials of Probability –Part II: Inside a Router –Part III: Network Analysis

3 Network Layer Performance Modeling & Analysis: Part I Essential of Probability Motivation Basic Definitions Modeling Experiments with Uncertainty Random Variables: Geometric, Poisson, Exponential

4 Network Layer Performance Modeling & Analysis: Part I Essential of Probability Read any of the probability references, e.g. Ross, Molloy, Papoulis, Stark and Wood Check out online source: misc/queue.pdf

5 Motivation for learning Probability in CCN

6 Basic Definitions Think of Probability as modeling an experiment The Set of all possible outcomes is the sample space: S Classic “Experiment”: Tossing a die: S = {1,2,3,4,5,6} Any subset A of S is an event: A = {the outcome is even} = {2,4,6}

7 Basic Operation of Events For any two events A, B the following are also events: Note, the empty set. If AB, then A and B are mutually exclusive.

8 Basic Operation of Events Can take many unions: Or even infinite unions: Ditto for intersections

9 Probability of Events P is the Probability Mass function if it maps each event A, into a real number P(A), and: i.) ii.) P(S) = 1 iii.)If A and B are mutually exclusive events then,

10 Probability of Events …In fact for any sequence of pair- wise-mutually-exclusive events we have

11 Other Properties

12 Conditional Probability = (conditional) probability that the outcome is in A given that we know the outcome in B Example: Toss one die. Note that:

13 Independence Events A and B are independent if P(AB) = P(A)P(B). Example: A card is selected at random from an ordinary deck of cards. A=event that the card is an ace. B=event that the card is a diamond.

14 Independence Event A and B are independent if P(AB) = P(A) P(B). Independence does NOT mean that A and B have “nothing to do with each other” or that A and B “having nothing in common”.

15 Independence Best intuition on independence is: A and B are independent if and only if (equivalently, ) i.e. if and only if knowing that B is true doesn’t change the probability that A is true. Note: If A and B are independent and mutually exclusive, then P(A)=0 or P(B) = 0.

16 Random Variables A random variable X maps each outcome s in the sample space S to a real number X(s). Example: A fair coin is tossed 3 times. S={(TTT),(TTH),(THT),(HTT),(HHT),(HTH),(TH H),(HHH)}

17 Random Variables Let X be the number of heads tossed in 3 tries. X(TTT)=X(HHT)= X(TTH)=X(HTH)= X(THT)=X(THH)= X(HTT)=X(HHH)= So P(X=0)=P(X=1)= P(X=2)=P(X=3)=

18 Random Variable as a Measurement Think of much more complicated experiments –A chemical reaction. –A laser emitting photons. –A packet arriving at a router.

19 Random Variable as a Measurement We cannot give an exact description of a sample space in these cases, but we can still describe specific measurements on them –The temperature change produced. –The number of photons emitted in one millisecond. –The time of arrival of the packet.

20 Random Variable as a Measurement Thus a random variable can be thought of as a measurement on an experiment

21 Probability Mass Function for a Random Variable The probability mass function (PMF) for a (discrete valued) random variable X is: Note thatfor Also for a (discrete valued) random variable X

22 Cumulative Distribution Function The cumulative distribution function (CDF) for a random variable X is Note that is non-decreasing in x, i.e. Also and

23 PMF and CDF for the 3 Coin Toss Example

24 Expectation of a Random Variable The expectation (average) of a (discrete- valued) random variable X is Three coins example:

25 Important Random Variables: Bernoulli The simplest possible measurement on an experiment: Success (X = 1) or failure (X = 0). Usual notation: E(X)=

26 Important Random Variables: Binomial Let X = the number of success in n independent Bernoulli experiments ( or trials). P(X=0) = P(X=1) = P(X=2)= In general, P(X = x) =

27 Important Random Variables: Binomial Exercise: Show that and E(X) = np

28 Important Random Variables: Geometric Let X = the number of independent Bernoulli trials until the first success. P(X=1) = p P(X=2) = (1-p)p P(X=3) = (1-p) 2 p In general,

29 Important Random Variables: Geometric Exercise: Show that

30 Important Random Variables: Poisson A Poisson random variable X is defined by its PMF: Where > 0 is a constant Exercise: Show that and E(X) =

31 Important Random Variables: Poisson Poisson random variables are good for counting things like the number of customers that arrive to a bank in one hour, or the number of packets that arrive to a router in one second.

32 Continuous-valued Random Variables So far we have focused on discrete(- valued) random variables, e.g. X(s) must be an integer Examples of discrete random variables: number of arrivals in one second, number of attempts until sucess

33 Continuous-valued Random Variables A continuous-valued random variable takes on a range of real values, e.g. X(s) ranges from 0 to as s varies. Examples of continuous(-valued) random variables: time when a particular arrival occurs, time between consecutive arrivals.

34 Continuous-valued Random Variables A discrete random variable has a “staircase” CDF. A continuous random variable has (some) continuous slope to its CDF.

35 Continuous-valued Random Variables Thus, for a continuous random variable X, we can define its probability density function (pdf) Note that since is non- decreasing in x we have for all x.

36 Properties of Continuous Random Variables From the Fundamental Theorem of Calculus, we have In particular, More generally,

37 Expectation of a Continuous Random Variable The expectation (average) of a continuous random variable X is given by Note that this is just the continuous equivalent of the discrete expectation

38 Important Continuous Random Variable: Exponential Used to represent time, e.g. until the next arrival Has PDF for some > 0 Show –Need to use integration by Parts!

39 Exponential Random Variable The CDF of an exponential random variable is: So

40 Memoryless Property of the Exponential An exponential random variable X has the property that “the future is independent of the part”, i.e. the fact that it hasn’t happened yet, tells us nothing about how much longer it will take. In math terms

41 Memoryless Property of the Exponential Proof: