Stochastic Models Lecture 2 Poisson Processes

Slides:



Advertisements
Similar presentations
Exponential Distribution
Advertisements

ST3236: Stochastic Process Tutorial 9
Some additional Topics. Distributions of functions of Random Variables Gamma distribution,  2 distribution, Exponential distribution.
Let X 1, X 2,..., X n be a set of independent random variables having a common distribution, and let E[ X i ] = . then, with probability 1 Strong law.
Chapter 3 Some Special Distributions Math 6203 Fall 2009 Instructor: Ayona Chatterjee.
Exponential and Poisson Chapter 5 Material. 2 Poisson Distribution [Discrete] Poisson distribution describes many random processes quite well and is mathematically.
MOMENT GENERATING FUNCTION AND STATISTICAL DISTRIBUTIONS
Many useful applications, especially in queueing systems, inventory management, and reliability analysis. A connection between discrete time Markov chains.
E&CE 418: Tutorial-4 Instructor: Prof. Xuemin (Sherman) Shen
Exponential Distribution. = mean interval between consequent events = rate = mean number of counts in the unit interval > 0 X = distance between events.
CS433: Modeling and Simulation
Chapter 2 Discrete Random Variables
Stochastic Processes Dr. Nur Aini Masruroh. Stochastic process X(t) is the state of the process (measurable characteristic of interest) at time t the.
Introduction to stochastic process
Probability theory 2011 Outline of lecture 7 The Poisson process  Definitions  Restarted Poisson processes  Conditioning in Poisson processes  Thinning.
A random variable that has the following pmf is said to be a binomial random variable with parameters n, p The Binomial random variable.
Continuous Random Variables and Probability Distributions
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
11/5/2003Probability and Statistics for Teachers, Math 507, Lecture 10 1 UNIFORM AND EXPONENTIAL RANDOM VARIABLES Sections
Chapter 4. Continuous Probability Distributions
Exponential Distribution & Poisson Process
1 Exponential Distribution & Poisson Process Memorylessness & other exponential distribution properties; Poisson process and compound P.P.’s.
The Poisson Process. A stochastic process { N ( t ), t ≥ 0} is said to be a counting process if N ( t ) represents the total number of “events” that occur.
Andy Guo 1 Handout Ch5(2) 實習. Andy Guo 2 Normal Distribution There are three reasons why normal distribution is important –Mathematical properties of.
Generalized Semi-Markov Processes (GSMP)
Ch4: 4.3The Normal distribution 4.4The Exponential Distribution.
Random Sampling, Point Estimation and Maximum Likelihood.
Random Variables. A random variable X is a real valued function defined on the sample space, X : S  R. The set { s  S : X ( s )  [ a, b ] is an event}.
1 Birth and death process N(t) Depends on how fast arrivals or departures occur Objective N(t) = # of customers at time t. λ arrivals (births) departures.
STA347 - week 31 Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5’s in the 6 rolls. Let X = number of.
Generalized Semi- Markov Processes (GSMP). Summary Some Definitions The Poisson Process Properties of the Poisson Process  Interarrival times  Memoryless.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
Chapter 5. Continuous Random Variables. Uniform Random Variable X is a uniform random variable on the interval (α, β) if its probability function is given.
S TOCHASTIC M ODELS L ECTURE 3 P ART II C ONTINUOUS -T IME M ARKOV P ROCESSES Nan Chen MSc Program in Financial Engineering The Chinese University of Hong.
S TOCHASTIC M ODELS L ECTURE 2 P ART II P OISSON P ROCESSES Nan Chen MSc Program in Financial Engineering The Chinese University of Hong Kong (ShenZhen)
Random Variables Example:
Topic 5: Continuous Random Variables and Probability Distributions CEE 11 Spring 2002 Dr. Amelia Regan These notes draw liberally from the class text,
Stochastic Models Lecture 3 Continuous-Time Markov Processes
S TOCHASTIC M ODELS L ECTURE 4 P ART II B ROWNIAN M OTIONS Nan Chen MSc Program in Financial Engineering The Chinese University of Hong Kong (Shenzhen)
 Recall your experience when you take an elevator.  Think about usually how long it takes for the elevator to arrive.  Most likely, the experience.
CS433 Modeling and Simulation Lecture 11 Continuous Markov Chains Dr. Anis Koubâa 01 May 2009 Al-Imam Mohammad Ibn Saud University.
Copyright © Cengage Learning. All rights reserved. 5 Joint Probability Distributions and Random Samples.
S TOCHASTIC M ODELS L ECTURE 4 B ROWNIAN M OTIONS Nan Chen MSc Program in Financial Engineering The Chinese University of Hong Kong (Shenzhen) Nov 11,
Chapter 5: The Basic Concepts of Statistics. 5.1 Population and Sample Definition 5.1 A population consists of the totality of the observations with which.
S TOCHASTIC M ODELS L ECTURE 4 P ART III B ROWNIAN M OTION Nan Chen MSc Program in Financial Engineering The Chinese University of Hong Kong (Shenzhen)
Copyright © Cengage Learning. All rights reserved. 4 Continuous Random Variables and Probability Distributions.
Conditional Expectation
Chapter5 Statistical and probabilistic concepts, Implementation to Insurance Subjects of the Unit 1.Counting 2.Probability concepts 3.Random Variables.
Renewal Theory Definitions, Limit Theorems, Renewal Reward Processes, Alternating Renewal Processes, Age and Excess Life Distributions, Inspection Paradox.
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
The Exponential and Gamma Distributions
Exponential Distribution & Poisson Process
The Poisson Process.
Chapter 2 Discrete Random Variables
Pertemuan ke-7 s/d ke-10 (minggu ke-4 dan ke-5)
Chapter 7: Sampling Distributions
Multinomial Distribution
6.3 Sampling Distributions
Berlin Chen Department of Computer Science & Information Engineering
Further Topics on Random Variables: 1
Further Topics on Random Variables: Derived Distributions
Berlin Chen Department of Computer Science & Information Engineering
Berlin Chen Department of Computer Science & Information Engineering
Further Topics on Random Variables: Derived Distributions
Poisson Process and Related Distributions
Introduction to Probability: Solutions for Quizzes 4 and 5
Further Topics on Random Variables: Derived Distributions
Presentation transcript:

Stochastic Models Lecture 2 Poisson Processes Nan Chen MSc Program in Financial Engineering The Chinese University of Hong Kong (ShenZhen) Sept. 23, 2015

Outline Exponential Distributions Poisson Process: Definition and Distribution Further Properties of Poisson Processes

2.1 The Exponential Distribution Use a section header for each of the topics, so there is a clear transition to the audience.

Definition A continuous random variable is said to have an exponential distribution with parameter , if its probability density function is given by

CDF, Mean and Variance The CDF of an exponentially distributed random variable is given by The mean and variance of an exponentially distributed random variable are Mean: Variance:

The Memory-less Property We can show that for a random variable with exponential distribution. If we think of as being the lifetime of some instrument, then this property states that the instrument does not remember that it has already been in use for a time

Example I: Service Time in a Bank Suppose that the amount of time one spends in a bank is exponentially distributed with mean 10 minutes, that is, What is the probability that a customer will spend more than 15 minutes in the bank? What is the probability that a customer will spend more than 15 minutes in the bank, given that she is still in the bank after 10 minutes?

Example II: Post Office Consider a post office that is run by two clerks. Suppose that when Mr. Smith enters the post office he discovers that Mr. Jones is being served by one of the clerks and Mr. Brown by the other. Suppose also that Mr. Smith is told that his service will begin as soon as either Jones or Brown leaves.

Example II: Post Office (Continued) If the amount of service time for a clerk is exponentially distributed, what is the probability that, of the three customers, Mr. Smith is the last one to leave?

Several Further Properties Suppose that and are independent exponential random variables with respect means and . The probability

Several Further Properties (Continued) Suppose that are independent exponential random variables, with having rate , The distribution of follows an exponential distribution with a rate equal to the sum of the . That is,

Several Further Properties (Continued) Let be independent and identically distributed exponential random variables having mean . The sum has a gamma distribution; that is, its PDF is given by

Example III: Post Office Again Suppose that you arrive at a post office having two clerks at a moment when both are busy but there is no one else waiting in line. You will enter service when either clerk becomes free. If service times for clerk are exponential with rate , find , where is the amount of time that you spend in the post office.

2.2 The Poisson Process Use a section header for each of the topics, so there is a clear transition to the audience.

Construction of a Poisson Process To construct a Poisson process, we begin with a sequence of independent exponential random variables, all with the same mean . We build a model in which “events” occur from time to time. In particular, the first event occurs at time the second event occurs time units after the first event; … Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Construction of a Poisson Process (Continued) The random variables are called the inter-arrival times. The waiting times of events are A process is said to be a Poisson process if it counts the number of events in the above model that occur at or before time Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Distribution of Poisson Processes It is easy to know that the waiting time until the th event follows a gamma distribution. A simple observation: if and only if From it, we can show i.e., follows a Poisson distribution. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Increments of Poisson Process Theorem: Let be a Poisson process with intensity and let be given. Then, the increments are independent and stationary, and Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Mean and Variance of Poisson Increments Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Poisson Process as a Counting Process In summary, the Poisson process must satisfy: is integer valued; for , the number of events that occur in the interval , follows a Poisson distribution. The Poisson process is a special case of counting processes. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

2.3 Further Properties of Poisson Processes Use a section header for each of the topics, so there is a clear transition to the audience.

Decomposition of a Poisson Process Consider a Poisson process having rate and suppose that each time an event occurs it is randomly classified as either a type I or a type II. Suppose further that each event is classified as a type I event with probability or a type II event with probability , independently of all other events. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Decomposition of a Poisson Process (Continued) Theorem: Let and denote respectively the number of type I and II events occurring in Then, and are both Poisson processes having respective rates and They are independent. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Superposition of Poisson Processes Theorem: Let and be two independent Poisson processes having intensities and , respectively. Then, is a Poisson process with intensity Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Example IV: Selling an Apartment Suppose that you want to sell your apartment. Potential buyers arrive according to a Poisson process with rate Assume that each buyer offer you a random price with continuous PDF Once the offer is presented to you, you must either accept it or reject it and wait for the next offer. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Example IV: Selling an Apartment (Continued) Suppose that you employ the policy of accepting the first offer that is greater than some pre-specified price Meanwhile, assume that a cost of rate will be incurred per unit time until the apartment is sold. If your objective is to maximize the expected return, the difference between the amount received and the total cost incurred, what is the best price you should set? Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Example IV: Selling an Apartment (Continued) For simplicity, consider the case that the offer distribution is exponential. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Conditional Distribution of Arrival Times Suppose that we are told that exactly one event of a Poisson process has taken place by time and we are asked to determine the distribution of the time at which the event occurred. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Conditional Distribution of Arrival Times (Continued) In other words, the time of the event should be uniformly distributed over This result may be generalized, but before doing so we need to introduce the concept of order statistics. Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Order Statistics Let be random variables. We say that are the corresponding order statistics if is the th smallest value among For instance, The corresponding order statistics are Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Order Statistics (Continued) If the are independent identically distributed continuous random variables with PDF then the joint density of the order statistics is given by for Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Order Statistics (Continued) In particular, if the are uniformly distributed over then for Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Conditional Distribution of Arrival Times Theorem: Given that the arrival times have the same distribution as the order statistics corresponding to independent random variables uniformly distributed on the interval Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Example V: Insurance Claims Insurance claims are made at times distributed according to a Poisson process with rate each claim amount is the same as Compute the discounted value of all claims made up to time Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.

Homework Assignments Read Ross Chapter 5.1, 5.2, and 5.3. Answer Questions: Exercises 1, 2, 4 (Page 338, Ross) Exercises 14 (Page 339, Ross) Exercises 34 (Page 343, Ross) Exercise 42 (Page 344, Ross) Exercise 68 (Page 349, Ross) (Optional, Extra Bonus) Exercise 44, 49 (page 345-346, Ross). Give a brief overview of the presentation. Describe the major focus of the presentation and why it is important. Introduce each of the major topics. To provide a road map for the audience, you can repeat this Overview slide throughout the presentation, highlighting the particular topic you will discuss next.