Lecture 7  Poisson Processes (a reminder)  Some simple facts about Poisson processes  The Birth/Death Processes in General  Differential-Difference.

Slides:



Advertisements
Similar presentations
Lecture 5 This lecture is about: Introduction to Queuing Theory Queuing Theory Notation Bertsekas/Gallager: Section 3.3 Kleinrock (Book I) Basics of Markov.
Advertisements

Exponential and Poisson Chapter 5 Material. 2 Poisson Distribution [Discrete] Poisson distribution describes many random processes quite well and is mathematically.
Exponential Distribution
Many useful applications, especially in queueing systems, inventory management, and reliability analysis. A connection between discrete time Markov chains.
Exponential Distribution. = mean interval between consequent events = rate = mean number of counts in the unit interval > 0 X = distance between events.
Lecture 6  Calculating P n – how do we raise a matrix to the n th power?  Ergodicity in Markov Chains.  When does a chain have equilibrium probabilities?
Continuous-Time Markov Chains Nur Aini Masruroh. LOGO Introduction  A continuous-time Markov chain is a stochastic process having the Markovian property.
Flows and Networks Plan for today (lecture 2): Questions? Continuous time Markov chain Birth-death process Example: pure birth process Example: pure death.
Markov Chains.
1 Chapter 5 Continuous time Markov Chains Learning objectives : Introduce continuous time Markov Chain Model manufacturing systems using Markov Chain Able.
Probability, Statistics, and Traffic Theories
TCOM 501: Networking Theory & Fundamentals
Continuous Time Markov Chains and Basic Queueing Theory
#11 QUEUEING THEORY Systems Fall 2000 Instructor: Peter M. Hahn
Performance analysis for high speed switches Lecture 6.
Queueing Theory: Part I
2003 Fall Queuing Theory Midterm Exam(Time limit:2 hours)
1 Overview of Queueing Systems Michalis Faloutsos Archana Yordanos The web.
Queueing Theory.
7/3/2015© 2007 Raymond P. Jefferis III1 Queuing Systems.
Queuing Networks: Burke’s Theorem, Kleinrock’s Approximation, and Jackson’s Theorem Wade Trappe.
Lecture 4 Mathematical and Statistical Models in Simulation.
11/5/2003Probability and Statistics for Teachers, Math 507, Lecture 10 1 UNIFORM AND EXPONENTIAL RANDOM VARIABLES Sections
1 Exponential Distribution & Poisson Process Memorylessness & other exponential distribution properties; Poisson process and compound P.P.’s.
Introduction to Queuing Theory
The Poisson Process. A stochastic process { N ( t ), t ≥ 0} is said to be a counting process if N ( t ) represents the total number of “events” that occur.
Generalized Semi-Markov Processes (GSMP)
MIT Fun queues for MIT The importance of queues When do queues appear? –Systems in which some serving entities provide some service in a shared.
Lecture 10: Queueing Theory. Queueing Analysis Jobs serviced by the system resources Jobs wait in a queue to use a busy server queueserver.
NETE4631:Capacity Planning (2)- Lecture 10 Suronapee Phoomvuthisarn, Ph.D. /
Continuous Distributions The Uniform distribution from a to b.
Network Design and Analysis-----Wang Wenjie Queueing System IV: 1 © Graduate University, Chinese academy of Sciences. Network Design and Analysis Wang.
Queuing Theory Basic properties, Markovian models, Networks of queues, General service time distributions, Finite source models, Multiserver queues Chapter.
1 Queuing Models Dr. Mahmoud Alrefaei 2 Introduction Each one of us has spent a great deal of time waiting in lines. One example in the Cafeteria. Other.
TexPoint fonts used in EMF.
1 Elements of Queuing Theory The queuing model –Core components; –Notation; –Parameters and performance measures –Characteristics; Markov Process –Discrete-time.
Modeling and Analysis of Computer Networks
Why Wait?!? Bryan Gorney Joe Walker Dave Mertz Josh Staidl Matt Boche.
Chapter 61 Continuous Time Markov Chains Birth and Death Processes,Transition Probability Function, Kolmogorov Equations, Limiting Probabilities, Uniformization.
Model under consideration: Loss system Collection of resources to which calls with holding time  (c) and class c arrive at random instances. An arriving.
CS433 Modeling and Simulation Lecture 06 – Part 02 Discrete Markov Chains Dr. Anis Koubâa 11 Nov 2008 Al-Imam Mohammad.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
Flows and Networks Plan for today (lecture 2): Questions? Birth-death process Example: pure birth process Example: pure death process Simple queue General.
The M/M/ N / N Queue etc COMP5416 Advanced Network Technologies.
CDA6530: Performance Models of Computers and Networks Chapter 3: Review of Practical Stochastic Processes.
4.3 More Discrete Probability Distributions NOTES Coach Bridges.
Chapter 2 Probability, Statistics and Traffic Theories
Queuing Theory.  Queuing Theory deals with systems of the following type:  Typically we are interested in how much queuing occurs or in the delays at.
 Recall your experience when you take an elevator.  Think about usually how long it takes for the elevator to arrive.  Most likely, the experience.
Chapter 5 Elementary Stochastic Analysis Prof. Ali Movaghar.
Flows and Networks Plan for today (lecture 3): Last time / Questions? Output simple queue Tandem network Jackson network: definition Jackson network: equilibrium.
Queueing Fundamentals for Network Design Application ECE/CSC 777: Telecommunications Network Design Fall, 2013, Rudra Dutta.
Random Variables r Random variables define a real valued function over a sample space. r The value of a random variable is determined by the outcome of.
1 Chapter 5 Continuous time Markov Chains Learning objectives : Introduce continuous time Markov Chain Model manufacturing systems using Markov Chain Able.
The Pure Birth Process Derivation of the Poisson Probability Distribution Assumptions events occur completely at random the probability of an event occurring.
Queueing Theory II.
Probability Distributions: a review
Flows and Networks Plan for today (lecture 3):
Flows and Networks Plan for today (lecture 4):
Lecture on Markov Chain
Multinomial Distribution
CPSC 531: System Modeling and Simulation
Birth-Death Process Birth – arrival of a customer to the system
Lecture 7 Poisson Processes (a reminder)
Queueing Theory II.
Introduction to Queueing Theory
Kendall’s Notation ❚ Simple way of summarizing the characteristics of a queue. Arrival characteristics / Departure characteristics / Number of servers.
CS723 - Probability and Stochastic Processes
Lecture 5 This lecture is about: Introduction to Queuing Theory
Presentation transcript:

Lecture 7  Poisson Processes (a reminder)  Some simple facts about Poisson processes  The Birth/Death Processes in General  Differential-Difference Equations  The Pure Birth Process (Generating our own Poisson process from scratch)  How are queues related to Markov chains  The M/M/1 queue  A Poisson arrival and Poisson departure queue modelled using Markov chains

The Poisson Distribution (reminder)  A random variable X is said to be Poisson if it has the following distribution:  We can calculate the mean as follows: beginner exercise – prove it IS a distribution

A Poisson Process  A Poisson process is a process where the number of arrivals in a time interval (size  ) has a Poisson distribution:  Where A(t) is the number of events (arrivals) up to time t.  Note that this is a Poisson distribution with mean t  The parameter is known as the rate of the process – because in t time units, t arrivals will occur.

Poisson Interarrival Times  t n is the time of packet n and  n = t n+1 – t n  How is  n distributed? The probability  n > s is the probability that there are 0 arrivals in the period t n to t n +s  Note that a similar derivation proves the “memoryless” property of the Poisson process. The distribution of the time to next arrival starting from any time t where t n < t < t n+1 would be just the same as if we start counting from the previous arrival.

Approximating a Poisson Process  For every t  0 and   0: The third property follows from the first two.

The Birth Death Process  A birth-death process is a Markov process in which transitions from state k can only be made from the adjacent states k-1 and k+1  Think of a transition from k to k+1 as a birth and in the reverse direction as a death.  More importantly, we could consider it as arrivals and departures from a queue where the arrivals and departures are Poisson processes.  Firstly, we must consider why a Markov chain is appropriate to the modelling.

Continuous Time Markov Chains  Note that the Markov chains we have talked about before were “discrete time” – there were discrete steps which occurred at given times.  Here we need to think about continuous time Markov chains – those where transitions between states could occur at any time.  The technicalities of continuous time Markov chains are beyond the scope of this course.  Therefore, we will ignore this technicality and pretend we are dealing with discrete time Markov chains with very small times between states.

The General Birth-Death Process  When the pop. = k, births and deaths happen as Poisson processes: birth rate k and death rate  k (  0 =0)  B(t,  t ) is the number of births in the period (t,t+  t )  D(t,  t ) is the number of deaths in the period (t,t+  t ) P{B(t,  t )= 0 | Pop. = k} = 1 - k  t +o (  t ) P{B(t,  t )= 1 | Pop. = k} = k  t +o (  t ) P{B(t,  t )> 1 | Pop. = k} = o (  t ) P{D(t,  t )= 0 | Pop. = k} = 1 -  k  t +o (  t ) P{D(t,  t )= 1 | Pop. = k} =  k  t +o (  t ) P{D(t,  t )> 1 | Pop. = k} = o (  t )

Differential Difference Equations  Define the probability that the pop. is k at time t as P k (t). Now, for k > 0 we have: Now, taking the limit as  t  0 These are known as differential difference equations

A Quick Aside – The Pure Birth Process  Consider process k = and  k =0 Which is the original Poisson process we started with (no surprise)!

The General Birth-Death Process as a Markov Chain 102 k 11 22 22 k-1 k kk  k+1... Note that we number the states from 0 so that the state number is the same as the population.

Equilibrium Probabilities  We are often interested in questions of the form: “What is the average size of the population?” or “What is the probability that the population is of size k at time t?”  We are therefore interested in the equilibrium probabilities.  Recall our balance equations:

Equilibrium Probabilities(2)  In the case of our Birth-Death process these are: rearrange to: compare with:

Solving the problem Rearrange (2): (1) (2) Substitute into (1) with k=1 We suspect (correctly) the following relation: (proving this is part of your coursework) Rearrange:

Completing the Birth-Death Process from other balance equation: Rearranging

Finally, the M/M/1 process  The M/M/1 queue is simply a birth death process with k = and  k = . Substituting into our previous equations we get: where  = /  is known as the utilisation factor for a stable system this is < 1 Therefore: From the geometric series:

The M/M/1 Process Solved  We now want to get the expected queue length: we use a familiar trick to get: From Little’s Theorem the average delay:

Average Queue Length in M/M/1 Utilisation E[N]