 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 1 Networks of Queues: Myth and Reality Guang-Liang Li and Victor O.K. Li The University of Hong.

Slides:



Advertisements
Similar presentations
Many useful applications, especially in queueing systems, inventory management, and reliability analysis. A connection between discrete time Markov chains.
Advertisements

Chapter Queueing Notation
Queueing Models and Ergodicity. 2 Purpose Simulation is often used in the analysis of queueing models. A simple but typical queueing model: Queueing models.
Continuous-Time Markov Chains Nur Aini Masruroh. LOGO Introduction  A continuous-time Markov chain is a stochastic process having the Markovian property.
TCOM 501: Networking Theory & Fundamentals
1 Part III Markov Chains & Queueing Systems 10.Discrete-Time Markov Chains 11.Stationary Distributions & Limiting Probabilities 12.State Classification.
Queuing Theory For Dummies
Queuing Analysis Based on noted from Appendix A of Stallings Operating System text 6/10/20151.
ECS 152A Acknowledgement: slides from S. Kalyanaraman & B.Sikdar
Performance analysis for high speed switches Lecture 6.
TCOM 501: Networking Theory & Fundamentals
Mean Delay in M/G/1 Queues with Head-of-Line Priority Service and Embedded Markov Chains Wade Trappe.
Delay models in Data Networks
1 TCOM 501: Networking Theory & Fundamentals Lecture 7 February 25, 2003 Prof. Yannis A. Korilis.
Modeling and Analysis of Manufacturing Systems Session 2 QUEUEING MODELS January 2001.
7/3/2015© 2007 Raymond P. Jefferis III1 Queuing Systems.
Queuing Networks: Burke’s Theorem, Kleinrock’s Approximation, and Jackson’s Theorem Wade Trappe.
1 TCOM 501: Networking Theory & Fundamentals Lecture 8 March 19, 2003 Prof. Yannis A. Korilis.
1 10. Joint Moments and Joint Characteristic Functions Following section 6, in this section we shall introduce various parameters to compactly represent.
CMPE 252A: Computer Networks Review Set:
Queuing Networks. Input source Queue Service mechanism arriving customers exiting customers Structure of Single Queuing Systems Note: 1.Customers need.
Introduction to Queuing Theory
Flows and Networks Plan for today (lecture 5): Last time / Questions? Waiting time simple queue Little Sojourn time tandem network Jackson network: mean.
Queueing Theory I. Summary Little’s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems  M/M/1  M/M/m  M/M/1/K  …
Copyright ©: Nahrstedt, Angrave, Abdelzaher, Caccamo1 Queueing Systems.
Generalized Semi-Markov Processes (GSMP)
Probability Review Thinh Nguyen. Probability Theory Review Sample space Bayes’ Rule Independence Expectation Distributions.
2.4 Sequences and Summations
MIT Fun queues for MIT The importance of queues When do queues appear? –Systems in which some serving entities provide some service in a shared.
Lecture 14 – Queuing Networks Topics Description of Jackson networks Equations for computing internal arrival rates Examples: computation center, job shop.
NETE4631:Capacity Planning (2)- Lecture 10 Suronapee Phoomvuthisarn, Ph.D. /
Stochastic Models Lecture 2 Poisson Processes
Networks of Queues Plan for today (lecture 6): Last time / Questions? Product form preserving blocking Interpretation traffic equations Kelly / Whittle.
Queuing Theory Basic properties, Markovian models, Networks of queues, General service time distributions, Finite source models, Multiserver queues Chapter.
Flows and Networks Plan for today (lecture 4): Last time / Questions? Output simple queue Tandem network Jackson network: definition Jackson network: equilibrium.
TexPoint fonts used in EMF.
Modeling and Analysis of Computer Networks
1 Chapters 8 Overview of Queuing Analysis. Chapter 8 Overview of Queuing Analysis 2 Projected vs. Actual Response Time.
SIMULATION OF A SINGLE-SERVER QUEUEING SYSTEM
CDA6530: Performance Models of Computers and Networks Chapter 7: Basic Queuing Networks TexPoint fonts used in EMF. Read the TexPoint manual before you.
Why Wait?!? Bryan Gorney Joe Walker Dave Mertz Josh Staidl Matt Boche.
Generalized Semi- Markov Processes (GSMP). Summary Some Definitions The Poisson Process Properties of the Poisson Process  Interarrival times  Memoryless.
State N 2.6 The M/M/1/N Queueing System: The Finite Buffer Case.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
Chapter 01 Probability and Stochastic Processes References: Wolff, Stochastic Modeling and the Theory of Queues, Chapter 1 Altiok, Performance Analysis.
Chapter 20 Queuing Theory to accompany Operations Research: Applications and Algorithms 4th edition by Wayne L. Winston Copyright (c) 2004 Brooks/Cole,
Flows and Networks Plan for today (lecture 6): Last time / Questions? Kelly / Whittle network Optimal design of a Kelly / Whittle network: optimisation.
Network Design and Analysis-----Wang Wenjie Queueing Theory II: 1 © Graduate University, Chinese academy of Sciences. Network Design and Performance Analysis.
Winter 2004EE384x1 Poisson Process Review Session 2 EE384X.
Copyright ©: Nahrstedt, Angrave, Abdelzaher, Caccamo1 Queueing Systems.
Chapter 6 Product-Form Queuing Network Models Prof. Ali Movaghar.
Queuing Theory.  Queuing Theory deals with systems of the following type:  Typically we are interested in how much queuing occurs or in the delays at.
Flows and Networks Plan for today (lecture 3): Last time / Questions? Output simple queue Tandem network Jackson network: definition Jackson network: equilibrium.
Random Variables r Random variables define a real valued function over a sample space. r The value of a random variable is determined by the outcome of.
QUEUING. CONTINUOUS TIME MARKOV CHAINS {X(t), t >= 0} is a continuous time process with > sojourn times S 0, S 1, S 2,... > embedded process X n = X(S.
Queueing Theory II.
Lecture 14 – Queuing Networks
Flows and Networks Plan for today (lecture 3):
Medium Access Control Protocols
Basic Modeling Components
Flows and Networks Plan for today (lecture 4):
Lecture on Markov Chain
ECE 358 Examples #1 Xuemin (Sherman) Shen Office: EIT 4155
Queueing Theory II.
Flows and Networks Plan for today (lecture 6):
Networks of queues Networks of queues reversibility, output theorem, tandem networks, partial balance, product-form distribution, blocking, insensitivity,
Queueing networks.
Lecture 14 – Queuing Networks
LECTURE 09 QUEUEING THEORY PART3
Presentation transcript:

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 1 Networks of Queues: Myth and Reality Guang-Liang Li and Victor O.K. Li The University of Hong Kong  glli,vli

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 2 Outline 1.“How Networks of Queues Came About” 2.Jackson Networks of Queues and Jackson’s Theorem 3.Unsolved Mysteries 4.Counterexample 1: M/M/1 Queue with Feedback 5.Counterexample 2: Two M/M/1 queues in Tandem 6.Possible Behavior of Networks of Queues 7.Conclusion

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 3 1. “How Networks of Queues Came About” 2002, J. Jackson, “How networks of queues came about,” Operations Research, vol. 50, no. 1, pp , J. Jackson, “Networks of waiting lines,” Operations Research, vol. 5, no. 4, pp , J. Jackson, “Jobshop-like queueing systems,” Management Science, vol. 10, no. 1, pp After 1963, various generalizations and variations by others.

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 4 2. Jackson Networks of Queues and Jackson’s Theorem Jackson Network of Queues independent Poisson arrivals from outside independent exponential service times, also independent of arrivals first-come-first-served once served at a queue, customer may either leave network, or go to the same or another queue in the network

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 5

6 Jackson’s Theorem Assumption: Network state (k 1, k 2, …, k m ) is a stationary Markov process Theorem: In steady state, every queue in a Jackson network behaves as if it was an M/M/m queue in isolation, independent of all other queues in the network.

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 7 3. Unsolved Mysteries “product form solution” tandem network –waiting times are dependent, cf., P.J. Burke, “The dependence of delays in tandem queues,” Ann. Math. Statist., vol. 35, no. 2, June, 1964, pp –but sojourn times are mutually independent, cf., E Reich, “Note on queues in tandem,” Ann. Math. Statist., , M/M/1 with feedback behaves as if it was without feedback, but –with feedback: transition is impossible in small time interval if feedback occurs –without feedback: transition is always possible in any time interval

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 8 4. Counterexample 1: M/M/1 Queue with Feedback Diagnosing Jackson’s Proof m = 1, 2, …, M: labels of queues n m : number of servers at queue m  m : service rate at queue m m : arrival rate of customers at queue m from outside network  km : probability that customers go from queue m to queue k = 1 -  k  km : probability that customers leave network from queue m  i (k) = min  k, n i ,  i = min  k, 1 

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 9 First Equation in Jackson’s Proof P k1, …, kM (t+h) =  1-(  i )h – [  i (k i )  i ]h  P k 1, …, k M (t) +  i (k i +1)  i hP k 1, …, k i +1, …, k M (t) +  i  i hP k 1, …, k i -1, …, k M (t) +  j (k j +1)  j  ij hP k 1, …, k j +1, …, k i -1, …, k M (t)+o(h)

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 10 M=1, n 1 =1, k 1 =k, 1 = >0,  1 =  >0,  11 =  >0 For k>1 P k (t+h) = (1- h-  h)P k (t)+  (1-  )hP k+1 (t)+ hP k-1 (t) +o(h). (1) X(t): number of customers waiting and being served in the single-server queue at time t. Equation (1) is actually P{X(t+h) = k} = P{X(t+h) = k|X(t) = k}P{X(t) = k} +P{X(t+h) = k  X(t) = k+1}P{X(t) = k+1} +P{X(t+h) = k|X(t) = k-1}P{X(t) = k-1}+o(h)(2)

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 11 Compare (1) with (2) P  X(t+h) = k  X(t) = k  = 1- h-  h Replace k by k-1 in (1) and (2), and compare the obtained equations. P  X(t+h) = k-1  X(t) = k  =  (1-  )h Replace k by k+1 in (1) and (2), and compare the obtained equations. P{X(t+h) = k+1|X(t) = k} = h Contradiction: the sum of the above probabilities is not equal to one. X(t) is not a Markov process. Jackson’s theorem does not hold.

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 12 Without Diagnosing Jackson’s Proof  (2): time spent by X(t) in state k=2 until a transition to k=1.  (2) is not exponential (to be shown) implies X(t) is not a Markov process. actual service time of a customer: initial service time plus any extra service time due to feedback  (2) =  d +  p  d >0: the (residual) actual service time of the departing customer  p >0: part of the actual service time of the other customer v(x): probability density function of  p S: the (residual) exponential service time first expired in  (2)

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 13 P{  (2)<t  = P  (2)<t  p = x}v(x)dx(3) P{  p = 0  = 1 implies v(x) =  (x) (Dirac delta function),  (2) = S, (3) becomes P  (2)<t} = P{S<t|  p = x  (x)dx = P{S<t  p = 0} = P  S<t} If 0<P{  p = 0  <1 P{  (2)<t  = P{  (2)<t|  p = 0  P{  p = 0  + P{  (2)<t  p = x}v(x)dx = P{S 0}P{  p >0} For any 0<t< , P{S P{  (2) 0} So  (2) cannot be exponential.

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong Counterexample 2: Two M/M/1 queues in Tandem All customers arrive at the first queue, go to the second queue after service, and leave the network form there. Jackson’s theorem in this case: corollary of Burke’s theorem: The output of the first queue is a Poisson Process at the same rate as that of the arrival process. The second queue is also an M/M/1 system.

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 15 Outline of Our Argument 1.The output of the first queue has both a marginal version, and a non-marginal version (shall be demonstrated). 2.The non-marginal version is neither a Poisson process nor a stationary process. 3.If the two queues are considered jointly as a network, the arrival process at the second queue is the non-marginal, non- stationary version. 4.The second queue is not an M/M/1 queue and is unstable. 5.The state of this network is not stationary. 6.So Jackson’s theorem does not hold.

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 16 Output of M/M/1 Queue Simulation (thought experiment) of stable M/M/1 queue in steady state Inter-departure time (t-s) is sampled in either case below Case (a): server is busy at time s - (t-s) is distributed as a service time - color a line segment of length (t-s) red - use “R” to represent the segment

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 17 case (b): server is idle at time s (t-s) is distributed as the sum of an idle time of the server and a service time color a segment of length (t-s) blue use “B” to represent the segment sample path of the inter-departure time sequence corresponds to a sequence of colored segments

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 18 Observation and Fact sequence of colored segments RRRBRRRRBBBRRRBBBBBRR…. segments of two colors: inter-departure times follow two different distributions tendency for segments with the same color to aggregate: Markov dependence

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 19 Non-Marginal Version of the Output the inter-departure time sequence: not i.i.d., not stationary the corresponding departure process: not Poisson process, not stationary

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 20 Marginal Version of the Output obtained by averaging out the impact of the state of the queue Experimental construction divide interval (0, H) into N (H) consecutive, disjoint subintervals of equal length for all segments with length less than H, calculate the frequencies that the lengths of the segments are in the small intervals, regardless of their colors. As H  , an exponential pdf with parameter equal to the arrival rate is found

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 21 Marginal Version of the output (cont’d.) experimental construction (continued) sample random variables independently, regardless of the state of the queue, from the constructed pdf sampled random variables form an i.i.d. exponential sequence marginal version: the Poisson process corresponding to the exponential sequence

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 22 What Does Burke’s Theorem Really Mean Separate queues in tandem based on the marginal version so as to treat them individually rather than jointly. “It is intuitively clear that, in tandem queuing processes of the type mentioned above, if the output distribution of each stage was of such character that the queuing system formed by the second stage was amenable to analysis, then the tandem queue could be analyzed stage-by-stage insofar as the separate delay and queue- length distributions are concerned. Such a stage-by-stage analysis can be expected to be considerably simpler than the simultaneous analysis heretofore necessary. Fortunately, under the conditions stated below, it is true that the output has the required simplicity for treating each stage individually.” P.J. Burke, “The output of a queueing system,” Operations Research, vol. 4, pp , 1956.

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong 23 What if two queues in tandem are considered jointly? the output of the first queue is the non-marginal, non-stationary version the second queue is not M/M/1, and is not stable The state of the network is not a stationary process Jackson’s theorem does not hold

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong Possible Behavior of Networks of Queues Jackson network without loops: not stationary if queues considered jointly after separation based on the marginal version, queues standing alone can be stable Jackson network with loops: not stationary network with renewal-type external arrivals and generally distributed service times: not stationary in general tandem network with renewal-type external arrivals and generally distributed service times: can be isolated and isolated queues can be stable

 2003 G.L. Li and V. O.K. Li, The University of Hong Kong Conclusion Jackson’s theorem does not hold, as shown by the counterexamples. The assumption (i.e., network state is a stationary Markov process) made by Jackson is invalid. All known “proofs” are based on this invalid assumption. Jackson network is not stationary, unless queues can be isolated. Generalizations and variations of Jackson networks are questionable. Re-investigation of related issues is necessary.