Palm Calculus Part 1 The Importance of the Viewpoint JY Le Boudec 1 May 2015.

Slides:



Advertisements
Similar presentations
1 On the Long-Run Behavior of Equation-Based Rate Control Milan Vojnović and Jean-Yves Le Boudec ACM SIGCOMM 2002, Pittsburgh, PA, August 19-23, 2002.
Advertisements

Simulating Single server queuing models. Consider the following sequence of activities that each customer undergoes: 1.Customer arrives 2.Customer waits.
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Modeling & Simulation. System Models and Simulation Framework for Modeling and Simulation The framework defines the entities and their Relationships that.
Lab Assignment 1 COP 4600: Operating Systems Principles Dr. Sumi Helal Professor Computer & Information Science & Engineering Department University of.
Confidence Intervals with Means Chapter 9. What is the purpose of a confidence interval? To estimate an unknown population parameter.
Active Queue Management: Theory, Experiment and Implementation Vishal Misra Dept. of Computer Science Columbia University in the City of New York.
1 Perfect Simulation and Stationarity of a Class of Mobility Models Jean-Yves Le Boudec (EPFL) Milan Vojnovic (Microsoft Research Cambridge)
Output Data Analysis. How to analyze simulation data? simulation –computer based statistical sampling experiment –estimates are just particular realizations.
Queuing Theory For Dummies
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
Performance analysis for high speed switches Lecture 6.
Statistical Inference Chapter 12/13. COMP 5340/6340 Statistical Inference2 Statistical Inference Given a sample of observations from a population, the.
Katz, Stoica F04 EECS 122: Introduction to Computer Networks Performance Modeling Computer Science Division Department of Electrical Engineering and Computer.
1 Performance Evaluation of Computer Networks Objectives  Introduction to Queuing Theory  Little’s Theorem  Standard Notation of Queuing Systems  Poisson.
LARGE SAMPLE TESTS ON PROPORTIONS
Simulation.
Simulation with ArenaChapter 2 – Fundamental Simulation Concepts Discrete Event “Hand” Simulation of a GI/GI/1 Queue.
1 Random Trip Stationarity, Perfect Simulation and Long Range Dependence Jean-Yves Le Boudec (EPFL) joint work with Milan Vojnovic (Microsoft Research.
Palm Calculus Made Easy The Importance of the Viewpoint JY Le Boudec Illustration : Elias Le Boudec.
1 TCOM 501: Networking Theory & Fundamentals Lecture 7 February 25, 2003 Prof. Yannis A. Korilis.
ACN: AVQ1 Analysis and Design of an Adaptive Virtual Queue (AVQ) Algorithm for Active Queue Managment Srisankar Kunniyur and R. Srikant SIGCOMM’01 San.
Little’s Theorem Examples Courtesy of: Dr. Abdul Waheed (previous instructor at COE)
Simulating Single server queuing models. Consider the following sequence of activities that each customer undergoes: 1.Customer arrives 2.Customer waits.
Simulation Waiting Line. 2 Introduction Definition (informal) A model is a simplified description of an entity (an object, a system of objects) such that.
OS Fall ’ 02 Performance Evaluation Operating Systems Fall 2002.
Confidence Intervals Chapter 10. Rate your confidence Name my age within 10 years? within 5 years? within 1 year? Shooting a basketball at a wading.
Basics of Sampling Theory P = { x 1, x 2, ……, x N } where P = population x 1, x 2, ……, x N are real numbers Assuming x is a random variable; Mean/Average.
Introduction to Behavioral Science Unit 1. I.Social Sciences  The study of society and the activities and relationships of individuals and groups within.
Slide - 1 Dr Terry Hinton 6/9/05UniS - Based on Slides by Micro Analysis & Design An example of a Simulation Simulation of a bank: Three tasks or processes:
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
Simulation Examples ~ By Hand ~ Using Excel
1 Performance Evaluation of Computer Networks: Part II Objectives r Simulation Modeling r Classification of Simulation Modeling r Discrete-Event Simulation.
Modeling and Simulation CS 313
Statistical Analysis of Loads
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) Each has some error or uncertainty.
MIT Fun queues for MIT The importance of queues When do queues appear? –Systems in which some serving entities provide some service in a shared.
Queuing Theory Basic properties, Markovian models, Networks of queues, General service time distributions, Finite source models, Multiserver queues Chapter.
General Statistics Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
ICOM 6115: Computer Systems Performance Measurement and Evaluation August 11, 2006.
Confidence Intervals with Means Unit 12, Notes p 189.
Statistics Presentation Ch En 475 Unit Operations.
Review. Why can average request time be used to determine the work-load required for saturation?
Simulation & Confidence Intervals COMP5416 Advanced Network Technologies.
Palm Calculus Made Easy The Importance of the Viewpoint JY Le Boudec 1.
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
© Copyright McGraw-Hill 2004
Internet Applications: Performance Metrics and performance-related concepts E0397 – Lecture 2 10/8/2010.
Evaluating Classifiers Reading: T. Fawcett, An introduction to ROC analysis, Sections 1-4, 7 (linked from class website)An introduction to ROC analysis.
1 Part Three: Chapters 7-9 Performance Modeling and Estimation.
Queueing Fundamentals for Network Design Application ECE/CSC 777: Telecommunications Network Design Fall, 2013, Rudra Dutta.
Queueing theory for TCP Damon Wischik, UCL Gaurav Raina, Cambridge.
Mean Field Methods for Computer and Communication Systems Jean-Yves Le Boudec EPFL Network Science Workshop Hong Kong July
Problem 1: Service System Capacity
Probability and Estimation
Simulation Statistics
22C:19 Discrete Math Discrete Probability
35 m = ______ cm 250 g = ______ kg 650 mm = ______ m 230 m = ______ km
Scheduling Jobs Across Geo-distributed Datacenters
CPSC 457 Operating Systems
Chapter 10 Verification and Validation of Simulation Models
Finite M/M/1 queue Consider an M/M/1 queue with finite waiting room.
Probability and Estimation
EE 122: Network Performance, Queueing Theory, Evaluation
Discrete Event “Hand” Simulation of a GI/GI/1 Queue
Queueing networks.
Equation-Based Rate Control: Is it TCP-friendly
Queuing Networks Mean Value Analysis
Evaluating Hypothesis
Presentation transcript:

Palm Calculus Part 1 The Importance of the Viewpoint JY Le Boudec 1 May 2015

1. Event versus Time Averages Consider a simulation, state S t Assume simulation has a stationary regime Consider an Event Clock: times T n at which some specific changes of state occur Ex: arrival of job; Ex. queue becomes empty Event average statistic Time average statistic 2

Example: Gatekeeper; Average execution time Real time t (ms) job arrival Execution time for a job that arrives at t (ms) Viewpoint 1: System Designer Viewpoint 2: Customer

Example: Gatekeeper; Average execution time Real time t (ms) job arrival Execution time for a job that arrives at t (ms) Viewpoint 1: System Designer Viewpoint 2: Customer

Sampling Bias W s and W c are different A metric definition should mention the sampling method (viewpoint) Different sampling methods may provide different values: this is the sampling bias Palm Calculus is a set of formulas for relating different viewpoints Can often be obtained by means of the Large Time Heuristic 5

Large Time Heuristic Explained on an Example 6

7

8

9

10

This is Palm Calculus ! 11

A.Sn = 90, 10, 90, 10, 90; Xn = 5000, 1000, 5000, 1000, 5000 B.S n = 90, 10, 90, 10, 90; X n = 1000, 5000, 1000, 5000, 1000 C.Both D.None E.I don’t know 12

Solution 13

The Large Time Heuristic Formally correct if simulation is stationary It is a robust method, i.e. independent of assumptions on distributions (and on independence) 14

Other «Clocks» 15 Flow 1 Flow 2 Flow 3 Distribution of flow sizes for an arbitrary flow for an arbitrary packet

Which curves are for the per-packet viewpoint ? A.A B.B C.It depends D.I don’t know 16

Solution Answer A There are more packets in the large flows. So more packets experience a large flow size. 17

18 Load Sensitive Routing of Long-Lived IP Flows Anees Shaikh, Jennifer Rexford and Kang G. Shin Proceedings of Sigcomm'99 ECDF, per flow viewpoint ECDF, per packet viewpoint

19 Flow 1 Flow 2 Flow 3 Distribution of flow sizes for an arbitrary flow for an arbitrary packet

Large «Time» Heuristic 20

Large «Time» Heuristic 21 Flow n=1 Flow n=2 Flow n=3 p=1 p=2 p=3 p=4 p=5p=6 p=7 p=8 p=9

Large «Time» Heuristic 3.Compare 22 Flow n=1 Flow n=2 Flow n=3 p=1 p=2 p=3 p=4 p=5p=6 p=7 p=8 p=9

Large «Time» Heuristic for PDFs of flow sizes Put the packets side by side, sorted by flow 1.How do we evaluate these metrics in a simulation ? 23 Flow n=1 Flow n=2 Flow n=3

24

25

Cyclist’s Paradox On a round trip tour, there is more uphill than downhill 26

The km clock vs the standard clock 27

BorduRail claims that only 5% of trains arrivals are late BorduKonsum claims that 30% of train users suffer from late train arrivals 28

29 Solution