Asaf Cohen (joint work with Rami Atar) Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan March 11,

Slides:



Advertisements
Similar presentations
One-phase Solidification Problem: FEM approach via Parabolic Variational Inequalities Ali Etaati May 14 th 2008.
Advertisements

Seminar in Auctions and Mechanism Design Based on J. Hartline’s book: Approximation in Economic Design Presented by: Miki Dimenshtein & Noga Levy.
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
Online Scheduling with Known Arrival Times Nicholas G Hall (Ohio State University) Marc E Posner (Ohio State University) Chris N Potts (University of Southampton)
Bounds on Code Length Theorem: Let l ∗ 1, l ∗ 2,..., l ∗ m be optimal codeword lengths for a source distribution p and a D-ary alphabet, and let L ∗ be.
Quantum One: Lecture 3. Implications of Schrödinger's Wave Mechanics for Conservative Systems.
EC941 - Game Theory Prof. Francesco Squintani Lecture 8 1.
Infinite Horizon Problems
Planning under Uncertainty
Function Optimization Newton’s Method. Conjugate Gradients
Hash Tables With Finite Buckets Are Less Resistant to Deletions Yossi Kanizo (Technion, Israel) Joint work with David Hay (Columbia U. and Hebrew U.) and.
1 Ecole Polytechnque, Nov 7, 2007 Scheduling Unit Jobs to Maximize Throughput Jobs:  all have processing time (length) = 1  release time r j  deadline.
Chapter 4: Stochastic Processes Poisson Processes and Markov Chains
An Introduction to Black-Box Complexity
The k-server Problem Study Group: Randomized Algorithm Presented by Ray Lam August 16, 2003.
Competitive Analysis of Incentive Compatible On-Line Auctions Ron Lavi and Noam Nisan SISL/IST, Cal-Tech Hebrew University.
Scientific Computing Partial Differential Equations Poisson Equation Calculus of Variations.
Asaf Cohen Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan September 10,
Called as the Interval Scheduling Problem. A simpler version of a class of scheduling problems. – Can add weights. – Can add multiple resources – Can ask.
On the variance curve of outputs for some queues and networks Yoni Nazarathy Gideon Weiss Yoav Kerner QPA Seminar, EURANDOM January 8, 2009.
Auction Seminar Optimal Mechanism Presentation by: Alon Resler Supervised by: Amos Fiat.
The importance of sequences and infinite series in calculus stems from Newton’s idea of representing functions as sums of infinite series.  For instance,
Trust-Aware Optimal Crowdsourcing With Budget Constraint Xiangyang Liu 1, He He 2, and John S. Baras 1 1 Institute for Systems Research and Department.
© 2009 IBM Corporation 1 Improving Consolidation of Virtual Machines with Risk-aware Bandwidth Oversubscription in Compute Clouds Amir Epstein Joint work.
Markov Decision Processes1 Definitions; Stationary policies; Value improvement algorithm, Policy improvement algorithm, and linear programming for discounted.
ECES 741: Stochastic Decision & Control Processes – Chapter 1: The DP Algorithm 31 Alternative System Description If all w k are given initially as Then,
1 ECE-517 Reinforcement Learning in Artificial Intelligence Lecture 7: Finite Horizon MDPs, Dynamic Programming Dr. Itamar Arel College of Engineering.
The Integers. The Division Algorithms A high-school question: Compute 58/17. We can write 58 as 58 = 3 (17) + 7 This forms illustrates the answer: “3.
Joint work with Yuval Peres, Mikkel Thorup, Peter Winkler and Uri Zwick Overhang Bounds Mike Paterson DIMAP & Dept of Computer Science University of Warwick.
Lecture #11 Stability of switched system: Arbitrary switching João P. Hespanha University of California at Santa Barbara Hybrid Control and Switched Systems.
1 Markov Decision Processes Infinite Horizon Problems Alan Fern * * Based in part on slides by Craig Boutilier and Daniel Weld.
Competitive Queue Policies for Differentiated Services Seminar in Packet Networks1 Competitive Queue Policies for Differentiated Services William.
Dynamic Programming Applications Lecture 6 Infinite Horizon.
Positive Harris Recurrence and Diffusion Scale Analysis of a Push-Pull Queueing Network Yoni Nazarathy and Gideon Weiss University of Haifa ValueTools.
Expectation for multivariate distributions. Definition Let X 1, X 2, …, X n denote n jointly distributed random variable with joint density function f(x.
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Principles of Parameter Estimation.
1 Markov Decision Processes Infinite Horizon Problems Alan Fern * * Based in part on slides by Craig Boutilier and Daniel Weld.
State N 2.6 The M/M/1/N Queueing System: The Finite Buffer Case.
CSCI1600: Embedded and Real Time Software Lecture 24: Real Time Scheduling II Steven Reiss, Fall 2015.
1. 2 You should know by now… u The security level of a strategy for a player is the minimum payoff regardless of what strategy his opponent uses. u A.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
Asymptotic behaviour of blinking (stochastically switched) dynamical systems Vladimir Belykh Mathematics Department Volga State Academy Nizhny Novgorod.
Approximation Algorithms based on linear programming.
Theory of Computational Complexity M1 Takao Inoshita Iwama & Ito Lab Graduate School of Informatics, Kyoto University.
Reliability Engineering
Advanced Algorithms Analysis and Design By Dr. Nazir Ahmad Zafar Dr Nazir A. Zafar Advanced Algorithms Analysis and Design.
Theory of Computational Complexity Probability and Computing Chapter Hikaru Inada Iwama and Ito lab M1.
“mean-Field games with strategic servers”
12. Principles of Parameter Estimation
risk Sensitive control of the lifetime ruin problem
risk Sensitive control of the lifetime ruin problem
Adv. Wireless Comm. Systems - Cellular Networks -
Chapter 5. Optimal Matchings
Independent Encoding for the Broadcast Channel
James B. Orlin Presented by Tal Kaminker
Chap 3. The simplex method
Chapter 7 Sampling Distributions.
Quantum One.
Partly Verifiable Signals (c.n.)
Partly Verifiable Signals (c.n.)
Summarizing Data by Statistics
Chapter 7 Sampling Distributions.
Stability Analysis of Linear Systems
Chapter 7 Sampling Distributions.
Compact routing schemes with improved stretch
Clustering.
Determination of Sample Size
12. Principles of Parameter Estimation
Chapter 7 Sampling Distributions.
Presentation transcript:

Asaf Cohen (joint work with Rami Atar) Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan March 11,

Contents The Differential Game The Model Varadhan’s Lemma The Approximation 2

Contents The Differential Game The Model Varadhan’s Lemma The Approximation 2

The Model Basic definitions 3 size of the i-th buffer arrival process finite 2 nd moment controlled service process finite 2 nd moment controlled rejection process buffers

The Model Basic definitions 3 Moderate-deviation rate parameters Arrival rates Departure rates The system is critically loaded size of the i-th buffer arrival process finite 2 nd moment controlled service process finite 2 nd moment controlled rejection process buffers Proportion of time that server i is busy

The Model Scaling 4

(1) and (2) and 5 The sequence satisfies the moderate-deviation principle with rate parameters and rate function. That is, for every and every closed and open sets one has The Model Sufficient condition:

The Model Cost and value function 6 Alternative costs: Scaling implies Technical difficulties Non-stationary solutions Value: Cost: Leads to a stationary robust control discount factor

The Model Why Moderate-Deviation? 7 While there are many diffusion-scaling papers, there are very few papers with the large/moderate-deviations scaling. In diffusion scaling the probability of overflow is of order 1, while in the large/moderate deviation the order is very low. In the large/moderate deviation we get a robust control. Unlike the large-deviation, which suffers from high complexity. Under the moderate-deviation, we solve the problem completely. TO ADD COLORS LATER ON AND TO SIMPLIFY THE POLICY LIKE IN THE 20MIN

The Model State space collapse 8 where is called the workload. Cost

The Model Varadhan’s Lemma (intuition for the differential game) 9 Suppose that (with support ) satisfies the large deviation principle with the good rate function and let be a continuous function. Assume further (to simplify the proof) that is compact. Then, Intuition:

The Model State space collapse 10 where Cost Deterministic differential game Cost: Value: Anticipating Elliot-Kalton is related to

11 The Model Assume that and that Assumption 1 holds. Then, where To his end, we analyze the differential game… (We will refer only to the one dimensional case here and work with. )

Contents The Differential Game The Model Varadhan’s Lemma The Approximation 12

The Differential Game Intuition 1313 Cost: Value: Anticipating Elliot-Kalton

Properties of the game 14 Explicit expression for the value function. Optimal strategy for the minimizer The Differential Game

Properties of the game 15 Simple controls for the maximizer that achieves : - Stopping immediately as the dynamics hits zero,. - until the first time the dynamics drop below and then decreases until the dynamics hit zero (solves PDE, independent of the minimizer choice). Also, the terminal time is smaller than. Under this control, if then the minimizer would prefer to reject immediately! The Differential Game

Contents The Differential Game The Model Varadhan’s Lemma The Approximation 16

Varadhan’s Lemma 17 Suppose that (with support ) satisfies the Large deviation principle with the good rate function and let be a continuous function. Assume further (to simplify the proof) that is compact. Then, Intuition:

Varadhan’s Lemma (proof) 18 Lower bound: Fix. There is s.t. So, and Since is arbitrary Varadhan’s Lemma

Varadhan’s Lemma (proof) 19 Upper bound: For every there is s.t. Since is compact there is a finite cover ( independent of ) Varadhan’s Lemma

Contents The Differential Game The Model Varadhan’s Lemma The Approximation 20

The Approximation Deterministic differential game 21 Cost: Value: anticipating

22 We prove it by showing that for every sequence one has and that, there is a sequence of policies for which The Approximation We will refer only to the one dimensional case here, and work with … Assume that and that Assumption 1 holds. Then, where

Lower bound 2323 Notice that depends on the control. Now we consider a sequence of controls. So, we consider. But how? We would like to center around. The Approximation less than

Lower bound 24 Take (3) Fix. There is an interval s.t. (1) s.t. stopping afterwards is too expensive. (2) Divide into small intervals: (4) Divide, the interval into small time intervals. Recall that termination time of the game is smaller than. (5) Now, continue centering around the second part of. There is an interval s.t. The Approximation

Lower bound 25 We focus on ‘s for which for a specific. Recall that there are only finitely many such. The Approximation is linear

Lower bound 26 So, The Approximation

Service (from workload to buffers): W.o.l.g. assume that Asymptotically optimal policy 27 Rejections: If overflow occurs (happens with low prob.) Otherwise, reject from buffer. Low priority: let the cheapest buffer, which is not almost full (up to ) to be filled. Serve the others with rate higher than The Approximation

Asymptotically optimal policy 28 Assume and the buffers have the same sizes The Approximation cheapest buffer

29

The Model State space collapse 3 where Cost Deterministic differential game Cost: Value: anticipating is related to