Page 1 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 Discussion of Marty Reiman’s Markov Lecture A Stochastic Programming Based Approach to ATO.

Slides:



Advertisements
Similar presentations
Impact of Interference on Multi-hop Wireless Network Performance Kamal Jain, Jitu Padhye, Venkat Padmanabhan and Lili Qiu Microsoft Research Redmond.
Advertisements

“Make to order or Make to Stock Model: and Application” S.Rajagopalan By: ÖNCÜ HAZIR.
Optimal Control of One-Warehouse Multi-Retailer Systems with Discrete Demand M.K. Doğru A.G. de Kok G.J. van Houtum
Page 1 Alan Scheller-Wolf Lunteren, The Netherlands January 16, 2013 Things I Thought I Knew about Queueing Theory, but was Wrong About (Part 2, Service.
Stochastic Modeling & Simulation Lecture 17 : Probabilistic Inventory Models part 2.
Computational Stochastic Optimization:
1 FIFTH International Conference on ``Analysis of Manufacturing Systems -- Production Management'‘ Zakynthos, Greece, 2005 QUEUEING MODELS FOR MANAGING.
DYNAMIC POWER ALLOCATION AND ROUTING FOR TIME-VARYING WIRELESS NETWORKS Michael J. Neely, Eytan Modiano and Charles E.Rohrs Presented by Ruogu Li Department.
All Hands Meeting, 2006 Title: Grid Workflow Scheduling in WOSE (Workflow Optimisation Services for e- Science Applications) Authors: Yash Patel, Andrew.
Planning under Uncertainty
Analyzing Multi-channel MAC Protocols for Underwater Sensor Networks Presenter: Zhong Zhou.
1 HEURISTICS FOR DYNAMIC SCHEDULING OF MULTI-CLASS BASE-STOCK CONTROLLED SYSTEMS Bora KAT and Zeynep Müge AVŞAR Department of Industrial Engineering Middle.
*Sponsored in part by the DARPA IT-MANET Program, NSF OCE Opportunistic Scheduling with Reliability Guarantees in Cognitive Radio Networks Rahul.
On Uniform Amplification of Hardness in NP Luca Trevisan STOC 05 Paper Review Present by Hai Xu.
Service Disciplines for Guaranteed Performance Service Hui Zhang, “Service Disciplines for Guaranteed Performance Service in Packet-Switching Networks,”
1 DYNAMIC SCHEDULING OF A PARALLEL SERVER SYSTEM IN HEAVY TRAFFIC UNDER A COMPLETE RESOURCE POOLING CONDITION Ruth J. Williams University of California,
1 A Second Stage Network Recourse Problem in Stochastic Airline Crew Scheduling Joyce W. Yen University of Michigan John R. Birge Northwestern University.
/faculteit technologie management An Integrated Approach to Inventory and Flexible Capacity Management under Non-stationary Stochastic Demand and Set-up.
On Stochastic Minimum Spanning Trees Kedar Dhamdhere Computer Science Department Joint work with: Mohit Singh, R. Ravi (IPCO 05)
Differentiating customer service on the basis of delivery lead-times Presented by: Y. Levent Kocaga.
Smooth Priorities for Make-to-Stock Inventory Control Carlos F. G. Bispo Instituto de Sistemas e Robótica – Instituto Superior Técnico Technical Univ.
Nonlinear Stochastic Programming by the Monte-Carlo method Lecture 4 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO.
Improved results for a memory allocation problem Rob van Stee University of Karlsruhe Germany Leah Epstein University of Haifa Israel WADS 2007 WAOA 2007.
ADITI BHAUMICK ab3585. To use reinforcement learning algorithm with function approximation. Feature-based state representations using a broad characterization.
Package Transportation Scheduling Albert Lee Robert Z. Lee.
Asaf Cohen (joint work with Rami Atar) Department of Mathematics University of Michigan Financial Mathematics Seminar University of Michigan March 11,
Multiple-access Communication in Networks A Geometric View W. Chen & S. Meyn Dept ECE & CSL University of Illinois.
ICALP'05Stochastic Steiner without a Root1 Stochastic Steiner Trees without a Root Martin Pál Joint work with Anupam Gupta.
Primal-Dual Meets Local Search: Approximating MST’s with Non-uniform Degree Bounds Author: Jochen Könemann R. Ravi From CMU CS 3150 Presentation by Dan.
ECES 741: Stochastic Decision & Control Processes – Chapter 1: The DP Algorithm 1 Chapter 1: The DP Algorithm To do:  sequential decision-making  state.
Planning Production of a Set of Semiconductor Components with Uncertain Wafer and Component Yield Frank W. Ciarallo Assistant Professor Biomedical, Industrial.
A Framework for Distributed Model Predictive Control
Page 1 Intelligent Quality of Service Routing for Terrestrial and Space Networks Funda Ergun Case Western Reserve University.
Transformation of Timed Automata into Mixed Integer Linear Programs Sebastian Panek.
© 2009 IBM Corporation 1 Improving Consolidation of Virtual Machines with Risk-aware Bandwidth Oversubscription in Compute Clouds Amir Epstein Joint work.
17 th International Teletraffic Congress Topological design of telecommunication networks Michał Pióro a,b, Alpar Jüttner c, Janos Harmatos c, Áron Szentesi.
Influence Maximization in Dynamic Social Networks Honglei Zhuang, Yihan Sun, Jie Tang, Jialin Zhang, Xiaoming Sun.
Web Caching and Content Distribution: A View From the Interior Syam Gadde Jeff Chase Duke University Michael Rabinovich AT&T Labs - Research.
ECES 741: Stochastic Decision & Control Processes – Chapter 1: The DP Algorithm 31 Alternative System Description If all w k are given initially as Then,
1 ECE-517 Reinforcement Learning in Artificial Intelligence Lecture 7: Finite Horizon MDPs, Dynamic Programming Dr. Itamar Arel College of Engineering.
On a Production/Inventory System with Strategic Customers and Unobservable Inventory Levels Can Oz Fikri Karaesmen SMMSO June 2015.
Control for Stochastic Models via Diffusion Approximations Amy Ward, ANS Lecture Series 2008 TexPoint fonts used in EMF. Read the TexPoint manual before.
Blind Fair Routing in Large-Scale Service Systems Mor Armony Stern School of Business, NYU *Joint work with Amy Ward TexPoint fonts used in EMF. Read the.
Yoni Nazarathy Gideon Weiss University of Haifa Yoni Nazarathy Gideon Weiss University of Haifa The Asymptotic Variance of the Output Process of Finite.
1 Optimal Inventory-Backorder Tradeoff in an Assemble-to-Order System with Random Leadtimes Yingdong Lu – IBM T.J. Watson Research Center Jing-Sheng Song.
Stochastic Multicast with Network Coding Ajay Gopinathan, Zongpeng Li Department of Computer Science University of Calgary ICDCS 2009, June , Montreal.
Tactical Planning in Healthcare with Approximate Dynamic Programming Martijn Mes & Peter Hulshof Department of Industrial Engineering and Business Information.
Energy-Efficient Sensor Network Design Subject to Complete Coverage and Discrimination Constraints Frank Y. S. Lin, P. L. Chiu IM, NTU SECON 2005 Presenter:
4th Annual INFORMS Revenue Management and Pricing Section Conference, June 2004 An Asymptotically-Optimal Dynamic Admission Policy for a Revenue Management.
Mobile Agent Migration Problem Yingyue Xu. Energy efficiency requirement of sensor networks Mobile agent computing paradigm Data fusion, distributed processing.
ORSIS Conference, Jerusalem Mountains, Israel May 13, 2007 Yoni Nazarathy Gideon Weiss University of Haifa Yoni Nazarathy Gideon Weiss University of Haifa.
The (Q, r) Model.
Optimal Resource Allocation for Protecting System Availability against Random Cyber Attack International Conference Computer Research and Development(ICCRD),
CUHK Learning-Based Power Management for Multi-Core Processors YE Rong Nov 15, 2011.
Approximating the Performance of Call Centers with Queues using Loss Models Ph. Chevalier, J-Chr. Van den Schrieck Université catholique de Louvain.
An Optimal Distributed Call Admission control for Adaptive Multimedia in Wireless/Mobile Networks Reporter: 電機所 鄭志川.
Introduction to Management Science / Operations Research What is Operations Research? Management Science? Operations research is concerned with scientifically.
Inventories with Multiple Supply Sources and Networks of Queues with Overflow Bypasses Jing-Sheng Song Paul Zipkin Duke University WLU, 25 April, 2008.
Optimization of Nonlinear Singularly Perturbed Systems with Hypersphere Control Restriction A.I. Kalinin and J.O. Grudo Belarusian State University, Minsk,
Sporadic model building for efficiency enhancement of the hierarchical BOA Genetic Programming and Evolvable Machines (2008) 9: Martin Pelikan, Kumara.
Simulation Modeling and Analysis Ernesto Gutierrez-Miravete Rensselaer at Hartford October 14th, 2003.
Smart Sleeping Policies for Wireless Sensor Networks Venu Veeravalli ECE Department & Coordinated Science Lab University of Illinois at Urbana-Champaign.
IE 312 Review 1. The Process 2 Problem Model Conclusions Problem Formulation Analysis.
R. Brafman and M. Tennenholtz Presented by Daniel Rasmussen.
Lecture 20 Review of ISM 206 Optimization Theory and Applications.
Nitzan Carmeli Advisors: Prof. Haya Kaspi, Prof. Avishai Mandelbaum
Jason A. Fuemmeler, and Venugopal V. Veeravalli Edwin Lei
Sachin Jayaswal Department of Management Sicences
Project Presentation   For
Javad Ghaderi, Tianxiong Ji and R. Srikant
Presentation transcript:

Page 1 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 Discussion of Marty Reiman’s Markov Lecture A Stochastic Programming Based Approach to ATO Inventory Systems Alan Scheller-Wolf Tepper School of Business or New Frontiers in ATO or The Continuing Evolution of a Great Idea

Page 2 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 Background for My Talk Like Amy, and probably most of you, I have been familiar with Marty’s asymptotic analysis of queueing networks for some time –This is work I admired, but it was outside my primary stream of research Within the past few years, led by student interest, I have begun to work on ATO systems –And whose work should I find dead center in in my research stream? Marty’s!

Page 3 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 ATO: So what’s the Problem? n Components m Products Inventory replenishmentAnd allocation! Highly dependent Highly multi-dimensional And non-linear!

Page 4 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 Selected Literature (I) Structural Results: –Special product architectures Markovian systems: Benjafaar and ElHafsi (‘06); ElHafsi (‘08); Nadar et al. (‘12) SP Analysis: DRW (‘10); Lu et al. (‘12); RW (‘12) Heavy Traffic: Plambeck and Ward (‘07, ‘08); RW (‘13) –No-Holdback: Song and Zhao (‘2009), Lu et al. (‘2010) General results still lacking

Page 5 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 Selected Literature (II) Optimization Results: –Approximations: Zhang (‘97); Song (‘98); Song and Yao (‘02); Cheng et al. (‘02); Kapucinski et al. (‘04); Lu and Song (‘05); van Jaarsveld et al. (‘11) –SP Formulations: Swaminathan and Tayur (’98); Akcay and Xu (’04); Huang and de Kok (‘11), van Jaarsveld and S-W (‘13) Limited problem size. No guarantees*

Page 6 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 “New” Ideas are Needed The “New” Idea: –Heavy Traffic Approach – “same hammer, new nail.” The New Idea: –Stochastic programming lower bound using full recourse Both ideas continue to evolve…

Page 7 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 DRW ’10 (I) Formulate ATO problem as two-stage SP, like NV Network –Assume identical LT’s Formulate second, Lower Bound SP by: –Giving controller complete freedom to reallocate inventory over the leadtime demand –Giving controller complete freedom to select initial backlog level

Page 8 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 DRW ’10 (II) – So What!? New LB: –Obliterates dependence of ordering policy on the past, as controller has complete freedom to reallocate decisions Makes base-stock ordering optimal –Forms universal lower bound over all policies –Provides guidance for “good” (maybe optimal) policies for original problem Follow LB policy when possible A great idea

Page 9 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 But… New LB: –Limited to identical lead times –Translating SP solution into actionable allocation policy can be difficult

Page 10 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 RW ’12 See evolution of LB: –Extended to non-identical leadtimes Creates (K+1) stage SP –Verification Lemma: Provide sufficient conditions for when can track SP optimal policy Now can determine quality of solutions in some cases

Page 11 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 RW ’13 Show sol of SP optimal under diffusion scaling Further evolution (reformulation) of LB: –Finite parameters at optimality –Actionable Backlog Targeting Heuristic Now can more easily implement policy implied by SP So what’s next?

Page 12 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 The Next Stages in Evolution? Extend asymptotic results to unequal LT’s and/or non-base stock replenishment Extend to industrial-sized problems –Make applicable in practice

Page 13 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 What About Practice? (I) Companies use a variety of simplifying assumptions: –Ignoring simultaneous stock outs (ISS): Wait time for product n is sum of wait time for components –Simpler allocation rules: First come first served (FCFS); First Ready First Served (FRFS)

Page 14 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 What About Practice? (II) Van Jaarsveld and SW (‘13) provide two-stage SP algorithm for larger problems –Tagged Job approach for waiting time –Novel formulation of second-stage SAA High-quality asymptotic lower bound –Limited to base stock + selected allocation rules Can DRW methodology be extended to practical- sized problems?

Page 15 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 Extending DRW to Larger Problems Requires workable solution to SP with unequal lead times –(K+1) stages may be too many Requires efficient way to solve allocation problem for optimal backlog targets This appears very promising

Page 16 Alan Scheller-Wolf INFORMS Minneapolis October 6, 2013 Conclusion ATO is classically difficult problem –Requires new solution approaches Marty and co-authors continue to provide these As ideas evolve, new results become possible It is exciting to follow evolution and see where this leads… Stay Tuned!