CSE808 F'99Xiangping Chen1 Simulation of Rare Events in Communications Networks J. Keith Townsend Zsolt Haraszti James A. Freebersyser Michael Devetsikiotis.

Slides:



Advertisements
Similar presentations
Bayesian Belief Propagation
Advertisements

Generating Random Numbers
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
CHAPTER 8 A NNEALING- T YPE A LGORITHMS Organization of chapter in ISSO –Introduction to simulated annealing –Simulated annealing algorithm Basic algorithm.
CHAPTER 2 D IRECT M ETHODS FOR S TOCHASTIC S EARCH Organization of chapter in ISSO –Introductory material –Random search methods Attributes of random search.
Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 19 Scheduling IV.
Gizem ALAGÖZ. Simulation optimization has received considerable attention from both simulation researchers and practitioners. Both continuous and discrete.
1 Rare Event Simulation Estimation of rare event probabilities with the naive Monte Carlo techniques requires a prohibitively large number of trials in.
Evaluation.
Kuang-Hao Liu et al Presented by Xin Che 11/18/09.
Date:2011/06/08 吳昕澧 BOA: The Bayesian Optimization Algorithm.
Importance Sampling. What is Importance Sampling ? A simulation technique Used when we are interested in rare events Examples: Bit Error Rate on a channel,
Appropriate Sampling Ann Abbott Rocky Mountain Research Station
Output Analysis and Experimentation for Systems Simulation.
MAE 552 – Heuristic Optimization Lecture 6 February 6, 2002.
Job Release-Time Design in Stochastic Manufacturing Systems Using Perturbation Analysis By: Dongping Song Supervisors: Dr. C.Hicks & Dr. C.F.Earl Department.
Evaluation.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Evaluating Hypotheses
Simulated Annealing Van Laarhoven, Aarts Version 1, October 2000.
Planning operation start times for the manufacture of capital products with uncertain processing times and resource constraints D.P. Song, Dr. C.Hicks.
Non-parametric Bayesian value of information analysis Aim: To inform the efficient allocation of research resources Objectives: To use all the available.
Lehrstuhl für Informatik 2 Gabriella Kókai: Maschine Learning 1 Evaluating Hypotheses.
Saturation, Flat-spotting Shift up Derivative Weight Decay No derivative on output nodes.
Monte Carlo Methods in Partial Differential Equations.
Advanced Image Processing Image Relaxation – Restoration and Feature Extraction 02/02/10.
Data Selection In Ad-Hoc Wireless Sensor Networks Olawoye Oyeyele 11/24/2003.
CHAPTER 15 S IMULATION - B ASED O PTIMIZATION II : S TOCHASTIC G RADIENT AND S AMPLE P ATH M ETHODS Organization of chapter in ISSO –Introduction to gradient.
Introduction to Monte Carlo Methods D.J.C. Mackay.
Data Mining Practical Machine Learning Tools and Techniques Slides for Chapter 5 of Data Mining by I. H. Witten, E. Frank and M. A. Hall 報告人:黃子齊
Particle Filtering in Network Tomography
1 Hybrid methods for solving large-scale parameter estimation problems Carlos A. Quintero 1 Miguel Argáez 1 Hector Klie 2 Leticia Velázquez 1 Mary Wheeler.
A Framework for Distributed Model Predictive Control
Stochastic Algorithms Some of the fastest known algorithms for certain tasks rely on chance Stochastic/Randomized Algorithms Two common variations – Monte.
Chap 20-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 20 Sampling: Additional Topics in Sampling Statistics for Business.
Module 1: Statistical Issues in Micro simulation Paul Sousa.
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
Chih-Ming Chen, Student Member, IEEE, Ying-ping Chen, Member, IEEE, Tzu-Ching Shen, and John K. Zao, Senior Member, IEEE Evolutionary Computation (CEC),
1 Simulated Annealing Contents 1. Basic Concepts 2. Algorithm 3. Practical considerations.
Combining Statistical Language Models via the Latent Maximum Entropy Principle Shaojum Wang, Dale Schuurmans, Fuchum Peng, Yunxin Zhao.
Statistical Sampling-Based Parametric Analysis of Power Grids Dr. Peng Li Presented by Xueqian Zhao EE5970 Seminar.
ECE 8443 – Pattern Recognition LECTURE 07: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Class-Conditional Density The Multivariate Case General.
Brian Macpherson Ph.D, Professor of Statistics, University of Manitoba Tom Bingham Statistician, The Boeing Company.
Lecture 2 Basics of probability in statistical simulation and stochastic programming Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius,
Probability and Measure September 2, Nonparametric Bayesian Fundamental Problem: Estimating Distribution from a collection of Data E. ( X a distribution-valued.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc.. Chap 7-1 Chapter 7 Sampling Distributions Basic Business Statistics.
CAS 721 Course Project Implementing Branch and Bound, and Tabu search for combinatorial computing problem By Ho Fai Ko ( )
Lecture V Probability theory. Lecture questions Classical definition of probability Frequency probability Discrete variable and probability distribution.
Vaida Bartkutė, Leonidas Sakalauskas
Reactive Tabu Search Contents A brief review of search techniques
The final exam solutions. Part I, #1, Central limit theorem Let X1,X2, …, Xn be a sequence of i.i.d. random variables each having mean μ and variance.
Sampling and estimation Petter Mostad
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
John Lafferty Andrew McCallum Fernando Pereira
Review of Statistical Terms Population Sample Parameter Statistic.
Sampling Theory and Some Important Sampling Distributions.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
Monte Carlo Linear Algebra Techniques and Their Parallelization Ashok Srinivasan Computer Science Florida State University
Parameter Estimation. Statistics Probability specified inferred Steam engine pump “prediction” “estimation”
Using MDP Characteristics to Guide Exploration in Reinforcement Learning Paper: Bohdana Ratich & Doina Precucp Presenter: Michael Simon Some pictures/formulas.
Data Mining Practical Machine Learning Tools and Techniques By I. H. Witten, E. Frank and M. A. Hall Chapter 5: Credibility: Evaluating What’s Been Learned.
1 Contents 1. Basic Concepts 2. Algorithm 3. Practical considerations Simulated Annealing (SA)
7th Int'l Workshop on Rare Event Simulation, Sept , Rennes, France Ant Colony Optimized Importance Sampling: Principles, Applications and Challenges.
OPERATING SYSTEMS CS 3502 Fall 2017
Goal We present a hybrid optimization approach for solving global optimization problems, in particular automated parameter estimation models. The hybrid.
Slides for Introduction to Stochastic Search and Optimization (ISSO) by J. C. Spall CHAPTER 15 SIMULATION-BASED OPTIMIZATION II: STOCHASTIC GRADIENT AND.
Metaheuristic methods and their applications. Optimization Problems Strategies for Solving NP-hard Optimization Problems What is a Metaheuristic Method?
Xin-She Yang, Nature-Inspired Optimization Algorithms, Elsevier, 2014
Uniform Probability Distribution
Stochastic Methods.
Presentation transcript:

CSE808 F'99Xiangping Chen1 Simulation of Rare Events in Communications Networks J. Keith Townsend Zsolt Haraszti James A. Freebersyser Michael Devetsikiotis

CSE808 F'99Xiangping Chen2 Background Rare event probabilities in communication networks. Require prohibitively long simulation times How to reducing simulation execution time while retain the ease and flexibility of simulation? --- Importance Sampling based techniques.

CSE808 F'99Xiangping Chen3 What is IS? Combination of analysis and simulation. Modifying (biasing) the underlying probability mass so that the rare events occur much more frequently. Results are weighted to yield a statistically unbiased estimator.

CSE808 F'99Xiangping Chen4 Objective Significant reduction in the number of trials while maintain the estimator precision. –Which parameter(s) of the system to bias? –How much to bias each of them? –What is the speedup?

CSE808 F'99Xiangping Chen5 Importance Sampling example

CSE808 F'99Xiangping Chen6 Techniques Modification of Individual Stochastic Elements Global Modification via Trajectory Splitting

CSE808 F'99Xiangping Chen7 Modification of Individual Stochastic Elements Modifying the probability distributions of one or more random number generators in the simulation model. Requires considerable prior knowledge about the system.

CSE808 F'99Xiangping Chen8 Global Modification via Trajectory Splitting Assumption: some well identifiable intermediate system states are visited much more often than the target states and behave as gateway states to reach the target states. Entering the intermediate states triggers the splitting of the trajectory. Step-by-step evolution of the system follows the original probability measure.

CSE808 F'99Xiangping Chen9 Trajectory splitting Example - DPR DPR - Direct probability redistribution Partitions the state-space S into m subsets, S 1, S 2, … S m. Oversampling factors,  1 <  2 <... <  m. Every state S i is visited  i more times. Unbiased factors are obtained by weighting a subset-dependent factor 1/   (S i ).

CSE808 F'99Xiangping Chen10 Tuning/Optimization of Parameters Large deviations, effective and decoupling bandwidths Stochastic optimization Conditional biasing Iterative balancing for trajectory splitting

CSE808 F'99Xiangping Chen11 LDT - Large Deviation Theory Specify the biased distributions as  - conjugate exponentially twisted versions of original, unbiased distribution. Effective bandwidths is invoked to determine the value of . –A(  ) = lim n   (1/n)log E exp[   n i=1 A i ] –d(  ) = A(  ) /  is the effective Bandwidth.

CSE808 F'99Xiangping Chen12 LDT Continued  value is equal to the service rate in a single queue with deterministic service. Additive property of effective bandwidths is used to describe multiple streams sharing the same queue. Decoupling bandwidths is used to provide sufficient conditions of a specific tagged stream.

CSE808 F'99Xiangping Chen13 Stochastic Optimization The mean field annealing (MFA) algorithm is a variant of simulated annealing (SA) that avoids local minima and arrives at optimal solutions in more rapid convergence. The stochastic gradient descent (SGD) algorithm can potentially zero in on favorable bias parameter settings fast by exploiting more information at hand.

CSE808 F'99Xiangping Chen14 Conditional Biasing An important IS technique that is effective in uniform probability distributions (UPD). Prior knowledge is used to partition the UPD into intervals that result in the important events or not. Requirement: occurrence of any sequence of random variables resulting in an important events not be excluded from the biased random variable selection process.

CSE808 F'99Xiangping Chen15 Iterative Balancing for Trajectory Splitting To find appropriate partitioning To choose the correct amount of splitting Near optimal  setting is when the subset probability masses are equalized. A simple iterative procedure can explore subset probabilities in a step-by-step fashion.

CSE808 F'99Xiangping Chen16 Application Examples Steady-state simulation of cell loss probability –Regenerative method or A-cycles Application of stochastic optimization –Tandem ATM network Application of Conditional Biasing –ATM switch is described using operational approach Application of DPR-based Splitting Simulation –Systems with internal loop

CSE808 F'99Xiangping Chen17 Conclusion Proves to be effective although it requires problem-specific analytical phase Simulation will be used to evaluate more complicated networks More reliable networks will be characterized by rarer events IS is more important in the future.