Bounding Variance and Expectation of Longest Path Lengths in DAGs Jeff Edmonds, York University Supratik Chakraborty, IIT Bombay.

Slides:



Advertisements
Similar presentations
Primal-dual Algorithm for Convex Markov Random Fields Vladimir Kolmogorov University College London GDR (Optimisation Discrète, Graph Cuts et Analyse d'Images)
Advertisements

Routing and Congestion Problems in General Networks Presented by Jun Zou CAS 744.
Minimum Clique Partition Problem with Constrained Weight for Interval Graphs Jianping Li Department of Mathematics Yunnan University Jointed by M.X. Chen.
Optimization Problems in Optical Networks. Wavelength Division Multiplexing (WDM) Directed: Symmetric: Undirected: Optic Fiber.
3.3 Hypothesis Testing in Multiple Linear Regression
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
ECE Longest Path dual 1 ECE 665 Spring 2005 ECE 665 Spring 2005 Computer Algorithms with Applications to VLSI CAD Linear Programming Duality – Longest.
Bipartite Matching, Extremal Problems, Matrix Tree Theorem.
Yaochen Kuo KAINAN University . SLIDES . BY.
ISE480 Sequencing and Scheduling Izmir University of Economics ISE Fall Semestre.
1 1 Slide Continuous Probability Distributions Chapter 6 BA 201.
Algorithms and Networks
Ch11 Curve Fitting Dr. Deshi Ye
Five Problems CSE 421 Richard Anderson Winter 2009, Lecture 3.
Precedence Constrained Scheduling Abhiram Ranade Dept. of CSE IIT Bombay.
Precedence Constrained Scheduling Abhiram Ranade Dept. of CSE IIT Bombay.
Chapter 6 Continuous Random Variables and Probability Distributions
Rules for means Rule 1: If X is a random variable and a and b are fixed numbers, then Rule 2: If X and Y are random variables, then.
Statistical timing and synthesis Chandu paper. Canonical form Compute max(A,B) = C in canonical form (assuming  X i independent)
PSY 307 – Statistics for the Behavioral Sciences
Maximum Flows Lecture 4: Jan 19. Network transmission Given a directed graph G A source node s A sink node t Goal: To send as much information from s.
1 Regular Grammars Generate Regular Languages. 2 Theorem Regular grammars generate exactly the class of regular languages: If is a regular grammar then.
CONTINUOUS RANDOM VARIABLES Continuous random variables take all values in an interval Too many values! Impossible to list them all! How to describe a.
DAST 2005 Week 4 – Some Helpful Material Randomized Quick Sort & Lower bound & General remarks…
Continuous Random Variables and Probability Distributions
VLSI DSP 2008Y.T. Hwang3-1 Chapter 3 Algorithm Representation & Iteration Bound.
T T Population Variance Confidence Intervals Purpose Allows the analyst to analyze the population confidence interval for the variance.
Penn ESE535 Spring DeHon 1 ESE535: Electronic Design Automation Day 15: March 18, 2009 Static Timing Analysis and Multi-Level Speedup.
1 IOE/MFG 543 Chapter 7: Job shops Sections 7.1 and 7.2 (skip section 7.3)
Math – Getting Information from the Graph of a Function 1.
Algorithms 2005 Ramesh Hariharan.
Approximating the MST Weight in Sublinear Time Bernard Chazelle (Princeton) Ronitt Rubinfeld (NEC) Luca Trevisan (U.C. Berkeley)
A Fast Algorithm for Enumerating Bipartite Perfect Matchings Takeaki Uno (National Institute of Informatics, JAPAN)
Error Analysis Accuracy Closeness to the true value Measurement Accuracy – determines the closeness of the measured value to the true value Instrument.
Distributed Coloring Discrete Mathematics and Algorithms Seminar Melih Onus November
Adaptive CSMA under the SINR Model: Fast convergence using the Bethe Approximation Krishna Jagannathan IIT Madras (Joint work with) Peruru Subrahmanya.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
How to reform a terrain into a pyramid Takeshi Tokuyama (Tohoku U) Joint work with Jinhee Chun (Tohoku U) Naoki Katoh (Kyoto U) Danny Chen (U. Notre Dame)
On s-t paths and trails in edge-colored graphs L. Gourvès, A. Lyra*, C. Martinhon, J. Monnot, F. Protti Lagos 2009 (RS, Brazil)
Computer Science and Engineering Parallel and Distributed Processing CSE 8380 March 08, 2005 Session 16.
Ch 6-1 © 2004 Pearson Education, Inc. Pearson Prentice Hall, Pearson Education, Upper Saddle River, NJ Ostwald and McLaren / Cost Analysis and Estimating.
1 Chapter 6 Continuous Probability Distributions.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
Robust System Design Session #11 MIT Plan for the Session Quiz on Constructing Orthogonal Arrays (10 minutes) Complete some advanced topics on OAs Lecture.
CS Statistical Machine learning Lecture 24
Pipelining and Retiming
Network Flows. Menger ’ s Theorem Theorem 7.1. (Menger [1927] ) Let G be a graph (directed or undirected), let s and t be two vertices, and k  N. Then.
Spanning tree Lecture 4.
Continuous Random Variables and Probability Distributions
Javad Azimi, Ali Jalali, Xiaoli Fern Oregon State University University of Texas at Austin In NIPS 2011, Workshop in Bayesian optimization, experimental.
A stochastic scheduling algorithm for precedence constrained tasks on Grid Future Generation Computer Systems (2011) Xiaoyong Tang, Kenli Li, Guiping Liao,
1 Chapter 7 Network Flow Slides by Kevin Wayne. Copyright © 2005 Pearson-Addison Wesley. All rights reserved.
1 Proving Properties of Recursive Functions and Data Structures CS 270 Math Foundations of CS Jeremy Johnson.
Introduction For inference on the difference between the means of two populations, we need samples from both populations. The basic assumptions.
New Characterizations in Turnstile Streams with Applications
Approximating the MST Weight in Sublinear Time
Algorithms and Networks
Chapter 5. Optimal Matchings
Chapter 7 Network Flow Slides by Kevin Wayne. Copyright © 2005 Pearson-Addison Wesley. All rights reserved.
Instructor: Shengyu Zhang
CSE Algorithms Max Flow Problems 11/21/02 CSE Max Flow.
CSE838 Lecture notes copy right: Moon Jung Chung
Markov Random Fields Presented by: Vladan Radosavljevic.
1.1- Relations and Functions
Functions and Their Properties II
CS 583 Analysis of Algorithms
Chapter 4. Supplementary Questions
ADDITIONAL ANALYSIS TECHNIQUES
Presentation transcript:

Bounding Variance and Expectation of Longest Path Lengths in DAGs Jeff Edmonds, York University Supratik Chakraborty, IIT Bombay

Motivation  Statistical timing analysis of circuits  Mean and std deviation of component delays provided by manufacturers  Joint distributions of component delays difficult to obtain in practice

The Longest Path Problem  Input:  st-DAG G gives job precedence.  For each edge i, x i is the time to complete job i  Output:  Time for all jobs to complete in parallel = length of longest st-path = Max p  i  p x i = X G t x1x1 x2x2 s x3x3 Easy with Dynamic Programming

The Longest Path Problem  Input:  st-DAG G gives job precedence.  For each edge i, x i is the time to complete job i  Output:  Time for all jobs to complete in parallel = length of longest st-path = Max p  i  p x i = X G t x1x1 x2x2 s x3x3 Inter-dependent random variables Understand random variable X G

The Longest Path Problem  Input:  st-DAG G gives job precedence.  For each edge i, x i is the time to complete job i  Output:  Time for all jobs to complete in parallel = length of longest st-path = Max p  i  p x i = X G t x1x1 x2x2 s x3x3 Exp[X i ] & Var[X i ] Bound Exp[X G ] & Var[X G ]

The Longest Path Problem  Input: t x1x1 x2x2 s x3x3 G(x 1, x 2, x 3 ) x G Exp(2, 2, 4) ? Var(1, 1, 0) ? Prob(x 1, x 2, x 3 ) x G 0.5(1, 1, 4) 4 0.5(3, 3, 4) 6  Possible distributions : Prob(x 1, x 2, x 3 ) x G 0.5(1, 3, 4) 4 0.5(3, 1, 4) 4  Another possibility : X G = Max( x 1 +x 2, x 3 )

The Longest Path Problem  Input: t x1x1 x2x2 s x3x3 G(x 1, x 2, x 3 ) x G Exp(2, 2, 4) ? Var(1, 1, 0) ? Upper & Lower bounds X G = Max( x 1 +x 2, x 3 )

Contributions  Upper bounds of Exp[X G ] and Var[X G ]  A spring “algorithm” for computing bounds  Proof no distributions give higher values (skip)  Cake distributions that achieve bounds  Lower bounds of Exp[X G ] and Var[X G ]  Continuum of values for Exp[X G ] and Var[X G ]  Cake distributions that achieve any Exp[X G ] and Var[X G ] within range  Special results for series-parallel graphs

Series Graphs If G is a series graph, X G = ∑ i x i Exp[x G ] = ∑ i Exp[x i ] 0 ≤ Var[x G ] ≤ (∑ i √Var[x i ] ) 2 t s

Series Graphs If G is a parallel graph, X G = Max i x i Max i Exp[x i ] ≤ Exp[x G ] ≤ ? 0 ≤ Var[x G ] ≤ ? t s

Representing Random Variables r X X : Two-valued random variable, prob 0.5 for each value 0.5

Representing Random Variables r X 0.5 X, Z : Two equivalent independent random variables. Z

Representing Random Variables r XY X, Y : Two-valued random variables, prob 0.5 for each value X, Y have perfect negative correlation 0.5 Exp( Max(x,y) ) = Exp(x) + Exp(y) Var( Max(x,y) ) = 0

Series Graphs If G is a parallel graph, X G = Max i x i Max i Exp[x i ] ≤ Exp[x G ] ≤ Min( ∑ i Exp[x i ], Max i Exp[x i ] + √∑ i Var[x i ] ) 0 ≤ Var[x G ] ≤ ∑ i Var[x i ] t s

Series Parallel Graphs Theorem In a series-parallel graph, Rules for maximum variance applied recursively to obtain Max Var[X G ]. Not so Max Exp[X G ]

Maximizing Var [ X G ] There are no distributions x i for which  Var[x i ] = v i and Exp[x i ] = m i  Var[X G ] > Proof uses lots of calculus. Theorem

Cakes Maximizing Var [ X G ] There exists “cake” distributions x i such that  Var[x i ] = v i and Exp[x i ] = m i  Var[X G ] = Theorem

Cake Distribution t s G(x 1, x 2,...) x G Exp(2, 8,....) ? Var(3, 2,....) ? Find a cake distribution for each edge with correct Exp[x i ] & Var[x i ] to maximize Var[x G ]

Cake Distribution t s G(x 1, x 2,...) x G Exp(2, 8,....) ? Var(3, 2,....) ? Exp[x i ]

Cake Distribution t s G(x 1, x 2,...) x G Exp(2, 8,....) ? Var(3, 2,....) ? Var[x i ] = ∑ c (ε h c ) 2

Cake Distribution t s G(x 1, x 2,...) x G Exp(2, 8,....) ? Var(3, 2,....) ? Series graphs G: X G ≈ x 1 + x 2 Candle heights add Want candle heights to be in same location

Cake Distribution t s G(x 1, x 2,...) x G Exp(2, 8,....) ? Var(3, 2,....) ? Parallel graphs G: X G ≈ Max( x 1, x 2 ) Candle heights max Want candle heights to be in different location

Cake Distribution t s A candle location for each st-path in G G(x 1, x 2,...) x G Exp(2, 8,....) ? Var(3, 2,....) ? but in the end # candles ≈ # edges

Cake Distribution t s If edge i not in path p, candle for x i at location p has height 0 G(x 1, x 2,...) x G Exp(2, 8,....) ? Var(3, 2,....) ? If candle is selected, then corresponding path p is the longest path

Cake Distribution t s G(x 1, x 2,...) x G Exp(2, 8,....) ? Var(3, 2,....) ? “Springs” give give candle heights.

Cakes Maximizing Var [ X G ] There exists “cake” distributions x i such that  Var[x i ] = v i and Exp[x i ] = m i  Var[X G ] = Theorem Proved

Lower Bound of Var[ X G ] Theorem Var[x G ] ≥ 0 Continuum Results Theorem Every Var[X G ] in this range achievable.

Lower bound of Exp [ X G ]

r 01 XGXG Upper bound of Exp [ X G ] pp For st-path p,  p is interval for which p is the longest path.  p  P  p = 1

r 01 XGXG Upper bound of Exp [ X G ] pp ii For edge i,  i is interval for which i is in the longest path.  i =  p  i  p

r 01 XiXi Upper bound of Exp [ X G ] pp ii If it can edge i contributes all of its m i =Exp[X i ] to Exp[X G ]

r 01 XiXi Upper bound of Exp [ X G ] pp ii But if v i = Var[X i ] is too small, it can only contribute

r 01 XGXG Upper bound of Exp [ X G ] pp ii

Conclusion & Future Work  Tight analysis for upper bounds was achieved  Cake distributions particularly important for achieving tight bounds  A related question is that of finding tight bounds of mean and expectation of difference in longest paths to two given nodes in a DAG  Spring algorithm involves solving non-linear constraints iteratively. Can an alternative algorithm be obtained?