Why is it useful to walk randomly? László Lovász Mathematical Institute Eötvös Loránd University October 20121.

Slides:



Advertisements
Similar presentations
Lower Bounds for Local Search by Quantum Arguments Scott Aaronson (UC Berkeley) August 14, 2003.
Advertisements

Generating Random Spanning Trees Sourav Chatterji Sumit Gulwani EECS Department University of California, Berkeley.
Slow and Fast Mixing of Tempering and Swapping for the Potts Model Nayantara Bhatnagar, UC Berkeley Dana Randall, Georgia Tech.
The Cover Time of Random Walks Uriel Feige Weizmann Institute.
Size-estimation framework with applications to transitive closure and reachability Presented by Maxim Kalaev Edith Cohen AT&T Bell Labs 1996.
Presentation by: Drew Wichmann Paper by: Samer Hanoun and Saeid Nahavandi 1.
Nonlinear methods in discrete optimization László Lovász Eötvös Loránd University, Budapest
Eigenvalues and geometric representations of graphs László Lovász Microsoft Research One Microsoft Way, Redmond, WA 98052
Randomized Algorithms Kyomin Jung KAIST Applied Algorithm Lab Jan 12, WSAC
Approximation Algorithms for Unique Games Luca Trevisan Slides by Avi Eyal.
1 Heat flow and a faster Algorithm to Compute the Surface Area of a Convex Body Hariharan Narayanan, University of Chicago Joint work with Mikhail Belkin,
Hierarchical Decompositions for Congestion Minimization in Networks Harald Räcke 1.
Random Walks Ben Hescott CS591a1 November 18, 2002.
Parallel random walks Brian Moffat. Outline What are random walks What are Markov chains What are cover/hitting/mixing times Speed ups for different graphs.
CS774. Markov Random Field : Theory and Application Lecture 04 Kyomin Jung KAIST Sep
BAYESIAN INFERENCE Sampling techniques
Analysis of Network Diffusion and Distributed Network Algorithms Rajmohan Rajaraman Northeastern University, Boston May 2012 Chennai Network Optimization.
A Randomized Polynomial-Time Simplex Algorithm for Linear Programming Daniel A. Spielman, Yale Joint work with Jonathan Kelner, M.I.T.
CS774. Markov Random Field : Theory and Application Lecture 06 Kyomin Jung KAIST Sep
Support Vector Machines and Kernel Methods
Computational statistics 2009 Random walk. Computational statistics 2009 Random walk with absorbing barrier.
Geographic Gossip: Efficient Aggregations for Sensor Networks Author: Alex Dimakis, Anand Sarwate, Martin Wainwright University: UC Berkeley Venue: IPSN.
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
Complexity 1 Mazes And Random Walks. Complexity 2 Can You Solve This Maze?
Approximating Power Indices Yoram Bachrach(Hebew University) Evangelos Markakis(CWI) Ariel D. Procaccia (Hebrew University) Jeffrey S. Rosenschein (Hebrew.
Randomness in Computation and Communication Part 1: Randomized algorithms Lap Chi Lau CSE CUHK.
1 Analyzing Kleinberg’s (and other) Small-world Models Chip Martel and Van Nguyen Computer Science Department; University of California at Davis.
1 Trends in Mathematics: How could they Change Education? László Lovász Eötvös Loránd University Budapest.
Randomized Algorithms Morteza ZadiMoghaddam Amin Sayedi.
Randomness – A computational complexity view Avi Wigderson Institute for Advanced Study.
Approximating the MST Weight in Sublinear Time Bernard Chazelle (Princeton) Ronitt Rubinfeld (NEC) Luca Trevisan (U.C. Berkeley)
Ragesh Jaiswal Indian Institute of Technology Delhi Threshold Direct Product Theorems: a survey.
1 MCMC Style Sampling / Counting for SAT Can we extend SAT/CSP techniques to solve harder counting/sampling problems? Such an extension would lead us to.
Graph limit theory: Algorithms László Lovász Eötvös Loránd University, Budapest May
The Power and Weakness of Randomness (when you are short on time) Avi Wigderson School of Mathematics Institute for Advanced Study.
July The Mathematical Challenge of Large Networks László Lovász Eötvös Loránd University, Budapest
Algorithms on large graphs László Lovász Eötvös Loránd University, Budapest May
Expanders via Random Spanning Trees R 許榮財 R 黃佳婷 R 黃怡嘉.
Volume computation László Lovász Microsoft Research
Graph limit theory: an overview László Lovász Eötvös Loránd University, Budapest IAS, Princeton June
Monte Carlo Methods So far we have discussed Monte Carlo methods based on a uniform distribution of random numbers on the interval [0,1] p(x) = 1 0  x.
October Large networks: a new language for science László Lovász Eötvös Loránd University, Budapest
Optimization in very large graphs László Lovász Eötvös Loránd University, Budapest December
Local and global convergence in bounded degree graphs László Lovász Eötvös Loránd University, Budapest Joint work with Christian Borgs, Jennifer Chayes.
The mathematical challenge of large networks László Lovász Eötvös Loránd University, Budapest Joint work with Christian Borgs, Jennifer Chayes, Balázs.
Seminar on random walks on graphs Lecture No. 2 Mille Gandelsman,
The Markov Chain Monte Carlo Method Isabelle Stanton May 8, 2008 Theory Lunch.
CS 351/ IT 351 Modeling and Simulation Technologies Review ( ) Dr. Jim Holten.
CS774. Markov Random Field : Theory and Application Lecture 15 Kyomin Jung KAIST Oct
Graphs, Vectors, and Matrices Daniel A. Spielman Yale University AMS Josiah Willard Gibbs Lecture January 6, 2016.
Complexity and Efficient Algorithms Group / Department of Computer Science Testing the Cluster Structure of Graphs Christian Sohler joint work with Artur.
Date: 2005/4/25 Advisor: Sy-Yen Kuo Speaker: Szu-Chi Wang.
Presented by: Dardan Xhymshiti Spring 2016:. Authors: Publication:  ICDM 2015 Type:  Research Paper 2 Michael ShekelyamGregor JosseMatthias Schubert.
geometric representations of graphs
Classical mathematics and new challenges László Lovász Microsoft Research One Microsoft Way, Redmond, WA Theorems and Algorithms.
Discrete mathematics: the last and next decade László Lovász Microsoft Research One Microsoft Way, Redmond, WA 98052
MAT 4830 Mathematical Modeling 04 Monte Carlo Integrations
The Poincaré Constant of a Random Walk in High- Dimensional Convex Bodies Ivona Bezáková Thesis Advisor: Prof. Eric Vigoda.
Tilings, Geometric Representations, and Discrete Analytic Functions László Lovász Microsoft Research
STAT 534: Statistical Computing
Sampling algorithms and Markov chains László Lovász Microsoft Research One Microsoft Way, Redmond, WA 98052
Generating Random Spanning Trees via Fast Matrix Multiplication Keyulu Xu University of British Columbia Joint work with Nick Harvey TexPoint fonts used.
Random Sampling Algorithms with Applications Kyomin Jung KAIST Aug ERC Workshop.
Approximation algorithms
Sampling Distribution
Sampling Distribution
Hariharan Narayanan, University of Chicago Joint work with
Partitioning and decomposing graphs László Lovász
geometric representations of graphs
Hyperfinite graphs and combinatorial optimization László Lovász
Presentation transcript:

Why is it useful to walk randomly? László Lovász Mathematical Institute Eötvös Loránd University October 20121

Random walk on a graph October Graph G=(V,E)

Random walk on a graph October  t (v): probability of being at node v after t steps Stationary distribution

Hitting time H(s,t) = hitting time from s to t = expected # of steps, starting at s, before hitting t  (s,t) = commute time between s and t = H(s,t) + H(t,s) October 20124

Every nonconstant function has at least 2 poles. Harmonic functions Every function defined on S  V (S  ) has a unique extension harmonic on V \ S. G=(V,E) graph, f: V   October 20125

S f(v)= E(f(Z v )) Z v : (random) point where random walk from v hits S v 0 v 1 f(v)= P( random walk from v hits t before s) s t Harmonic functions and random walks October 20126

0 v 1 f(v)= electrical potential s t Harmonic functions and electrical networks October 20127

f(v) = position of nodes 0 1 Harmonic functions and rubber bands October 20128

Commute time and resistance October effective resistence between u and v

Distance from s to t = H(s,t). t weight=degree strength=1 Hitting time and rubber bands October

11 1{ 7 5 } Hitting time and rubber bands October

Random maze October

Random maze October

October We obtain every maze with the same probability! Random maze

Random spanning tree October

- card shuffling - statistics - simulation - counting - numerical integration - optimization - … Sampling: a general algorithmic task October

polynomial time algorithm certificate October L: a „language” (a family of graphs, numbers,...) Sampling: a general algorithmic task

Find: - a certificate Given: x - an optimal certificate - the number of certificates - a random certificate (uniform, or given distribution) October L: a „language” (a family of graphs, numbers,...) Sampling: a general algorithmic task

One general method for sampling: Random walks (+rejection sampling, lifting,…) Construct regular graph with node set V Want: sample uniformly from V Simulate (run) random walk for T steps Output the final node ???????????? mixing time October Sampling by random walk

Given: convex body K   n Want: volume of K Not possible in polynomial time, even if an error of n n/10 is allowed. Elekes, Bárány, Füredi Volume computation October

Dyer-Frieze-Kannan 1989 But if we allow randomization: There is a polynomial time randomized algorithm that computes the volume of a convex body with high probability with arbitrarily small relative error Volume computation October

Why not just.... * * * * * * * * * * ** * * * * * * S Need exponential size S to get nonzero! Volume computation by plain Monte-Carlo October

Volume computation by multiphase Monte-Carlo October

Can use Monte-Carlo! But... Now we have to generate random points from K i+1. Need sampling to compute the volume Volume computation by multiphase Monte-Carlo October

Do sufficiently long random walk on centers of cubes in K Construct sufficiently dense lattice Pick random point p from little cube If p is outside K, abort; else return p Dyer-Frieze-Kannan 1989 Sampling by random walk on lattice October

Sampling by ball walk October

Sampling by hit-and-run walk October

steplength can be large! Sampling by reflecting walk October

- Stepsize - Where to start the walk? - How long to walk? - How close will be the returned point to random? Issues with all these walks October

bottleneck isoperimetric quantity Conductance October

Dyer-Frieze-Kannan 1989 Polynomial time! Cost of volume computation (number of oracle calls) Amortized cost of sample point Cost of sample point Time bounds October

Dyer-Frieze-Kannan 1989 Lovász-Simonovits 1990 Applegate-Kannan 1990 Lovász 1991 Dyer-Frieze 1991 Lovász-Simonovits 1992,93 Kannan-Lovász-Simonovits 1997 Lovász 1999 Kannan-Lovász 1999 Lovász-Vempala 2002 Lovász-Vempala 2003 Time bounds October

- The Slicing Conjecture - Reflecting walk Possibilities for further improvement October

Reflecting random walk in K steplength h large How fast does this mix? Stationary distribution: uniform Chain is time-reversible (e.g. exponentially distributed with expectation = diam( K )) October

Smallest bisecting surface F H Smallest bisecting hyperplane ? ? The Slicing Conjecture October