Presented by Dajiang Zhu 11/1/2011.  Introduction of Markov chains Definition One example  Two problems as examples 2-SAT Algorithm (simply introduce.

Slides:



Advertisements
Similar presentations
Chapter 5: Tree Constructions
Advertisements

1. Find the cost of each of the following using the Nearest Neighbor Algorithm. a)Start at Vertex M.
JAYASRI JETTI CHINMAYA KRISHNA SURYADEVARA
Max Cut Problem Daniel Natapov.
Theory of Computing Lecture 18 MAS 714 Hartmut Klauck.
Gibbs sampler - simple properties It’s not hard to show that this MC chain is aperiodic. Often is reversible distribution. If in addition the chain is.
Lecture 22: April 18 Probabilistic Method. Why Randomness? Probabilistic method: Proving the existence of an object satisfying certain properties without.
Random Walks. Random Walks on Graphs - At any node, go to one of the neighbors of the node with equal probability. -
1 The Monte Carlo method. 2 (0,0) (1,1) (-1,-1) (-1,1) (1,-1) 1 Z= 1 If  X 2 +Y 2  1 0 o/w (X,Y) is a point chosen uniformly at random in a 2  2 square.
The Probabilistic Method Shmuel Wimer Engineering Faculty Bar-Ilan University.
Approximation Algorithms
Graph Algorithms: Minimum Spanning Tree We are given a weighted, undirected graph G = (V, E), with weight function w:
. PGM: Tirgul 8 Markov Chains. Stochastic Sampling  In previous class, we examined methods that use independent samples to estimate P(X = x |e ) Problem:
Computational statistics 2009 Random walk. Computational statistics 2009 Random walk with absorbing barrier.
Reduction Techniques Restriction Local Replacement Component Design Examples.
Ryan Kinworthy 2/26/20031 Chapter 7- Local Search part 1 Ryan Kinworthy CSCE Advanced Constraint Processing.
Algorithms in Exponential Time. Outline Backtracking Local Search Randomization: Reducing to a Polynomial-Time Case Randomization: Permuting the Evaluation.
Complexity 19-1 Complexity Andrei Bulatov More Probabilistic Algorithms.
Belief Propagation, Junction Trees, and Factor Graphs
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Christian Sohler 1 University of Dortmund Testing Expansion in Bounded Degree Graphs Christian Sohler University of Dortmund (joint work with Artur Czumaj,
Randomzied Unique k-SAT R. Paturi, P. Pudlak, M.E. Saks and F. Zane An Improved Exponential-time Algorithm for k-SAT Journal of the ACM, Vol 52, No. 3,
Complexity ©D.Moshkovitz 1 Paths On the Reasonability of Finding Paths in Graphs.
Sampling Combinatorial Space Using Biased Random Walks Jordan Erenrich, Wei Wei and Bart Selman Dept. of Computer Science Cornell University.
Monte Carlo Methods in Partial Differential Equations.
Minimum Spanning Trees. Subgraph A graph G is a subgraph of graph H if –The vertices of G are a subset of the vertices of H, and –The edges of G are a.
Randomized Algorithms Morteza ZadiMoghaddam Amin Sayedi.
Random Walks and Markov Chains Nimantha Thushan Baranasuriya Girisha Durrel De Silva Rahul Singhal Karthik Yadati Ziling Zhou.
The Theory of NP-Completeness 1. What is NP-completeness? Consider the circuit satisfiability problem Difficult to answer the decision problem in polynomial.
All that remains is to connect the edges in the variable-setters to the appropriate clause-checkers in the way that we require. This is done by the convey.
1 MCMC Style Sampling / Counting for SAT Can we extend SAT/CSP techniques to solve harder counting/sampling problems? Such an extension would lead us to.
Liang Ge.  Introduction  Important Concepts in MCL Algorithm  MCL Algorithm  The Features of MCL Algorithm  Summary.
MCS 312: NP Completeness and Approximation algorithms Instructor Neelima Gupta
Markov Decision Processes1 Definitions; Stationary policies; Value improvement algorithm, Policy improvement algorithm, and linear programming for discounted.
On a random walk strategy for the Q2SAT problem K. Subramani.
A DNA-Based Random Walk Method for Solving k-SAT Sergio Diaz, Juan Luis Esteban and Mitsunori Ogihara.
Markov Chain Monte Carlo and Gibbs Sampling Vasileios Hatzivassiloglou University of Texas at Dallas.
Algorithms for SAT Based on Search in Hamming Balls Author : Evgeny Dantsin, Edward A. Hirsch, and Alexander Wolpert Speaker : 羅正偉.
Graph Theory Techniques in Model-Based Testing
© 2001 by Charles E. Leiserson Introduction to AlgorithmsDay 12 L8.1 Introduction to Algorithms 6.046J/18.401J/SMA5503 Lecture 8 Prof. Charles E. Leiserson.
Random walks on undirected graphs and a little bit about Markov Chains Guy.
Seminar on random walks on graphs Lecture No. 2 Mille Gandelsman,
Artur Czumaj DIMAP DIMAP (Centre for Discrete Maths and it Applications) Computer Science & Department of Computer Science University of Warwick Testing.
Accelerating Random Walks Wei Wei and Bart Selman.
NPC.
Complexity ©D.Moshkovits 1 2-Satisfiability NOTE: These slides were created by Muli Safra, from OPICS/sat/)
Network Partition –Finding modules of the network. Graph Clustering –Partition graphs according to the connectivity. –Nodes within a cluster is highly.
1 Distributed Vertex Coloring. 2 Vertex Coloring: each vertex is assigned a color.
Escaping Local Optima. Where are we? Optimization methods Complete solutions Partial solutions Exhaustive search Hill climbing Exhaustive search Hill.
Graphical Models for Segmenting and Labeling Sequence Data Manoj Kumar Chinnakotla NLP-AI Seminar.
 2005 SDU Lecture15 P,NP,NP-complete.  2005 SDU 2 The PATH problem PATH = { | G is a directed graph that has a directed path from s to t} s t
CHAPTER SIX T HE P ROBABILISTIC M ETHOD M1 Zhang Cong 2011/Nov/28.
The Monte Carlo Method/ Markov Chains/ Metropolitan Algorithm from sec in “Adaptive Cooperative Systems” -summarized by Jinsan Yang.
Theory of Computational Complexity Probability and Computing Chapter Hikaru Inada Iwama and Ito lab M1.
Costas Busch - LSU 1 More NP-complete Problems. Costas Busch - LSU 2 Theorem: If: Language is NP-complete Language is in NP is polynomial time reducible.
Random walks on undirected graphs and a little bit about Markov Chains
More NP-complete Problems
(xy)(yz)(xz)(zy)
More NP-complete Problems
NP-Completeness Proofs
Poisson Cloning Model for Random Graphs
زنجیره مارکف گشت تصادفی استاد : محمد فرشی ارائه دهنده: میثم رجعتی
Random Walks.
Chapter 5: Probabilistic Analysis and Randomized Algorithms
CSE 6408 Advanced Algorithms.
Chapter 5: Probabilistic Analysis and Randomized Algorithms
Instructor: Aaron Roth
Presentation transcript:

Presented by Dajiang Zhu 11/1/2011

 Introduction of Markov chains Definition One example  Two problems as examples 2-SAT Algorithm (simply introduce random walks) 3-SAT Algorithm

/4 1/2 1/6 1/3 1/4 3/4 1 1/4

 Random walk A fandom walk on G is a Markov chain defined by the movement of a particle between vertices of G. In this process, the place of the particle at a given time step is the state of the system. If the particle is at vertex i, and i has d(i) outgoing edges, then the probability that the particle follows the edge(i, j) and moves to a neighbor j is 1/d(i).

 3-SAT Algorithm 1. Start with an arbitrary truth assignment. 2. Repeat the clauses are satisfied: (a) Choose an arbitrary clause that is not satisfied. (b) Choose one of the literals uniformly at random, and change the value of the variable in the current truth assignment.

 Two key observations: 1. If we choose an initial truth assignment uniformly at random, the number of variables that match S has a binomial distribution with expectation n/2. 2. Once the algorithm starts, it is more likely to move toward 0 than toward n. The longer we run the process, the more likely it has moved toward 0. Therefore we are better off re- starting the process with many randomly chosen initial assignments and running the process each time for a small number of steps, rather than running the process for many steps on the same initial assignment.

 Modified 3-SAT Algorithm 1. Repeat until all clauses are satisfied: (a) Start with a truth assignment chosen uniformly at random. (b) Repeat the following up to 3n times terminating if a satisfying assignment is found. i) Choose an arbitrary clause that is not satisfied. ii) Choose one of the literals uniformly at random, and change the value of the variable in the current truth assignment.

 How many times the process needs to restart before it reaches a satisfying assignment?

 Questions? Thanks!