The Probabilistic Method Shmuel Wimer Engineering Faculty Bar-Ilan University.

Slides:



Advertisements
Similar presentations
On allocations that maximize fairness Uriel Feige Microsoft Research and Weizmann Institute.
Advertisements

Approximation Algorithms Chapter 14: Rounding Applied to Set Cover.
Gibbs sampler - simple properties It’s not hard to show that this MC chain is aperiodic. Often is reversible distribution. If in addition the chain is.
Lecture 22: April 18 Probabilistic Method. Why Randomness? Probabilistic method: Proving the existence of an object satisfying certain properties without.
NP-Completeness: Reductions
The Theory of NP-Completeness
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
1 The Monte Carlo method. 2 (0,0) (1,1) (-1,-1) (-1,1) (1,-1) 1 Z= 1 If  X 2 +Y 2  1 0 o/w (X,Y) is a point chosen uniformly at random in a 2  2 square.
The number of edge-disjoint transitive triples in a tournament.
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
Complexity 11-1 Complexity Andrei Bulatov NP-Completeness.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
February 23, 2015CS21 Lecture 201 CS21 Decidability and Tractability Lecture 20 February 23, 2015.
Computability and Complexity 15-1 Computability and Complexity Andrei Bulatov NP-Completeness.
Semidefinite Programming
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
Complexity 19-1 Complexity Andrei Bulatov More Probabilistic Algorithms.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 23 Instructor: Paul Beame.
1 Discrete Structures CS 280 Example application of probability: MAX 3-SAT.
Time Complexity.
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Toward NP-Completeness: Introduction Almost all the algorithms we studies so far were bounded by some polynomial in the size of the input, so we call them.
Complexity 1 Hardness of Approximation. Complexity 2 Introduction Objectives: –To show several approximation problems are NP-hard Overview: –Reminder:
Clique Cover Cook’s Theorem 3SAT and Independent Set
What is the next line of the proof? a). Assume the theorem holds for all graphs with k edges. b). Let G be a graph with k edges. c). Assume the theorem.
1 Joint work with Shmuel Safra. 2 Motivation 3 Motivation.
Randomized Algorithms Morteza ZadiMoghaddam Amin Sayedi.
Introduction to Graph Theory
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
The Theory of NP-Completeness 1. What is NP-completeness? Consider the circuit satisfiability problem Difficult to answer the decision problem in polynomial.
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
NP-Completeness: 3D Matching
Lecture 22 More NPC problems
The Complexity of Optimization Problems. Summary -Complexity of algorithms and problems -Complexity classes: P and NP -Reducibility -Karp reducibility.
Edge-disjoint induced subgraphs with given minimum degree Raphael Yuster 2012.
Expanders via Random Spanning Trees R 許榮財 R 黃佳婷 R 黃怡嘉.
NP-complete Problems SAT 3SAT Independent Set Hamiltonian Cycle
EMIS 8373: Integer Programming NP-Complete Problems updated 21 April 2009.
Linear Program Set Cover. Given a universe U of n elements, a collection of subsets of U, S = {S 1,…, S k }, and a cost function c: S → Q +. Find a minimum.
1.1 Chapter 3: Proving NP-completeness Results Six Basic NP-Complete Problems Some Techniques for Proving NP-Completeness Some Suggested Exercises.
Presented by Dajiang Zhu 11/1/2011.  Introduction of Markov chains Definition One example  Two problems as examples 2-SAT Algorithm (simply introduce.
28.
NPC.
Liaoruo Wang and John E. Hopcroft Dept. of Computer Engineering & Computer Science, Cornell University In Proc. 7th Annual Conference on Theory and Applications.
CSE 421 Algorithms Richard Anderson Lecture 27 NP-Completeness Proofs.
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
Non-LP-Based Approximation Algorithms Fabrizio Grandoni IDSIA
COSC 3101A - Design and Analysis of Algorithms 14 NP-Completeness.
Approximation Algorithms based on linear programming.
Hongyu Liang Institute for Theoretical Computer Science Tsinghua University, Beijing, China The Algorithmic Complexity.
Theory of Computational Complexity Yusuke FURUKAWA Iwama Ito lab M1.
CHAPTER SIX T HE P ROBABILISTIC M ETHOD M1 Zhang Cong 2011/Nov/28.
Theory of Computational Complexity Probability and Computing Chapter Hikaru Inada Iwama and Ito lab M1.
ICS 353: Design and Analysis of Algorithms NP-Complete Problems King Fahd University of Petroleum & Minerals Information & Computer Science Department.
More NP-Complete and NP-hard Problems
Richard Anderson Lecture 26 NP-Completeness
Richard Anderson Lecture 26 NP-Completeness
(xy)(yz)(xz)(zy)
NP-Completeness (36.4-5) P: yes and no in pt NP: yes in pt NPH  NPC
Probability III: The Probabilistic Method
NP-Completeness Yin Tat Lee
Where Can We Draw The Line?
NP-Completeness Yin Tat Lee
CS21 Decidability and Tractability
CSE 589 Applied Algorithms Spring 1999
Instructor: Aaron Roth
Presentation transcript:

The Probabilistic Method Shmuel Wimer Engineering Faculty Bar-Ilan University

The probabilistic method comprises two ideas: Any random variable assumes at least one value not smaller than its expectation If an object chosen randomly from the universe satisfies a property with positive probability, then there must be an object of the universe satisfying that property Theorem: For any undirected graph G(V,E) with n vertices and m edges, there is a partition of V into A and B such that the edge cut-set has m/2 edges at least, namely

Proof: Consider the following experiment. Each vertex is independently and equiprobaly assigned to A or B. The probability that the end points pf and edge (u,v) are in different sets is ½. By the linearity of expectation the expected number of edges in the cut is m/2. It follows that there must a partition satisfying the theorem.□

Consider the satisfiability problem where a set of m clauses is given in conjunctive normal form over n variables, and we have to decide whether there is a truth assignment of the n variables satisfying all the clauses. There is an optimization version called MAX-SAT where wee seek for a truth assignment maximizing the number of satisfied clauses. This problem is NP-hard. We subsequently show that there is always a truth assignment satisfying at least m/2 clauses. This is the best possible universal guarantee (consider and ).

Theorem: For any set of m clauses, there is a truth assignment satisfying at least m/2 clauses. Proof: Suppose that every variable is set to TRUE or FALSE independently and equiprobaly. For, let if the clause is satisfies and otherwise. Due to the conjunctive form, the probability that a clause containing literals is not satisfied is, or that it is satisfied, implying. The expected number of satisfied clauses is therefore, implying that there must be an assignment for which. □

Expanding Graphs G(V,E) is called an expanding graph if there is a µ>0 such that for any there is, where is the set of S’s neighbors.. A particular type of expanding graph is a bipartite multi graph G(L,R,E) called OR-concentrator. It is defined by, where, such that Such that there is. In most applications it is desired to have d as small as possible and c as large as possible.

Of particular interest are those graph where α, c and d are constants independent of n and c>1. Those are strict requirements and it is not trivial task to construct such graphs. We rather show that such graphs exist. We show that a random graph chosen from a suitable probability space has a positive probability of being an (n,18,1/3,2) OR-concentrator. (The constants are arbitrary. Other combinations are possible) Theorem: There is an integer n 0 such that for all n>n 0 there is an (n,18,1/3,2) OR-concentrator. Proof: Consider a random G(L,R,E), where vϵL choses its d neighbors Γ(v) in R independently and uniformly with replacements and avoid multi edges.

Let be the event that for a there is. Consider and. There are ways of choosing S and of choosing T. There is.