Theta Function Lecture 24: Apr 18. Error Detection Code Given a noisy channel, and a finite alphabet V, and certain pairs that can be confounded, the.

Slides:



Advertisements
Similar presentations
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Advertisements

1 Matching Polytope x1 x2 x3 Lecture 12: Feb 22 x1 x2 x3.
Orthogonal Drawing Kees Visser. Overview  Introduction  Orthogonal representation  Flow network  Bend optimal drawing.
Introduction to Algorithms
1 NP-completeness Lecture 2: Jan P The class of problems that can be solved in polynomial time. e.g. gcd, shortest path, prime, etc. There are many.
Multicut Lower Bounds via Network Coding Anna Blasiak Cornell University.
Some Graph Problems. LINIAL’S CONJECTURE Backgound: In a partially ordered set we have Dilworth’s Theorem; The largest size of an independent set (completely.
Approximation Algorithms for Unique Games Luca Trevisan Slides by Avi Eyal.
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
CSC5160 Topics in Algorithms Tutorial 2 Introduction to NP-Complete Problems Feb Jerry Le
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
1 Discrete Structures & Algorithms Graphs and Trees: II EECE 320.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
Approximation Algoirthms: Semidefinite Programming Lecture 19: Mar 22.
[1][1][1][1] Lecture 4: Frequency reuse, channel assignment, and more June 15, Introduction to Algorithmic Wireless Communications David Amzallag.
Linear Programming and Approximation
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
Semidefinite Programming
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Randomized Algorithms and Randomized Rounding Lecture 21: April 13 G n 2 leaves
Duality Lecture 10: Feb 9. Min-Max theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum Cut Both.
Perfect Graphs Lecture 23: Apr 17. Hard Optimization Problems Independent set Clique Colouring Clique cover Hard to approximate within a factor of coding.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
Semidefinite Programming Based Approximation Algorithms Uri Zwick Uri Zwick Tel Aviv University UKCRC’02, Warwick University, May 3, 2002.
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Job Scheduling Lecture 19: March 19. Job Scheduling: Unrelated Multiple Machines There are n jobs, each job has: a processing time p(i,j) (the time to.
Randomness in Computation and Communication Part 1: Randomized algorithms Lap Chi Lau CSE CUHK.
1 Introduction to Approximation Algorithms Lecture 15: Mar 5.
(work appeared in SODA 10’) Yuk Hei Chan (Tom)
The Maximum Independent Set Problem Sarah Bleiler DIMACS REU 2005 Advisor: Dr. Vadim Lozin, RUTCOR.
Packing Element-Disjoint Steiner Trees Mohammad R. Salavatipour Department of Computing Science University of Alberta Joint with Joseph Cheriyan Department.
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
Approximation Algorithms for NP-hard Combinatorial Problems Magnús M. Halldórsson Reykjavik University
C&O 355 Mathematical Programming Fall 2010 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
Design Techniques for Approximation Algorithms and Approximation Classes.
Approximating Minimum Bounded Degree Spanning Tree (MBDST) Mohit Singh and Lap Chi Lau “Approximating Minimum Bounded DegreeApproximating Minimum Bounded.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Lecture 22 More NPC problems
Approximation Algorithms Department of Mathematics and Computer Science Drexel University.
Combinatorial Algorithms Reference Text: Kreher and Stinson.
NP-complete Problems SAT 3SAT Independent Set Hamiltonian Cycle
Chapter 15 Approximation Algorithm Introduction Basic Definition Difference Bounds Relative Performance Bounds Polynomial approximation Schemes Fully Polynomial.
Semidefinite Programming
Graph Colouring L09: Oct 10. This Lecture Graph coloring is another important problem in graph theory. It also has many applications, including the famous.
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
EMIS 8373: Integer Programming Combinatorial Relaxations and Duals Updated 8 February 2005.
CSE 589 Part V One of the symptoms of an approaching nervous breakdown is the belief that one’s work is terribly important. Bertrand Russell.
Lecture.6. Table of Contents Lp –rounding Dual Fitting LP-Duality.
Unique Games Approximation Amit Weinstein Complexity Seminar, Fall 2006 Based on: “Near Optimal Algorithms for Unique Games" by M. Charikar, K. Makarychev,
A perfect notion László Lovász Microsoft Research To the memory of Claude Berge.
CSE 421 Algorithms Richard Anderson Lecture 27 NP-Completeness Proofs.
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
C&O 355 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
Approximation Algorithms Duality My T. UF.
Approximation Algorithms based on linear programming.
Graph Coloring.
Lap Chi Lau we will only use slides 4 to 19
Richard Anderson Lecture 26 NP-Completeness
Topics in Algorithms Lap Chi Lau.
Richard Anderson Lecture 26 NP-Completeness
Approximation algorithms
What is the next line of the proof?
Computability and Complexity
Parameterised Complexity
Richard Anderson Lecture 25 NP-Completeness
Linear Programming and Approximation
CSE 6408 Advanced Algorithms.
Flow Feasibility Problems
Vertex Covers and Matchings
Presentation transcript:

Theta Function Lecture 24: Apr 18

Error Detection Code Given a noisy channel, and a finite alphabet V, and certain pairs that can be confounded, the goal is to select as many words of length k as possible so that no two can be confounded. Let G be the graph. Then for k=1 it is the independent set problem. What about for general k?

Graph Product Given G1=(V1,E1) and G2=(V2,E2), their product G1xG2 is the graph whose vertex set is V1xV2 and the edge set is {((u1,v1),(u2,v2)) : u1=u2 and (v1,v2) in E2 or v1=v2 and (u1,u2) in E1 or (u1,u2) in E1 and (v1,v2) in E2. The problem is now to find a maximum independent set in G k.

Shannon Capacity The Shannon capacity is defined to be Consider G = C 4 Consider all the code words using “a” and “c” On the other hand, each codeword forbids 2 k codewords, and so So Shannon capacity is 2 if G = C 4

Shannon Capacity The Shannon capacity is defined to be What about C 5 ? Obviously Consider {(0,0),(1,2),(2,4),(3,1),(4,3)}. It is an independent set of size 5 in C 5 2 So Can we do better? So Shannon capacity is at least √5 if G = C 5 Lovasz

Geometry Vertex vs Vector Independent set of vertices vs Orthogonal set of vectors Let the handle be e1. Let all be unit vectors. Let S be an independent set. The corresponding vectors form an orthogonal set.

Suppose we can find a drawing so that each projection to the handle has length x. Each term is >= x 2 So |S| <= 1/x 2 A geometric upper bound for maximum independent set! Orthogonal Representation

To give the best upper bound, find a drawing with the maximum projection. Umbrella Each term is >= x 2 So |S| <= 1/x 2 A geometric upper bound for maximum independent set! For C 5, So |S| <= √5

Higher Dimension For C 5, Use v1,v2,v3,v4,v5 as building block. For the vector corresponds to (i,j) would be Tensor product: So independent set in the power corresponds to orthogonal set of these vectors.

Tight Analysis For C 5, Use v1,v2,v3,v4,v5 as building block. Tensor product: This term becomes So |S| <= 1/x 2 In general Shannon capacity is at most √5 for C 5

To give the best upper bound, find a drawing with the maximum projection. Lovasz Theta Function This can be computed using SDP for any graph! over all orthogonal representation {v1,…,vn}.

Solving Clique LP for each clique C Let’s write a better LP using Lovasz idea.

Theta LP for each c and ONR {vi} Each independent set would satisfy this LP, because:

Theta LP for each c and ONR {vi} This LP is stronger than the clique LP, because: Given any clique C, set vi=1 if i is in C; otherwise set vi=0 if i is not in C. Then

The Sandwich Theorem Each independent set is a feasible solution for Theta-LP, so For clique LP, its optimal value <= minimum clique cover.

Many Faces of Theta

Theta <= Theta-1 Easy computation. Theta is maximum fractional independent set. Theta-1 is the umbrella upper bound.

Theta-1 <= Theta-2 From Theta-2, use those vectors vi plus a vector c orthogonal to all vi. Consider ui = (c + vi)/√t This will show Theta-1 is at most t. Theta-2 is minimum vector clique cover.

Theta-2 <= Theta-3 The most important step Duality of SDP. Theta-3 is maximum vector independent set.

Theta-3 <= Theta-4 Use wi in Theta-3. Set This will show Theta-3 is at most Theta-4. Theta-4 is another form of maximum vector independent set.

Theta-4 <= Theta Set This is a feasible solution of Theta. Idea: use the projection to get fractional solution.

SDP for every ij not in E(G) This is a vector program, and can be solved in polynomial time! How to construct an independent set? Blackbox construction! How to construct a clique cover? Compute the dual solution of clique LP.

Colouring a 3-Colourable Graph Each vertex of the same colour corresponds to the same vector above. for all ij in E Solve this SDP and turn it into a colouring using colours.

Colouring a 3-Colourable Graph Observation: adjacent vertices are far apart. Idea: Take a random vector. Find a “large” independent set close to it. Use one colour for that set and repeat. Pick g=(g1,g2,…,gn), each gi is independently drawn from a Normal distribution. Random vector

Finding a Large Independent Set If t is large, not enough vertices; if t is small, may have many edges. First compute By symmetry, assume v=(1,0,0,…,0). Then

How Many Edges? What is the probability that v has a neighbour in V g (t)? If this probability is = half the vertices in V g (t)?

Analysis By symmetry, assume v=(1,0,0,…,0) u=(-1/2,√3/2,0,0,…,0) Both >= t Since g2 is normally distributed,

How Many Edges? What is the probability that v has a neighbour in V g (t)? If this probability is <= 1/2, then we can keep half the vertices in V g (t)? Set t to find an independent set of size

Summary Idea: Take a random vector. Find a “large” independent set close to it. Use one colour for that set and repeat. “large” means: So we repeat foriterations.

Kneser Graph KG(n,k) has a vertex for each k-element subset of a ground set of size n, two vertices have an edge if and only if the corresponding subsets are disjoint. Colouring <= n – 2k + 2 e.g. when n=3k-1, no triangle, but need k+1 colors. Lovasz, topological method, colouring = n-2k+2. Vector colouring is 3! Kneser conjecture: minimum colouring = n – 2k + 2.

Open Problems A combinatorial algorithm to compute maximum independent set in perfect graphs? Just a better rounding algorithm? Class of graphs with bounded Theta gap?

Remarks Thanks!