Dagstuhl 2010 University of Puerto Rico Computer Science Department The power of group algebras for constrained multilinear monomial detection Yiannis.

Slides:



Advertisements
Similar presentations
NP-Hard Nattee Niparnan.
Advertisements

Applied Informatics Štefan BEREŽNÝ
On the Density of a Graph and its Blowup Raphael Yuster Joint work with Asaf Shapira.
Polynomial dynamical systems over finite fields, with applications to modeling and simulation of biological networks. IMA Workshop on Applications of.
CS420 lecture one Problems, algorithms, decidability, tractability.
CS774. Markov Random Field : Theory and Application Lecture 17 Kyomin Jung KAIST Nov
Noga Alon Institute for Advanced Study and Tel Aviv University
The number of edge-disjoint transitive triples in a tournament.
Generalized Chebyshev polynomials and plane trees Anton Bankevich St. Petersburg State University Jass’07.
02/01/11CMPUT 671 Lecture 11 CMPUT 671 Hard Problems Winter 2002 Joseph Culberson Home Page.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
THE DIMENSION OF A VECTOR SPACE
x – independent variable (input)
2007 Kézdy André Kézdy Department of Mathematics University of Louisville * Preliminary report.  More -valuations for trees via the combinatorial nullstellensatz*
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 21 Instructor: Paul Beame.
1 Finding cycles using rectangular matrix multiplication and dynamic programming Raphael Yuster Haifa Univ. - Oranim Uri Zwick Tel Aviv University Uri.
Probabilistic Methods in Coding Theory: Asymmetric Covering Codes Joshua N. Cooper UCSD Dept. of Mathematics Robert B. Ellis Texas A&M Dept. of Mathematics.
Randomized Process of Unknowns and Implicitly Enforced Bounds on Parameters Jianer Chen Department of Computer Science & Engineering Texas A&M University.
Computability and Complexity 24-1 Computability and Complexity Andrei Bulatov Approximation.
Chapter 11: Limitations of Algorithmic Power
Randomness in Computation and Communication Part 1: Randomized algorithms Lap Chi Lau CSE CUHK.
Quantum Algorithms II Andrew C. Yao Tsinghua University & Chinese U. of Hong Kong.
DAST 2005 Week 4 – Some Helpful Material Randomized Quick Sort & Lower bound & General remarks…
Chapter 11 Limitations of Algorithm Power Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
15-853Page :Algorithms in the Real World Error Correcting Codes I – Overview – Hamming Codes – Linear Codes.
A POLYNOMIAL is a monomial or a sum of monomials.
LINEAR REGRESSION Introduction Section 0 Lecture 1 Slide 1 Lecture 5 Slide 1 INTRODUCTION TO Modern Physics PHYX 2710 Fall 2004 Intermediate 3870 Fall.
System of Linear Equations Nattee Niparnan. LINEAR EQUATIONS.
Distributed Constraint Optimization Michal Jakob Agent Technology Center, Dept. of Computer Science and Engineering, FEE, Czech Technical University A4M33MAS.
1 A fast algorithm for Maximum Subset Matching Noga Alon & Raphael Yuster.
CS774. Markov Random Field : Theory and Application Lecture 08 Kyomin Jung KAIST Sep
Strong list coloring, Group connectivity and the Polynomial method Michael Tarsi, Blavatnik School of Computer Science, Tel-Aviv University, Israel.
Computational Complexity Polynomial time O(n k ) input size n, k constant Tractable problems solvable in polynomial time(Opposite Intractable) Ex: sorting,
Nattee Niparnan. Easy & Hard Problem What is “difficulty” of problem? Difficult for computer scientist to derive algorithm for the problem? Difficult.
Great Theoretical Ideas in Computer Science.
4.1 Vector Spaces and Subspaces 4.2 Null Spaces, Column Spaces, and Linear Transformations 4.3 Linearly Independent Sets; Bases 4.4 Coordinate systems.
Theory of Computing Lecture 15 MAS 714 Hartmut Klauck.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Quantum Computing MAS 725 Hartmut Klauck NTU TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A.
The Complexity of Optimization Problems. Summary -Complexity of algorithms and problems -Complexity classes: P and NP -Reducibility -Karp reducibility.
Analysis of Algorithms
AN ORTHOGONAL PROJECTION
The Selection Problem. 2 Median and Order Statistics In this section, we will study algorithms for finding the i th smallest element in a set of n elements.
Télécom 2A – Algo Complexity (1) Time Complexity and the divide and conquer strategy Or : how to measure algorithm run-time And : design efficient algorithms.
Chapter 9 Polynomial Functions
1 Lower Bounds Lower bound: an estimate on a minimum amount of work needed to solve a given problem Examples: b number of comparisons needed to find the.
Linear Feedback Shift Register. 2 Linear Feedback Shift Registers (LFSRs) These are n-bit counters exhibiting pseudo-random behavior. Built from simple.
PODC Distributed Computation of the Mode Fabian Kuhn Thomas Locher ETH Zurich, Switzerland Stefan Schmid TU Munich, Germany TexPoint fonts used in.
Great Theoretical Ideas in Computer Science.
Data Structures & Algorithms Graphs
Amplification and Derandomization Without Slowdown Dana Moshkovitz MIT Joint work with Ofer Grossman (MIT)
Prof. Amr Goneid, AUC1 Analysis & Design of Algorithms (CSCE 321) Prof. Amr Goneid Department of Computer Science, AUC Part 1. Complexity Bounds.
Quantum Computing MAS 725 Hartmut Klauck NTU
Computability NP complete problems. Space complexity. Homework: [Post proposal]. Find PSPACE- Complete problems. Work on presentations.
C&O 355 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
Introduction to NP Instructor: Neelima Gupta 1.
4 4.5 © 2016 Pearson Education, Inc. Vector Spaces THE DIMENSION OF A VECTOR SPACE.
The geometric GMST problem with grid clustering Presented by 楊劭文, 游岳齊, 吳郁君, 林信仲, 萬高維 Department of Computer Science and Information Engineering, National.
Network Topology Single-level Diversity Coding System (DCS) An information source is encoded by a number of encoders. There are a number of decoders, each.
Algebraic Proofs over Noncommutative Formulas
College Algebra Chapter 3 Polynomial and Rational Functions
Some Great Theoretical Ideas in Computer Science for.
Exact Algorithms via Monotone Local Search
Bin Fu Department of Computer Science
Raphael Yuster Haifa University Uri Zwick Tel Aviv University
Chapter 11 Limitations of Algorithm Power
Bart M. P. Jansen Jesper Nederlof
Polynomial Functions.
NP-Completeness Yin Tat Lee
Restrictions on sums over
Presentation transcript:

Dagstuhl 2010 University of Puerto Rico Computer Science Department The power of group algebras for constrained multilinear monomial detection Yiannis Koutis Computer Science Department (CMU)  University of Puerto Rico

Dagstuhl 2010 University of Puerto Rico Computer Science Department

Dagstuhl 2010 University of Puerto Rico Computer Science Department the k-path problem How fast can we decide the following: Given a graph G, does it contain a k-vertex path ? In O * ((2e) k ) time [Alon, Yuster, Zwick 94] In O * (4 k ) time [Chen et.al. 07] In O * (2 k ) time [K, Williams 08] In O * (1.66 k ) time [Bjoerklund et. al. 10]

Dagstuhl 2010 University of Puerto Rico Computer Science Department the k-multilinear monomial detection problem How fast can we decide the following: Given an n-variate polynomial P presented as an arithmetic circuit does the sum-product expansion of P contain a square-free monomial of total degree k? In O * ((2e) k ) time [Alon, Yuster, Zwick 94] In O * (2 k ) time [K, Williams 08]

Dagstuhl 2010 University of Puerto Rico Computer Science Department the constrained k-multilinear monomial detection problem How fast can we decide the following: Given a graph G with vertices colored red and blue, does it contain a k-path that uses at most 3k/4 red nodes and at most 3k/4 blue nodes? A special case of the problem, MULTISET MAX MOTIF appears to be useful in computational biology. Previous algorithms use color-coding. In time O * (4 k ) using [Guillemot, Sikora MFCS10].

Dagstuhl 2010 University of Puerto Rico Computer Science Department the constrained k-multilinear monomial detection problem [this talk] In time O * (2 k )

Dagstuhl 2010 University of Puerto Rico Computer Science Department the color-coding approach Observation 1: k-multilinear monomials in k-variate polynomials can be detected in time O * (2 k ). Observation 2: Pick a random mapping of the n variables X to a set of k variables Y. Then with probability 1/e k the k-multilinear monomial stays multilinear. Then obs1 can be applied.

Dagstuhl 2010 University of Puerto Rico Computer Science Department the algebraic approach Try to decide the instance by only evaluating the circuit over an interesting commutative algebra What is the definition of interesting ? –Squares of variables annihilate, i.e. evaluate to 0 –Sum of multilinear terms evaluate to something non-zero –The complexity of the algebra must be small

Dagstuhl 2010 University of Puerto Rico Computer Science Department the group algebra approach Fix the group to be Z 2 k (k-dimensional 0-1 vectors) Commutative group multiplication (xor-ing vectors v and w) Group identity, the zero vector

Dagstuhl 2010 University of Puerto Rico Computer Science Department the group algebra approach On top of the usual group operator, we introduce an addition (mod 2) operator to define ABLERAG = Z 2 [Z 2 k ] The elements of the algebra are sums of vectors –For example: v+u+w is an element –The only possible simplification: v+v = 0 Multiplication of algebra elements apply the usual rules, e.g.

Dagstuhl 2010 University of Puerto Rico Computer Science Department the group algebra approach Theorem: ABLERAG is nearly interesting [K08] 1.For each x i pick a random vector v i 2.Assign to x i the value v 0 + v i and evaluate Squares annihilate: Any given multilinear term is non-zero if and only if the corresponding k vectors are linearly independent. This happens with prob>0.25 Circuit can be evaluated in O * (2 k ) time (and pspace) If polynomial contains an odd number of square-free terms then their sum evaluates to non-zero with prob>0.25

Dagstuhl 2010 University of Puerto Rico Computer Science Department the group algebra approach Theorem: ABLERAG is interesting [nearly-officemate-08] Multiply the edges of the circuit by random univariate polynomials of degree O(k). This essentially hashes the terms of P: At least one P i contains an odd number of square-free monomials if P contains square-free monomials.

Dagstuhl 2010 University of Puerto Rico Computer Science Department the constrained k-multilinear monomial detection problem How fast can we decide the following: Given a graph G with vertices colored red and blue, does it contain a k-path that uses at most 3k/4 red nodes and at most 3k/4 blue nodes? In time O * (4 k ) using ABLERAG [Guillemot, Sikora MFCS10]. In time O * (2 k ) [this talk].

Dagstuhl 2010 University of Puerto Rico Computer Science Department the constrained k-multilinear monomial detection problem We will still assign to the variables elements of ABLERAG that look exactly like the ones we used three slides ago. But NOT SO RANDOMLY! Any given t-multilinear term is non-zero if and only if the corresponding t vectors are linearly independent. This happens with prob>0.25 Force any (3k/4+1) blue vectors to be linearly dependent (same for red) Pick the blue vectors from a (3k/4)-dimensional subspace of Z 2 k

Dagstuhl 2010 University of Puerto Rico Computer Science Department the constrained k-multilinear monomial detection problem Input: A graph G, with blue and red nodes. Upper bound k b on the number of blue variables on a valid k-multilinear monomial. Upper bound k r on the number of blue (red) variables on a valid k-multilinear monomial. The algorithm: 1.Pick a random k b -dimensional subspace B of Z2 k (same with R) 2.Assign to each blue variable a random vector from B 3.Evaluate the circuit as in the non-constrained case.

Dagstuhl 2010 University of Puerto Rico Computer Science Department the constrained k-multilinear monomial detection problem Analysis: Every invalid multilinear monomial evaluates to 0. For a given valid multilinear monomial, the blue vectors are linearly independent with constant probability p b >0.25. Similarly define p r. Let’s call these the ok-subspace probabilities. The subspace spanned by the blue vectors does not contain a red vector with probability g>1/2. Let’s call this the glue probability. The three events are independent, so probability of success is greater than g p b p r (a constant loss comparing to non-constrained)

Dagstuhl 2010 University of Puerto Rico Computer Science Department the constrained k-multilinear monomial detection problem Arbitrarily many color classes? In time O * (4 k ) using ABLERAG [Guillemot, Sikora MFCS10] In time O * (6 k/2 ) using the obvious generalization of the two-colored algo. –We pick up a constant loss in probability of sucess for every class –But the ok-subspace probabilities become progressively better –The glue probability is always at least 0.25 –Worst case is when the solution contains k/2 color classes –Carefully working out the probabilities gives the bound

Dagstuhl 2010 University of Puerto Rico Computer Science Department The weighted version of monomial detection i.e. the TSP-like analogue Each variable x i is associated with a weight w i. The weight of a multilinear monomial is defined as the sum of the weights of the variables in it.

Dagstuhl 2010 University of Puerto Rico Computer Science Department The weighted version of monomial detection i.e. the TSP-like analogue How fast can we decide the following: Given a polynomial P, what is the minimum weight k-multilinear monomial in P ? In O * ((2e) k ) time but exp(k) space [color coding] In O * (2 k *k*max_weight) and pspace [ABLERAG+ Lokshtanov&Nederlof 10]

Dagstuhl 2010 University of Puerto Rico Computer Science Department The weighted version of monomial detection i.e. the TSP-like analogue Consider for example the case where variables have weight 0 or 1 We introduce a new indeterminate z, and in P(X) we multiply each variable of weight 1 by z. This essentially hashes the terms of P: Evaluate with ABLERAG and find the smallest i, for which the coefficient of z i is non-zero. An O * (k ) deteroriation in time and space comparing to the decision version

Dagstuhl 2010 University of Puerto Rico Computer Science Department The weighted version of monomial detection i.e. the TSP-like analogue We can view weights 0 and 1, as color classes We can answer in time essentially the same as the decision problem the following question: Is there a k-multilinear monomial that uses 1 at most t times? We can then find the minimum number of ones with binary search An O * (log k ) slowdown with respect to the decision version No blowup in space requirements.

Dagstuhl 2010 University of Puerto Rico Computer Science Department open questions Is there an O * (2 k ) algorithm for the general constrained problem ? Extend applications to weighted versions.

Dagstuhl 2010 University of Puerto Rico Computer Science Department Thank you !