Circuit Lower Bounds via Ehrenfeucht- Fraïssé Games Michal Koucký Joint work with: Clemens Lautemann, Sebastian Poloczek, Denis Thérien.

Slides:



Advertisements
Similar presentations
Model Checking Lecture 4. Outline 1 Specifications: logic vs. automata, linear vs. branching, safety vs. liveness 2 Graph algorithms for model checking.
Advertisements

Bounded-depth circuits: Separating wires from gates Michal Koucký Joint work with: Pavel Pudlák and Denis Thérien.
Complexity Theory Lecture 6
Boolean Circuits of Depth-Three and Arithmetic Circuits with General Gates Oded Goldreich Weizmann Institute of Science Based on Joint work with Avi Wigderson.
Circuit and Communication Complexity. Karchmer – Wigderson Games Given The communication game G f : Alice getss.t. f(x)=1 Bob getss.t. f(y)=0 Goal: Find.
CSE 311: Foundations of Computing Fall 2013 Lecture 3: Logic and Boolean algebra.
Diagram 1 shows a four wires (w1, w2, w3 & w4) logic circuit.
Amplifying lower bounds by means of self- reducibility Eric Allender Michal Koucký Rutgers University Academy of Sciences Czech Republic Czech Republic.
Complexity 11-1 Complexity Andrei Bulatov Space Complexity.
A Semantic Characterization of Unbounded-Nondeterministic Abstract State Machines Andreas Glausch and Wolfgang Reisig 1.
1 Finite Model Theory Lecture 10 Second Order Logic.
Eric Allender Rutgers University Chipping Away at P vs NP: How Far Are We from Proving Circuit Size Lower Bounds? Joint work with Michal Koucky ʹ Czech.
CS 454 Theory of Computation Sonoma State University, Fall 2011 Instructor: B. (Ravi) Ravikumar Office: 116 I Darwin Hall Original slides by Vahid and.
1 Finite Model Theory Lecture 13 FO k, L k 1, ,L  1, , and Pebble Games.
Arithmetic Hardness vs. Randomness Valentine Kabanets SFU.
2005certain1 Views as Incomplete Databases – Certain & Possible Answers  Views – an incomplete representation  Certain and possible answers  Complexity.
Computability and Complexity 32-1 Computability and Complexity Andrei Bulatov Boolean Circuits.
–Def: A language L is in BPP c,s ( 0  s(n)  c(n)  1,  n  N) if there exists a probabilistic poly-time TM M s.t. : 1.  w  L, Pr[M accepts w]  c(|w|),
Finite monoids, regular languages, circuit complexity and logic Pascal Tesson Laval University, Quebec City, Canada.
Technion 1 (Yet another) decision procedure for Equality Logic Ofer Strichman and Orly Meir Technion.
Computability and Complexity 10-1 Computability and Complexity Andrei Bulatov Gödel’s Incompleteness Theorem.
Complexity ©D. Moshkovitz 1 And Randomized Computations The Polynomial Hierarchy.
Eric Allender Rutgers University Cracks in the Defenses: Scouting Out Approaches on Circuit Lower Bounds CSR 2008.
1 Institute for Theoretical Computer Science, IIIS Tsinghua university, Beijing Iddo Tzameret Based on joint work with Sebastian Müller (Prague)
Plan Lecture 3: 1. Fraisse Limits and Their Automaticity: a. Random Graphs. a. Random Graphs. b. Universal Partial Order. b. Universal Partial Order. 2.
Recent Developments in Algebraic Proof Complexity Recent Developments in Algebraic Proof Complexity Iddo Tzameret Tsinghua Univ. Based on Pavel Hrubeš.
Quantum Computing MAS 725 Hartmut Klauck NTU TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A.
What is an And Gate? It is a digital circuit that produce logical operations The logical operations are call Boolean logical Boolean operation consist.
Circuit Complexity of Regular Languages Michal Koucký (Institute of Mathemaics, AS ČR, Praha)
Logic Circuits Chapter 2. Overview  Many important functions computed with straight-line programs No loops nor branches Conveniently described with circuits.
Languages with Bounded Multiparty Communication Complexity Arkadev Chattopadhyay (McGill) Joint work with: Andreas Krebs (Tubingen) Michal Koucky (Czech.
Week 10Complexity of Algorithms1 Hard Computational Problems Some computational problems are hard Despite a numerous attempts we do not know any efficient.
1 P P := the class of decision problems (languages) decided by a Turing machine so that for some polynomial p and all x, the machine terminates after at.
Amplifying lower bounds by means of self- reducibility Eric Allender Michal Koucký Rutgers University Academy of Sciences Czech Republic Czech Republic.
1 Finite Model Theory Lecture 3 Ehrenfeucht-Fraisse Games.
Pumping with Al and Izzy Richard Beigel CIS Temple University.
1 Finite Model Theory Lecture 14 Proof of the Pebble Games Theorem.
Pseudorandom Bits for Constant-Depth Circuits with Few Arbitrary Symmetric Gates Emanuele Viola Harvard University June 2005.
Complexity 24-1 Complexity Andrei Bulatov Interactive Proofs.
CSE 421 Algorithms Richard Anderson Lecture 27 NP-Completeness Proofs.
Characterizing Propositional Proofs as Non-Commutative Formulas Iddo Tzameret Royal Holloway, University of London Based on Joint work Fu Li (Texas Austin)
Logic Gates and Boolean Algebra Introduction to Logic II.
1 IAS, Princeton ASCR, Prague. The Problem How to solve it by hand ? Use the polynomial-ring axioms ! associativity, commutativity, distributivity, 0/1-elements.
From Classical Proof Theory to P vs. NP
Introduction to Randomized Algorithms and the Probabilistic Method
Richard Anderson Lecture 26 NP-Completeness
NP-Completeness (2) NP-Completeness Graphs 7/23/ :02 PM x x x x
Richard Anderson Lecture 26 NP-Completeness
A new characterization of ACC0 and probabilistic CC0
Umans Complexity Theory Lectures
NP-Completeness Yin Tat Lee
Intro to Theory of Computation
Intro to Theory of Computation
Richard Anderson Lecture 25 NP-Completeness
CSE 311 Foundations of Computing I
Alternating tree Automata and Parity games
Richard Anderson Lecture 28 NP-Completeness
Linear Algebra in Weak Formal Theories of Arithmetic
Lecture 20: Combinatorial Circuits I
Finite Model Theory Lecture 2
Finite Model Theory Lecture 6
Indistinguishability by adaptive procedures with advice, and lower bounds on hardness amplification proofs Aryeh Grinberg, U. Haifa Ronen.
Richard Anderson Lecture 26 NP-Completeness
This Lecture Substitution model
CPSC 121: Models of Computation
CPSC 121: Models of Computation
Switching Lemmas and Proof Complexity
CS151 Complexity Theory Lecture 5 April 16, 2019.
On Derandomizing Algorithms that Err Extremely Rarely
Recent Structure Lemmas for Depth-Two Threshold Circuits
Presentation transcript:

Circuit Lower Bounds via Ehrenfeucht- Fraïssé Games Michal Koucký Joint work with: Clemens Lautemann, Sebastian Poloczek, Denis Thérien

2 Clemens Lautemann

3 Circuit complexity of Boolean functions Relationship among circuit classes: Relationship among circuit classes: AC 0  ACC 0  TC 0  NC 1 Circuit complexity of concrete functions: Circuit complexity of concrete functions: e.g., INTEGER ADDITION -  (n g O(d ) (n )) wires - O(n g O(d ) (n )) gates

4 Computational complexity of regular languages Algebraic properties of regular lang’s  computational complexity of these lang’s [B, BT, Sz, TT, KPT, …] Algebraic properties of regular lang’s  computational complexity of these lang’s [B, BT, Sz, TT, KPT, …] A*(ac*a)A* A*(ac*a)A* -  (n g O(d ) (n )) wires - O(n g O(d ) (n )) gates Question: Does a linear number of gates suffices to compute the above language?

5 Possible tools to answer these questions → descriptive complexity – characterization of complexity classes in terms of logic. → possibility to use tools from logic.

6 Our results: Logic characterization of languages computable by linear size AC 0 circuits. Logic characterization of languages computable by linear size AC 0 circuits. ( → Lin-AC 0 = FO 2 [arb] ) Arguments using Ehrenfeucht-Fraïssé games of non- expressibility of certain functions in first order logic. Arguments using Ehrenfeucht-Fraïssé games of non- expressibility of certain functions in first order logic. ( → PARITY is not in AC 0 ) AC 0 circuits … constant-depth circuits consisting of polynomially many , ,  gates.

7 First order structure universe U = {1, …, n } universe U = {1, …, n } numerical predicates – relations R 1, …, R m numerical predicates – relations R 1, …, R m input predicate   ( i ) is true iff w i = 1 input predicate   ( i ) is true iff w i =

8 Representing a Boolean function f : {0,1}*  {0,1} First order formula  First order formula   x  y  z ( P(x, y)  ( R(x, z )   ( z )) ) Sequence of first order structures Sequence of first order structures S 1,., S 2,., S 3,., … For all i, w : S i, w has universe {1,…n } S i,. have the same numerical predicates → f ( w )=1iff S i, w  

9 Thm [Immerman]: f is expressible by a first order formula iff f is in AC 0 Thm [BIS]: f is expressible by a first order formula using only “BIT“ predicate iff f is in uniform AC 0 Thm [McNaughton]: f is expressible by a first order formula using only “<“ predicate iff f is a star-free regular language in AC 0

10 Thm: f is expressible by a first order formula using only two variables iff f is a in linear size AC 0

11 Example: Function “at least two input bits are set to one”: Function “at least two input bits are set to one”:  x  y ( x < y   ( x )   ( y ) ) “at least three input bits are set to one” “at least three input bits are set to one”  x (  ( x )   y (  ( y )  x < y  (  x  ( x )  y < x )))

12 Non-expressibility of functions in first order logic Non-expressibility of functions in first order logic  impossibility to compute these functions by AC 0 circuits. So far: Impossibility to compute functions by AC 0 circuits So far: Impossibility to compute functions by AC 0 circuits  non-expressibility of functions in first order logic. Thm: PARITY is not expressible in first order logic. Cor: PARITY is not in AC 0.

13 Ehrenfeucht-Fraïssé games: Spoiler : wants to point out a difference Duplicator : wants to show that structures are isomorphic

14 f is expressible by a first order formula of quantifier depth k using structures S 1,., S 2,., … f is expressible by a first order formula of quantifier depth k using structures S 1,., S 2,., …  Spoiler has a winning strategy in k-round EF game on S n, u and S n, w for any u, w s.t. f ( u )=0 and f ( w )=1. To prove non-expressibility Want: For n large enough and any choice of numerical predicates for structure S n,.  strings u, w, f ( u )=0 and f ( w )=1 such that Duplicator has a winning strategy on S n, u and S n, w.

15 Duplicator has a winning strategy  localy isomorphic structures (elt’s of same game type)  localy isomorphic structures (elt’s of same game type) Claim: enough to assign 0/1 to only part of the universe. Claim: enough to assign 0/1 to only part of the universe. 1 1

16 Proof overview Induction on number of pebbles Induction on number of pebbles Switching lemma Switching lemma

17 Conclusions Lin-AC 0  formulas with two variables Lin-AC 0  formulas with two variables Non-expressibility of functions using Ehrenfeucht-Fraïssé games Non-expressibility of functions using Ehrenfeucht-Fraïssé games Cons: Cons: Not as simple (as we hoped for) Not as simple (as we hoped for) Too powerful Too powerful Pros: Pros: Could be tuned up for e.g. uniform lower-bounds Could be tuned up for e.g. uniform lower-bounds Could be possibly simpler Could be possibly simpler

18 Open problems Simple proof of non-expressibility Simple proof of non-expressibility Is integer ADDITION in AC 0 with linear number of gates? Is integer ADDITION in AC 0 with linear number of gates? Is A*(ac*a)A* in AC 0 with linear number of gates? Is A*(ac*a)A* in AC 0 with linear number of gates?