From Classical Proof Theory to P vs. NP

Slides:



Advertisements
Similar presentations
Automated Theorem Proving Lecture 1. Program verification is undecidable! Given program P and specification S, does P satisfy S?
Advertisements

Models of Computation Prepared by John Reif, Ph.D. Distinguished Professor of Computer Science Duke University Analysis of Algorithms Week 1, Lecture 2.
Nathan Brunelle Department of Computer Science University of Virginia Theory of Computation CS3102 – Spring 2014 A tale.
Complexity class NP Is the class of languages that can be verified by a polynomial-time algorithm. L = { x in {0,1}* | there exists a certificate y with.
P, NP, PS, and NPS By Muhannad Harrim. Class P P is the complexity class containing decision problems which can be solved by a Deterministic Turing machine.
Submitted by : Estrella Eisenberg Yair Kaufman Ohad Lipsky Riva Gonen Shalom.
Chapter 11: Limitations of Algorithmic Power
Computability and Complexity 10-1 Computability and Complexity Andrei Bulatov Gödel’s Incompleteness Theorem.
Iddo Tzameret Tel Aviv University The Strength of Multilinear Proofs (Joint work with Ran Raz)
1 Institute for Theoretical Computer Science, IIIS Tsinghua university, Beijing Iddo Tzameret Based on joint work with Sebastian Müller (Prague)
A Brief Summary for Exam 1 Subject Topics Propositional Logic (sections 1.1, 1.2) –Propositions Statement, Truth value, Proposition, Propositional symbol,
Recent Developments in Algebraic Proof Complexity Recent Developments in Algebraic Proof Complexity Iddo Tzameret Tsinghua Univ. Based on Pavel Hrubeš.
DECIDABILITY OF PRESBURGER ARITHMETIC USING FINITE AUTOMATA Presented by : Shubha Jain Reference : Paper by Alexandre Boudet and Hubert Comon.
Theory of Computing Lecture 17 MAS 714 Hartmut Klauck.
Prabhas Chongstitvatana1 NP-complete proofs The circuit satisfiability proof of NP- completeness relies on a direct proof that L  p CIRCUIT-SAT for every.
TECH Computer Science NP-Complete Problems Problems  Abstract Problems  Decision Problem, Optimal value, Optimal solution  Encodings  //Data Structure.
Complexity and G ö del Incomplete theorem 電機三 B 劉峰豪.
Prabhas Chongstitvatana1 NP-Complete What is an algorithm What is a proof What is a hard problem NP-Complete problems -- practical problems that are strongly.
Week 10Complexity of Algorithms1 Hard Computational Problems Some computational problems are hard Despite a numerous attempts we do not know any efficient.
1 P P := the class of decision problems (languages) decided by a Turing machine so that for some polynomial p and all x, the machine terminates after at.
Umans Complexity Theory Lectures Lecture 1a: Problems and Languages.
1 Introduction to Abstract Mathematics Chapter 2: The Logic of Quantified Statements. Predicate Calculus Instructor: Hayk Melikya 2.3.
CS6133 Software Specification and Verification
Mathematical Preliminaries
THE IMPORTANCE OF DISCRETE MATHEMATICS IN COMPUTER TECHNOLOGY.
1 First order theories (Chapter 1, Sections 1.4 – 1.5) From the slides for the book “Decision procedures” by D.Kroening and O.Strichman.
Characterizing Propositional Proofs as Non-Commutative Formulas Iddo Tzameret Royal Holloway, University of London Based on Joint work Fu Li (Texas Austin)
Recent Developments in Algebraic & Proof Complexity Recent Developments in Algebraic & Proof Complexity Iddo Tzameret Tsinghua Univ. Based on Hrubes and.
1 IAS, Princeton ASCR, Prague. The Problem How to solve it by hand ? Use the polynomial-ring axioms ! associativity, commutativity, distributivity, 0/1-elements.
The NP class. NP-completeness
Data Structures and Algorithm Analysis Lecture 24
Graphs 4/13/2018 5:25 AM Presentation for use with the textbook, Algorithm Design and Applications, by M. T. Goodrich and R. Tamassia, Wiley, 2015 NP-Completeness.
P & NP.
Chapter 10 NP-Complete Problems.
NP-Completeness NP-Completeness Graphs 5/7/ :49 PM x x x x x x x
Algebraic Proofs over Noncommutative Formulas
Francisco Antonio Doria
Gödel's Legacy: The Limits Of Logics
Computational problems, algorithms, runtime, hardness
L is in NP means: There is a language L’ in P and a polynomial p so that L1 ≤ L2 means: For some polynomial time computable map r :  x: x  L1 iff.
Discrete Mathematics for Computer Science
Great Theoretical Ideas in Computer Science
Computability and Complexity
Matrix PI-algebras and Lower Bounds on Arithmetic Proofs (work in progress) Iddo Tzameret Joint work with Fu Li Tsinghua University.
Umans Complexity Theory Lectures
Great Theoretical Ideas in Computer Science
Lecture 2 Propositional Logic
NP-Completeness Yin Tat Lee
Intro to Theory of Computation
NP-Completeness NP-Completeness Graphs 11/16/2018 2:32 AM x x x x x x
Resolution over Linear Equations: (Partial) Survey & Open Problems
NP-Completeness NP-Completeness Graphs 12/3/2018 2:46 AM x x x x x x x
Linear Algebra in Weak Formal Theories of Arithmetic
CSE 311: Foundations of Computing
Chapter 34: NP-Completeness
CS 583 Fall 2006 Analysis of Algorithms
Halting Problem.
Finite Model Theory Lecture 6
CS21 Decidability and Tractability
Prabhas Chongstitvatana
CPS 173 Computational problems, algorithms, runtime, hardness
Great Theoretical Ideas in Computer Science
Prabhas Chongstitvatana
Class 24: Computability Halting Problems Hockey Team Logo
NP-Completeness Yin Tat Lee
Our First NP-Complete Problem
CSC 380: Design and Analysis of Algorithms
Instructor: Aaron Roth
Instructor: Aaron Roth
Switching Lemmas and Proof Complexity
Presentation transcript:

From Classical Proof Theory to P vs. NP Iddo Tzameret IIIS, Tsinghua University Logic Conference, Tsinghua Oct. 2013

Complexity Theory Does P = NP? Can we find proofs as fast as we check them? Central open problem in contemporary mathematics and science P = PTIME: Efficiently computable problems; Algorithms of polynomial run-time Example: Input: a proof in Peano Arithmetic (PA) Output: output “yes’’ iff the proof is correct. NP: Non-deterministic polynomial time; Problems whose solutions are efficiently verifiable Input: a number k in unary and a statement S in the language of PA Output: “yes” if exists a PA proof of S of ≤k number of symbols

What can Proof Theory say about this problem?

Formal Theory of Arithmetic X(i)=1 iff i-th bit in string X is 1 Formally: range over finite sets of numbers, encoding binary string: {0,2,5} encodes string 10101 Length of string Beginning with Peano Arithmetic For convenience: Two-sorted theory: 1. Number sort: String sort: 2. Language: 3. Logical connectives: Quantifiers: 4. Axioms for the symbols Example of axioms: , , Simplified view. Technical details missing.

Formal Theory of Arithmetic y≤|X| Γ-Comprehension Axiom: for a set Γ of formulas: for in Γ. Determines what sets provably exist in the theory If Γ is set of all formulas: gives us ‘too much power’! Parikh 1971: What if we restrict Γ ? Restriction: Γ = = set of formulas with only bounded number quantifiers (i.e., no string quantifiers) Example: X is a (binary) palindrome:

Bounded Arithmetic So we get: PA, except that axioms assert only the existence of finite sets definable with formulas (formulas with no string-quantifiers and with bounded number-quantifiers.) Such formulas correspond to a (weak) complexity class: constant-depth Boolean circuits of polynomial-size (aka AC0). Denote this class C. And the theory TC First-order theory of arithmetic; Axioms state the existence of finite sets defined by class C. What kind of (string) functions essentially exist in our world?

Definable Functions of TC What kind of functions our theory TC can (essentially) prove to exist? When do we say that a theory can prove the existence of a function f(X) (aka, a provably total function in the theory) ? (There is a reason we require ; otherwise things become not interesting\useful) Witnessing Theorem: A function is definable in TC if and only if a function is in complexity class C. For simplicity: only string inputs to function

Witnessing Theorem for TC Witnessing Theorem: A function is definable in TC if and only if a function is in complexity class C. Proof: () This is not very hard. The interesting part: () Assume is a definable function in TC . We want to show it is in complexity class C. All axioms are universal (all quantifiers are ∀ appering on the left). Herbrand Theorem: Let T be a universal theory and let be a quantifier-free formula such that: , then there are finitely many terms in the language such that:

Proof of Witnessing Theorem for TC Need to show: if and Then defines a function from C. To apply Herbrand Theorem (and conclude Witnessing Theorem) we need: TC is universal theory Make sure all terms in language describe functions from C; We can assume Herbrand Theorem: Let T be a universal theory and let be a quantifier-free formula, such that: . Then there are finitely many terms in the language such that: TC is not universal. But we can add new function symbols and take out some axioms to get a universal theory that is a conservative extension of TC We add function symbols (with defining axioms) in C. And the C-closure of all functions is C itself.

Some Credits Bounded Arithmetic: Parikh ’71, Cook ‘75, Paris & Wilkie ‘85, Buss ’85, Krajíček ‘90s, Pudlák ‘90s, Razborov ‘95, Cook & Ngyuen ’10 … Krajicek Nguyen Paris Buss Cook Pudlak Razborov Wilkie

Polynomial-Time Reasoning Go beyond TC : add axiom stating the existence of a solution to a complete problem for P: P-Axiom: “The gates of a given monotone Boolean circuit with specified inputs can be evaluated” Obtain the theory VP for ``polynomial time reasoning’’. Witnessing Theorem for VP: the same as before, but now a function is definable in the VP iff it is a polynomial-time function!

Propositional Translation True formulas  family of propositional tautologies formula Let be a formula. If is true for every string length (in standard model ) Then the propositional translation of is a family of tautologies:

From First-Order Proofs to Propositional Proofs Translation Theorem: If and then has polynomial-size propositional proofs. Propositional Proof: (Hilbert style + extension rule = Extended Frege): and successively apply inference rules to derive new formulas Start from some axioms,

Propositional Proofs THEOREM: If there exists a family of tautologies with no polynomial size Propositional Proofs, then: it is consistent with the theory that I.e., you can’t prove in polynomial-time reasoning that P=NP. I.e., There is a model of VP where P≠NP. Note: experience shows most contemporary complexity theory is provable in VP Proof idea. Assume by a way of contradiction that it is inconsistent with that . Then . Hence, . Then, by Translation Theorem there are polynomial-size propositional proofs of . Since the set of TAUTOLOGIES is coNP, , there are polynomial-size propositional proofs for all tautologies. Contradiction.

Conclusion We’ve seen one reason why proving super-polynomial lower bounds on propositional proofs (Extended Frege) is a very important and fundamental question. Currently only linear Ω(n) lower bounds are known on size of Extended Frege proofs! Possibly feasible: super-linear lower bounds Ω(nɛ), for 1>ɛ>0. My work on related issues: algebraic analogues of these questions. Have more structure.

Thank you !