9. Complexity Theory : The Frontier

Slides:



Advertisements
Similar presentations
Completeness and Expressiveness
Advertisements

Models of Computation Prepared by John Reif, Ph.D. Distinguished Professor of Computer Science Duke University Analysis of Algorithms Week 1, Lecture 2.
Lecture 24 MAS 714 Hartmut Klauck
JAYASRI JETTI CHINMAYA KRISHNA SURYADEVARA
Problem: Give as many proofs as you can for the Pythagorean Theorem. i.e., a 2 + b 2 = c 2 holds for any right triangle with sides a & b and hypotenuse.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen Department of Computer Science University of Texas-Pan American.
1 COMP 382: Reasoning about algorithms Unit 9: Undecidability [Slides adapted from Amos Israeli’s]
Computability and Complexity 4-1 Existence of Undecidable Problems Computability and Complexity Andrei Bulatov.
1 Introduction to Computability Theory Lecture12: Reductions Prof. Amos Israeli.
CPSC 411, Fall 2008: Set 12 1 CPSC 411 Design and Analysis of Algorithms Set 12: Undecidability Prof. Jennifer Welch Fall 2008.
P, NP, PS, and NPS By Muhannad Harrim. Class P P is the complexity class containing decision problems which can be solved by a Deterministic Turing machine.
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
Decidable and undecidable problems deciding regular languages and CFL’s Undecidable problems.
CHAPTER 4 Decidability Contents Decidable Languages
Fall 2004COMP 3351 Reducibility. Fall 2004COMP 3352 Problem is reduced to problem If we can solve problem then we can solve problem.
Chapter 11: Limitations of Algorithmic Power
Courtesy Costas Busch - RPI1 Reducibility. Courtesy Costas Busch - RPI2 Problem is reduced to problem If we can solve problem then we can solve problem.
Theory of Computing Lecture 20 MAS 714 Hartmut Klauck.
Lecture 27UofH - COSC Dr. Verma 1 COSC 3340: Introduction to Theory of Computation University of Houston Dr. Verma Lecture 27.
CS21 Decidability and Tractability
1 Reducibility. 2 Problem is reduced to problem If we can solve problem then we can solve problem.
Theory of Computing Lecture 19 MAS 714 Hartmut Klauck.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
Theory of Computing Lecture 15 MAS 714 Hartmut Klauck.
1 1 CDT314 FABER Formal Languages, Automata and Models of Computation Lecture 15-1 Mälardalen University 2012.
A Universal Turing Machine
CS 3813: Introduction to Formal Languages and Automata Chapter 12 Limits of Algorithmic Computation These class notes are based on material from our textbook,
1 Turing’s Thesis. 2 Turing’s thesis: Any computation carried out by mechanical means can be performed by a Turing Machine (1930)
 2005 SDU Lecture13 Reducibility — A methodology for proving un- decidability.
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
LIMITATIONS OF ALGORITHM POWER
NP-Completness Turing Machine. Hard problems There are many many important problems for which no polynomial algorithms is known. We show that a polynomial-time.
Chapter 15 P, NP, and Cook’s Theorem. 2 Computability Theory n Establishes whether decision problems are (only) theoretically decidable, i.e., decides.
Young CS 331 D&A of Algo. NP-Completeness1 NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and.
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
Chapter 9 Turing Machines What would happen if we change the stack in Pushdown Automata into some other storage device? Truing Machines, which maintains.
1 Recursively Enumerable and Recursive Languages.
Recursively Enumerable and Recursive Languages. Definition: A language is recursively enumerable if some Turing machine accepts it.
Decidability.
1 A Universal Turing Machine. 2 Turing Machines are “hardwired” they execute only one program A limitation of Turing Machines: Real Computers are re-programmable.
Chapters 11 and 12 Decision Problems and Undecidability.
The Acceptance Problem for TMs
CIS Automata and Formal Languages – Pei Wang
Probabilistic Algorithms
Recursively Enumerable and Recursive Languages
Linear Bounded Automata LBAs
Lecture12 The Halting Problem
MCC 2093 Advanced Theoretical Computer Science
Turing Machines Acceptors; Enumerators
Busch Complexity Lectures: Undecidable Problems (unsolvable problems)
Summary.
Andreas Klappenecker [based on slides by Prof. Welch]
CSCE 411 Design and Analysis of Algorithms
How Hard Can It Be?.
Alternating tree Automata and Parity games
Decidable Languages Costas Busch - LSU.
MA/CSSE 474 Theory of Computation
Formal Languages, Automata and Models of Computation
Recall last lecture and Nondeterministic TMs
CS21 Decidability and Tractability
NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and Johnson, W.H. Freeman and Company, 1979.
Instructor: Aaron Roth
CSE 589 Applied Algorithms Spring 1999
Theorem 9.3 A problem Π is in P if and only if there exist a polynomial p( ) and a constant c such that ICp (x|Π) ≤ c holds for all instances x of Π.
Instructor: Aaron Roth
More Undecidable Problems
Lecture 4: Unsolvable Problems
MA/CSSE 474 Theory of Computation
Complexity Theory: Foundations
CIS Automata and Formal Languages – Pei Wang
Presentation transcript:

9. Complexity Theory : The Frontier Sai Divya Enni

9.1 Introduction Complexity theory is the most active area of research in the theory of Computation. This chapter deals above the practical applications of Complexity theory. It deals with basically 2 issues : The complexity of single instances (characterizing the complexity of a single instance into a worst case behavior or average case behavior). The second issue is can we develop complexity classes and completeness results based on average case. Much of the complexity theory is about modeling computation in order to understand it we would naturally want to study these new devices, develop models for their mode of computation and compare the results with current models.

Parallel computing has been applied intensively to various applications like Optical computing, DNA computing, Quantum computing. Parallelism helps us to make many problem tractable but it does not alas helps us to solve NP-hard problems in Polynomial time. The most important development in complexity theory has been in “Proof theory”. The researchers have focused in 2 distinct models they are: One where the prover and checker interact for as many rounds as the prover needs to convince the checker. Second one where the prover simply writes down the argument as a single, non interactive communication to the checker. Complexity theory has its own side which deals with internal questions like P vs NP this is called “ Structural Theory”

Some of what we have covered in the previous chapters comes under structure theory like polynomial hierarchy. Some of the blossoming areas of research are Complexity Learning Theory. This research into fine structure of NP has also lead to research in fine structure in P this is called Fixed-Parameter Tractability. All these above mentioned researches have been of theoretical interests only.

9.2 The Complexity of Specific Instances Complexity core: Complexity core for a problem is an infinite set of instances all but a finite number of which are hard by hard meaning we shall look at complexity cores of P and define hard problems as the problems that are not solvable in polynomial time. Theorem 9.1: if a set is not in P then it posses an infinite subset , such that any decision algorithms must take more than a polynomial number of steps almost everywhere on X Proof: our proof proceeds by diagonalizing over all the TMs. Denote the ith turing machine in the enumeration by Mi and the output that it produces when it runs with string x is Mi(x). Let pi be the sequence of polynomials

Note that this sequence has following 2 properties: For any value n>0, i>j→Pi(n)>Pj(n). Given any polynomial p there exists an I such that Pi(n) >Pj(n) holds for all n>0. We construct a sequence of elements of s such that the nth elements cannot be accpted in Pn|Xn| time by any of the first n turing machines in the enumeration. Denote by the Xs the characteristic function of s that is we have xЄs→Xs(s)=1 and the converse implies that Xs(s)=0. we construct each element by element s follows: Let y be the empty string and let the stage number n be 1. For each i 1≤ i ≤n such that I is not yet cancelled run machine Mi on the string y Pn(|y|) until it terminates . If Mi terminates but does not solve instance y correctly we need not consider Mi again since it cannot decide membership in S.

For each I not yet cancelled determine if it passed step 2 because machine Mi did not stop in time. If so let Xn=y and proceed to step 4 if not so replace y y the next string in lexicographic order and return to step 4. After replacing increase n by 1 and return to step 2. If stage n does not terminate it loops back between step 3 and 2 to produce infinite long strings y. This can happen only if there exists an un canceled i such that Mi terminates in no more than P|y| steps. But then we have Mi(y)=Xs(y) since I is not cancelled thus we have a polynomial time decision procedure for our problem. Hence we have proved that for all but a finite number of instances of X machine Mi must run in super polynomial time.

Theorem 9.2: Definition 9.1: Definition 9.2: Every NP complete problem has complexity cores of Super polynomial density. Definition 9.1: A hard instance is one that can be solved efficiently only through table lookup. Definition 9.2: Let Iy be the yes instances of some problems ∏, x an arbitrary instance of the problem and t() some time bound. The t bound instance complexity of x w.r.t to ∏, IC^t (x|∏), is defined as the size of the smallest turing machine that solves ∏ and runs in time bounded by t|x| on the instance x, if no such machine exists then the instance complexity is infinite.

For every problem ∏ , there exists a contact such that The descriptional complexity of a string x, K(x) is the size of the smallest Turing machine that produces x when started with the empty string. We write K’(x) if we also require that the turing machine halt in no more than t|x| steps. Proposition 9.1: For every problem ∏ , there exists a contact such that Holds for any time bound t() and instance x. Definition 9.3: Given constant c and time bound t(), an instance x is (t,c) hard for the problem ∏ if

Questions ????