C SC 573 Theory of Computation Theory of Computation Lecture 05 Reduction.

Slides:



Advertisements
Similar presentations
Formal Models of Computation Part III Computability & Complexity
Advertisements

David Evans cs302: Theory of Computation University of Virginia Computer Science Lecture 17: ProvingUndecidability.
Lecture 3 Universal TM. Code of a DTM Consider a one-tape DTM M = (Q, Σ, Γ, δ, s). It can be encoded as follows: First, encode each state, each direction,
Variants of Turing machines
Lecture 19. Reduction: More Undecidable problems
Lecture 24 MAS 714 Hartmut Klauck
CS 461 – Nov. 9 Chomsky hierarchy of language classes –Review –Let’s find a language outside the TM world! –Hints: languages and TM are countable, but.
The Recursion Theorem Sipser – pages Self replication Living things are machines Living things can self-reproduce Machines cannot self reproduce.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen Department of Computer Science University of Texas-Pan American.
Computability and Complexity 5-1 Classifying Problems Computability and Complexity Andrei Bulatov.
1 Introduction to Computability Theory Lecture14: Recap Prof. Amos Israeli.
1 Introduction to Computability Theory Lecture15: Reductions Prof. Amos Israeli.
1 Introduction to Computability Theory Lecture12: Reductions Prof. Amos Israeli.
1 Introduction to Computability Theory Lecture13: Mapping Reductions Prof. Amos Israeli.
CPSC 411, Fall 2008: Set 12 1 CPSC 411 Design and Analysis of Algorithms Set 12: Undecidability Prof. Jennifer Welch Fall 2008.
Fall 2004COMP 3351 Recursively Enumerable and Recursive Languages.
Lecture 8 Recursively enumerable (r.e.) languages
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
Recursively Enumerable and Recursive Languages
1 The Chomsky Hierarchy. 2 Unrestricted Grammars: Rules have form String of variables and terminals String of variables and terminals.
Decidable and undecidable problems deciding regular languages and CFL’s Undecidable problems.
Programming the TM qa  (,q) (,q) q1q1 0q1q1 R q1q1 1q1q1 R q1q1  h  Qa  (,q) (,q) q1q1 0q2q2  q1q1 1q3q3  q1q1  h  q2q2 0q4q4 R q2q2 1q4q4.
Fall 2004COMP 3351 The Chomsky Hierarchy. Fall 2004COMP 3352 Non-recursively enumerable Recursively-enumerable Recursive Context-sensitive Context-free.
1 Lecture 10 Proving more specific problems are not recursive Reduction technique –Use subroutine theme to show that if one problem is unsolvable, so is.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 19 Instructor: Paul Beame.
Fall 2004COMP 3351 Reducibility. Fall 2004COMP 3352 Problem is reduced to problem If we can solve problem then we can solve problem.
Automata & Formal Languages, Feodor F. Dragan, Kent State University 1 CHAPTER 5 Reducibility Contents Undecidable Problems from Language Theory.
Courtesy Costas Busch - RPI1 Reducibility. Courtesy Costas Busch - RPI2 Problem is reduced to problem If we can solve problem then we can solve problem.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 18 Instructor: Paul Beame.
Theory of Computing Lecture 20 MAS 714 Hartmut Klauck.
January 28, 2015CS21 Lecture 101 CS21 Decidability and Tractability Lecture 10 January 28, 2015.
CS21 Decidability and Tractability
1 Reducibility. 2 Problem is reduced to problem If we can solve problem then we can solve problem.
Formal Language Finite set of alphabets Σ: e.g., {0, 1}, {a, b, c}, { ‘{‘, ‘}’ } Language L is a subset of strings on Σ, e.g., {00, 110, 01} a finite language,
CSCI 2670 Introduction to Theory of Computing November 4, 2004.
1 The Halting Problem and Decidability How powerful is a TM? Any program in a high level language can be simulated by a TM. Any algorithmic procedure carried.
Theory of Computation, NTUEE Theory of Computation Lecture 04 Undecidability Part of the materials are from Courtesy of Prof. Peter J. Downey Department.
1 Turing’s Thesis. 2 Turing’s thesis: Any computation carried out by mechanical means can be performed by a Turing Machine (1930)
 2005 SDU Lecture13 Reducibility — A methodology for proving un- decidability.
CS Master – Introduction to the Theory of Computation Jan Maluszynski - HT Lecture 7 Undecidability cont. Jan Maluszynski, IDA, 2007
Lecture 21 Reducibility. Many-one reducibility For two sets A c Σ* and B c Γ*, A ≤ m B if there exists a Turing-computable function f: Σ* → Γ* such that.
Recursively Enumerable and Recursive Languages
Overview of the theory of computation Episode 3 0 Turing machines The traditional concepts of computability, decidability and recursive enumerability.
Decidability Decidable/Undecidable problems. Jaruloj Chongstitvatana Decidability2 Accepting: Definition Let T = (Q, , , , s) be a TM. T accepts.
 2005 SDU Lecture14 Mapping Reducibility, Complexity.
Recursively Enumerable and Recursive Languages
CSCI 2670 Introduction to Theory of Computing
Theory of Computability
Busch Complexity Lectures: Reductions
Linear Bounded Automata LBAs
Reductions.
Undecidable Problems Costas Busch - LSU.
Reductions Costas Busch - LSU.
Automata, Grammars and Languages
Homework: Friday Read Section 4.1. In particular, you must understand the proofs of Theorems 4.1, 4.2, 4.3, and 4.4, so you can do this homework. Exercises.
Busch Complexity Lectures: Undecidable Problems (unsolvable problems)
CSCI 2670 Introduction to Theory of Computing
Decidable Languages Costas Busch - LSU.
Undecidable problems:
Proposed in Turing’s 1936 paper
CSC 4170 Theory of Computation Mapping Reducibility Section 5.3.
CS21 Decidability and Tractability
Theory of Computability
Theory of Computability
CSC 4170 Theory of Computation Mapping Reducibility Section 5.3.
Theory of Computability
Instructor: Aaron Roth
Automata, Grammars and Languages
More Undecidable Problems
Intro to Theory of Computation
Presentation transcript:

C SC 573 Theory of Computation Theory of Computation Lecture 05 Reduction

C SC 573 Theory of Computation 2 Reducibility Language is (many-one) reducible to language iff there is some total computable function (algorithm) f such that: Notation Full name: “many-one reducible” (  other kinds e.g. ) If  an algorithm for deciding then  one for since f has an algorithm: x

C SC 573 Theory of Computation 3 Reducibility (cont.) Lemma 3.2: Let. Then decidable  decidable [decidability inherited down] undecidable  undecidable [undecidability inherited up] c.e.  c.e. [acceptability inherited down]  If you want to show a problem P is easier than problem Q then reduce P to Q  If you want to show a problem P is harder than problem Q then reduce Q to P easinesshardness ? Q P: ?P Q:

C SC 573 Theory of Computation 4 Unsolvability via Reductions: HALTING HALTING PROBLEM UNIVERSAL LANGUAGE In the Homer & Selman text, these two problems are treated as identical. They are actually different, but equivalent in the sense that Theorem 3.6: is undecidable. Proof: Since the mapping is total computable, then From which we conclude is undecidable.  Corollary: is c.e. but undecidable.

C SC 573 Theory of Computation 5 Unsolvability via Reductions (cont.) Theorem 3.6: The HALTING problem is c.e. but not decidable. Proof: It is c.e. because the UTM U given e and w will halt just in case halts on w. To show undecidable, we show that by constructing a decider for assuming one for Consider a “compiler” c that takes a TM and converts it to a TM such that if halts and accepts, then so does but if halts and rejects, then will diverge. (This can be done simply by arranging that transitions to are replaced by transitions to a loop.) Then Since c is totally computable, 

C SC 573 Theory of Computation 6 Unsolvability via Reductions (cont.) Visual proof that the universal language is reducible to the HALTING problem: Proof: Consider a “compiler” c that given e constructs index c(e) for a TM as follows: Reduction yes no yes loop 

C SC 573 Theory of Computation 7 Unsolvability via Reductions: Examples Theorem: The EMPTY-TAPE-ACCEPTANCE problem is c.e. but not decidable: Proof: An acceptor is easy to construct: submit (e,0) to the UTM. We will show that. Consider a “compiler” c that given ( e,w) constructs TM c(e,w) as follows: Reduction no yes no yes no 

C SC 573 Theory of Computation 8 Unsolvability via Reductions [alternate] Theorem: The EMPTY-TAPE-ACCEPTANCE problem is c.e. but not decidable: Proof: An acceptor is easy to construct: submit ( e,0) to the UTM. We will show that. Consider a “compiler” c that given ( e,w) constructs TM c(e,w): Reduction yes no yes no { M (w)  } 

C SC 573 Theory of Computation 9 Reductions Properties of reduction relation Reduction: major method for showing unsolvability or non- enumerability: Goal: to show is not c.e. Known:is not c.e. Strategy: reduce to Method: build total computable “translator” f to accept f yes w

C SC 573 Theory of Computation 10 Non-CE via Reductions Theorem: The EMPTY-SET-ACCEPTANCE problem is not c.e.: Proof: Show Consider a “compiler” c that given e,w constructs TM encoding Reduction: c is total recursive (an algorithm) yes x 

C SC 573 Theory of Computation 11 Undecidable via Reductions Theorem: The NONEMPTY-SET-ACCEPTANCE problem is c.e. but not decidable: Proof: It is easy to see that since So it cannot be decidable. An acceptor for is the following nondeterministic ‡ TM yes _____________________________________ †what if w is not a syntactically valid TM encoding? Which set is it in? ‡ a good illustration of the power of nondeterminism to describe processes 

C SC 573 Theory of Computation 12 Non-RE via Reductions Exercise: The FINITE-SET-ACCEPTANCE problem is not c.e.: Proof: Show that Exercise: The INFINITE-SET-ACCEPTANCE problem is not c.e.: Proof: Show that _____________________________________ †what if e is not a syntactically valid TM encoding? Which set is it in?

C SC 573 Theory of Computation 13 Equivalence and Completeness Definition: Let C be a class of sets. A set A is many-one complete ( -complete ) in C iff  Remark: “ A is complete” says A is a “hardest problem in C ” A is many-one equivalent to B iff Fact: all complete sets in C are many-one equivalent Exercise:

C SC 573 Theory of Computation 14 Completeness Theorem: is complete in CE. Proof: is accepted by U, so is in CE. To show completeness, let B be any c.e. set and suppose for TM that. Define the total recursive function Then  Exercise: Show the Halting Problem is complete in CE

C SC 573 Theory of Computation 15 Arithmetic Hierarchy DEC=CE  co-CE For every class C, a class co-C C } Ladder of complexity CE co-CE DEC=Decidable Sets

C SC 573 Theory of Computation 16 Arithmetic Hierarchy Fact: CE Corollary: CE  co-CE CE  co-CE Proof: Know that CE. If co-CE, then CE, which is a contradiction. A similar argument holds for 