Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 1 Chapter 5 Reducibility Some slides are in courtesy.

Slides:



Advertisements
Similar presentations
Formal Models of Computation Part III Computability & Complexity
Advertisements

CS 345: Chapter 9 Algorithmic Universality and Its Robustness
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen Department of Computer Science University of Texas-Pan American.
1 COMP 382: Reasoning about algorithms Unit 9: Undecidability [Slides adapted from Amos Israeli’s]
1 CSC3130 Formal Languages and Automata Theory Tutorial 9 Undecidable Problem KN Hung SHB 1026.
Reducibility 2 Theorem 5.1 HALT TM is undecidable.
Applied Computer Science II Chapter 3 : Turing Machines Prof. Dr. Luc De Raedt Institut für Informatik Albert-Ludwigs Universität Freiburg Germany.
Computability and Complexity 5-1 Classifying Problems Computability and Complexity Andrei Bulatov.
1 Introduction to Computability Theory Lecture12: Decidable Languages Prof. Amos Israeli.
1 Introduction to Computability Theory Lecture12: Reductions Prof. Amos Israeli.
Mapping Reducibility Sipser 5.3 (pages ).
1 Introduction to Computability Theory Lecture13: Mapping Reductions Prof. Amos Israeli.
Mapping Reducibility Sipser 5.3 (pages ). CS 311 Fall Computable functions Definition 5.17: A function f:Σ*→Σ* is a computable function.
Prof. Busch - LSU1 Decidable Languages. Prof. Busch - LSU2 Recall that: A language is Turing-Acceptable if there is a Turing machine that accepts Also.
Reducibility A reduction is a way of converting one problem into another problem in such a way that a solution to the second problem can be used to solve.
CHAPTER 4 Decidability Contents Decidable Languages
Applied Computer Science II Chapter 5: Reducability Prof. Dr. Luc De Raedt Institut für Informatik Albert-Ludwigs Universität Freiburg Germany.
Fall 2004COMP 3351 Reducibility. Fall 2004COMP 3352 Problem is reduced to problem If we can solve problem then we can solve problem.
1 Decidability continued. 2 Undecidable Problems Halting Problem: Does machine halt on input ? State-entry Problem: Does machine enter state halt on input.
Automata & Formal Languages, Feodor F. Dragan, Kent State University 1 CHAPTER 5 Reducibility Contents Undecidable Problems from Language Theory.
Courtesy Costas Busch - RPI1 Reducibility. Courtesy Costas Busch - RPI2 Problem is reduced to problem If we can solve problem then we can solve problem.
CS21 Decidability and Tractability
February 4, 2015CS21 Lecture 131 CS21 Decidability and Tractability Lecture 13 February 4, 2015.
1 Introduction to Computability Theory Lecture11: The Halting Problem Prof. Amos Israeli.
1 Reducibility. 2 Problem is reduced to problem If we can solve problem then we can solve problem.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
CSCI 2670 Introduction to Theory of Computing November 4, 2004.
MA/CSSE 474 Theory of Computation More Reduction Examples Non-SD Reductions.
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
1 Linear Bounded Automata LBAs. 2 Linear Bounded Automata (LBAs) are the same as Turing Machines with one difference: The input string tape space is the.
1 Turing’s Thesis. 2 Turing’s thesis: Any computation carried out by mechanical means can be performed by a Turing Machine (1930)
 2005 SDU Lecture13 Reducibility — A methodology for proving un- decidability.
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
D E C I D A B I L I T Y 1. 2 Objectives To investigate the power of algorithms to solve problems. To explore the limits of algorithmic solvability. To.
CS Master – Introduction to the Theory of Computation Jan Maluszynski - HT Lecture 7 Undecidability cont. Jan Maluszynski, IDA, 2007
Turing -Recognizable vs. -Decidable
Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 1 Chapter 3 Church-Turing Thesis Some slides are.
Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 1 Chapter 7 Time Complexity Some slides are in courtesy.
Donghyun (David) Kim Department of Mathematics and Physics North Carolina Central University 1 Chapter 1 Regular Languages Some slides are in courtesy.
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
CSCI 2670 Introduction to Theory of Computing October 13, 2005.
Donghyun (David) Kim Department of Mathematics and Physics North Carolina Central University 1 Chapter 0 Introduction Some slides are in courtesy of Prof.
Donghyun (David) Kim Department of Mathematics and Physics North Carolina Central University 1 Chapter 2 Context-Free Languages Some slides are in courtesy.
Overview of the theory of computation Episode 3 0 Turing machines The traditional concepts of computability, decidability and recursive enumerability.
Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 1 Chapter 4 Decidability Some slides are in courtesy.
Automata & Formal Languages, Feodor F. Dragan, Kent State University 1 CHAPTER 3 The Church-Turing Thesis Contents Turing Machines definitions, examples,
1 Introduction to Turing Machines
Sofya Raskhodnikova Intro to Theory of Computation L ECTURE 20 Last time Mapping reductions Computation history method Today Computation history method.
The Church-Turing Thesis Chapter Are We Done? FSM  PDA  Turing machine Is this the end of the line? There are still problems we cannot solve:
Recursively Enumerable and Recursive Languages. Definition: A language is recursively enumerable if some Turing machine accepts it.
 2005 SDU Lecture14 Mapping Reducibility, Complexity.
The Acceptance Problem for TMs
Theory of Computability
Busch Complexity Lectures: Reductions
Linear Bounded Automata LBAs
Reductions.
Reductions Costas Busch - LSU.
Intro to Theory of Computation
CSC 4170 Theory of Computation Turing reducibility Section 6.3.
Intro to Theory of Computation
Busch Complexity Lectures: Undecidable Problems (unsolvable problems)
Undecidable Problems (unsolvable problems)
Jaya Krishna, M.Tech, Assistant Professor
Decidable Languages Costas Busch - LSU.
Undecidable problems:
Reducability Sipser, pages
CS21 Decidability and Tractability
Theory of Computability
Decidability continued….
More Undecidable Problems
Presentation transcript:

Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 1 Chapter 5 Reducibility Some slides are in courtesy of Prof. Verma at Univ. of Houston, Max Alekseyev at Univ. of South Carolina Spring 2016 CISG 5115 Theory of Computation

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Overview In Chapter 3 and Chapter 4, established a general purpose computer model, TM, and presented several TM solvable problems and A TM, a computationally unsolvable problem. This chapter introduces additional unsolvable problems. The primary method for proving that problems are computationally unsolvable is called reducibility. 2

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Reducibility Informally speaking, “a problem A is reduced to a problem B ” means that if we can solve B then we can solve A if we cannot solve A then we cannot solve B the problem A is not “harder” than the problem B A at most as “hard” as B and possibly even “simpler” than B B is at least as “hard” as A and possibly even “harder” than A Mostly we will use reduction to prove something is “hard”. Q: What needs to be done to show that problem T is “hard”? To prove that T is “hard” we need to find such S that ( i ) S is known to be hard ( ii ) S is reduced to T. 3

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Reducibility – cont’ In our current language, hardness is measured in terms of decidability: from decidable (“simple”) to undecidable (“hard”). Correspondingly, solution is a decider. We can solve “simple” problems but not “hard” ones. A reduction is a way of converting one problem to another problem in such a way that a solution to the second problem can be used to solve the first problem. To prove a problem is undecidable, we need to show that some other known undecidable problem reduces to it. 4

Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 5 Chapter 5.1 Undecidable Problems from Language Theory Some slides are in courtesy of Prof. Verma at Univ. of Houston, Max Alekseyev at Univ. of South Carolina Spring 2016 CISG 5115 Theory of Computation

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Undecidable Problems from Language Theory 6 A TM is undecidable->Halt TM is undecidable  Halt TM is decidable -> A TM is decidable

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Undecidable Problems from Language Theory – cont’ 7 A TM is undecidable->E TM is undecidable  E TM is decidable -> A TM is decidable

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Undecidable Problems from Language Theory – cont’ 8

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Undecidable Problems from Language Theory – cont’ 9

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Reduction via Computation History A computation history of a TM M is a sequence of its configurations C 1, C 2, …, C l such that C l+1 legally follows from C l according to the rules of M. A computation history is accepting/rejecting if C l is accepting or rejecting configuration respectively. In general, for a TM there may exist an infinite number of configurations (because of an infinite tape). However, for TMs that use only limited amount of the tape, the number of configurations is finite. A linear bounded automaton (LBA) is a TM that is permitted to use only portion of the tape containing the input (i.e., cannot move the head beyond the input). 10

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University A LBA is decidable Lemma: Let M be an LBA with q states and g symbols in the tape alphabet. Then there are exactly qng n distinct configurations of M for the tape of length n. Lemma: Let M be an LBA with q states and g symbols in the tape alphabet. If M on input of length n does not produce an output within first qng n steps, it loops. Theorem A LBA = { | M is a LBA and M accepts w } is decidable The algorithm (TM) L that decides A LBA is as follows. On input, where M is an LBA and w is a string, Simulate M on w for qng n steps or until it halts. If M has halted, accept if it has accepted and reject if it has rejected. If it has not halted, reject. 11

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University E LBA is undecidable 12

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University E LBA is undecidable – cont’ 13

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University E LBA is undecidable – cont’ 14

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Computable Functions 15

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Computable Functions – Example 16

Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 17 Chapter 5.3 Mapping Reducibility Some slides are in courtesy of Prof. Verma at Univ. of Houston, Max Alekseyev at Univ. of South Carolina Spring 2016 CISG 5115 Theory of Computation

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Mapping Reducibility 18

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Mapping Reducibility – cont’ 19

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Mapping Reducibility – cont’ 20

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University 21

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University 22

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University 23

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University EQ TM = { | M 1, M 2 are TMs and L ( M 1 )= L ( M 2 )} Theorem: EQ TM is neither Turing-recognizable nor co- Turing-recognizable. Q: What would be a high-level outline of the proof? To prove that EQ TM not Turing-recognizable, we need to show that To prove that not Turing-recognizable, we need to show that 24

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University To show that, we need to need to construct a computable to such that Define a TM F that on input does the following: 1.Construct the following TMs M 1 and M 2 : M 1 rejects any input. M 2 ignores its input and run M on w. If it accepts, accept. 2.Output 25

Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 26 Chapter 6.3 Turing Reducibility Some slides are in courtesy of Prof. Verma at Univ. of Houston, Max Alekseyev at Univ. of South Carolina Spring 2016 CISG 5115 Theory of Computation

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Oracle Turing Machine An oracle for a language B is an external device that is capable of reporting whether any string w is a member of B. An oracle Turing machine is a modified Turing machine that has the additional capability of querying an oracle. We write M B to describe an oracle Turing machine that has an oracle for language B. 27

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Oracle Turing Machine – cont’ 28

Spring 2016 CISG 5115 Department of Mathematics and Physics Donghyun (David) Kim North Carolina Central University Turing Reducibility 29