Cs3102: Theory of Computation Class 17: Undecidable Languages Spring 2010 University of Virginia David Evans.

Slides:



Advertisements
Similar presentations
David Evans cs302: Theory of Computation University of Virginia Computer Science Lecture 17: ProvingUndecidability.
Advertisements

Variants of Turing machines
Turing -Recognizable vs. -Decidable
Class 39: Universality cs1120 Fall 2009 David Evans University of Virginia.
Theory of Computation CS3102 – Spring 2014 A tale of computers, math, problem solving, life, love and tragic death Nathan Brunelle Department of Computer.
Nathan Brunelle Department of Computer Science University of Virginia Theory of Computation CS3102 – Spring 2014 A tale.
Computability and Complexity 4-1 Existence of Undecidable Problems Computability and Complexity Andrei Bulatov.
1 Introduction to Computability Theory Lecture12: Reductions Prof. Amos Israeli.
More Turing Machines Sipser 3.2 (pages ). CS 311 Fall Multitape Turing Machines Formally, we need only change the transition function to.
The Halting Problem Sipser 4.2 (pages ). CS 311 Mount Holyoke College 2 Taking stock All languages Turing-recognizable Turing-decidable Context-free.
The Halting Problem Sipser 4.2 (pages ).
Mapping Reducibility Sipser 5.3 (pages ).
More Turing Machines Sipser 3.2 (pages ).
Mapping Reducibility Sipser 5.3 (pages ). CS 311 Fall Computable functions Definition 5.17: A function f:Σ*→Σ* is a computable function.
Prof. Busch - LSU1 Decidable Languages. Prof. Busch - LSU2 Recall that: A language is Turing-Acceptable if there is a Turing machine that accepts Also.
Reducibility A reduction is a way of converting one problem into another problem in such a way that a solution to the second problem can be used to solve.
Fall 2004COMP 3351 Recursively Enumerable and Recursive Languages.
Decidability. Why study un-solvability? When a problem is algorithmically unsolvable, we realize that the problem must be simplified or altered before.
Recursively Enumerable and Recursive Languages
1 Uncountable Sets continued Theorem: Let be an infinite countable set. The powerset of is uncountable.
Fall 2004COMP 3351 The Chomsky Hierarchy. Fall 2004COMP 3352 Non-recursively enumerable Recursively-enumerable Recursive Context-sensitive Context-free.
CHAPTER 4 Decidability Contents Decidable Languages
Tutorial CSC3130 : Formal Languages and Automata Theory Tu Shikui ( ) SHB 905, Office hour: Thursday 2:30pm-3:30pm
CS Master – Introduction to the Theory of Computation Jan Maluszynski - HT Lecture 6 Decidability Jan Maluszynski, IDA, 2007
CS5371 Theory of Computation Lecture 10: Computability Theory I (Turing Machine)
Fall 2005Costas Busch - RPI1 Recursively Enumerable and Recursive Languages.
David Evans cs302: Theory of Computation University of Virginia Computer Science Lecture 2: Modeling Computers.
Class 19: Undecidability in Theory and Practice David Evans cs302: Theory of Computation University of Virginia Computer.
Prof. Busch - LSU1 Reductions. Prof. Busch - LSU2 Problem is reduced to problem If we can solve problem then we can solve problem.
1 Introduction to Computability Theory Lecture11: The Halting Problem Prof. Amos Israeli.
Cs3102: Theory of Computation Class 20: Busy Beavers Spring 2010 University of Virginia David Evans Office hours: I am not able to hold my Thursday morning.
David Evans CS200: Computer Science University of Virginia Computer Science Class 31: Universal Turing Machines.
Lecture 14: Church-Turing Thesis Alonzo Church ( ) Alan Turing ( )
Complexity and Computability Theory I Lecture #13 Instructor: Rina Zviel-Girshin Lea Epstein Yael Moses.
Cs3102: Theory of Computation Class 18: Proving Undecidability Spring 2010 University of Virginia David Evans.
Announcements Homework – HW8 due Tues 5/29 11am – HW5 grades are out Monday is Memorial Day; no office hours, etc. – Go see a parade, or some fireworks,
The Halting Problem – Undecidable Languages Lecture 31 Section 4.2 Wed, Oct 31, 2007.
1 1 CDT314 FABER Formal Languages, Automata and Models of Computation Lecture 15-1 Mälardalen University 2012.
Cs3102: Theory of Computation Class 24: NP-Completeness Spring 2010 University of Virginia David Evans.
Turing Machines – Decidability Lecture 25 Section 3.1 Fri, Oct 19, 2007.
Computability Construct TMs. Decidability. Preview: next class: diagonalization and Halting theorem.
Cs3102: Theory of Computation Class 14: Turing Machines Spring 2010 University of Virginia David Evans.
David Evans cs302: Theory of Computation University of Virginia Computer Science Lecture 16: Universality and Undecidability.
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
CS 3813: Introduction to Formal Languages and Automata Chapter 12 Limits of Algorithmic Computation These class notes are based on material from our textbook,
CS 208: Computing Theory Assoc. Prof. Dr. Brahim Hnich Faculty of Computer Sciences Izmir University of Economics.
1 Turing’s Thesis. 2 Turing’s thesis: Any computation carried out by mechanical means can be performed by a Turing Machine (1930)
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
CS 461 – Nov. 7 Decidability concepts –Countable = can number the elements  –Uncountable = numbering scheme impossible  –A TM undecidable –Language classes.
Turing -Recognizable vs. -Decidable
Computability Review homework. Video. Variations. Definitions. Enumerators. Hilbert's Problem. Algorithms. Summary Homework: Give formal definition of.
Recursively Enumerable and Recursive Languages
Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 1 Chapter 4 Decidability Some slides are in courtesy.
Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central University 1 Chapter 5 Reducibility Some slides are in courtesy.
CSCI 3130: Formal languages and automata theory Andrej Bogdanov The Chinese University of Hong Kong Decidable.
Theory of Computation Automata Theory Dr. Ayman Srour.
David Evans CS200: Computer Science University of Virginia Computer Science Class 26: Halting Problem It is plain at any.
CSC 3130: Automata theory and formal languages Andrej Bogdanov The Chinese University of Hong Kong Undecidable.
Recursively Enumerable Languages
Class 30: Models of Computation CS200: Computer Science
Busch Complexity Lectures: Reductions
Reductions.
Reductions Costas Busch - LSU.
Lecture 37: A Universal Computer
Intro to Theory of Computation
Decidable Languages Costas Busch - LSU.
Recall last lecture and Nondeterministic TMs
Class 34: Models of Computation CS200: Computer Science
More undecidable languages
Lecture 23: Computability CS200: Computer Science
Presentation transcript:

cs3102: Theory of Computation Class 17: Undecidable Languages Spring 2010 University of Virginia David Evans

Menu Another S ELF -R EJECTING argument: diagonalization A language that is Turing-recognizable but not Turing-decidable Ed Clarke, 2007 Turing Award Barbara Liskov, 2008 Turing Award Monday, March 29 3:30pm in MEC 205 Thursday, April 1 2:00pm in Chemistry

Yes? Contradiction! No? Contradiction! The assumption leads to a contradiction: thus, M SR must not exist!

Alternate Proof  … M()M() … M(0) … M(1) M(00) M(01) M(10) M(11) M(000) … M(w)M(w) … Input Machine Which of the machines are in S ELF -R EJECTING ?

Alternate Proof  … M()M() … M(0) … M(1) M(00) M(01) M(10) M(11) M(000) … M(w)M(w) … Input Machine Where is w SR ?

s Languages that can be recognized by any mechanical computing machine All Languages S ELF -R EJECTING

s Turing-Recognizable All Languages S ELF -R EJECTING Turing-Decidable Context-Free

Recognizing vs. Deciding Turing-recognizable: A language L is “Turing- recognizable” if there exists a TM M such that for all strings w : – If w  L : eventually M enters q accept. – If w  L : either M enters q reject or M never terminates. Turing-decidable: A language L is “Turing-decidable” if there exists a TM M such that for all strings w : – If w  L : eventually M enters q accept. – If w  L : eventually M enters q reject.

Detour: Exam Revisions

Proof that SF is not CFL Contradiction means one of the two assumptions must be false, but we don’t know which!

Is SF Context-Free?

Squarefree Sequences in {a, b, c}* There are infinitely long squarefree sequences with at least 3 alphabet symbols Some interesting applications and lots of interesting efficient ways to generate them Ron Rivest’s paper If you solved PS4 question 2 do you know an inefficient way?

Proving Recognizability How do we prove a language is Turing-recognizable? How do we prove a language is Turing-decidable? How do we prove a language is not Turing-decidable?

Accepted by TM Is this language Turing-recognizable?

Accepted by TM Is this language Turing-recognizable? Can we really do this? Universal Turing Machine: a TM that can simulate every other TM.

Universal Turing Machine Universal Turing Machine w Output of running M starting on tape w

Manchester Illuminated Universal Turing Machine, #9 from

Universal Turing Machines Universal Turing Machines designed with: – 4 symbols, 7 states (Marvin Minsky) – 4 symbols, 5 states – 2 symbols, 22 states – 18 symbols, 2 states – 2 states, 5 symbols (Stephen Wolfram)

2-state, 3-symbol Universal TM Sequence of configurations

Of course, simplicity is in the eye of the beholder. The 2,3 Turing machine described in the dense new 40-page proof “chews up a lot of tape” to perform even a simple job, Smith says. Programming it to calculate 2 + 2, he notes, would take up more memory than any known computer contains. And image processing? “It probably wouldn't finish before the end of the universe,” he says. Alex Smith, University of Birmingham

Rough Sketch of Proof System 0 (the claimed UTM) can simulate System 1 which can simulate System 2 which can simulate System 3 which can simulate System 4 which can simulate System 5 which can simulate any 2-color cyclic tag system which can simulate any TM. See for the 40-page version with all the details… See for the 40-page version with all the details… None of these steps involve universal computation themselves

Accepted by TM Is this language Turing-decidable?

Proof that A TM is Undecidable

Both are contractions! So, D must not exist. But, if H exists, we can make D. So, H must not exist! But, if A TM is decidable, H must exist. Thus, A TM must not be decidable.

s Turing-Recognizable All Languages S ELF -R EJECTING Turing-Decidable Context-Free A TM

Halting Problem

Halting Problem is Undecidable

HALTSANY

Crashes Any equivalent to a TM enters some bad state

Edmund M. Clarke, The Birth of Model Checking

Model Checking in Theory Model Checking is Undecidable. Impossible to write a program that answers this correctly for all inputs.

Model Checking in Practice

Monday’s Talk Model Checking: My 27 year Quest to Overcome the State Explosion Problem MEC 205, 3:30pm (cookies after talk) Edmund Clarke 2007 Turing Award Winner (with Allen Emerson, Joseph Sifakis)

Return PS4 and Exam Revisions