Nathan Brunelle Department of Computer Science University of Virginia www.cs.virginia.edu/~njb2b/theory Theory of Computation CS3102 – Spring 2014 A tale.

Slides:



Advertisements
Similar presentations
Completeness and Expressiveness
Advertisements

Nathan Brunelle Department of Computer Science University of Virginia Theory of Computation CS3102 – Spring 2014 A tale.
Nathan Brunelle Department of Computer Science University of Virginia Theory of Computation CS3102 – Spring 2014 A tale.
Copyright © Cengage Learning. All rights reserved.
Gödel’s Incompletness Theorem By Njegos Nincic. Overview  Set theory: Background, History Naïve Set Theory  Axiomatic Set Theory  Icompleteness Theorem.
Basic Structures: Sets, Functions, Sequences, Sums, and Matrices
1 COMP 382: Reasoning about algorithms Unit 9: Undecidability [Slides adapted from Amos Israeli’s]
Week 7 - Wednesday.  What did we talk about last time?  Set proofs and disproofs  Russell’s paradox.
Russel‘s paradox (also known as Russel‘s antimony)
Basic Structures: Sets, Functions, Sequences, Sums, and Matrices
Elementary Number Theory and Methods of Proof
Zermelo-Fraenkel Axioms Ernst Zermelo ( ) gave axioms of set theory, which were improved by Adolf Fraenkel ( ). This system of axioms called.
HISTORY OF LOGIC BY JOHN NAGUIB. What is Logic? The science or study of how to evaluate arguments and reasoning. “Logic is new and necessary reasoning”
Math 333 – Euclidean and Non-Euclidean Geometry Dr. Hamblin.
Introduction to Computability Theory
CS1001 Lecture 22. Overview Mechanizing Reasoning Mechanizing Reasoning G ö del ’ s Incompleteness Theorem G ö del ’ s Incompleteness Theorem.
Logic and Set Theory.
Logic and Proof. Argument An argument is a sequence of statements. All statements but the first one are called assumptions or hypothesis. The final statement.
So far we have learned about:
First Order Logic (chapter 2 of the book) Lecture 3: Sep 14.
Lecture 24: Gödel’s Proof CS150: Computer Science
Computability Thank you for staying close to me!! Learning and thinking More algorithms... computability.
2012: J Paul GibsonTSP: Mathematical FoundationsMAT7003/L5- CountingAndEnumeration.1 MAT 7003 : Mathematical Foundations (for Software Engineering) J Paul.
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
Introduction to Computer Science. A Quick Puzzle Well-Formed Formula  any formula that is structurally correct  may be meaningless Axiom  A statement.
Mathematics and the Theory of Knowledge
First Order Logic. This Lecture Last time we talked about propositional logic, a logic on simple statements. This time we will talk about first order.
Class 36: Proofs about Unprovability David Evans University of Virginia cs1120.
Problem: Can 5 test tubes be spun simultaneously in a 12-hole centrifuge? What does “balanced” mean? Why are 3 test tubes balanced? Symmetry! Can you merge.
David Evans CS200: Computer Science University of Virginia Computer Science Class 24: Gödel’s Theorem.
Math 3121 Abstract Algebra I Section 0: Sets. The axiomatic approach to Mathematics The notion of definition - from the text: "It is impossible to define.
Logic in Computer Science - Overview Sep 1, 2011 POSTECH 박성우.
Complexity and G ö del Incomplete theorem 電機三 B 劉峰豪.
Lecture 18. Unsolvability Before the 1930’s, mathematics was not like today. Then people believed that “everything true must be provable”. (More formally,
CS 345: Chapter 8 Noncomputability and Undecidability Or Sometimes You Can’t Get It Done At All.
Course Overview and Road Map Computability and Logic.
CompSci 102 Discrete Math for Computer Science
Great Theoretical Ideas in Computer Science.
Aim: How can the word ‘infinite’ define a collection of elements?
Godel’s proof Danny Brown. Outline of godel’s proof 1.Create a statement that says of itself that it is not provable 2.Show that this statement is provable.
Great Theoretical Ideas in Computer Science.
Thinking in Methodologies Class Notes. Gödel’s Theorem.
First Order Logic Lecture 3: Sep 13 (chapter 2 of the book)
Incompleteness. System Relativity Soundness and completeness are properties of particular logical systems. There’s no sense to be made of the claim that.
CSE 311 Foundations of Computing I Lecture 26 Cardinality, Countability & Computability Autumn 2011 CSE 3111.
Computation Motivating questions: What does “computation” mean? What are the similarities and differences between computation in computers and in natural.
Lecture 4 Infinite Cardinals. Some Philosophy: What is “2”? Definition 1: 2 = 1+1. This actually needs the definition of “1” and the definition of the.
Chapter 4 Computation Chapter 4: Computation.
CSE 311 Foundations of Computing I Lecture 25 Pattern Matching, Cardinality, Computability Spring
CSE 311: Foundations of Computing Fall 2013 Lecture 26: Pattern matching, cardinality.
CSE 311: Foundations of Computing Fall 2014 Lecture 27: Cardinality.
On computable numbers, with an application to the ENTSCHEIDUNGSPROBLEM COT 6421 Paresh Gupta by Alan Mathison Turing.
Week 7 - Wednesday.  What did we talk about last time?  Proving the subset relationship  Proving set equality  Set counterexamples  Laws of set algebra.
The Church-Turing Thesis Chapter Are We Done? FSM  PDA  Turing machine Is this the end of the line? There are still problems we cannot solve:
CIS Automata and Formal Languages – Pei Wang
From Classical Proof Theory to P vs. NP
Francisco Antonio Doria
Gödel's Legacy: The Limits Of Logics
Axiomatic Number Theory and Gödel’s Incompleteness Theorems
Computable Functions.
Discrete Mathematics for Computer Science
No vector calculus / trig! No equations!
Great Theoretical Ideas in Computer Science
Lecture 2 Propositional Logic
Homework: Friday Read Section 4.1. In particular, you must understand the proofs of Theorems 4.1, 4.2, 4.3, and 4.4, so you can do this homework. Exercises.
Lecture 22: Gödel’s Theorem CS200: Computer Science
First Order Logic Rosen Lecture 3: Sept 11, 12.
Great Theoretical Ideas in Computer Science
Philosophy of Mathematics: a sneak peek
An example of the “axiomatic approach” from geometry
Presentation transcript:

Nathan Brunelle Department of Computer Science University of Virginia Theory of Computation CS3102 – Spring 2014 A tale of computers, math, problem solving, life, love and tragic death

Today: Infinities and Paradoxes Themes: Dovetailing Diagonalization Contradiction Cardinality Describability

Historical Perspectives Georg Cantor ( ) Created modern set theory Invented trans-finite arithmetic (highly controvertial at the time) Invented diagonalization argument First to use 1-to-1 correspondences with sets Proved some infinities “bigger” than others Showed an infinite hierarchy of infinities Formulated continuum hypothesis Cantor’s theorem, “Cantor set”, Cantor dust, Cantor cube, Cantor space, Cantor’s paradox Laid foundation for computer science theory Influenced Hilbert, Godel, Church, Turing

Problem: How can a new guest be accommodated in a full infinite hotel? ƒ(n) = n+1

Problem: How can an infinity of new guests be accommodated in a full infinite hotel? … ƒ(n) = 2n

… one-to-one correspondence Problem: How can an infinity of infinities of new guests be accommodated in a full infinite hotel?

Problem: Are there more integers than natural #’s? ℕ ℤℕ ℤ ℕ  ℤℕ  ℤ So | ℕ |<| ℤ | ? Rearrangement: Establishes 1-1 correspondence ƒ: ℕ  ℤ |ℕ|=|ℤ||ℕ|=|ℤ| ℤ ℕ ℤ

Problem: Are there more rationals than natural #’s? … … … … … … … … ℕ ℚℕ ℚ ℕ  ℚℕ  ℚ So | ℕ |<| ℚ | ? Dovetailing: Establishes 1-1 correspondence ƒ: ℕ  ℚ |ℕ|=|ℚ||ℕ|=|ℚ|

Problem: Are there more rationals than natural #’s? … … … … … … … … ℕ  ℚ ℕ  ℚ So | ℕ |<| ℚ | ? Dovetailing: Establishes 1-1 correspondence ƒ: ℕ  ℚ  | ℕ |=| ℚ | Avoiding duplicates!

Problem: Are there more rationals than natural #’s? … … … … … … … … ℕ  ℚ ℕ  ℚ So | ℕ |<| ℚ | ? Dovetailing: Establishes 1-1 correspondence ƒ: ℕ  ℚ  | ℕ |=| ℚ |

Problem: Why doesn’t this “dovetailing” work? … … … … … … … … There’s no “last” element on the first line! So the 2 nd line is never reached!  1-1 function is not defined!

Dovetailing Reloaded Dovetailing: ƒ: ℕ  ℤ … … To show | ℕ |=| ℚ | we can construct ƒ: ℕ  ℚ by sorting x/y by increasing key max(|x|,|y|), while avoiding duplicates: max(|x|,|y|) = 0 : {} max(|x|,|y|) = 1 : 0/1, 1/1 max(|x|,|y|) = 2 : 1/2, 2/1 max(|x|,|y|) = 3 : 1/3, 2/3, 3/1, 3/2...{finite new set at each step} Dovetailing can have many disguises! So can diagonalization! ℕ ℤ Dovetailing!

Theorem: Some numbers have no description. Proof: Dovetailing!

Problem 1: Why not just insert X into the table? Problem 2: What if X=0.999… but 1.000… is already in table? ƒ(1) = … ƒ(2) = … ƒ(3) = … ƒ(4) = … ƒ(5) = … X = 0.  ℝ Table with X inserted will have X’ still missing! Inserting X (or any number of X’s) will not help! To enforce unique table values, we can avoid using 9’s and 0’s in X. ℕℝ Non-existence proof! Diagonalization

Corollary: Some real numbers do not have finite descriptions! ƒ(1) = … ƒ(2) = … ƒ(3) = … ƒ(4) = … ƒ(5) = … X = 0.  ℝ Table with X inserted will have X’ still missing! Inserting X (or any number of X’s) will not help! To enforce unique table values, we can avoid using 9’s and 0’s in X. ℕℝ Non-existence proof! Diagonalization

Non-Existence Proofs Must cover all possible (usually infinite) scenarios! Examples / counter-examples are not convincing! Not “symmetric” to existence proofs! Ex: proof that you are a millionaire: “Proof” that you are not a millionaire ? Existence proofs can be easy! Non-existence proofs are often hard! P  NP

Historical Perspectives Bertrand Russell ( ) Philosopher, logician, mathematician, historian, social reformist, and pacifist Co-authored “Principia Mathematica” (1910) Axiomatized mathematics and set theory Co-founded analytic philosophy Originated Russell’s Paradox Activist: humanitarianism, pacifism, education, free trade, nuclear disarmament, birth control gender & racial equality, gay rights Profoundly transformed math & philosophy, mentored Wittgenstein, influenced Godel Laid foundation for computer science theory Won Nobel Prize in literature (1950)

Russell’s paradox was invented by Russell in 1901 to show that naïve set theory is self-contradictory: Define: set of all sets that do not contain themselves S = { T | T  T } Q: does S contain itself as an element? S  S  S  S contradiction! Similar paradoxes: “A barber who shaves exactly those who do not shave themselves.” “This sentence is false.” “I am lying.” “Is the answer to this question ‘no’?” “The smallest positive integer not describable in twenty words or less.”

Star Trek, 1967, “I, Mudd” episode Captain James Kirk and Harry Mudd use a logical paradox to cause hostile android “Norman” to crash Diagonalization!

Historical Perspectives Kurt Gödel ( ) Logician, mathematician, and philosopher Proved completeness of predicate logic and Gödel’s incompleteness theorem Proved consistency of axiom of choice and the continuum hypothesis Invented “Gödel numbering” and “Gödel fuzzy logic” Developed “Gödel metric” and paradoxical relativity solutions: “Gödel spacetime / universe” Made enormous impact on logic, mathematics, and science

Gödel’s Incompleteness Theorem Frege & Russell: Mechanically verifying proofs Automatic theorem proving A set of axioms is: Sound: iff only true statements can be proved Complete: iff any statement or its negation can be proved Consistent: iff no statement and its negation can be proved Hilbert’s program: find an axiom set for all of mathematics i.e., find a axiom set that is consistent and complete Gödel: any consistent axiomatic system is incomplete! (as long as it subsumes elementary arithmetic) i.e., any consistent axiomatic system must contain true but unprovable statements Mathematical surprise: truth and provability are not the same!

Gödel’s Incompleteness Theorem That some axiomatic systems are incomplete is not surprising, since an important axiom may be missing (e.g., Euclidean geometry without the parallel postulate) However, that every consistent axiomatic system must be incomplete was an unexpected shock to mathematics! This undermined not only a particular system (e.g., logic), but axiomatic reasoning and human thinking itself! Truth  Provability Justice  Legality

Gödel’s Incompleteness Theorem Gödel: consistency or completeness - pick one! Which is more important? Incomplete: not all true statements can be proved. But if useful theorems arise, the system is still useful. Inconsistent: some false statement can be proved. This can be catastrophic to the theory: E.g., supposed in an axiomatic system we proved that “1=2”. Then we can use this to prove that, e.g., all things are equal! Consider the set:{Bush, Pope} | {Bush, Pope} | = 2  | {Bush, Pope} | = 1 (since 1=2)  Bush = PopeQED  All things become true: system is “complete” but useless!

Gödel’s Incompleteness Theorem Moral: it is better to be consistent than complete, If you can not be both. “It is better to be feared than loved, if you cannot be both.” -Niccolo Machiavelli ( ), “The Prince” “You can have it good, cheap, or fast – pick any two.” - Popular business adage

Gödel’s Incompleteness Theorem Thm: any consistent axiomatic system is incomplete! Proof idea: Every formula is encoded uniquely as an integer Extend “Gödel numbering” to formula sequences (proofs) Construct a “proof checking” formula P(n,m) such that P(n,m) iff n encodes a proof of the formula encoded by m Construct a self-referential formula that asserts its own non-provability: “I am not provable” Show this formula is neither provable nor disprovable George Boolos (1989) gave shorter proof based on formalizing Berry’s paradox The set of true statements is not R.E.! Dovetailing! Algorithm! Diagonalization!

Gödel’s Incompleteness Theorem Systems known to be complete and consistent: Propositional logic (Boolean algebra) Predicate calculus (first-order logic) [Gödel, 1930] Sentential calculus [Bernays,1918; Post, 1921] Presburger arithmetic (also decidable) Systems known to be either inconsistent or incomplete: Peano arithmetic Primitive recursive arithmetic Zermelo–Frankel set theory Second-order logic Q: Is our mathematics both consistent and complete? A: No [Gödel, 1931] Q: Is our mathematics at least consistent? A: We don’t know! But we sure hope so.

Gödel’s “Ontological Proof” that God exists! Formalized Saint Anselm's ontological argument using modal logic: For more details, see:

Continuum Hypothesis

Axiom of Choice Given any set of sets, it is possible to construct a new set by picking exactly one item from each set. Obvious for case where the set is finite, tricky for infinite Non-constructive! Statement of possibility, bot procedure Is it true? Mathematics has no answer!

Banach-Tarski Paradox Non-intuitive side-effect of the Axiom of Choice Any solid sphere can be broken into a finite number of pieces and reassembled into 2 spheres of the same size as the original