Of 25 January 7, 2016 CBS: Math, Proofs, Computing 1 Mathematics, Proofs and Computation Madhu Sudan Harvard.

Slides:



Advertisements
Similar presentations
Turing Machines January 2003 Part 2:. 2 TM Recap We have seen how an abstract TM can be built to implement any computable algorithm TM has components:
Advertisements

Logic: The Big Picture Propositional logic: atomic statements are facts –Inference via resolution is sound and complete (though likely computationally.
Cs3102: Theory of Computation Class 25: NP-Complete Appetizers Spring 2010 University of Virginia David Evans PS6 is due Tuesday, April 27 (but don’t wait.
Hard problems November Administrivia Ps 8 –Handed out Tuesday (12/4) –Due Tuesday (12/11) or Tuesday (12/18) your choice Ps 9 –Handed out Thursday.
AI 授課教師:顏士淨 2013/09/12 1. Part I & Part II 2  Part I Artificial Intelligence 1 Introduction 2 Intelligent Agents Part II Problem Solving 3 Solving Problems.
Probabilistically Checkable Proofs (and inapproximability) Irit Dinur, Weizmann open day, May 1 st 2009.
Proof, Computation, & Randomness Kurt Gödel John von Neumann and Theoretical Computer Science Avi Wigderson School of Mathematics Institute for Advanced.
Probabilistically Checkable Proofs Madhu Sudan MIT CSAIL 09/23/20091Probabilistic Checking of Proofs TexPoint fonts used in EMF. Read the TexPoint manual.
Introductory Lecture. What is Discrete Mathematics? Discrete mathematics is the part of mathematics devoted to the study of discrete (as opposed to continuous)
PCPs and Inapproximability Introduction. My T. Thai 2 Why Approximation Algorithms  Problems that we cannot find an optimal solution.
Computability and Complexity 13-1 Computability and Complexity Andrei Bulatov The Class NP.
CS1001 Lecture 22. Overview Mechanizing Reasoning Mechanizing Reasoning G ö del ’ s Incompleteness Theorem G ö del ’ s Incompleteness Theorem.
1 Polynomial Church-Turing thesis A decision problem can be solved in polynomial time by using a reasonable sequential model of computation if and only.
P versus NP and Cryptography Wabash College Mathematics and Computer Science Colloquium Nov 16, 2010 Jeff Kinne, Indiana State University (Theoretical)
COMP 3009 Introduction to AI Dr Eleni Mangina
CSE 421 Algorithms Richard Anderson Lecture 27 NP Completeness.
1 More Counting Techniques Possibility trees Multiplication rule Permutations Combinations.
Lecture 24: Gödel’s Proof CS150: Computer Science
CSCI-256 Data Structures & Algorithm Analysis Lecture Note: Some slides by Kevin Wayne. Copyright © 2005 Pearson-Addison Wesley. All rights reserved. 31.
Class 36: Proofs about Unprovability David Evans University of Virginia cs1120.
Of 28 Probabilistically Checkable Proofs Madhu Sudan Microsoft Research June 11, 2015TIFR: Probabilistically Checkable Proofs1.
AOK. D6 Journal (5 th entry) TWE can imagination be objective if it is derived in the mind? If it is always subjective can it lead to knowledge?
March 24, 2009 Complexity in everyday life 1 (Computational) Complexity: In every day life? Madhu Sudan MIT.
Introduction to the Theory of Computation
Scott Perryman Jordan Williams.  NP-completeness is a class of unsolved decision problems in Computer Science.  A decision problem is a YES or NO answer.
Nattee Niparnan. Easy & Hard Problem What is “difficulty” of problem? Difficult for computer scientist to derive algorithm for the problem? Difficult.
Complexity Classes (Ch. 34) The class P: class of problems that can be solved in time that is polynomial in the size of the input, n. if input size is.
David Evans CS200: Computer Science University of Virginia Computer Science Class 24: Gödel’s Theorem.
Math 3121 Abstract Algebra I Section 0: Sets. The axiomatic approach to Mathematics The notion of definition - from the text: "It is impossible to define.
FACULTY OF ENGINEERING & INFORMATION TECHNOLOGIES P, NP, and Complexity Six fundamental facts One rule of thumb Three fundamental notions One fundamental.
Logic in Computer Science - Overview Sep 1, 2011 POSTECH 박성우.
Complexity and G ö del Incomplete theorem 電機三 B 劉峰豪.
Instructor: Shengyu Zhang 1. Tractable While we have introduced many problems with polynomial-time algorithms… …not all problems enjoy fast computation.
Course Overview and Road Map Computability and Logic.
Artificial Intelligence: Introduction Department of Computer Science & Engineering Indian Institute of Technology Kharagpur.
Great Theoretical Ideas in Computer Science.
1/19 Minimizing weighted completion time with precedence constraints Nikhil Bansal (IBM) Subhash Khot (NYU)
Great Theoretical Ideas in Computer Science.
CS6133 Software Specification and Verification
Thinking in Methodologies Class Notes. Gödel’s Theorem.
Artificial Intelligence “Introduction to Formal Logic” Jennifer J. Burg Department of Mathematics and Computer Science.
Of 27 12/03/2015 Boole-Shannon: Laws of Communication of Thought 1 Laws of Communication of Thought? Madhu Sudan Harvard.
“One ring to rule them all” Analogy (sort of) Lord of The Rings Computational Complexity “One problem to solve them all” “my preciousss…”
Week 13 - Monday.  What did we talk about last time?  B-trees  Hamiltonian tour  Traveling Salesman Problem.
David Evans CS200: Computer Science University of Virginia Computer Science Lecture 15: Intractable Problems (Smiley.
P robabilistically C heckable P roofs Guy Kindler The Hebrew University.
CMPT 308 — Computability and Complexity Fall 2004 Instructor: Andrei Bulatov, TA: Ramsay Dyer, Learning.
Donghyun (David) Kim Department of Mathematics and Physics North Carolina Central University 1 Chapter 0 Introduction Some slides are in courtesy of Prof.
Lecture. Today Problem set 9 out (due next Thursday) Topics: –Complexity Theory –Optimization versus Decision Problems –P and NP –Efficient Verification.
CSE 421 Algorithms Richard Anderson Lecture 27 NP-Completeness Proofs.
TU/e Algorithms (2IL15) – Lecture 9 1 NP-Completeness NOT AND OR AND NOT AND.
David Evans CS200: Computer Science University of Virginia Computer Science Lecture 23: Intractable Problems (Smiley Puzzles.
Introductory Lecture. What is Discrete Mathematics? Discrete mathematics is the part of mathematics devoted to the study of discrete (as opposed to continuous)
Proof And Strategies Chapter 2. Lecturer: Amani Mahajoub Omer Department of Computer Science and Software Engineering Discrete Structures Definition Discrete.
Sub-fields of computer science. Sub-fields of computer science.
Gödel's Legacy: The Limits Of Logics
Computable Functions.
Discrete Mathematics for Computer Science
Richard Anderson Lecture 26 NP-Completeness
Computation: The Mathematical Story
Unsolvable Problems December 4, 2017.
Great Theoretical Ideas in Computer Science
Dana Moshkovitz The Institute For Advanced Study
Introduction to Automata Theory
Artificial Intelligence and Consciousness
Richard Anderson Lecture 25 NP-Completeness
Emergence of Intelligent Machines: Challenges and Opportunities
Lecture 22: Gödel’s Theorem CS200: Computer Science
Introduction to PCP and Hardness of Approximation
Presentation transcript:

of 25 January 7, 2016 CBS: Math, Proofs, Computing 1 Mathematics, Proofs and Computation Madhu Sudan Harvard

of 25 Logic, Mathematics, Proofs Reasoning: Reasoning: Start with body of knowledge. Start with body of knowledge. Add to body of knowledge by new observations, and new deductions Add to body of knowledge by new observations, and new deductions Process susceptible to errors: Process susceptible to errors: One erroneous observation may propagate. One erroneous observation may propagate. Constant process of “consistency checking”. Constant process of “consistency checking”. Mathematics = Language of Precision Mathematics = Language of Precision Captures (subset of) knowledge precisely. Captures (subset of) knowledge precisely. Proofs: Enable checking of consistency of precisely stated facts. Proofs: Enable checking of consistency of precisely stated facts. January 7, 2016CBS: Math, Proofs, Computing2

of 25 In this talk: Proofs and Computation “Computer Assisted Proofs ?” “Computer Assisted Proofs ?” [Appel-Haken] – 4-color theorem [Appel-Haken] – 4-color theorem [Hales] – Kepler Conjecture [Hales] – Kepler Conjecture [Petkovsky,Wilf,Zeilberger] – “A=B” [Petkovsky,Wilf,Zeilberger] – “A=B” January 7, 2016CBS: Math, Proofs, Computing3 No! Mathematics Computing Proofs

of 25 Formal Logic Attempts to convert reasoning to symbolic manipulation. Attempts to convert reasoning to symbolic manipulation. Remarkably powerful. Remarkably powerful. Originated independently, and with different levels of impact, in different civilizations … Originated independently, and with different levels of impact, in different civilizations … January 7, 2016CBS: Math, Proofs, Computing4 "Aristotle Altemps Inv8575" by Copy of Lysippus - Jastrow (2006). Licensed under Public Domain via Commons - Mathematics Proofs

of 25 George Boole ( ) January 7, 2016CBS: Math, Proofs, Computing5 (page 34) Mathematics Proofs

of 25 Boole’s Mathematics: Boole’s Mathematics: Focus on tiny part of mathematical universe. Focus on tiny part of mathematical universe. January 7, 2016CBS: Math, Proofs, Computing6 {0,1} Progress In Math

of 25 Boole’s “modest” ambition “The design of the following treatise is to investigate the fundamental laws of those operations of the mind by which reasoning is performed; to give expression to them in the symbolical language of a Calculus, and upon this foundation to establish the science of Logic and construct its method; to make that method itself the basis of a general method for the application of the mathematical doctrine of Probabilities; and, finally, to collect from the various elements of truth brought to view in the course of these inquiries some probable intimations concerning the nature and constitution of the human mind.” [G.Boole, “On the laws of thought …” p.1] “The design of the following treatise is to investigate the fundamental laws of those operations of the mind by which reasoning is performed; to give expression to them in the symbolical language of a Calculus, and upon this foundation to establish the science of Logic and construct its method; to make that method itself the basis of a general method for the application of the mathematical doctrine of Probabilities; and, finally, to collect from the various elements of truth brought to view in the course of these inquiries some probable intimations concerning the nature and constitution of the human mind.” [G.Boole, “On the laws of thought …” p.1] January 7, 2016CBS: Math, Proofs, Computing7 {0,1}

of 25 Whither Computing? How well does the logic capture mathematics? How well does the logic capture mathematics? January 7, 2016CBS: Math, Proofs, Computing8 Cantor‘1890: Logic may face some problems? Hilbert ‘1900: Should capture everything! Godel ‘1920s: Incompleteness Church-Turing 1930s: Incompleteness holds for any effective reasoning procedure. This statement is not true provable

of 25 January 7, 2016CBS: Math, Proofs, Computing9 Turing’s Machine Model of computer Model of computer FiniteState Control Control R/W UniversalMachine Encodings of other machines One machine to rule them all! → von Neumann architecture CPU RAM - Universal! Mathematics Computing Proofs

of 25 Proofs: Story so far Proof: Has to be mechanically verifiable. Proof: Has to be mechanically verifiable. Theorem: Statement with a proof. Theorem: Statement with a proof. Incompleteness: There exist statements consistent with the system of logic that do not admit a proof. Incompleteness: There exist statements consistent with the system of logic that do not admit a proof. Unaddressed: What difference does proof make? Unaddressed: What difference does proof make? January 7, 2016CBS: Math, Proofs, Computing10 Both mechanically verifiable!

of 25 Origins of Modern Complexity January 7, 2016CBS: Math, Proofs, Computing11

of 25 Proofs, Complexity & Optimization! January 7, 2016CBS: Math, Proofs, Computing12 [Cook ’70] Complexity of Theorem Proving [Levin ’71] Universal Search problems

of 25 Proofs, Complexity & Optimization - 2 January 7, 2016CBS: Math, Proofs, Computing13 [Karp ‘72] Reducibility among combinatorial optimization problems

of 25 Some NP-complete Problems Map Coloring: Can you color a given map with 3- colors, s.t. bordering states have diff. colors? Map Coloring: Can you color a given map with 3- colors, s.t. bordering states have diff. colors? January 7, 2016CBS: Math, Proofs, Computing14

of 25 Some NP-Complete Problems Travelling Salesman Problem: (TSP) – Find tour of minimum length visiting given set of cities. Travelling Salesman Problem: (TSP) – Find tour of minimum length visiting given set of cities. January 7, 2016CBS: Math, Proofs, Computing15 Image due to [Applegate, Bixby, Chvatal, Cook]. Optimal TSP visiting ~13000 most populated cities in US.

of 25 Some NP-Complete Problems Biology: Fold DNA sequence so as to minimize energy. Biology: Fold DNA sequence so as to minimize energy. Economics: Finding optimal portfolio of stocks subject to budget constraint. Economics: Finding optimal portfolio of stocks subject to budget constraint. Industrial Engineering: Schedule tasks subject to precedence constraints to minimize completion time. Industrial Engineering: Schedule tasks subject to precedence constraints to minimize completion time. … January 7, 2016CBS: Math, Proofs, Computing16

of 25 Consequences to Proof Checking January 7, 2016CBS: Math, Proofs, Computing17

of 25 Don’t know … Don’t know … If P=NP … If P=NP … Cryptography might well be impossible (current systems all broken simultaneously) Cryptography might well be impossible (current systems all broken simultaneously) All optimization problems become “easy” All optimization problems become “easy” … You get whatever you wish … if you can verify satisfaction. … You get whatever you wish … if you can verify satisfaction. Mathematicians replaced by computers. Mathematicians replaced by computers. If P≠NP … If P≠NP … … Consistent with current thinking, so no radical changes. … Consistent with current thinking, so no radical changes. Proof would be very educational. Proof would be very educational. Might provide sound cryptosystems. Might provide sound cryptosystems. Independent of Peano’s axioms, Choice …? Independent of Peano’s axioms, Choice …? January 7, 2016CBS: Math, Proofs, Computing18 Is P=NP? “Of all the Clay Problems, this might be the one to find the shortest solution, by an amateur mathematician.” - Devlin, The Millenium Problems (Possibly thinking P=NP) “If someone shows P=NP, then they prove any theorem they wish. So they would walk away not just with $1M, but $6M by solving all the Clay Problems!” - Lance Fortnow, Complexity Blog “P = NP?” is Mathematics-Complete !!

of 25 Post-Modern Complexity Emphasis on Randomness. Emphasis on Randomness. Randomness can potentially speed up algorithms. Randomness can potentially speed up algorithms. Essential for Essential for Equilibrium behavior Equilibrium behavior Coordination among multiple players Coordination among multiple players Cryptography Cryptography But it probably can’t help with Logic – right? But it probably can’t help with Logic – right? Actually – it does!! Actually – it does!! January 7, 2016CBS: Math, Proofs, Computing19

of 25 Interactive Proofs January 7, 2016CBS: Math, Proofs, Computing20

of 25 Probabilistically Checkable Proofs Do proofs have to be read in entirety to verify? Do proofs have to be read in entirety to verify? January 7, 2016CBS: Math, Proofs, Computing21

of 25 Probabilistically Checkable Proofs January 7, 2016CBS: Math, Proofs, Computing22

of 25 PCPs and Optimization January 7, 2016CBS: Math, Proofs, Computing23

of 25 Summary and Conclusions Computing is a science: Computing is a science: Goes to the very heart of scientific inquiry. Goes to the very heart of scientific inquiry. What big implications follow from local steps? What big implications follow from local steps? Search for proofs captures essence of all search and optimization. Search for proofs captures essence of all search and optimization. “Is P=NP?” Central mathematical question. “Is P=NP?” Central mathematical question. Still open. Still open. But lots of progress … But lots of progress … “Khot’s UGC” (Unique Games Conjecture): Cutting edge of optimization. “Khot’s UGC” (Unique Games Conjecture): Cutting edge of optimization. Khot’s Unique Games Conjecture: Cutting edge of optimization. Sharp thresholds almost everywhere? Khot’s Unique Games Conjecture: Cutting edge of optimization. Sharp thresholds almost everywhere? Communication of Knowledge: Communication of Knowledge: Will we use PCPs to communicate math proofs? Will we use PCPs to communicate math proofs? Will we use PCPs anywhere? Will we use PCPs anywhere? Computing is a science!! Computing is a science!! What global changes can/can not be effected by sequence of local changes? What global changes can/can not be effected by sequence of local changes? January 7, 2016CBS: Math, Proofs, Computing24

of 25 Thank You! January 7, 2016CBS: Math, Proofs, Computing25