Complexity theory and combinatorial optimization Class #2 – 17 th of March …. where we deal with decision problems, finite automata, Turing machines pink.

Slides:



Advertisements
Similar presentations
Turing Machines Memory = an infinitely long tape Persistent storage A read/write tape head that can move around the tape Initially, the tape contains only.
Advertisements

CS 345: Chapter 9 Algorithmic Universality and Its Robustness
 2004 SDU Lecture17-P,NP, NPC.  2004 SDU 2 1.Decision problem and language decision problem decision problem and language 2.P and NP Definitions of.
Programming Languages Wrap-up. Your Toolkit Object-oriented Imperative Functional Logic.
NP-Completeness Lecture for CS 302. Traveling Salesperson Problem You have to visit n cities You want to make the shortest trip How could you do this?
Recap CS605: The Mathematics and Theory of Computer Science.
Complexity 25-1 Complexity Andrei Bulatov #P-Completeness.
Applied Computer Science II Chapter 3 : Turing Machines Prof. Dr. Luc De Raedt Institut für Informatik Albert-Ludwigs Universität Freiburg Germany.
Computability and Complexity 13-1 Computability and Complexity Andrei Bulatov The Class NP.
Advanced Topics in Algorithms and Data Structures
CS5371 Theory of Computation
P, NP, PS, and NPS By Muhannad Harrim. Class P P is the complexity class containing decision problems which can be solved by a Deterministic Turing machine.
Complexity ©D.Moshkovitz 1 Turing Machines. Complexity ©D.Moshkovitz 2 Motivation Our main goal in this course is to analyze problems and categorize them.
FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY Read sections 7.1 – 7.3 of the book for next time.
Programming the TM qa  (,q) (,q) q1q1 0q1q1 R q1q1 1q1q1 R q1q1  h  Qa  (,q) (,q) q1q1 0q2q2  q1q1 1q3q3  q1q1  h  q2q2 0q4q4 R q2q2 1q4q4.
1 Polynomial Time Reductions Polynomial Computable function : For any computes in polynomial time.
Lecture 5 Turing Machines
1 Other Models of Computation. 2 Models of computation: Turing Machines Recursive Functions Post Systems Rewriting Systems.
Linear Bounded Automata LBAs
Chapter 11: Limitations of Algorithmic Power
Fall 2004COMP 3351 Time Complexity We use a multitape Turing machine We count the number of steps until a string is accepted We use the O(k) notation.
Halting Problem. Background - Halting Problem Common error: Program goes into an infinite loop. Wouldn’t it be nice to have a tool that would warn us.
Final Exam Review Cummulative Chapters 0, 1, 2, 3, 4, 5 and 7.
Remaining Topics Decidability Concept 4.1 The Halting Problem 4.2
Computational Complexity Polynomial time O(n k ) input size n, k constant Tractable problems solvable in polynomial time(Opposite Intractable) Ex: sorting,
Machines with Memory Chapter 3 (Part B). Turing Machines  Introduced by Alan Turing in 1936 in his famous paper “On Computable Numbers with an Application.
Introduction to the Theory of Computation
Ding-Zhu Du Office: ECSS 3-611, M 3:15-4:30 Lecture: ECSS 2.311, MW 12:30-1:45.
Internet Engineering Czesław Smutnicki Discrete Mathematics – Computational Complexity.
© M. Winter COSC/MATH 4P61 - Theory of Computation COSC/MATH 4P61 Theory of Computation Michael Winter –office: J323 –office hours: Mon & Fri, 10:00am-noon.
Review Byron Gao. Overview Theory of computation: central areas: Automata, Computability, Complexity Computability: Is the problem solvable? –solvable.
CSCI 2670 Introduction to Theory of Computing December 1, 2004.
CSE 024: Design & Analysis of Algorithms Chapter 9: NP Completeness Sedgewick Chp:40 David Luebke’s Course Notes / University of Virginia, Computer Science.
Complexity 25-1 Complexity Andrei Bulatov Counting Problems.
CSCI 3160 Design and Analysis of Algorithms Tutorial 10 Chengyu Lin.
CS848: Topics in Databases: Foundations of Query Optimization Topics covered  Review of complexity.
P Vs NP Turing Machine. Definitions - Turing Machine Turing Machine M has a tape of squares Each Square is capable of storing a symbol from set Γ (including.
Lecture 12 P and NP Introduction to intractability Class P and NP Class NPC (NP-complete)
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
Strings Basic data type in computational biology A string is an ordered succession of characters or symbols from a finite set called an alphabet Sequence.
Costas Busch - LSU1 Time Complexity. Costas Busch - LSU2 Consider a deterministic Turing Machine which decides a language.
NP-Completeness  For convenience, the theory of NP - Completeness is designed for decision problems (i.e. whose solution is either yes or no).  Abstractly,
Chapter 11 Introduction to Computational Complexity Copyright © 2011 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1.
1 Time Complexity We use a multitape Turing machine We count the number of steps until a string is accepted We use the O(k) notation.
Chapter 15 P, NP, and Cook’s Theorem. 2 Computability Theory n Establishes whether decision problems are (only) theoretically decidable, i.e., decides.
COMPLEXITY. Satisfiability(SAT) problem Conjunctive normal form(CNF): Let S be a Boolean expression in CNF. That is, S is the product(and) of several.
1 Linear Bounded Automata LBAs. 2 Linear Bounded Automata (LBAs) are the same as Turing Machines with one difference: The input string tape space is the.
NP ⊆ PCP(n 3, 1) Theory of Computation. NP ⊆ PCP(n 3,1) What is that? NP ⊆ PCP(n 3,1) What is that?
CS623: Introduction to Computing with Neural Nets (lecture-7) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
1 1. Which of these sequences correspond to Hamilton cycles in the graph? (a) (b) (c) (d) (e)
Prof. Busch - LSU1 Time Complexity. Prof. Busch - LSU2 Consider a deterministic Turing Machine which decides a language.
CS 154 Formal Languages and Computability May 12 Class Meeting Department of Computer Science San Jose State University Spring 2016 Instructor: Ron Mak.
The Church-Turing Thesis
Turing Machines CS 130 Theory of Computation HMU Textbook: Chap 8.
Costas Busch - RPI1 Decidability. Costas Busch - RPI2 Consider problems with answer YES or NO Examples: Does Machine have three states ? Is string a binary.
Computability. Turing Machines Read input letter & tape letter, write tape letter, move left or right.
Theory of Computation. Introduction to The Course Lectures: Room ( Sun. & Tue.: 8 am – 9:30 am) Instructor: Dr. Ayman Srour (Ph.D. in Computer Science).
 2005 SDU Lecture14 Mapping Reducibility, Complexity.
Complexity, Decidability, Computability and other impossible questions Stephen Dolan, IMSA 2010.
Modeling Arithmetic, Computation, and Languages Mathematical Structures for Computer Science Chapter 8 Copyright © 2006 W.H. Freeman & Co.MSCS SlidesTuring.
Formal Foundations-II [Theory of Automata]
Introduction to the Theory of Computation
Linear Bounded Automata LBAs
Reductions Costas Busch - LSU.
Other Models of Computation
Recall last lecture and Nondeterministic TMs
Chapter 1 Regular Language
NP and NP completeness 姚鹏晖
CS6382 Theory of Computation
Presentation transcript:

Complexity theory and combinatorial optimization Class #2 – 17 th of March …. where we deal with decision problems, finite automata, Turing machines pink dogs, …. But also P, NP, NP-completeness, …..

Introduction to computational intractability Is my problem efficiently solved by a computer? an automatic machine an algorithm?

What’s a problem? Decision problems:each instance is a question Formal definition with language theory More natural problems: “meta-language” encoding scheme That is the problem ….

What’s an algorithm? The pink dog question Does a pink dog exist?Does a pink dog exist (outside London)? Since the answer is yes, it can be answered Since there are only a finite number of dogs (outside London) and since for each one a can decide whether it is pink or not it can be answered. Will be ever exist any pink dog outside London? To answer it one needs a formal model of dogs.

What’s an algorithm? Computability models o Lambda-calculus (A. Church, 1931) o General recursive functions (K. Gödel, 1934) o Turing machines (A. Turing, 1936) o Random-Access Machines, … Church thesis Before the first computer The pink dog question

What’s an algorithm: the Turing machine model From finite states automaton ….. to Turing machines 1-tape (deterministic) Turing Machine (DTM) multi-tape Turing machines non-deterministic Turing machines (NDTM) o transition function transition relation o put non-determinism at the beginning equivalence between all these Turing machines models universal Turing Machine Example

Problems solved by Turing machines Is L recognized by M? Is L decided by L? The halting problem: an example of undecidable problem M: DTM, L a language on the same input alphabet Decision problem solved by an algorithm? (through an encoding scheme)

Complexity of Turing machines Complexity of DTM (halting for each instance) Complexity of NDTM Polynomial-time: considered as efficiency (Cobham-Edmond’s thesis) Difference between DTM and NDTM (from complexity point of view) From languages to problems (reasonable encoding schemes) A notion of efficiency

P, NP and NP-completeness The class P The class NP Exponentially solving problems in NP Polynomial reductions NP-complete problems

Some NP-complete problems SAT Cook’s theorem (1971) How to prove NP-completeness after Cook? 3-SAT to be continued during the next class

Enjoy your vacation

01100 b b b b b b … q0q0 q1q1 q1q1 q2q2 qNqN An Example of 1-tape Deterministic Turing Machine

01110 b b b b b b … q0q0 q1q1 q1q1 q2q2 q2q2 q2q2

1110 b b b b b b … q4q4 q4q4 q4q4 q4q4 q3q3 q2q2 b

b110 b b b b b b … q4q4 q0q0 q1q1 q2q2 q2q2 b

b11 b b b b b b … q4q4 q4q4 q3q3 q2q2 bb

b1b b b b b b b … q4q4 q0q0 qNqN b

b110 0 b b b b b … q0q0

b110 b b b b b b … q4q4 q4q4 q4q4 q3q3 q2q2 b

b1b0 b b b b b b … q4q4 q0q0 q1q1 q2q2 b

b1b b b b b b b … q3q3 q3q3 q2q2 b b

bbb b b b b b b … q3q3 q0q0 qYqY b What is the accepted language?