CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.

Slides:



Advertisements
Similar presentations
Part VI NP-Hardness. Lecture 23 Whats NP? Hard Problems.
Advertisements

Based on Powerpoint slides by Giorgi Japaridze, Villanova University Space Complexity and Interactive Proof Systems Sections 8.0, 8.1, 8.2, 8.3, 10.4.
Variants of Turing machines
1 Savitch and Immerman- Szelepcsènyi Theorems. 2 Space Compression  For every k-tape S(n) space bounded offline (with a separate read-only input tape)
1 Nondeterministic Space is Closed Under Complement Presented by Jing Zhang and Yingbo Wang Theory of Computation II Professor: Geoffrey Smith.
Complexity Theory Lecture 3 Lecturer: Moni Naor. Recap Last week: Non deterministic communication complexity Probabilistic communication complexity Their.
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
1 Space Complexity. 2 Def: Let M be a deterministic Turing Machine that halts on all inputs. Space Complexity of M is the function f:N  N, where f(n)
Giorgi Japaridze Theory of Computability Savitch’s Theorem Section 8.1.
The class NP Section 7.3 Giorgi Japaridze Theory of Computability.
Fall 2013 CMU CS Computational Complexity Lecture 5 Savich’s theorem, and IS theorems. These slides are mostly a resequencing of Chris Umans’ slides.
Umans Complexity Theory Lectures Lecture 4b: Nondeterministic Space: I-S Theorem: NL = coNL.
NL equals coNL Section 8.6 Giorgi Japaridze Theory of Computability.
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
Complexity 12-1 Complexity Andrei Bulatov Non-Deterministic Space.
Complexity 15-1 Complexity Andrei Bulatov Hierarchy Theorem.
Complexity 11-1 Complexity Andrei Bulatov Space Complexity.
Computability and Complexity 22-1 Computability and Complexity Andrei Bulatov Hierarchy Theorem.
Complexity 13-1 Complexity Andrei Bulatov Hierarchy Theorem.
Computability and Complexity 14-1 Computability and Complexity Andrei Bulatov Cook’s Theorem.
P and NP Sipser (pages ). CS 311 Fall Polynomial time P = ∪ k TIME(n k ) … P = ∪ k TIME(n k ) … TIME(n 3 ) TIME(n 2 ) TIME(n)
NP-completeness Sipser 7.4 (pages 271 – 283). CS 311 Mount Holyoke College 2 The classes P and NP NP = ∪ k NTIME(n k ) P = ∪ k TIME(n k )
NP-completeness Sipser 7.4 (pages 271 – 283). CS 311 Fall The classes P and NP NP = ∪ k NTIME(n k ) P = ∪ k TIME(n k )
Computability and Complexity 19-1 Computability and Complexity Andrei Bulatov Non-Deterministic Space.
P, NP, PS, and NPS By Muhannad Harrim. Class P P is the complexity class containing decision problems which can be solved by a Deterministic Turing machine.
Complexity ©D.Moshkovitz 1 Turing Machines. Complexity ©D.Moshkovitz 2 Motivation Our main goal in this course is to analyze problems and categorize them.
FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY Read sections 7.1 – 7.3 of the book for next time.
Complexity ©D.Moshkovits 1 Space Complexity Complexity ©D.Moshkovits 2 Motivation Complexity classes correspond to bounds on resources One such resource.
1 Polynomial Time Reductions Polynomial Computable function : For any computes in polynomial time.
Computability and Complexity 20-1 Computability and Complexity Andrei Bulatov Class NL.
Alternating Turing Machine (ATM) –  node is marked accept iff any of its children is marked accept. –  node is marked accept iff all of its children.
CS Master – Introduction to the Theory of Computation Jan Maluszynski - HT Lecture NP-Completeness Jan Maluszynski, IDA, 2007
Non-Deterministic Space is Closed Under Complementation Neil Immerman Richard Szelepcsenyi Presented By: Subhajit Dasgupta.
1 The Cook-Levin Theorem Zeph Grunschlag. 2 Announcements Last HW due Thursday Please give feedback about course at oracle.seas.columbia.edu/wces oracle.seas.columbia.edu/wces.
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
INHERENT LIMITATIONS OF COMPUTER PROGRAMS CSci 4011.
PSPACE-Completeness Section 8.3 Giorgi Japaridze Theory of Computability.
Definition: Let M be a deterministic Turing Machine that halts on all inputs. Space Complexity of M is the function f:N  N, where f(n) is the maximum.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
חישוביות וסיבוכיות Computability and Complexity Lecture 7 TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A AAAA.
CSCI 2670 Introduction to Theory of Computing November 29, 2005.
CS848: Topics in Databases: Foundations of Query Optimization Topics covered  Review of complexity.
A Problem That Is Complete for PSPACE (Polynomial Space) BY TEJA SUDHA GARIGANTI.
NP-completeness Class of hard problems. Jaruloj ChongstitvatanaNP-complete Problems2 Outline  Introduction  Problems and Languages Turing machines and.
Computability NP complete problems. Space complexity. Homework: [Post proposal]. Find PSPACE- Complete problems. Work on presentations.
The Classes L and NL Section 8.4 Giorgi Japaridze Theory of Computability.
Umans Complexity Theory Lectures Lecture 1c: Robust Time & Space Classes.
Alternation Section 10.3 Giorgi Japaridze Theory of Computability.
NP-complete Languages
Homework 8 Solutions Problem 1. Draw a diagram showing the various classes of languages that we have discussed and alluded to in terms of which class.
CSCI 2670 Introduction to Theory of Computing December 2, 2004.
CSCI 2670 Introduction to Theory of Computing December 7, 2005.
Theory of Computational Complexity Yuji Ishikawa Avis lab. M1.
The NP class. NP-completeness Lecture2. The NP-class The NP class is a class that contains all the problems that can be decided by a Non-Deterministic.
Chapter 7 Introduction to Computational Complexity.
 2005 SDU Lecture15 P,NP,NP-complete.  2005 SDU 2 The PATH problem PATH = { | G is a directed graph that has a directed path from s to t} s t
 2005 SDU Lecture14 Mapping Reducibility, Complexity.
Space Complexity Complexity ©D.Moshkovits.
Part VI NP-Hardness.
Theory of Computability
Theory of Computational Complexity
Intractable Problems Time-Bounded Turing Machines Classes P and NP
Space Complexity Costas Busch - LSU.
CSC 4170 Theory of Computation Space complexity Chapter 8.
CSC 4170 Theory of Computation The class NP Section 7.3.
Theory of Computability
Part II Theory of Nondeterministic Computation
Space Complexity and Interactive Proof Systems
Intro to Theory of Computation
CS151 Complexity Theory Lecture 4 April 8, 2004.
Presentation transcript:

CSCI 4325 / 6339 Theory of Computation Zhixiang Chen

Chapter 8 Space Complexity

Topics Savitch’s Theorem PSPACE Class, PSPACE-Completeness, The TQBE Problem L and NL NL-Completeness, the PATH Problem NL=co-NL

Space Complexity Definition.  Let M be a DTM that halts on all inputs. The space complexity of M is the function where f(n) is the maximum number of tape cells that M scans on any input of length n. We say M runs in space f(n).  If M is a NTM wherein all branches halt on all inputs, we define its space complexity f(n) to be the maximum number of tape cells that M scans on any branch of its computation for any input of length n.

Space Complexity Classes Definition Let be a function. We define space complexity classes  L is a language decided by an O(f(n)) space DTM}  L is a language decided by an O(f(n)) space NTM}

Examples

Savitch’s Theorem Theorem. For any function where we have

Proof. For space O(f(n)), the total number of config’s is Use “binary-search” to decide whether C-start yields c-accept in steps.  Use a stack to maintain the recursive calls. Initial Config C-start Final Config c-accept mid Config c-middle

PSPACE vs. NPSPACE Definition By Savitch’s Theorem,

A New World P NP NP-complete PSPACE EXPTIME

PSPACE-Completeness Definition A language B is PSPACE-complete if 1. B is in PSPACE 2. Every language in PSPACE is ploy-time reducible to B. If M merely satisfies condition 2, we say B is PSPACE-hard.

The TQBF Problem Quantified Boolean functions  or and is a Boolean CNF formula.  is true if exists some value of is true.  is true if for all values of is true. Example 

TQBF TQBF is the set of all true fully quantified Boolean formulas. The TQBF problem is to determine whether a fully quantified Boolean formula is true or false.

TQBF is PSPACE-complete. Proof.  We can view the evaluation process of a given fully quantified formula as a tree, performing depth-first search of the tree gives a poly-space algorithm. So, TQBF is in PSPACE.  To prove TQBF is PSPACE-hard, we need to construct a fully quantified Boolean formula to simulate the computation of a given space TM M so that

The Classes L and NL Sublinear space TM: A TM M with one read-only input tape and read/write work tape. The read head remains in the portion of the input tape containing the input. The space used on the work tape contributes to the space complexity. Definition Example

The PATH problem

PATH is in P  Easy PATH is in NL  Starting a node s, the machine records only the current node and nondeterministically guesses the next node among those adjacent to the current node. Repeat until t is found, or all m guesses have been done, where m is the number of nodes. This is done in NL.

New Configurations If M is a TM that has a separate read-only input tape and w is an input, a configuration of M on w is the setting the state, the work tape, and the positions of the two tape heads. The input w is not part of the configuration of M on w. q

NL-Completeness Log space transducer: A TM with a r-only input tape, and r/w work tape and a w-only output tape. A log space transducer computes a function using log space of work tape, the result of the function is written on the output tape. Log space reduction:

A language B is NL-complete if However, L=?NL is also open.

PATH is NL-Complete Proof.  PATH is in NL is known  Need to show every A in NL is log space reducible to PATH. Let the log space NTM M computing A. Simulate the computation of M on w, find all possible configurations of M on w to express nodes for a directed graph. Let s be and t be the start and accept configurations of M on w. Have an edge from one node to another node is the first yields the second. M accepts w iff there is a directed path from the start node to the accept node.

NL=Co-NL Proof. Since PATH is in NL, it suffices to show

Suppose we know that the number of nodes in G that are reachable from s is c. Nondeterministically select exactly c nodes reachable from s, not including t, and prove that each is reachable from s by guessing the path. If this is true, then the remaining nodes, including t, is not reachable from s, so accept. Otherwise, reject.

How to compute the number of nodes reachable from s?