Time Hierarchies with One Bit of Advice Konstantin Pervyshev Steklov Mathematics Institute, St. Petersburg, Russia joint work with Dieter van Melkebeek.

Slides:



Advertisements
Similar presentations
Limitations of Quantum Advice and One-Way Communication Scott Aaronson UC Berkeley IAS Useful?
Advertisements

Space Hierarchy Results for Randomized Models Jeff Kinne Dieter van Melkebeek University of Wisconsin-Madison.
Complexity Theory Lecture 6
CS 461 – Nov. 9 Chomsky hierarchy of language classes –Review –Let’s find a language outside the TM world! –Hints: languages and TM are countable, but.
QuickSort Average Case Analysis An Incompressibility Approach Brendan Lucier August 2, 2005.
Chapter 5 The Witness Reduction Technique: Feasible Closure Properties of #P Greg Goldstein Andrew Learn 18 April 2001.
Probabilistic algorithms Section 10.2 Giorgi Japaridze Theory of Computability.
Complexity 13-1 Complexity Andrei Bulatov Hierarchy Theorem.
Complexity 18-1 Complexity Andrei Bulatov Probabilistic Algorithms.
CPSC 411, Fall 2008: Set 12 1 CPSC 411 Design and Analysis of Algorithms Set 12: Undecidability Prof. Jennifer Welch Fall 2008.
CS151 Complexity Theory Lecture 7 April 20, 2004.
1 Linear Bounded Automata LBAs. 2 Linear Bounded Automata are like Turing Machines with a restriction: The working space of the tape is the space of the.
Fall 2003Costas Busch - RPI1 Decidability. Fall 2003Costas Busch - RPI2 Recall: A language is decidable (recursive), if there is a Turing machine (decider)
Perfect and Statistical Secrecy, probabilistic algorithms, Definitions of Easy and Hard, 1-Way FN -- formal definition.
1 Undecidability Andreas Klappenecker [based on slides by Prof. Welch]
Derandomization: New Results and Applications Emanuele Viola Harvard University March 2006.
Randomized Computation Roni Parshani Orly Margalit Eran Mantzur Avi Mintz
On Uniform Amplification of Hardness in NP Luca Trevisan STOC 05 Paper Review Present by Hai Xu.
Probabilistic Complexity. Probabilistic Algorithms Def: A probabilistic Turing Machine M is a type of non- deterministic TM, where each non-deterministic.
1 Slides by Golan Weisz, Omer Ben Shalom Nir Ailon & Tal Moran Adapted from Oded Goldreich’s course lecture notes by Moshe Lewenstien, Yehuda Lindell.
Fall 2004COMP 3351 The Chomsky Hierarchy. Fall 2004COMP 3352 Non-recursively enumerable Recursively-enumerable Recursive Context-sensitive Context-free.
1 Polynomial Time Reductions Polynomial Computable function : For any computes in polynomial time.
Submitted by : Estrella Eisenberg Yair Kaufman Ohad Lipsky Riva Gonen Shalom.
Time Hierarchies for Heuristic Algorithms Konstantin Pervyshev UCSD.
Computability and Complexity 20-1 Computability and Complexity Andrei Bulatov Class NL.
–Def: A language L is in BPP c,s ( 0  s(n)  c(n)  1,  n  N) if there exists a probabilistic poly-time TM M s.t. : 1.  w  L, Pr[M accepts w]  c(|w|),
Linear Bounded Automata LBAs
Complexity ©D. Moshkovitz 1 And Randomized Computations The Polynomial Hierarchy.
January 28, 2015CS21 Lecture 101 CS21 Decidability and Tractability Lecture 10 January 28, 2015.
1 Reducibility. 2 Problem is reduced to problem If we can solve problem then we can solve problem.
In a World of BPP=P Oded Goldreich Weizmann Institute of Science.
The Polynomial Hierarchy By Moti Meir And Yitzhak Sapir Based on notes from lectures by Oded Goldreich taken by Ronen Mizrahi, and lectures by Ely Porat.
CS 461 – Nov. 21 Sections 7.1 – 7.2 Measuring complexity Dividing decidable languages into complexity classes. Algorithm complexity depends on what kind.
CSCI 4325 / 6339 Theory of Computation Zhixiang Chen.
חישוביות וסיבוכיות Computability and Complexity Lecture 7 TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A AAAA.
The Complexity of Primality Testing. What is Primality Testing? Testing whether an integer is prime or not. – An integer p is prime if the only integers.
Approximation Algorithms Pages ADVANCED TOPICS IN COMPLEXITY THEORY.
Optimal Proof Systems and Sparse Sets Harry Buhrman, CWI Steve Fenner, South Carolina Lance Fortnow, NEC/Chicago Dieter van Melkebeek, DIMACS/Chicago.
CS151 Complexity Theory Lecture 13 May 11, Outline proof systems interactive proofs and their power Arthur-Merlin games.
1 2 Probabilistic Computations  Extend the notion of “efficient computation” beyond polynomial-time- Turing machines.  We will still consider only.
Computation Model and Complexity Class. 2 An algorithmic process that uses the result of a random draw to make an approximated decision has the ability.
. CLASSES RP AND ZPP By: SARIKA PAMMI. CONTENTS:  INTRODUCTION  RP  FACTS ABOUT RP  MONTE CARLO ALGORITHM  CO-RP  ZPP  FACTS ABOUT ZPP  RELATION.
On approximate majority and probabilistic time Emanuele Viola Institute for advanced study Work done during Ph.D. at Harvard University June 2007.
1 Linear Bounded Automata LBAs. 2 Linear Bounded Automata (LBAs) are the same as Turing Machines with one difference: The input string tape space is the.
1Computer Sciences Department. Book: INTRODUCTION TO THE THEORY OF COMPUTATION, SECOND EDITION, by: MICHAEL SIPSER Reference 3Computer Sciences Department.
1 Introduction to Quantum Information Processing CS 467 / CS 667 Phys 467 / Phys 767 C&O 481 / C&O 681 Richard Cleve DC 3524 Course.
Probabilistic verification Mario Szegedy, Rutgers www/cs.rutgers.edu/~szegedy/07540 Lecture 1.
Recursively Enumerable and Recursive Languages
Pseudo-random generators Talk for Amnon ’ s seminar.
Comparing Notions of Full Derandomization Lance Fortnow NEC Research Institute With thanks to Dieter van Melkebeek.
1 Linear Bounded Automata LBAs. 2 Linear Bounded Automata (LBAs) are the same as Turing Machines with one difference: The input string tape space is the.
Theory of Computational Complexity Yuji Ishikawa Avis lab. M1.
CSC 3130: Automata theory and formal languages Andrej Bogdanov The Chinese University of Hong Kong Undecidable.
Decidability.
CSCI 2670 Introduction to Theory of Computing November 15, 2005.
Probabilistic Algorithms
Recursively Enumerable and Recursive Languages
Busch Complexity Lectures: Reductions
Linear Bounded Automata LBAs
Computational Complexity Theory
New Nonuniform lower bounds for uniform classes
Perspective on Lower Bounds: Diagonalization
An average-case lower bound against ACC0
Intractable Problems Time-Bounded Turing Machines Classes P and NP
Decidable Languages Costas Busch - LSU.
CS21 Decidability and Tractability
CS154, Lecture 12: Time Complexity
The Polynomial Hierarchy
Space Hierarchy Results for Randomized Models
CSE 105 theory of computation
Presentation transcript:

Time Hierarchies with One Bit of Advice Konstantin Pervyshev Steklov Mathematics Institute, St. Petersburg, Russia joint work with Dieter van Melkebeek

Time Hierarchy An open question for probabilistic algorithms: is there a time hierarchy ? O(n 2 ) O(n 3 ) O(n) (we still can’t disprove this)

Our result Previous results –[Barak 02] uses a modified notion of algorithm (algorithms with small advice) –Under the modified notion of algorithm, a time hierarchy for the probabilistic algorithms exists Our result –Under the same modified notion of algorithm, a time hierarchy exists for any class of algorithms various classes of probabilistic algorithms Arthur-Merlin and Merlin-Arthur games, other kinds of IP NP ∩ co-NP

Outline Why standard techniques don’t work Where advice helps How to prove the generic time hierarchy

Diagonalization To separate deterministic time n a+e from time n a, consider a machine M such that –M(k) := not N k (k), where n a steps of N k are simulated M runs in time n a+ M recognizes some languages L L can’t be recognized in time n a (!) deterministic algorithms are recursively enumerable

Probabilistic Algortithms and Diagonalization Probabilistic Algorithms –Probabilistic Turing machines that satisfy some condition on the error probability Two-sided error (BPP) –Pr[M(x) = 1] > 2/3 or Pr[M(x) = 0] > 2/3 –“machine M is good on input x” –“machine M is good at length n” Need to enumerate only good machines M(k) := not N k (k) Pr[N k (k) = 1] = 1/2 => Pr[M(k) = 1] = 1/2 It’s not possible

More Failures Various classes of probabilistic algorithms –bounded probability of error BPP – two-sided error RR – one-sided error ZPP – zero-sided error NP ∩ co-NP –two machines solve the same language Generally speaking, semantic classes Diagonalization fails –N k (k) is bad => M(k) is bad To overcome this, M needs advice on whether N k is good

Algorithms with Advice Turing machine M on input x of length n is provided with –some advice a(n) of length l(n) Advice is the same for every input of length n Depending on the advice provided, –M may recognize several languages –M may satisfy the promise or not Advice of length 1 bit helps with time hierarchies

Time Hierarchies with Advice A time hierarchy exists for probabilistic algorithms with advice of length –O(log log n) bits – [Barak 02] –1 bit – [Fortnow, Santhanam 04] Time hierarchy for any class of algorithms with advice of length –O(log n * log log n) bits – [Fortnow, Santhanam, Trevisan 05] –1 bit – our result

Generic Time Hierarchy –To separate n a+e from n a, it’s sufficient to prove that for any 1 ≤ a, there exists a language L solvable in probabilistic polynomial time with 1 bit of advice – machine M with advice a(n) not solvable in probabilistic time n a with 1 bit of advice –any machine N k with any advice b(n)

A Failed Approach Construct M with advice a(n) so that –for some inputs x (0) and x (1) of the same length n M (x (0),a(n)) := not N k (x (0),0) M (x (1),a(n)) := not N k (x (1),1) Both N k (x,0) and N k (x,1) may be bad => M needs 2 bits of advice in order to diagonalize safely

Another Failed Approach M can safely simulate N k via deterministic simulation –needs exponentially more time To get exponentially more time, we use delayed diagonalization

A Step of Delayed Diagonalization x (0) x (1) z (1) y (0) Advice on whether N/0 is good on x’s M(z (1) ) = N(x (1),1) M(y (0) ) = “no” Advice on whether N/1 is good on x’s N/0 is bad N/1 is good

Tree-Like Delayed Diagonalization x (00-11) z (10,11) y (00,01) v (01) w (11) M(z (01) ) = N(x (01),1) M(z (11) ) = N(x (11),1) M(v (01) ) = N(z (01),0) M(y (00) ) = “no” M(y (01) ) = “no” M(w (11) ) = “no” N/0 is bad N/1 is good N/0 is good N/1 is bad

Towards a Contradiction –Assume for some advice b(n), N is good and solves the same language as M –Then N(v (s),b(|v|)) = M(v (s),a(|v|)) = N(z (s),b(|z|)) = M(z (s),a(|z|)) = N(x (s),b(|x|)) = M(x (s),a(|x|)) –Therefore, N(v (s),b(|v|)) = M(x (s),a(|x|)) for some s –So let M(x (s),a(|x|)) := not N(v (s),b(|v|)) this can be done deterministically –thus a contradiction x (s) z (s) v (s) |x| ~ 2 |v| a

Choice of the Input Lengths We need –parent’s length is polynomial in children’s length so that M runs in poly-time –for any leaf v, roots length is greater than 2 |v| a so that M can deterministically simulate N at leaves It’s possible to satisfy these conditions QED x (s) z (s) v (s)

Summary A time hierarchy exists for virtually any kind of algorithms with one bit of advice The probabilistic time hierarchy with advice is a property of algorithms with advice

Thank you! Dieter van Melkebeek, Konstantin Pervyshev “A Generic Time Hierarchy for Semantic Models with One Bit of Advice” (CCC’06)

Generic Time Hierarchy –Theorem for any 1 ≤ a < b, there exists a language L solvable in probabilistic time n b with 1 bit of advice not solvable in probabilistic time n a with 1 bit of advice –Only basic properties of algorithms are needed –Approach Construct probabilistic M with 1-bit advice a(n) that –works in time n b –is good Prove that for any probabilistic N with any 1-bit advice b(n) that –works in time n a –is good There exists x such that M(x,a(|x|)) ≠ N(x,b(|x|))

Non-Uniform World Previous results –[Barak02, FS04, FST05] a time hierarchy exists for 1 bit non-uniform probabilistic algorithms with two- and one- sided error Our result –a time hierarchy exists for any class of 1 bit non-uniform algorithms various classes of probabilistic algorithms Arthur-Merlin and Merlin-Arthur games, other kinds of IP NP ∩ co-NP

Recall Non-deterministic Time Hierarchy Non-deterministic time –M can copy (simulate) N –M can’t negate N Our case –M can copy N(x,b(|x|)) –We have no idea of how to negate N trivially Delayed diagonalization x (0) x (1) z (1) y (0)