Kernelization and the Larger Picture of Practical Algorithmics, in Contemporary Context Michael R. Fellows Charles Darwin University Australia WorKer,

Slides:



Advertisements
Similar presentations
Chapter 11 Limitations of Algorithm Power Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
Advertisements

From Approximative Kernelization to High Fidelity Reductions joint with Michael Fellows Ariel Kulik Frances Rosamond Technion Charles Darwin Univ. Hadas.
Bart Jansen 1.  Problem definition  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least k leaves?
Unsupervised Learning Clustering K-Means. Recall: Key Components of Intelligent Agents Representation Language: Graph, Bayes Nets, Linear functions Inference.
Introduction to Kernel Lower Bounds Daniel Lokshtanov.
COMP 553: Algorithmic Game Theory Fall 2014 Yang Cai Lecture 21.
Lecture 24 Coping with NPC and Unsolvable problems. When a problem is unsolvable, that's generally very bad news: it means there is no general algorithm.
What is Intractable? Some problems seem too hard to solve efficiently. Question 1: Does an efficient algorithm exist?  An O(a ) algorithm, where a > 1,
Bart Jansen, Utrecht University. 2  Max Leaf  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least.
Approximative Kernelization: On the Trade-off between Fidelity and Kernel Size joint with Michael Fellows and Frances Rosamond Charles Darwin University.
The Theory of NP-Completeness
1 NP-Complete Problems. 2 We discuss some hard problems:  how hard? (computational complexity)  what makes them hard?  any solutions? Definitions 
Polynomial Time Approximation Schemes Presented By: Leonid Barenboim Roee Weisbert.
The Power of Preprocessing Bart M. P. Jansen September 29th, Algorithms & Visualization seminar, TU Eindhoven.
Probabilistically Checkable Proofs (and inapproximability) Irit Dinur, Weizmann open day, May 1 st 2009.
Effective Heuristics for NP-Hard Problems Arising in Molecular Biology Richard M. Karp Bangalore, January 5, 2011.
Ai in game programming it university of copenhagen Statistical Learning Methods Marco Loog.
CPSC 322 Introduction to Artificial Intelligence October 27, 2004.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
1 NP-Completeness Objectives: At the end of the lesson, students should be able to: 1. Differentiate between class P, NP, and NPC 2. Reduce a known NPC.
Implicit Hitting Set Problems Richard M. Karp Harvard University August 29, 2011.
CSE 326: Data Structures NP Completeness Ben Lerner Summer 2007.
Randomized Process of Unknowns and Implicitly Enforced Bounds on Parameters Jianer Chen Department of Computer Science & Engineering Texas A&M University.
EXPANDER GRAPHS Properties & Applications. Things to cover ! Definitions Properties Combinatorial, Spectral properties Constructions “Explicit” constructions.
Analysis of Algorithms CS 477/677
The community-search problem and how to plan a successful cocktail party Mauro SozioAris Gionis Max Planck Institute, Germany Yahoo! Research, Barcelona.
NP-complete and NP-hard problems. Decision problems vs. optimization problems The problems we are trying to solve are basically of two kinds. In decision.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 25 Instructor: Paul Beame.
1 Refined Search Tree Technique for Dominating Set on Planar Graphs Jochen Alber, Hongbing Fan, Michael R. Fellows, Henning Fernau, Rolf Niedermeier, Fran.
Tal Mor  Create an automatic system that given an image of a room and a color, will color the room walls  Maintaining the original texture.
CSE 589 Applied Algorithms Spring Colorability Branch and Bound.
Do we need theoretical computer science in software engineering curriculum: an experience from Uni Novi Sad Bansko, August 28, 2013.
1 UTeach Professional Development Courses. 2 UTS Step 1 Early exposure to classroom environment (can be as early as a student’s first semester)
Programming & Data Structures
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Fixed Parameter Complexity Algorithms and Networks.
Computational Complexity Polynomial time O(n k ) input size n, k constant Tractable problems solvable in polynomial time(Opposite Intractable) Ex: sorting,
Scott Perryman Jordan Williams.  NP-completeness is a class of unsolved decision problems in Computer Science.  A decision problem is a YES or NO answer.
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
Advanced Algorithm Design and Analysis (Lecture 13) SW5 fall 2004 Simonas Šaltenis E1-215b
Algorithms  Al-Khwarizmi, arab mathematician, 8 th century  Wrote a book: al-kitab… from which the word Algebra comes  Oldest algorithm: Euclidian algorithm.
1 The Price of Defense M. Mavronicolas , V. Papadopoulou , L. Michael ¥, A. Philippou , P. Spirakis § University of Cyprus, Cyprus  University of Patras.
UT-ORNL 15 March 2005 CSIIR Workshop 1 Trusted Computing Amidst Untrustworthy Intermediaries Mike Langston Department of Computer Science University of.
Models in I.E. Lectures Introduction to Optimization Models: Shortest Paths.
Digital Intuition Cluster, Smart Geometry 2013, Stylianos Dritsas, Mirco Becker, David Kosdruy, Juan Subercaseaux Welcome Notes Overview 1. Perspective.
Complexity of Determining Nonemptiness of the Core Vincent Conitzer, Tuomas Sandholm Computer Science Department Carnegie Mellon University.
NP-Complete Problems. Running Time v.s. Input Size Concern with problems whose complexity may be described by exponential functions. Tractable problems.
Two Dimension Measures: A New Algorithimic Method for Solving NP-Hard Problems Yang Liu.
Implicit Hitting Set Problems Richard M. Karp Erick Moreno Centeno DIMACS 20 th Anniversary.
2101INT – Principles of Intelligence Systems Lecture 3.
CS6045: Advanced Algorithms NP Completeness. NP-Completeness Some problems are intractable: as they grow large, we are unable to solve them in reasonable.
Data Reduction for Graph Coloring Problems Bart M. P. Jansen Joint work with Stefan Kratsch August 22 nd 2011, Oslo.
Algorithms For Solving History Sensitive Cascade in Diffusion Networks Research Proposal Georgi Smilyanov, Maksim Tsikhanovich Advisor Dr Yu Zhang Trinity.
Algorithms for hard problems Introduction Juris Viksna, 2015.
Introduction to NP-Completeness Tahir Azim. The Downside of Computers Many problems can be solved in linear time or polynomial time But there are also.
Conditional Lower Bounds for Dynamic Programming Problems Karl Bringmann Max Planck Institute for Informatics Saarbrücken, Germany.
1 The Theory of NP-Completeness 2 Review: Finding lower bound by problem transformation Problem X reduces to problem Y (X  Y ) iff X can be solved by.
The NP class. NP-completeness Lecture2. The NP-class The NP class is a class that contains all the problems that can be decided by a Non-Deterministic.
Conceptual Foundations © 2008 Pearson Education Australia Lecture slides for this course are based on teaching materials provided/referred by: (1) Statistics.
The NP class. NP-completeness
Introduction to Approximation Algorithms
Algorithms for hard problems
Analysis and design of algorithm
Parameterised Complexity
REDUCESEARCH Polynomial Kernels for Hitting Forbidden Minors under Structural Parameterizations Bart M. P. Jansen Astrid Pieterse ESA 2018 August.
On the effect of randomness on planted 3-coloring models
Chapter 11 Limitations of Algorithm Power
Complexity Theory in Practice
Hamiltonicity below Dirac’s condition
15th Scandinavian Workshop on Algorithm Theory
Presentation transcript:

Kernelization and the Larger Picture of Practical Algorithmics, in Contemporary Context Michael R. Fellows Charles Darwin University Australia WorKer, Vienna 2011

Two thoughts on parameterized complexity and theoretical computer science. (1)PC is as much about “workflow reform” as about “more fine-grained complexity analysis” (2) We want to create mathematical tools with  Explanatory  Predictive Three kinds of power  Engineering To help us create useful algorithms.

A classic example of explanatory power: TYPE CHECKING in ML

Combinatorial optimization problems arise frequently in computational molecular biology …Except in rare cases, the problems are NP-hard, and the performance guarantees provided by polynomial-time approximation algorithms are far too pessimistic to be useful. Average-case analysis of algorithms is also of limited use because the spectrum of real-life problem instances is unlikely to be representable by a mathematically tractable probablility distribution. Thus it appears necessary to attack these problems using heuristic algorithms. Although we focus here on computational biology, heuristics are also likely to be the method of choice in many other application areas, for reasons similar to those that we have advanced in the case of biology. -Introduction to “Heuristic algorithms in computational molecular biology,” Richard M. Karp, JCSS 77 (2011)

Karp’s proposed: General heuristic for Implicit Hitting Set problems. Running example: DIRECTED FEEDBACK VERTEX SET In: Digraph D Out: A minimum cardinality set of vertices that “hit” all directed cycles. Explicit versus implicit Hitting Set Problems Explicit: List the things that need to be hit. Implicit: The list is implicit in the digraph description (made explicit, the list might be exponential in size).

Assumed Separation oracle – Find an unhit cycle if there is one P-time algorithm for approx solution of the explicit hitting set problem Algorithm for optimal solution of the explicit HS problem

Γ : things to be hit (cycles) Н : a hitting set (vertices) Karp’s generic Hitting Set heuristic: Γ ← empty set Repeat: Using the approximation algorithm, construct a hitting set Н for Γ : Using the separation oracle, attempt to find a circuit that H does not hit; If a circuit is found then add that circuit to Γ else Н ← an optimal hitting set for Γ : Using the separation oracle, attempt to find a circuit Н that does not hit; If a circuit is found then add the circuit to Γ : else return Н and halt

The intuition behind Karp’s general heuristic Quickly identify a (hopefully) small set of important cycles to cover If these are covered then “probably” all cycles are covered – reasonable to pay for optimal solution at this point If this fails, then (win/win) a new important cycle has been discovered

Quickly identify a (hopefully) small set of important cycles to cover What to call this? “Strategic kernelization” in the space between “implicit” and “explicit” ?

EXPLICIT DFVS I In: digraph D, and a list L of directed cycles in D Parameter: k Question: Is there a set of at most k vertices that hits every cycle on the list L? OOPS! While IMPLICIT DFVS I is FPT, Thm: EXPLICIT DFVS I is W[1] – hard.

v “V” selected k– 1 of these u R to B B to R Backward adjacency test k vertex selection gadgets Forward adjacency test N(v)

EXPLICIT DFVS II In: digraph D, list L of directed cycles in D, r Parameter: | L | = k Question: Is there a set of at most r vertices that hits all cycles in L? Thm: This problem is FPT Pf: (1) If r > k, then YES (2) r · 2 k dynamic programming

Summary so Far The design of “effective heuristics” is our inevitable primary mission for most problems, as theoretical computer scientists. General strategic approaches to this task throw up many novel parameterized problems, largely unexplored, as subroutines.

Plan “B” – Two Principles We do what we have been doing: enriching the model when there is tractability deconstructing the proofs when there is intractability and there is very very much to be done, for fun and profit.

Parameterized Algorithmics Branch out! To opportunity! – Focus on the unvisited core problems – Find a mentor/collaborator/interpreter who is established in the area Report on NAG and examples

Stefan and Fran in Australia

Taking Our Own Advice II A Report on the workshop: Not About Graphs Darwin, Australia August 5—8 and 9-13

Workshop Theme The focus of the workshop is to investigate opportunities for expanding parameterized complexity into important unreached areas of algorithmic mathematical science (algebra, number theory, analysis, topology, geometry, game theory, robotics, vision, crypto, etc.) beyond areas where it already has a strong presence (graph theory, computational biology, AI, social choice, etc.). This may require new mathematical techniques. The workshop is also focused on identifying and promoting the key unsolved problems in these new directions.

According to Papadimitriou, every year, several thousand scientific papers use the words “NP-complete” or “NP-hard”.

Example: Computational Logistics Trains! Regular meeting: ATMOS NP-hard classic problem TRAIN MARSHALLING In: Partition Π of [n] Ex. {1, 3}, {2, 4, 5} Parameter: k k = 2 Question: Is k enough? | 4 5 · YES

Example: Computational Geometry Problem! Most of the classic problems are in P. Not a problem! “enrich the model” In: A set of colored points in the plane. Parameter: k Question: Are k lines sufficient to dissect into monochrome regions? Good news: NP-hard!

Example: Computer Vision SEGMENTATION In: matrix of grey-scale values Parameter: k Question: Can the matrix be segmented into < k regions?

Question Should we do this again next year in Germany? Maybe…Gabor Erdelyi has offered to host. Proposed acronym: DECON

Open Problem How does kernelization as we know it interact with real practical computing and heurisitcs?

Thank you