When intuition is wrong Heuristics for clique and maximum clique Patrick Prosser esq.

Slides:



Advertisements
Similar presentations
An empirical study of the stable marriage problem with ties and incomplete lists (SMTI) Ian Gent & Patrick Prosser.
Advertisements

Propositional Satisfiability (SAT) Toby Walsh Cork Constraint Computation Centre University College Cork Ireland 4c.ucc.ie/~tw/sat/
10/7/2014 Constrainedness of Search Toby Walsh NICTA and UNSW
Problems and Their Classes
WELCOME TO: The Auckland Deaf Christian Fellowship
Identifying Quadratic Functions
Evaluating Heuristics for the Fixed-Predecessor Subproblem of Pm | prec, p j = 1 | C max.
 "Gravitation is not responsible for people falling in love."  "I want to know God's thoughts; the rest are details."
IBM Labs in Haifa © 2005 IBM Corporation Adaptive Application of SAT Solving Techniques Ohad Shacham and Karen Yorav Presented by Sharon Barner.
The Theory of NP-Completeness
Theory of Computing Lecture 16 MAS 714 Hartmut Klauck.
Lecture 10: Integer Programming & Branch-and-Bound
Identifying Quadratic Functions
Algorithms and Problems for Quantified SAT Toby Walsh Department of Computer Science University of York England Ian P. Gent School of Computer Science.
Planning under Uncertainty
Complexity 26-1 Complexity Andrei Bulatov Interactive Proofs.
Complexity Theory CSE 331 Section 2 James Daly. Reminders Project 4 is out Due Friday Dynamic programming project Homework 6 is out Due next week (on.
16:36MCS - WG20041 On the Maximum Cardinality Search Lower Bound for Treewidth Hans Bodlaender Utrecht University Arie Koster ZIB Berlin.
1 Polynomial Church-Turing thesis A decision problem can be solved in polynomial time by using a reasonable sequential model of computation if and only.
08/1 Foundations of AI 8. Satisfiability and Model Construction Davis-Putnam, Phase Transitions, GSAT Wolfram Burgard and Bernhard Nebel.
MAE 552 – Heuristic Optimization Lecture 4 January 30, 2002.
Analysis of Algorithms CS 477/677
Carla P. Gomes CS4700 CS 4700: Foundations of Artificial Intelligence Carla P. Gomes Module: Instance Hardness and Phase Transitions.
Using a “Memetic” Evolutionary Algorithm to Solve a Form of The Maximum Clique Problem By Ian Baird November 20 th, 2003.
Chapter 11: Limitations of Algorithmic Power
Coloring Algorithms and Networks. Coloring2 Graph coloring Vertex coloring: –Function f: V  C, such that for all {v,w}  E: f(v)  f(w) Chromatic number.
If God created everything, he is responsible for everything? Today’s lesson will be successful if: You can evaluate the above statement You can begin to.
Job Shop Reformulation of Vehicle Routing Evgeny Selensky University of Glasgow
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
1 The Theory of NP-Completeness 2012/11/6 P: the class of problems which can be solved by a deterministic polynomial algorithm. NP : the class of decision.
Graph Colouring Various Models. an obvious model SAT sets demo random graphs chromatic number maxCol phase transition.
Theory of Computing Lecture 15 MAS 714 Hartmut Klauck.
Constrainedness Including slides from Toby Walsh.
Theory of Computation, Feodor F. Dragan, Kent State University 1 NP-Completeness P: is the set of decision problems (or languages) that are solvable in.
Computational Complexity Jang, HaYoung BioIntelligence Lab.
ACM today! Nice work to everyone in the qualifiers and evening lab... Today: BS! Next 11/2: guest speaker... On 11/9: final lab session 11/13: regionals.
UT-ORNL 15 March 2005 CSIIR Workshop 1 Trusted Computing Amidst Untrustworthy Intermediaries Mike Langston Department of Computer Science University of.
An Efficient Algorithm for Enumerating Pseudo Cliques Dec/18/2007 ISAAC, Sendai Takeaki Uno National Institute of Informatics & The Graduate University.
Games. Adversaries Consider the process of reasoning when an adversary is trying to defeat our efforts In game playing situations one searches down the.
Curricularizing the ACM... ? Zach Dodds ~ November 13, 2010.
1 Psych 5500/6500 The t Test for a Single Group Mean (Part 1): Two-tail Tests & Confidence Intervals Fall, 2008.
© Negnevitsky, Pearson Education, Lecture 9 Evolutionary Computation: Genetic algorithms Introduction, or can evolution be intelligent? Introduction,
1 The Theory of NP-Completeness 2 Cook ’ s Theorem (1971) Prof. Cook Toronto U. Receiving Turing Award (1982) Discussing difficult problems: worst case.
Solve Absolute Value Inequalities © 2011 The Enlightened Elephant.
Fitting a Function to the Difficulty of Boolean Formulas Greg Dennis NMM Final Project.
A Membrane Algorithm for the Min Storage problem Dipartimento di Informatica, Sistemistica e Comunicazione Università degli Studi di Milano – Bicocca WMC.
Performance prediction for real world optimisation problems Tommy Messelis Stefaan Haspeslagh Burak Bilgin Patrick De Causmaecker Greet Vanden Berghe.
Scientific Method An organized way of trying to find the solution to a problem.
CS 615: Design & Analysis of Algorithms Chapter 2: Efficiency of Algorithms.
Optimization Problems
Lagrangean Relaxation
A Recap. Absolute Optimization 1.The domain is constrained to a closed and bounded region most of the time. 2.Closed and bounded regions are guaranteed.
Costas Busch - LSU1 Time Complexity. Costas Busch - LSU2 Consider a deterministic Turing Machine which decides a language.
Exponential time algorithms Algorithms and networks.
Young CS 331 D&A of Algo. NP-Completeness1 NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and.
“ The Four Principles of Spirituality ” - Indian Thoughts.
Lecture. Today Problem set 9 out (due next Thursday) Topics: –Complexity Theory –Optimization versus Decision Problems –P and NP –Efficient Verification.
The Theory of NP-Completeness 1. Nondeterministic algorithms A nondeterminstic algorithm consists of phase 1: guessing phase 2: checking If the checking.
Paradise Lost – Major Themes Justifying the Ways of God to Man God’s Omnipotence, Omniscience, and Free Will Individual Responsibility The True Nature.
Where are the hard problems?. Remember Graph Colouring? Remember 3Col?
Prof. Busch - LSU1 Time Complexity. Prof. Busch - LSU2 Consider a deterministic Turing Machine which decides a language.
1 The Theory of NP-Completeness 2 Review: Finding lower bound by problem transformation Problem X reduces to problem Y (X  Y ) iff X can be solved by.
Solve Absolute Value Inequalities © 2011 The Enlightened Elephant.
Where are the hard problems?
Time Complexity Costas Busch - LSU.
Unscramble The Words What are these key terms from the current theory we’re looking at? Finicalmounts Callaroues Ipunt Optutu Relegatedgunkmown Nupmat.
NP-Completeness Reference: Computers and Intractability: A Guide to the Theory of NP-Completeness by Garey and Johnson, W.H. Freeman and Company, 1979.
1.6 Linear Programming Pg. 30.
Presentation transcript:

When intuition is wrong Heuristics for clique and maximum clique Patrick Prosser esq.

You have a set of people You have to produce the largest group of people such that everyone in the group knows each other How would you do that?

To a man with a hammer everything looks like a nail Solve it!

lovely lovely java

Model 3

colouring lower bound

clique(n,p,k ) Given a random graph G(n,p) is there a clique of size k or more? GT[19]

clique(n,p,k ) Given a random graph G(n,p) is there a clique of size k or more? GT[19] A “decision problem”, NP-complete

clique(n,p,k ) Given a random graph G(n,p) is there a clique of size k or more? GT[19] A “decision problem”, NP-complete What we did: Generate 100 instances of G(50,0.9) Vary k from 1 to 50 apply Model 1 with max-degree heuristic measure search cost of clique(G(50,0.9), k) determine if sat or unsat Analyse results (5,000 points)

Search effort (decisions)

scatter max mean med Search effort (decisions) Vary that

Complexity peak coincide with crossover point

vary p

vary n

clique(50,0.9,k) for four heuristics

Search is on a log scale!

What are those heuristics?!

H00: choose max degree and reject H01: choose max degree and accept H10: choose min degree and reject H11: choose min degree and accept

H00: choose max degree and reject H01: choose max degree and accept H10: choose min degree and reject H11: choose min degree and accept H1*

WHY? H1*

SoCS-TV

Normal service will soon be resumed

… but just to build tension, here’s what happens when we compare models (normal service will soon be resumed)

SoCS-TV … and we are back

What’s all that “phase transition” malarkey?

Constrainedness (circa 1996)

kappa for clique

kappa seems to work … it fits the empirical results reasonably well

minimise kappa

When you make a decision make sure it drives you into the easy soluble region … capiche? easy soluble

minimise kappa

I wonder if kappa can predict heuristic behaviour?

If a heuristic is good for the decision problem, will it be good for optimisation?

optimisation

What about the DIMACS benchmarks?

DIMACS

?

How not to do it

Could we predict the size of the largest clique?

But we must apply this with caution … we cannot always assume that the graph is random.

What lessons have I learned?

If ethical approval is not required, go wild!

What lessons have I learned? Try and explain why things are the way they are.

What lessons have I learned? If there is theory … use it!

What lessons have I learned? Be honest … report all of your results

What lessons have I learned? And finally … never lend anyone any books

But what about Michaela Regneri’s dinner?

FATA-TV