Presentation is loading. Please wait.

Presentation is loading. Please wait.

Discriminative Training of Markov Logic Networks

Published byCassie Akehurst Modified over 9 years ago

Similar presentations

Presentation on theme: "Discriminative Training of Markov Logic Networks"— Presentation transcript:

1 Discriminative Training of Markov Logic Networks
Parag Singla & Pedro Domingos

2 Outline Motivation Review of MLNs Discriminative Training Experiments
Link Prediction Object Identification Conclusion and Future Work

3 Outline Motivation Review of MLNs Discriminative Training Experiments
Link Prediction Object Identification Conclusion and Future Work

4 Markov Logic Networks(MLNs)
AI systems must be able to learn, reason logically and handle uncertainty Markov Logic Networks [Richardson and Domingos, 2004]- an effective way to combine first order logic and probability Markov Networks are used as underlying representation Features specfied using arbitrary formulas in finite first order logic

5 Training of MLNs – Generative Approach
Optimize the joint distribution of all the variables Parameters learnt independent of specific inference task Maximum-likelihood (ML) training – computation of the gradient involves inference – too slow! Use Psuedo-likelihood (PL) as an alternative – easy to compute PL is suboptimal. Ignores any non-local interactions between variables ML, PL – generative training approaches

6 Training of MLNs -Discriminative Approach
No need to optimize the joint distribution of all the variables Optimize the conditional likelihood (CL) of non-evidence variables given evidence variables Parameters learnt for a specific inference task Tends to do better than generative training in general

7 Why is Discriminative Better?
Generative Parameters learnt are not optimized for the specific inference task. Need to model all the dependencies in the data – learning might become complicated. Example of generative models: MRFs Discriminative Parameters learnt are optimized for the specific inference task. Need not model dependencies between evidence variables – makes learning task easier. Example of discriminative models: CRFs [Lafferty, McCallum, Pereira 2001]

8 Outline Motivation Review of MLNs Discriminative Training Experiments
Link Prediction Object Identification Conclusion and Future Work

9 Markov Logic Networks A Markov Logic Network (MLN) is a set of pairs (F, w) where F is a formula in first-order logic w is a real number Together with a finite set of constants, it defines a Markov network with One node for each grounding of each predicate in the MLN One feature for each grounding of each formula F in the MLN, with the corresponding weight w

10 Likelihood 1 if jth ground clause is true, 0 otherwise
Iterate over all ground clauses 1 if jth ground clause is true, 0 otherwise # true groundings of ith clause Iterate over all MLN clauses

11 Gradient of Log-Likelihood
Feature count according to data Feature count according to model 1st term: # true groundings of formula in DB 2nd term: inference required (slow!)

12 Pseudo-Likelihood [Besag, 1975]
Likelihood of each ground atom given its Markov blanket in the data Does not require inference at each step Optimized using L-BFGS [Liu & Nocedal, 1989]

13 Gradient of Pseudo-Log-Likelihood
where nsati(x=v) is the number of satisfied groundings of clause i in the training data when x takes value v Most terms not affected by changes in weights After initial setup, each iteration takes O(# ground predicates x # first-order clauses)

14 Outline Motivation Review of MLNs Discriminative Training Experiments
Link Prediction Object Identification Conclusion and Future Work

15 Conditional Likelihood (CL)
Normalize over all possible configurations of non-evidence variables Non-evidence variables Iterate over all MLN clauses with at least one grounding containing query variables Evidence variables

16 Derivative of log CL 1st term: # true groundings (involving query
variables) of formula in DB 2nd term: inference required, as before (slow!)

17 Derivative of log CL Approximate the expected count by MAP count
MAP state

18 Approximating the Expected Count
Use Voted Perceptron Algorithm [Collins, 2002] Approximate the expected count by count for the most likely state (MAP) state Used successfully for linear chain Markov networks MAP state found using Viterbi

19 Voted Perceptron Algorithm
Initialize wi=0 For t=1 to T Find the MAP configuration according to current set of weights. wi,t=  * (training count – MAP count) wi= wi,t/T (Avoids over-fitting)

20 Generalizing Voted Perceptron
Finding the MAP configuration NP hard for the general case. Can be reduced to a weighted satisfiability (MaxSAT) problem. Given a SAT formula in clausal form e.g. (x1 V x3 V x5) … (x5 V x7 Vx50) with clause i having weight of wi Find the assignment maximizing the sum of weights of satisfied clauses.

21 MaxWalkSAT [Kautz, Selman & Jiang 97]
Assumes clauses with positive weights Mixes greedy search with random walks Start with some configuration of variables. Randomly pick an unsatisfied clause. With probability p, flip the literal in the clause which gives maximum gain. With probability 1-p flip a random literal in the clause. Repeat for a pre-decided number of flips, storing the best seen configuration.

22 Handling the Negative Weights
MLN allows formulas with negative weights. A formula with weight w can be replaced by its negation with weight –w in the ground Markov network. (x1  x3  x5) [w] => (x1  x3  x5) [-w] => (x1  x3  x5) [-w] (x1  x3  x5) [-w] => x1 , x3 , x5 [ -w/3]

23 Weight Initialization and Learning Rate
Weights initialized using log odds of each clause being true in the data. Determining the learning rate – use a validation set. Learning rate  1/#(ground predicates)

24 Outline Motivation Review of MLNs Discriminative Training Experiments
Link Prediction Object Identification Conclusion and Future Work

25 Outline Motivation Review of MLNs Discriminative Training Experiments
Link Prediction Object Identification Conclusion and Future Work

26 Link Prediction UW-CSE database Used by Richardson & Domingos [2004]
Database of people/courses/publications at UW-CSE 22 Predicates e.g. Student(P), Professor(P), AdvisedBy(P1,P2) 1158 constants divided into 10 types 4,055,575 ground atoms 3212 true ground atoms 94 hand coded rules stating various regularities Student(P) => !Professor(P) Predict AdvisedBy in the absence of information about the predicates Professor and Student

27 Systems Compared MLN(VP) MLN(ML) MLN(PL) KB CL NB BN

28 Results on Link Prediction

29 Results on Link Prediction

30 Outline Motivation Review of MLNs Discriminative Training Experiments
Link Prediction Object Identification Conclusion and Future Work

31 Object Identification
Given a database of various records referring to objects in the real world Each record represented by a set of attribute values Want to find out which of the records refer to the same object Example: A paper may have more than one reference in a bibliography database

32 Why is it Important? Data Cleaning and Integration – first step in the KDD process Merging of data from multiple sources results in duplicates Entity Resolution: Extremely important for doing any sort of data-mining State of the art – far from what is required. Citeseer has 30 different entries for the AI textbook by Russell and Norvig

33 Standard Approach [Fellegi & Sunter, 1969]
Look at each pair of records independently Calculate the similarity score for each attribute value pair based on some metric Find the overall similarity score Merge the records whose similarity is above a threshold Take a transitive closure

34 An Example Subset of a Bibliography Relation Record Title Author Venue
Object Identification using MLNs Linda Stewart KDD 2004 B2 SIGKDD 10 B3 Learning Boolean Formulas Bill Johnson B4 Learning of Boolean Formulas William Johnson Subset of a Bibliography Relation

35 Graphical Representation in Standard Model
Title Title Sim(Object Identification using MLNs, Object Identification using MLNs) Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b1=b2 ? b3=b4 ? Sim(KDD 2004, SIGKDD 10) Sim(KDD 2004, SIGKDD 10) Venue Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author Record-pair node Evidence node

36 What’s Missing? Title Title Sim(Object Identification using MLNs, Object Identification using MLNs) Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b1=b2 ? b3=b4 ? Sim(KDD 2004, SIGKDD 10) Sim(KDD 2004, SIGKDD 10) Venue Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author If from b1=b2, you infer that “KDD 2004” is same as “SIGKDD 10”, how can you use that to help figure out if b3=b4?

37 Collective Model – Basic Idea
Perform simultaneous inference for all the candidate pairs Facilitate flow of information through shared attribute values

38 Representation in Standard Model
Title Title Sim(Object Identification using MLNs, Object Identification using MLNs) Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b3=b4 ? b1=b2 ? Sim(KDD 2004, SIGKDD 10) Sim(KDD 2004, SIGKDD 10) Venue Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author No sharing of nodes

39 Merging the Evidence Nodes
Title Title Sim(Object Identification using MLNs, Object Identification using MLNs) Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b3=b4 ? b1=b2 ? Sim(KDD 2004, SIGKDD 10) Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author Author Still does not solve the problem. Why?

40 Introducing Information Nodes
Title Title Sim(Object Identification using MLNs, Object Identification using MLNs) Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b1=b2 ? b3=b4 ? Information node b1.T=b2.T? b3.T=b4.T? b1.V=b2.V? b3.V=b4.V? b1.A=b2.A? b3.A=b4.A? Sim(KDD 2004, SIGKDD 10) Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author Full representation in Collective Model

41 Flow of Information Title Title Sim(Object Identification using MLNs,
Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b1=b2 ? b3=b4 ? b1.T=b2.T? b3.T=b4.T? b1.V=b2.V? b3.V=b4.V? b1.A=b2.A? b3.A=b4.A? Sim(KDD 2004, SIGKDD 10) Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author

42 Flow of Information Title Title Sim(Object Identification using MLNs,
Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b1=b2 ? b3=b4 ? b1.T=b2.T? b3.T=b4.T? b1.V=b2.V? b3.V=b4.V? b1.A=b2.A? b3.A=b4.A? Sim(KDD 2004, SIGKDD 10) Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author

43 Flow of Information Title Title Sim(Object Identification using MLNs,
Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b1=b2 ? b3=b4 ? b1.T=b2.T? b3.T=b4.T? b1.V=b2.V? b3.V=b4.V? b1.A=b2.A? b3.A=b4.A? Sim(KDD 2004, SIGKDD 10) Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author

44 Flow of Information Title Title Sim(Object Identification using MLNs,
Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b1=b2 ? b3=b4 ? b1.T=b2.T? b3.T=b4.T? b1.V=b2.V? b3.V=b4.V? b1.A=b2.A? b3.A=b4.A? Sim(KDD 2004, SIGKDD 10) Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author

45 Flow of Information Title Title Sim(Object Identification using MLNs,
Sim(Learning Boolean Formulas, Leraning of Boolean Formulas) b1=b2 ? b3=b4 ? b1.T=b2.T? b3.T=b4.T? b1.V=b2.V? b3.V=b4.V? b1.A=b2.A? b3.A=b4.A? Sim(KDD 2004, SIGKDD 10) Venue Sim(Linda Stewart, Linda Stewart) Sim(Bill Johnson, William Johnson) Author Author

46 MLN Predicates for De-Duplicating Citation Databases
If two bib entries are the same - SameBib(b1,b2) If two field values are the same - SameAuthor(a1,a2), SameTitle(t1,t2), SameVenue(v1,v2) If cosine based TFIDF score of two field values lies in a particular range (0, , , etc.) – 6 predicates for each field. E.g. AuthorTFIDF.8(a1,a2) is true if TFIDF similarity score of a1,a2 is in the range (.2, .4]

47 MLN Rules for De-Duplicating Citation Databases
Singleton Predicates ! SameBib(b1,b2) Two fields are same => corresponding bib entries are same. Author(b1,a1)  Author(b2,a2)  SameAuthor(a1,a2)=> SameBib(b1,b2) Two papers are same => corresponding fields are same Author(b1,a1)  Author(b2,a2)  SameBib(b1,b2)=> SameAuthor(a1,a2) High similarity score => two fields are same AuthorTFIDF.8(a1,a2) =>SameAuthor(a1,a2) Transitive closure (currently not incorporated) SameBib(b1,b2)  SameBib(b2,b3) => SameBib(b1,b3) 25 first order predicates, 46 first order clauses.

48 Cora Database Cleaned up version of McCallum’s Cora database.
1295 citations to 132 difference Computer Science research papers, each citation described by author, venue, title fields. 401,552 ground atoms. 82,026 tuples (true ground atoms) Predict SameBib, SameAuthor, SameVenue

49 Systems Compared MLN(VP) MLN(ML) MLN(PL) KB CL NB BN

50 Results on Cora Predicting the Citation Matches

51 Results on Cora Predicting the Citation Matches

52 Results on Cora Predicting the Author Matches

53 Results on Cora Predicting the Author Matches

54 Results on Cora Predicting the Venue Matches

55 Results on Cora Predicting the Venue Matches

56 Outline Motivation Review of MLNs Discriminative Training Experiments
Link Prediction Object Identification Conclusion and Future Work

57 Conclusions Markov Logic Networks – a powerful way of combining logic and probability. MLNs can be discriminatively trained using a voted perceptron algorithm Discriminatively trained MLNs perform better than purely logical approaches, purely probabilistic approaches as well as generatively trained MLNs.

58 Future Work Discriminative learning of MLN structure
Max-margin type training of MLNs Extensions of MaxWalkSAT Further application to the link prediction, object identification and possibly other application areas.

Download ppt "Discriminative Training of Markov Logic Networks"

Similar presentations

Online Max-Margin Weight Learning with Markov Logic Networks Tuyen N. Huynh and Raymond J. Mooney Machine Learning Group Department of Computer Science.

Online Max-Margin Weight Learning with Markov Logic Networks Tuyen N. Huynh and Raymond J. Mooney Machine Learning Group Department of Computer Science.
Joint Inference in Information Extraction Hoifung Poon Dept. Computer Science & Eng. University of Washington (Joint work with Pedro Domingos)

Joint Inference in Information Extraction Hoifung Poon Dept. Computer Science & Eng. University of Washington (Joint work with Pedro Domingos)
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.

Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
University of Texas at Austin Machine Learning Group Department of Computer Sciences University of Texas at Austin Discriminative Structure and Parameter.

University of Texas at Austin Machine Learning Group Department of Computer Sciences University of Texas at Austin Discriminative Structure and Parameter.
“Using Weighted MAX-SAT Engines to Solve MPE” -- by James D. Park Shuo (Olivia) Yang.

“Using Weighted MAX-SAT Engines to Solve MPE” -- by James D. Park Shuo (Olivia) Yang.
Online Max-Margin Weight Learning for Markov Logic Networks Tuyen N. Huynh and Raymond J. Mooney Machine Learning Group Department of Computer Science.

Online Max-Margin Weight Learning for Markov Logic Networks Tuyen N. Huynh and Raymond J. Mooney Machine Learning Group Department of Computer Science.
Constrained Approximate Maximum Entropy Learning (CAMEL) Varun Ganapathi, David Vickrey, John Duchi, Daphne Koller Stanford University TexPoint fonts used.

Constrained Approximate Maximum Entropy Learning (CAMEL) Varun Ganapathi, David Vickrey, John Duchi, Daphne Koller Stanford University TexPoint fonts used.
Undirected Probabilistic Graphical Models (Markov Nets) (Slides from Sam Roweis)

Undirected Probabilistic Graphical Models (Markov Nets) (Slides from Sam Roweis)
Review Markov Logic Networks Mathew Richardson Pedro Domingos Xinran(Sean) Luo, u0866707.

Review Markov Logic Networks Mathew Richardson Pedro Domingos Xinran(Sean) Luo, u
Speeding Up Inference in Markov Logic Networks by Preprocessing to Reduce the Size of the Resulting Grounded Network Jude Shavlik Sriraam Natarajan Computer.

Speeding Up Inference in Markov Logic Networks by Preprocessing to Reduce the Size of the Resulting Grounded Network Jude Shavlik Sriraam Natarajan Computer.
Adbuctive Markov Logic for Plan Recognition Parag Singla & Raymond J. Mooney Dept. of Computer Science University of Texas, Austin.

Adbuctive Markov Logic for Plan Recognition Parag Singla & Raymond J. Mooney Dept. of Computer Science University of Texas, Austin.
Markov Networks.

Markov Networks.
1 Profile Hidden Markov Models For Protein Structure Prediction Colin Cherry

1 Profile Hidden Markov Models For Protein Structure Prediction Colin Cherry
Efficient Weight Learning for Markov Logic Networks Daniel Lowd University of Washington (Joint work with Pedro Domingos)

Efficient Weight Learning for Markov Logic Networks Daniel Lowd University of Washington (Joint work with Pedro Domingos)
Markov Logic: A Unifying Framework for Statistical Relational Learning Pedro Domingos Matthew Richardson

Markov Logic: A Unifying Framework for Statistical Relational Learning Pedro Domingos Matthew Richardson
Speaker:Benedict Fehringer Seminar:Probabilistic Models for Information Extraction by Dr. Martin Theobald and Maximilian Dylla Based on Richards, M., and.

Speaker:Benedict Fehringer Seminar:Probabilistic Models for Information Extraction by Dr. Martin Theobald and Maximilian Dylla Based on Richards, M., and.
GS 540 week 6. HMM basics Given a sequence, and state parameters: – Each possible path through the states has a certain probability of emitting the sequence.

GS 540 week 6. HMM basics Given a sequence, and state parameters: – Each possible path through the states has a certain probability of emitting the sequence.
Overview Full Bayesian Learning MAP learning

Overview Full Bayesian Learning MAP learning
A Probabilistic Framework for Information Integration and Retrieval on the Semantic Web by Livia Predoiu, Heiner Stuckenschmidt Institute of Computer Science,

A Probabilistic Framework for Information Integration and Retrieval on the Semantic Web by Livia Predoiu, Heiner Stuckenschmidt Institute of Computer Science,
CSE 574 – Artificial Intelligence II Statistical Relational Learning Instructor: Pedro Domingos.

CSE 574 – Artificial Intelligence II Statistical Relational Learning Instructor: Pedro Domingos.

Similar presentations

Ads by Google