Download presentation
Presentation is loading. Please wait.
Published byRodger Cross Modified over 9 years ago
1
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS Data Sciences Summer Institute Multimodal Information Access and Synthesis Learning and Reasoning with Graphical Models of Probability for the Identity Uncertainty Problem William H. Hsu Thursday, 07 Jun 2007 Laboratory for Knowledge Discovery in Databases Kansas State University http://www.kddresearch.org/KSU/CIS/DSSI-MIAS-SRL-20070607.ppt
2
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS MCMC Tutorial (Murphy, BNT) Identity Uncertainty (IDU) Problem –Definition –Example: citation matching Relevance to Named Entity Recognition and Resolution Relational Graphical Models –What they are –Why use them –How to learn and apply them (next week) Part 4 of 8: Identity Uncertainty Overview
3
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS 1. Making the graph X Y Q X = 1; Q = 2; Y = 3; dag = zeros(3,3); dag(X, [Q Y]) = 1; dag(Q, Y) = 1; Graphs are (sparse) adjacency matrices GUI would be useful for creating complex graphs Repetitive graph structure (e.g., chains, grids) is best created using a script (as above) From Murphy (2003)
4
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS 2. Making the model node_sizes = [1 2 1]; dnodes = [2]; bnet = mk_bnet(dag, node_sizes, … ‘discrete’, dnodes); X Y Q X is always observed input, hence only one effective value Q is a hidden binary node Y is a hidden scalar node bnet is a struct, but should be an object mk_bnet has many optional arguments, passed as string/value pairs From Murphy (2003)
5
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS 3. Specifying the parameters X Y Q bnet.CPD{X} = root_CPD(bnet, X); bnet.CPD{Q} = softmax_CPD(bnet, Q); bnet.CPD{Y} = gaussian_CPD(bnet, Y); CPDs are objects which support various methods such as Convert_from_CPD_to_potential Maximize_params_given_expected_suff_stats Each CPD is created with random parameters Each CPD constructor has many optional arguments From Murphy (2003)
6
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS 4. Training the model load data –ascii; ncases = size(data, 1); cases = cell(3, ncases); observed = [X Y]; cases(observed, :) = num2cell(data’); Training data is stored in cell arrays (slow!), to allow for variable-sized nodes and missing values cases{i,t} = value of node i in case t engine = jtree_inf_engine(bnet, observed); Any inference engine could be used for this trivial model bnet2 = learn_params_em(engine, cases); We use EM since the Q nodes are hidden during training learn_params_em is a function, but should be an object X Y Q From Murphy (2003)
7
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS Before training From Murphy (2003)
8
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS After training From Murphy (2003)
9
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS 5. Inference/ prediction engine = jtree_inf_engine(bnet2); evidence = cell(1,3); evidence{X} = 0.68; % Q and Y are hidden engine = enter_evidence(engine, evidence); m = marginal_nodes(engine, Y); m.mu % E[Y|X] m.Sigma % Cov[Y|X] X Y Q From Murphy (2003)
10
Computing & Information Sciences Kansas State University University of Illinois at Urbana-ChampaignDSSI--MIAS Citation Matching Spatial Deduplication –Reported events (e.g., tornado sightings) –Objects (e.g., water wells) Relevance to Named Entity Recognition –“George Bush”: GHWB, GWB, or someone else? –“The Secretary of State”: Albright, Powell, Rice? Guergis? Other? –Anaphora: back-references by pronoun or generic noun (“Jane showed her homework to her professor Sarah. She pointed out the hole in her proof.”) –Generic references: “an online bookseller” Identity Uncertainty (IDU) Problem: Real-World Applications
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.