Automatically Identifying Record Patterns from the Extracted Data Fields of Genealogical Microfilm Kenneth Tubbs David W. Embley

Problem Searching through microfilm by hand is tedious.Searching through microfilm by hand is tedious. Extraction by hand requires large amounts of time and manpower.Extraction by hand requires large amounts of time and manpower.

Algorithm Record Patterns Record Patterns XML Input File (Preprocessed Microfilm Image) Genealogical OntologyInputOutputMethod Match Attributes Match Attributes Identify Structure Identify Structure Check Constraints Check Constraints Evaluate Candidates Evaluate Candidates

External Preprocessing Input Features Input Features 1.Coordinates of each zone. 2.Printed text of each zone. 3.Whether or not each zone is empty. XML Input File < zone rectangle="66,55,223,11" printed_text=“NAME and Surname of each Person" empty="0" />

Identify Structure Identify Table PrimitivesIdentify Table Primitives Evaluate PrimitivesEvaluate Primitives Factor Table PrimitivesFactor Table Primitives Identify Structure Identify Structure

Identify Table Primitives Name Row: [label:value+] right, height Identify Structure Identify Structure

Identify Table Primitives Column: [label:value+] down, width Name Identify Structure Identify Structure

Identify Table Primitives Row: [label:value+] right, height Identify Structure Identify Structure

Evaluate Primitives Primitive Confidence Level == Identify Structure Identify Structure

Evaluate Primitives * Confidence (Label i, Value j ) = Identify Structure Identify Structure

Factor Table Primitives ABCDEF [A B C D E F] or [A] [B C D E F] or [E] [A B C D F] or Others. Identify Structure Identify Structure

Factor Table Primitives An expert user assigns probabilities to types of factorings.An expert user assigns probabilities to types of factorings. Example Example [column:column+] left,.90 [column:column+] left,.90 [row:column+] below,.85 [row:column+] below,.85 Identify Structure Identify Structure

Match Attributes Identify Possible Mappings from the Microfilm Table to the Genealogical Ontology.Identify Possible Mappings from the Microfilm Table to the Genealogical Ontology. Match Attributes Match Attributes Identify Structure Identify Structure

Identify Possible Mappings 1.Identical Matches 2.Synonym Matches 3.Composite Matches Genealogical Ontology Printed Text Name SexGender Female AgeFemale, Age Mapping types Match Attributes Match Attributes Identify Structure Identify Structure

Evaluate Mapping Edit distance between wordsEdit distance between words Match Attributes Match Attributes Identify Structure Identify Structure

Check Constraints The algorithm evaluates each the factoring of each record with a genealogical ontology.The algorithm evaluates each the factoring of each record with a genealogical ontology. Match Attributes Match Attributes Identify Structure Identify Structure Check Constraints Check Constraints

Identify Records Table (Address, Name) = 14 / 3 = 4.67 LabelNumber of Values Address 3 Name 14 Age 13 Gender 14 Match Attributes Match Attributes Identify Structure Identify Structure Check Constraints Check Constraints

Genealogical Ontology The genealogical ontology is created by an expert user. The cardinalities are assigned to the ontology by recording the cardinalities of a corpus of microfilm. The cardinalities are assigned to the ontology by recording the cardinalities of a corpus of microfilm. Match Attributes Match Attributes Identify Structure Identify Structure Check Constraints Check Constraints

Genealogical Ontology Ontology (Address, Name) = 1 * 4.3 * 1.1 = 4.73 Family Address AgeGender 1 1 Person Name Match Attributes Match Attributes Identify Structure Identify Structure Check Constraints Check Constraints

Evaluate Factoring Ontology (Address, Name) = 1.0 * 4.3 * 1.1 = 4.73 Table (Address, Name) = 14 / 3 = 4.67 Distance Classifier Distance_From_Ontology = 1 / (4.73 – 4.67) 2 = 277 Distance_From_No_Factoring = 1 / (1 – 4.67) 2 =.0724 Match Attributes Match Attributes Identify Structure Identify Structure Check Constraints Check Constraints

Evaluate Candidates For every combination of primitives, attribute mappings, and factorings compute the product of their confidences.For every combination of primitives, attribute mappings, and factorings compute the product of their confidences. Select most confident combination.Select most confident combination.

Evaluate Candidates Primitive 1 Primitive 2 Primitive 3 Attribute Confidence FFFF FFFF FFFF FFFF FFFF FFFF FFFF FFFF FFFF

Evaluate Candidates Primitive 1 Primitive 2 Primitive 3 Attribute Confidence F F F F F

Evaluate Candidates Primitive 1 Primitive 2 Primitive 3 Attribute Confidence F F F

Evaluate Candidates Primitive 1 Primitive 2 Primitive 3 Attribute Confidence FFFF FFFF FFFF FFFF FFFF FFFF FFFF FFFF FFFF

Evaluate Candidates Primitive 1 Primitive 2 Primitive 3 Attribute Confidence FFFF FFFF FFFF FFFF FFFF

Evaluate Candidates Primitive 1 Primitive 2 Primitive 3 Attribute Confidence F F F

Algorithm Record Patterns Record Patterns XML Input File (Preprocessed Microfilm Image) Genealogical OntologyInputOutputMethod Match Attributes Match Attributes Identify Structure Identify Structure Check Constraints Check Constraints Evaluate Candidates Evaluate Candidates

Output Record Patterns –Attributes of each record. –Geometry of each record. Attribute mappings for the table to the ontology.

Microfilm Queries A web form provides the interfaceA web form provides the interface to query the microfilm database. Individuals can enter keywords, (such as first and last name), and the system locates the appropriate records among the indexed documents.Individuals can enter keywords, (such as first and last name), and the system locates the appropriate records among the indexed documents.

Web Query EyreJohn

Query Results Click an image to select a result document.

Query Results Relevant region of the document is displayed.

Automatically Identifying Record Patterns from the Extracted Data Fields of Genealogical Microfilm Kenneth Tubbs David W. Embley