Presentation is loading. Please wait.

Presentation is loading. Please wait.

New Ways of Mapping Knowledge Organization Systems Using a Semi-Automatic Matching- Procedure for Building Up Vocabulary Crosswalks Andreas Oskar Kempf.

Published byLesley Armstrong Modified over 9 years ago

Similar presentations

Presentation on theme: "New Ways of Mapping Knowledge Organization Systems Using a Semi-Automatic Matching- Procedure for Building Up Vocabulary Crosswalks Andreas Oskar Kempf."— Presentation transcript:

1 New Ways of Mapping Knowledge Organization Systems Using a Semi-Automatic Matching- Procedure for Building Up Vocabulary Crosswalks Andreas Oskar Kempf – GESIS – Leibniz Institute for the Social Sciences Benjamin Zapilko – GESIS – Leibniz Institute for the Social Sciences Dominique Ritze – Mannheim University Library Kai Eckert – Mannheim University

2 Content Vocabulary Crosswalks –Why are they needed? –How do they look like? Automatic Matching Initiatives and Procedures –Ontology Matching Approaches OAEI Library Track 2012 –What kind of outcome and limitations regarding an automatic creation of vocabulary crosswalks do we have to expect? Optimizing the Manual Evaluation Process Conclusion and Outlook ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 2

3 Publication x subject (thesaurus 2): ontology alignment Ontology Mapping Search 0 results Thesaurus 1Thesaurus 2 Ontology Mapping Ontology Alignment Ontology Mapping Search Publication x subject (thesaurus 1): ontology alignment = Mapping KOS - Motivation ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 3

4 Why are they needed? allow for integrated and high-quality search scenarios in distributed information collections indexed on the basis of different controlled vocabularies allow for interoperability among different knowledge organization systems allow for vocabulary expansion and provide possible routes into various domain-specific languages allow for query expansion and reformulation allow for the use of familiar vocabularies to maneuver between different information resources 1. Vocabulary Crosswalks (1/2) ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 4

5 How do they look like?  consist of equivalence (=), hierarchy ( ) and association (^) relations  could consist of a mapping to several terms of the vocabulary being mapped to and of a combination of terms of the vocabulary being mapped to  are established bilaterally (A > B and B > A) How are they being done?  get an overview over the topical overlap and the structure of the different vocabularies  build up an understanding of the meaning and semantics of the terms and the internal relations of the vocabularies  start the mapping process (take all the internal relations, synonyms/non- descriptors within the concepts into account)  modify mappings already built up during the mapping process  perform retrieval tests Projects  MACS (National Libraries CH, F, GB, GER), OCLC Mappings 1. Vocabulary Crosswalks (2/2) ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 5

6 Ontology Matching Person Author PCMember Document Paper Review People Author Reviewer Doc Paper reviews writes reviews … CommitteeMember ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 6

7 Ontology Matching Evaluation ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 7

8 Ontology Alignment Evaluation Initiative (OAEI)  Annual international campaign started in the year 2004  Different tracks/datasets  Objectives:  Improving the performances of mapping tools in the field of ontology matching  Comparing the different algorithms  Detecting new challanges for matching systems 2. Terminology Mapping (2/2) ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 8

9 OAEI Library Track 2012 Data Sets  Thesaurus for the Sociel Sciences (TheSoz) about 8.000 concepts with about 4.000 additional keywords/entry terms (EN, DE, FR)  Thesaurus for Economics (STW) about 6.000 concepts with about 19.000 additional keywords/entry terms (EN, DE) Reference Alignment (2006)  TheSoz > STW; STW > TheSoz (≈7,000 intellectually created relations in each direction)

10 Thesaurus = Ontology? SKOSOWL skos:Conceptowl:Class skos:prefLabel skos:altLabel rdfs:label skos:scopeNote skos:notation rdfs:comment A skos:narrower BA rdfs: subClassOf B A skos:broader BB rdfs:subClassOf A skos:relatedrdfs:seeAlso Ananas Tropical Fruit Metal Product -> Metal Thesauri:Polydimensional Ontologies (for they are characterized by only a limited number of conceptual relation types). Ontologies: Multidimensional Systems with potentially infinite number of relation types. See: Gietz 2001: 24f.

11 Results How to evaluate the results? F-Measure of 0.67 good? SystemPrecisionRecallF-MeasureTime (s)Size1:1 GOMMA0.5370.9060.6748044712 ServOMapLt0.6540.6870.670452938 LogMap0.6880.6440.665952620 ServOMap0.7170.6190.665442413yes YAM++0.5950.7500.6644963522 LogMapLt0.5770.7760.662213756 G02A0.6750.6450.660327732671 Hertuda0.4650.9250.619143635559 WeSeE0.6120.6070.6091440702774yes HotMatch0.6450.5750.608144942494yes CODI0.4340.4810.456398693100yes MapSSS0.5200.1840.2722171989yes AROMA0.1070.6520.184109617001 Optima0.3210.0720.11737457624

12 ISKO UK Conference, 8th -12 Equivalence Relations (in total) Correct Equivalence Relations Non-Correct Equivalence Relations AROMA3.500215 (6,1%)3.285 CODI628162 (25,8%)466 GO2A631213 (33,8%)418 GOMMA682246 (36,1%)436 Hertuda828269 (32,5%)556 HotMatch448194 (43,3%)254 LogMapLt540234 (43,3%)306 LogMap403203 (50,4%)200 MapSSS17564 (36,6%)111 Optima16538 (23,0%)127 ServOMapL525252 (48,0%)273 ServOMap433232 (53,8)201 WeSeE682225 (33,0%)457 YAM++613248 (40,5%)365 Manual Evaluation

13 Optimizing the Evaluation Process All correspondences (including duplicates) Unique correspondences Total number 5546622592 …of which are correct 215412484 (11%) Leading question: How can the intellectual matching process be best supported by ontology matching tools? Approach: Reorganizing the alignments according to the largest agreement between the different matching tools. ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 13

14 Number of Accordances between the different Matching Tools

15 Percentage of Correct Correspondences Number of corresponding matchers Number of all correspondences Number of all correct correspondences Percentage of correct correspondences 13717098.56 % 1220919492.82 % 1165258189.11 % 1050640980.83 % 944827561.38 % 848623848.87 % 752319437.09 % 655517731.89 % 552810820.45 % 45749015.68 % 35385610.41 % 2840485.71 % 116662500.27 % ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 15

16 Comparison between Regular and Optimized Evaluation Scenario optimized scenario normal evaluation No. of correspondin g matchers No. of all correspondences % of all correspondences (22592=100%) No. of correct correspondences % of all correct correspondences (2484=100%) No. of correct correspondences (estimated) % of all correct correspondences (2484=100%) 13 71 0.31 %702.82 %80.32 % 12 280 (71 + 209) 1.24 %26410.63 %311.25 % 11 932 (…+… ) 4.13 %84534.02 %1034.15 % 10 1438 (…+…) 6.37 %125450.48 %1586.36 % 9 1886 (…+…) 8.34 %152961.55 %2078.33 % 8 2372 (…+…) 10.50 %176771.14 %26110.51 % 7 2895 (…+…) 12.81 %196178.95 %31812.80 % 6 3450 (…+…) 15.27 %213886.1 %38015.30 % 5 3978 (…+…) 17.61 %224690.42 %43817.63 % 4 4552 (…+…) 20.15 %233694.04 %50120.17 % 3 5090 (…+…) 22.53 %239296.30 %56022.54 % 2 5930 (…+…) 26.25 %244098.23 %65226.25 % 1 22592 (…+…) 100 %2484100 %2484100 %

17 Conclusion  Significant differences between the different ontology matching tools  Some tools provide rather promising performances  None of the evaluated matching tools alone could ensure high-quality standards for building up vocabulary crosswalks automatically  Ontology matching tools can be used to optimize the intellectual evaluation process  By reorganizing the validation process considering the number of accordances between the different matching tools the intellectual evaluation process could be made more time-efficient  Matching tools can be used as recommendation systems for manual evaluation ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 17

18 Thank you for your attention. Contact Dr. Andreas Oskar Kempf GESIS – Leibniz-Institute for the Social Sciences andreas.kempf@gesis.org Benjamin Zapilko GESIS – Leibniz-Institute for the Social Sciences benjamin.zapilko@gesis.org Dominique Ritze Mannheim University Library dominique.ritze@bib.uni-mannheim.de Kai Eckert Mannheim University kai@informatik.uni-mannheim.de ISKO UK Conference, 8th - 9th July 2013, London | Kempf et al. | Mapping KOS 18

Download ppt "New Ways of Mapping Knowledge Organization Systems Using a Semi-Automatic Matching- Procedure for Building Up Vocabulary Crosswalks Andreas Oskar Kempf."

Similar presentations

Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.

Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Inventories, Discovery of Digital Content Minerva WP3 Sarah Faraud.

Inventories, Discovery of Digital Content Minerva WP3 Sarah Faraud.
Oyster, Edinburgh, May 2006 AIFB OYSTER - Sharing and Re-using Ontologies in a Peer-to-Peer Community Raul Palma 2, Peter Haase 1 1) Institute AIFB, University.

Oyster, Edinburgh, May 2006 AIFB OYSTER - Sharing and Re-using Ontologies in a Peer-to-Peer Community Raul Palma 2, Peter Haase 1 1) Institute AIFB, University.
European Thesaurus on International Relations and Area Studies A multilingual terminological tool on international affairs Axel Huckstorf Stiftung Wissenschaft.

European Thesaurus on International Relations and Area Studies A multilingual terminological tool on international affairs Axel Huckstorf Stiftung Wissenschaft.
Alexandria Digital Library Project Integration of Knowledge Organization Systems into Digital Library Architectures Linda Hill, Olha Buchel, Greg Janée.

Alexandria Digital Library Project Integration of Knowledge Organization Systems into Digital Library Architectures Linda Hill, Olha Buchel, Greg Janée.
Controlled Vocabularies in TELPlus Antoine ISAAC Vrije Universiteit Amsterdam EDLProject Workshop 22-23 November 2007.

Controlled Vocabularies in TELPlus Antoine ISAAC Vrije Universiteit Amsterdam EDLProject Workshop November 2007.
Schema Matching and Query Rewriting in Ontology-based Data Integration Zdeňka Linková ICS AS CR Advisor: Július Štuller.

Schema Matching and Query Rewriting in Ontology-based Data Integration Zdeňka Linková ICS AS CR Advisor: Július Štuller.
Stefania Bergamasco, Cecilia Colasanti An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced.

Stefania Bergamasco, Cecilia Colasanti An integrated approach to turn statistics into knowledge combining data warehouse, controlled vocabularies and advanced.
Maurice Hermans.  Ontologies  Ontology Mapping  Research Question  String Similarities  Winkler Extension  Proposed Extension  Evaluation  Results.

Maurice Hermans.  Ontologies  Ontology Mapping  Research Question  String Similarities  Winkler Extension  Proposed Extension  Evaluation  Results.
First Insights into the Library Track of the OAEI Dominique Ritze Mannheim University Library.

First Insights into the Library Track of the OAEI Dominique Ritze Mannheim University Library.
1 Entity Ranking Using Wikipedia as a Pivot (CIKM 10’) Rianne Kaptein, Pavel Serdyukov, Arjen de Vries, Jaap Kamps 2010/12/14 Yu-wen,Hsu.

1 Entity Ranking Using Wikipedia as a Pivot (CIKM 10’) Rianne Kaptein, Pavel Serdyukov, Arjen de Vries, Jaap Kamps 2010/12/14 Yu-wen,Hsu.
Standards for networked knowledge organisation systems Ron Davies European Library Automation Group Bucharest, April 2006.

Standards for networked knowledge organisation systems Ron Davies European Library Automation Group Bucharest, April 2006.
2006 Ontopia AS1 Towards an Ontology Design Methodology Initial work Lars Marius Garshol CTO, Ontopia TMRA 2006 2006-10-11.

2006 Ontopia AS1 Towards an Ontology Design Methodology Initial work Lars Marius Garshol CTO, Ontopia TMRA
SKOS and Other W3C Vocabulary Related Activities Gail Hodge Information International Assoc. NKOS Workshop Denver, CO June 10, 2005.

SKOS and Other W3C Vocabulary Related Activities Gail Hodge Information International Assoc. NKOS Workshop Denver, CO June 10, 2005.
PROMPT: Algorithm and Tool for Automated Ontology Merging and Alignment Natalya Fridman Noy and Mark A. Musen.

PROMPT: Algorithm and Tool for Automated Ontology Merging and Alignment Natalya Fridman Noy and Mark A. Musen.
Thesaurus Design and Development

Thesaurus Design and Development
Aligning Thesauri for an integrated Access to Cultural Heritage Collections Antoine ISAAC (including slides by Frank van Harmelen) STITCH Project UDC Conference.

Aligning Thesauri for an integrated Access to Cultural Heritage Collections Antoine ISAAC (including slides by Frank van Harmelen) STITCH Project UDC Conference.
The Value of Usage Scenarios for Thesaurus Alignment in Cultural Heritage Context Antoine Isaac, Claus Zinn, Henk Matthezing, Lourens van der Meij, Stefan.

The Value of Usage Scenarios for Thesaurus Alignment in Cultural Heritage Context Antoine Isaac, Claus Zinn, Henk Matthezing, Lourens van der Meij, Stefan.
Queensland University of Technology An Ontology-based Mining Approach for User Search Intent Discovery Yan Shen, Yuefeng Li, Yue Xu, Renato Iannella, Abdulmohsen.

Queensland University of Technology An Ontology-based Mining Approach for User Search Intent Discovery Yan Shen, Yuefeng Li, Yue Xu, Renato Iannella, Abdulmohsen.
Multi-Concept Alignment and Evaluation Shenghui Wang, Antoine Isaac, Lourens van der Meij, Stefan Schlobach Ontology Matching Workshop Oct. 11 th, 2007.

Multi-Concept Alignment and Evaluation Shenghui Wang, Antoine Isaac, Lourens van der Meij, Stefan Schlobach Ontology Matching Workshop Oct. 11 th, 2007.

Similar presentations

Ads by Google