1. First Insights into the Library Track of the OAEI Dominique Ritze Mannheim University Library

2. Motivation Publication x subject (thesaurus 2): ontology alignment Ontology Mapping Search 0 results Thesaurus 1Thesaurus 2 Ontology Mapping Ontology Alignment Ontology Mapping Search Publication x subject (thesaurus 1): ontology alignment =

3. Overview Ontology Matching OAEI Thesaurus vs. Ontology OAEI Library Track 2012 Lessons learned and Future Work

4. Ontology Matching Person Author PCMember Document Paper Review People Author Reviewer Doc Paper reviews writes reviews … CommitteeMember

5. Ontology Matching Evaluation Tool O1 R A O2 m Test Result

6. Ontology Alignment Evaluation Initiative (OAEI) Annual campaign started 2005 Different tracks/datasets Benchmark, Anatomy, Conference, Multifarm, Large BioMed, Library, Instance Matching 21 submitted systems (2012) Goal: Improving the performances of the ontology matching field Through comparison of algorithms New challenges for the systems

7. Thesaurus = Ontology? SKOSOWL skos:conceptowl:class skos:prefLabel skos:alternativeLabel rdfs:label skos:scopeNote skos:notation rdfs:comment A skos:narrower BA rdfs: subClassOf B A skos:broader BB rdfs:subClassOf A skos:relatedrdfs:seeAlso Commodities Germany Ananas Tropical Fruit Metal Product -> Metal

8. OAEI Library Track Are current state-of-the-art ontology matching tools able to match thesauri? Dominique Ritze, Kai Eckert, Benjamin Zapilko, Joachim Neubert

9. Data Set Thesaurus for economics (STW) 6.000 concepts with 19.000 additional keywords (EN, DE) Thesaurus for the Sociel Sciences (TheSoz) 8.000 concepts with 4.000 additional keywords (EN, DE, FR) Reference alignment manually created in 2006 Both actively used in libraries for keyword indexing

10. Execution 7GB Debian machine Timeframe 1 week 13 of the 21 submitted systems were able to generate an alignment No system had a heap space problem Evaluation: Precision, Recall, F-Measure, Runtime

11. Results How to evaluate the results? F-Measure of 0.67 good? SystemPrecisionRecallF-MeasureTime (s)Size1:1 GOMMA0.5370.9060.6748044712 ServOMapLt0.6540.6870.670452938 LogMap0.6880.6440.665952620 ServOMap0.7170.6190.665442413yes YAM++0.5950.7500.6644963522 LogMapLt0.5770.7760.662213756 G02A0.6750.6450.660327732671 Hertuda0.4650.9250.619143635559 WeSeE0.6120.6070.6091440702774yes HotMatch0.6450.5750.608144942494yes CODI0.4340.4810.456398693100yes MapSSS0.5200.1840.2722171989yes AROMA0.1070.6520.184109617001 Optima0.3210.0720.11737457624

12. Results SystemPrecisionRecallF-MeasureTime (s)Size1:1 MatcherPref0.8200.6420.720752190 MatcherDE0.8910.6010.717421885 MatcherAll0.5440.8960.6777354605 GOMMA0.5370.9060.6748044712 ServOMapLt0.6540.6870.670452938 LogMap0.6880.6440.665952620 … MatcherEN0.8080.4390.569361518 CODI0.4340.4810.456398693100yes MapSSS0.5200.1840.2722171989yes AROMA0.1070.6520.184109617001 Optima0.3210.0720.11737457624

13. Manual Evaluation Between 38 and 269 new correct correspondences found per matcher Up to half of the correspondences correct Many new correspondences are quite simple Some more “complex” and interesting ones Automated production = CAM Several incorrect ones if the labels are quite similar Difficult to distinguish the names of countries, their inhabitants and the languages

14. Lessons Learned Transformation SKOS to OWL causes some problems, especially regarding the labels Ontology matching systems are nevertheless able to match the thesauri and even discover unknown correct correspondences Interest of the community in this topic

15. Future Work Update reference alignment adapted results SKOS import for matching systems Use instance data to match thesauri? Other thesauri?

16. Thank you for your attention! dominique.ritze@bib.uni-mannheim.de