1. Experimentation phase 2. October 11th 2005 1 © Raúl García-Castro Experimentation Phase 2 Raúl García-Castro October 11th, 2005 Interoperability Working Days October 10th-11th, 2005

2. Experimentation phase 2. October 11th 2005 2 © Raúl García-Castro Experimentation phase 2 Once the RDF(S) importers and exporters have been evaluated, the second phase will cover the evaluation of the ontology exchange between ontology development tools. Goal: To obtain the elements of the knowledge model of an ontology development tool that can be interchanged with another ontology development tool using RDF(S) for exchanging ontologies. Tool X RDF(S) Tool Y ExportImport Interchange

3. Experimentation phase 2. October 11th 2005 3 © Raúl García-Castro Interoperability Benchmark Suite The interoperability benchmark suite is identical to the RDF(S) Export Benchmark Suite. WebODE RDF(S) files Protégé RDF(S) files KAON RDF(S) files OntoStudio RDF(S) files DOE RDF(S) files Corese RDF(S) files Tool X IMPORT Export files are available from previous experimentation phase.

4. Experimentation phase 2. October 11th 2005 4 © Raúl García-Castro Steps to follow The expected ontologies that should be obtained when importing the RDF(S) files that the other tool exported are already defined. They are each tool’s instantiation of the corresponding export benchmarks. To import into our tool the RDF(S) files with the ontologies. To compare the ontologies imported in our tool with the expected ontologies. IdDescriptionWebODE’s instatiationProtégé’s instantiation (expected result) E44Export one instance that has an object property with another instance of the same class Export one concept that has a relation with itself with a cardinality of "N" and one instance of the concept that has a relation instance with another instance of the same concept Export just one class with a template slot with a cardinality of 1 and of type Instance of itself, and two instances of the class related by the slot.

5. Experimentation phase 2. October 11th 2005 5 © Raúl García-Castro Document with the results The process followed for executing the benchmark suite (including any modifications performed in the tool). The results obtained in each benchmark: –The expected result of the benchmark. –Knowedge added/lost in the exchange. –If the tool passes the benchmark or does not. –If not, the reason for not passing the benchmark. –If the tool does not pass the benchmark and is corrected to pass it, and the changes performed. Comments on the results. Comments on the benchmark suites. Comments on improving the interoperability between the tools.

6. Experimentation phase 2. October 11th 2005 6 © Raúl García-Castro Timeline October 24th, 2005Benchmark suite and RDF(S) files on the web January 2nd, 2006Interoperability results

7. Experimentation phase 2. October 11th 2005 7 © Raúl García-Castro Experimentation Phase 2 Raúl García-Castro October 11th, 2005 Interoperability Working Days October 10th-11th, 2005