1. Conclusion and follow-up. October 10th 2005 1 © Raúl García-Castro Conclusion and follow-up Raúl García-Castro October 11th, 2005 Interoperability Working Days October 10th-11th, 2005

2. Conclusion and follow-up. October 10th 2005 2 © Raúl García-Castro What did we achieve? Refinement of the benchmark suites. Report on the evaluation of RDF(S) import and export capabilities of ontology editors using the latest versions of the tools. Preparation of the next phase of the evaluation.

3. Conclusion and follow-up. October 10th 2005 3 © Raúl García-Castro Exporting and Importing RDF(S) Most of the tools export correctly to RDF(S). Every tool has some problem when importing RDF(S). RDF-based tools are the ones that import/export better. Information addition/loss is common when importing/exporting.

4. Conclusion and follow-up. October 10th 2005 4 © Raúl García-Castro Tool Interoperability We are still far from achieving ontology development tools interoperability using RDF(S) as an interchanfe format.

5. Conclusion and follow-up. October 10th 2005 5 © Raúl García-Castro Developer involvement Involvement of tool developers is crucial for improvement. All the tools that participated with support of tool developers were improved, correcting errors in their RDF(S) importers/exporters.

6. Conclusion and follow-up. October 10th 2005 6 © Raúl García-Castro Comments / Open Questions Automation of the experimentation can be quite useful. How do we improve interoperability? –Agreement between developers. –Tools must export/import correctly. Should ontology tools agree on “how” to export RDF(S)? –Tools must be compliant with standards. –Problems with agreements: may induce to forget/misuse standards. Should we use fragments of a “real” ontology in the benchmarks (see Corese)? –Not necessary with the current simple ontologies.

7. Conclusion and follow-up. October 10th 2005 7 © Raúl García-Castro Next steps Refinement of the benchmark suites. Perform again the modified/new benchmarks before end of 2005. Meet again (maybe in Knowledge Web general assembly in Trento, January 2006).

8. Conclusion and follow-up. October 10th 2005 8 © Raúl García-Castro Thanks everyone for coming!

9. Conclusion and follow-up. October 10th 2005 9 © Raúl García-Castro Conclusion and follow-up Raúl García-Castro October 11th, 2005 Interoperability Working Days October 10th-11th, 2005