1. A Platform for Object-Action Semantic Web Interaction Roberto García, Juan Manuel Gimeno, Ferran Perdrix*, Rosa Gil, Marta Oliva HCI and Data Integration Research Group Universitat de Lleida, Spain *Segre Media, Spain

2. Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

3. Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

4. Introduction The Semantic Web is here......but difficult take off in the real world Problem: it is complicated to use it [1] –Even for researchers/advanced users [2] –No just browsing, also edition (Wiki-like) [1] Shadbolt, Hall, Berners-Lee. The Semantic Web Revisited. Intelligent Systems 21(3), 2006 [2] Heath, Domingue, Shabajee. User interaction and uptake challenges to successfully deploying Semantic Web technologies. 3rd Semantic Web User Interaction Workshop, 2006

5. Introducción Human-Computer Interaction Usability –User tasks analysis: Web: reduced set and clearly defined Web 2.0, 3.0: wider set, still to define –Action-Object Paradigm Hierarchical actions menus Select action (e.g. Open) and the object (e.g. File) Reduced usability in heterogeneous object domains Rhizomer Semantic Content Management System

6. Introduction Semantic Web –Facilitates data integration –Heterogeneous objects Look for a more appropriate interaction paradigm… Object-Action Paradigm –Appropriate for heterogeneous domains –Select object, then from available object actions –Cognitively, easier to organise/identify objects –Semantic Web : Ontologies organise objects, restrict available actions Rhizomer Semantic Content Management System

7. Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

8. Rhizomer Platform for Semantic Content Management and Human-Semantic Web Interaction –Based on Web 2.0 technologies Client (AJAX) / Server (REST) –Web 3.0 data model Semantic metadata store: RDF(OWL) / SPARQL –Generic metadata browsing HTML + Javascript –Object-Action Interaction Paradigm Semantic Web Services Rhizomer Semantic Content Management System

9. Rhizomer Server part: –REST interface over repository Jena, Sesame,… GET: SPARQL end-point PUT/POST/DELETE: RDF metadata management –Semantic Web Services OWL-S descriptions –Service Profile: Process, hasInput, hasOutput REST adapters for –Javascript APIs (e.g. Google Maps), SOAP,… Metadata Store Rhizomer GET PUT POST DEL search new edit delete

10. Rhizomer Client part: –AJAX (asynchronously send queries and metadata) –RDF/XML XSLT HTML (browsing) –Semantic forms (edition) RDF/XML XSLT FORM Javascript RDF Rhizomer Semantic Content Management System RDF SemFORMS JavaScript

11. Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

12. S5T Project S5T Spanish research project (TIN2005-06885) –Scaleable Semantic personalised Search of Spoken and written contents on the Semantic Web Application in the Segre media group –Newspaper, TV, radio and web site –Internal use (media house): facilitate content production, history tracking, contextualisation,… –External use (web users): advanced services (e.g. news personalisation, semantic podcasts,…) Rhizomer Semantic Content Management System

13. S5T Project Semantic annotation of audiovisual content –voice text (keywords) semantic annotations Rhizomer: user interface for browsing/interacting with content and associated knowledge Rhizomer Semantic Content Management System

14. S5T Project: query Queries: –Metadata –Content (transcript) Words Concepts GET s5t:Audio specific properties P rdfs:domain s5t:Audio or s5t:Audio owl:Restriction on P (or superclass) ?query= DESCRIBE ?s WHERE { ?s dc:title ?y0; s5t:genre ?y1. FILTER regex(?y0, "…") && ?y1= } …

15. Rhizomer Semantic Content Management System S5T Project: store GET SPARQL endpoint Metadata store –Jena, Sesame,… DESCRIBE queries by default. Facilitate: –Browse heterogeneous metadata –Without a priori knowledge DESCRIBE implementation –Concise Bounded Description + rdfs:labels for all selected resources Result: RDF/XML

16. Rhizomer Semantic Content Management System S5T Project: store DESCRIBE http://rhizomik.net/~rosa: CBD(…~rosa) = Fragment A U rdfs:labels Fragment A

17. Rhizomer Semantic Content Management System S5T Project: browse RDF2HTML GET RDF2HTML Butlletí Migdia 2007-03-23 http://www.segre.com/audio/20070323-bm.xml http://www.segre.com/audio/20070323-bm.mp3http://www.segre.com/audio/20070323-bm.xml http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio titleButlletí Migdia date2007-03-23 genrepolitics transcripthttp://www.segre.com/audio/20070323-bm.xml Referrers http://rhizomik.net/.../NewsCodes-SubjectsOnto#11000000 a Subject labelpolitics description Local, regional, national and international exercise of power, or struggle for power, and the relationships between governing bodies and states. Referrers

18. Rhizomer Semantic Content Management System S5T Project: edition edit – del – new http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio titleButlletí Migdia date2007-03-23 genrepolitics transcripthttp://www.segre.com/audio/20070323-bm.xml Referrers

19. Rhizomer Semantic Content Management System S5T Project: edition Semantic form: … –PUT: description for new resource –POST: replace resource description <Subject,… Predicate,Object>

20. Rhizomer Semantic Content Management System S5T Project: uploading Semantically annotate uploaded content (facilitate metadata creation) Content-type specific metadata extraction plugins –Audio: text-to-speech –Text: keyword detection, disambiguation OpenCalais, Freeling,…: named entities –Photo: EXIFtoRDF,… –…

21. Rhizomer Semantic Content Management System S5T Project: interaction Given a resource (object)… determine available services (actions) Resource description: type, properties, values,… http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio titleButlletí Migdia date2007-03-23 genrepolitics transcripthttp://www.segre.com/audio/20070323-bm.xml Referrers

22. Rhizomer Semantic Content Management System S5T Project: interaction Services descriptions: –ID: Service Adapter URL –hasInput: an OWL Class Service applicable to any resource classified in this class –hasOutput: output content type text/html, application/rdf+xml,… http://rhizomik.net/services/play a Process labelPlay hasInputhttp://rhizomik.net/.../s5t.owl#Audio hasOutputtext/html Referrers

23. Rhizomer Semantic Content Management System S5T Project: interaction For each resource: –Processes s.t. resource rdf:type hasInput Class Call: REST PUT/POST RDF resource Adapter: service invocation (Javascript, SOAP,…) http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio titleButlletí Migdia date2007-03-23 genrepolitics transcripthttp://www.segre.com/audio/20070323-bm.xml PlayReferrers

24. S5T Project: interaction Rhizomer Semantic Content Management System Butlletí Migdia (23/03/2007) La mobilització en contra dels transgènics i en favor de Josep Pàmies també ha servit per introduir altres reclamacions. En aquest cas, alguns dels col·lectius de la lluita contra aquests cultius demanen que la Universitat de Lleida rebi una especialització en Agricultura Ecològica. Asseguren que serien uns estudis pioners que servirien al centre per recuperar prestigi. Search Keyword Browse Term http://www.segre.com/ audio/ 20070323-bm.mp3 a Audio titleButlletí Migdia date2007-03-23 genrepolitics transcripthttp://www.segre.com/audio/20070323-bm.xml PlayReferrers Search Keyword: describe resources whose transcript contains keyword… Browse Term: describe the concept annotating the keyword http://www.udl.cat a University labelUniversitat de Lleida lat41.37 long0.37 MapReferrers

25. S5T Project: interaction Map any resource with lat/long: map 1 1 text/html Service Adapter includes GoogleMap Javascript The same for events (Timeline, Calendar,…), etc. Rhizomer Semantic Content Management System

26. Contents Introduction The Rhizomer Platform Use Case: S5T Project Conclusions & Future Work Rhizomer Semantic Content Management System

27. Conclusions Content Management System based on semantic metadata Framework for Human-Semantic Web Interaction Flexible –Projects: S5T, Rhizomik,… Extensible –Plugins for visualisation, interaction and metadata extraction Usable –Preliminary usability tests

28. Future Work Assisted metadata edition –Properties and values recommended based on available ontologies Create basic services set –Map –Time line –Calendar –Plot… Complete usability test Rhizomer Semantic Content Management System

29. Thank you for your attention More: http://rhizomik.net Roberto García http://rhizomik.net/~roberto