USER-assisted SEMANTIC INTEROPERABILITY in INTERNET of THINGS IARIA the Sixth International Conference on Mobile Ubiquitous Computing, Systems and Technologies UBICOMM 2012 USER-assisted SEMANTIC INTEROPERABILITY in INTERNET of THINGS Authors: Oleksiy Khriyenko Vagan Terziyan Olena Kaikova 23-28 September 2012, BARCELONA, SPAIN Presenter: Oleksiy Khriyenko oleksiy.khriyenko@jyu.fi Ontology Industrial Ontologies Group University of Jyväskylä

Outline Towards new era Internet of Things Thing integration infrastructure Human-powered Service Ecosystem Visual ontology alignment Visually-enriched semantic annotation Conclusions

Towards new era Internet of Things Demands of Society and Businesses nowadays, society requires new innovative services and applications that make the life more comfortable and interactive; industry requires new intelligent systems to better perform maintenance and do better automation of product development and product operation processes. Thing infrastructure we are going to be surrounded by amazingly huge amount of smart devices and entities that do a lot of invisible work for us, but bring really useful added value; various sensors constantly produce huge amount of data measuring and logging various parameters of the environment, devises, systems, and of cause people; having such variety of data and contextual information, intelligent systems are able to provide new innovative services that were impossible to even imagine before. Challenges of interoperable Web of Things unwillingness of vendors to provide open, flexible and interoperable solutions; lack of infrastructure for third party application and services development; unavailability of appropriate business model that brings benefits to end-users through fair open competitive environment of thing vendors.

Thing Integration Infrastructure Vendor 3 Vendor 4 Vendor 2 Vendor 5 Application Subnet of devices Service/System Device, sensor, etc. … Vendor 1 Subnet of devices Vendor N Application Ontology Smart Gateways Thing Integration Platform Users

Human as a part of Technology World Applications Devices/sensors Services Systems Applications (Service Provider) Expert User (Service Consumer) People are great asset to be utilized in servicing, service support and creation process. In the context of open solutions and free services development, people (as end-users) are the most interested party. Therefore, people should take active position and be a part of the service they want to utilize, make it smarter, personalized, and able to provide appropriate data, features and capabilities. Human should not be considered only as a user (service consumer) anymore. Human should be involved to the process as an expert – valuable part of a service ecosystem that provides own knowledge and expertise, and adds value to technology evolution. To be able to utilize the power of people, we have to concentrate our efforts on development of user-oriented tools and technique that involve people to the process, teach and help them to access and manipulate with information and capabilities in easy and handy for human way, utilize people knowledge and expertise for the common welfare of society.

Human-powered Service Ecosystem: Visual Ontology Alignment User Visual Ontology Alignment Vendor A Ontology Ontology Vendor B

Visually-enriched Semantic Annotation @prefix : <http://www.example.org/sample.rdfs#> . @prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>. @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>. rdfs:visSemantics rdf:type rdf:Property; rdfs:domain rdfs:Resource; rdfs:range rdfs:Literal. :FloorHeatingSystem rdfs:subClassOf :HeatingSystem; rdfs:visSemantics ”www.example.org/FHSystem.jpeg”. Ontology/Domain Expert Scenario 1 Service/System Ontology Vendor V Creates visual ontology Provides annotation of the Service/System Visually enriched ontology Service/System Vendor Produces Service/System V VisAnnotation Visually enriched annotation V Provides visually enriched annotation of the Service/System Ontology V Ontology Vendor VisOntology Scenario 2 Service/System Creates domain ontology Ontology Ontology/Domain Expert

Conclusions With the aim to elaborate an environment that enables integration of heterogeneous “things” and intelligent distributed systems within the Internet of Things framework, we addressed the mechanism of human-assisted simplification of semantic matching to allow interoperability of entities in IoT. We proposed a way to make end-user be not only consumer of thing-based solutions, but also be an expert capable to compose and establish interoperability among the things. The question that stays open… How to encourage vendors to provide appropriate semantic annotation of things and how to help them by automating this process?

Questions and comments… Thank you Questions and comments…