1. “Smart Semantic Middleware for Ubiquitous Computing”
UBIWARE Project
“Smart Semantic Middleware for Ubiquitous Computing”
Deliverable 3.2
“Expert”
Resource Agent
“Device”
Resource Agent
Resource Agent
“Service” PI
& GB
shared services SC
Industrial Ontologies Group
University of Jyväskylä

2. Industrial Ontologies Group
UBIWARE Team
University of Jyväskylä
Researchers
Vagan Terziyan (Head)
Olena Kaykova
Oleksiy Khriyenko
Sergiy Nikitin
Michal Nagy
Contact Person:
Timo Tiihonen s:
phone:
Joonas Kesäniemi
Michael Cochez
Atte Pulkkis
Toni Piirainen
URL:

3. Just a reminder or short Introduction
What is UBIWARE ?
Just a reminder or short Introduction

4. What is UBIWARE (in short)
UBIWARE is a tool to support:
design and installation of…,
autonomic operation of… and
interoperability among…
… complex, heterogeneous, open, dynamic and self-configurable distributed industrial systems;…
… and to provide following services for system components:
adaptation;
automation;
centralized or P2P organization;
coordination, collaboration, interoperability and negotiation;
self-awareness, communication and observation;
data and process integration;
(semantic) discovery, sharing and reuse.

5. Current UBIWARE Agent Architecture
Behavior Engine
Beliefs storage
Data
Rules
RAB
RAB
RAB
RAB
Blackboard
S-APL
RAB: Reusable Atomic Behaviors
Pool of Atomic Behaviours c
S-APL Repository
S-APL – Semantic Agent Programming Language (RDF-based)
S-APL – is a hybrid of semantics (metadata / ontologies/ rules) specification languages, semantic reasoners, and agent programming languages. It integrates the semantic description of domain resources with the semantic prescription of the agents' behaviors
Ontology

6. Why do you need UBIWARE ? Industrial Ontologies Group
University of Jyväskylä
Industrial Ontologies Group

7. What the companies usually want to get from us?
They want to see technology applied to their problems, allegorically they want a ready-to-use product, let us say, coffee,
but…

8. UBIWARE allegoric view
S-APL script
UBIWARE
IOG
But we are providing much more than just a coffee, we are providing a coffee maker !

9. UBIWARE allegoric view (2)
Coffee
Roaster
Unroasted beans 1.
S-APL script
UBIWARE
IOG 2.
Roasted beans
Roasted beans 3.
Coffee
Grinder 4.
Ground coffee
UBIWARE is also about orchestrating external resources to achieve a goal!

10. Outsourced external resources can be both: information and service providers
S-APL script
UBIWARE
IOG

11. UBIWARE
Workpackages

12. Project Workpackages Core Distributed AI platform design (UbiCore);
Managing Distributed Resource Histories (UbiBlog);
Smart Ubiquitous Resource Privacy and Security (SURPAS);
Self-Management, Configurability and Integration (COIN);
Smart Interfaces: Context-aware GUI for Integrated Data
(4i technology);
Middleware for Peer-to-Peer Discovery (MP2P);
Industrial cases and prototypes.

13. “Smart Semantic Middleware for Ubiquitous Computing”
UBIWARE Project
( )
“Smart Semantic Middleware for Ubiquitous Computing”
Industrial Cases:
Industrial Cases:
DELIVERABLE D3.2 Workpackage WP7
TASK T3.1_w7
case leader: Michal Nagy
Fingrid case

14. State after the last year
WP-7: Fingrid case
State after the last year
Equipment alarms
Allows to either count the number of R1 category alarms or to retrieve all such events from the Eventlog database.
Operation counts
The number of operations is counted for all circuit-breakers and disconnectors owned by Fingrid. Needs integration of Eventlog and Elnet databases.
Event groups
Automatically checks for new events in the Eventlog database, identifies if any of new events fall under the scope of some defined human “job responsibilities”, notifies by the persons in charge about the event(s).

15. Architecture WP-7: Fingrid case Oracle Event Log Oracle Elnet DB agent
Standard S-APL models
Eventlog
Ontonut
Oracle
Event Log
DB agent
User agent
List
SQL
Informer
Data
access,
processing
RAB: OntonutBehavior
Follower
Count
Oracle
Elnet
SQL
Elnet
Ontonut
List
XHTML generation
Monitoring agent
Periodically checks responsibilities
RAB: XMLWriter
RAB: HTTPResponseSender s

16. Proposals (as specified on 7.10.2009)
WP-7: Fingrid case
Proposals (as specified on )
P1: Operation counts and operation time of compressors in compressed-air plants (Paineilmalaitosten kompressorien toimintakerrat ja käyntiaika)
P2: Operation time of compensation equipments (capacitors, reactors) and transformers (Kompensointilaitteiden ja muuntajien käyntiaika)
P3: Operation counts of circuit-breakers and disconnectors owned by Fingrid after the last maintenance (Katkaisijoiden ja erottimien toimintakerrat viime huollon jälkeen)
P4: Adding of new filtering conditions for equipment alarms of the job responsibility areas (R1 alarms) (Työaluekohtaisten laitehälytysten suodatusehtojen lisäys)
P5: Protection alarms to the experts of protection by (Suojaushälytykset suojausasiantuntijoille)
P6: Tripping alarms will be sent more often than once a day, for example once a hour (Laukaisutiedot tiheämmällä lähetysvälillä)
P7: Developing of the user interface for management of filtering conditions (Käyttöliittymän kehittäminen suodatusehtojen hallintaa varten)

17. Operation times and counts
WP-7: Fingrid case
Results
Operation times and counts
Allows the user to see total operation time and counts of different types of equipment within the specified time period.
Filtering allowed
Administrative interface
In general the administrator can:
Change existing responsibilities
Delete existing responsibilities
Create new responsibilities
Within the responsibility the administrator can:
Graphically edit the pattern
Change basic responsibility properties (title, s, etc.)
Change the notification interval

18. Future work WP-7: Fingrid case
Tighter integration of Eventlog and Elnet
Development of tool for history management of responsibilities
Development of tool for pattern management
Minor GUI improvements proposed by Fingrid

19. “Smart Semantic Middleware for Ubiquitous Computing”
UBIWARE Project
( )
“Smart Semantic Middleware for Ubiquitous Computing”
Industrial Cases:
Industrial Cases:
DELIVERABLE D3.2 Workpackage WP7
TASK T3.1_w7
case leader: Oleksiy Khriyenko
Inno-W case
4i (FOR EYE) TECHNOLOGY
Intelligent Interface for Integrated Information

20. Source adaptation WP-7: Inno-W case
To make Browser applicable for different tasks and systems we elaborated functionality that enables Browser to convert data from original format to the required one. GUI-Shell provides user interface to specify external repository to be imported via appropriate adaptation sub-module (convertor/adapter) from a list of available in Browser.
Inno-W idea RDF Convertor – converts RDF (XML serialization and N-triple notation) source to internal xml-based format. In current case we have an input source storage in N-triple RDF format.
Input:
Output:
“resultType”;
“servletURL”;
“sourceFileURL”.
result in an XML that contains converted resources and other supportive data (context, metaprovider, profile descriptions);
result in an XML that contains correspondent file URLs for converted resources and other supportive data.

21. Source data converting
WP-7: Inno-W case
Source data converting
According to the ontology provided by Inno-W, we selected a set of relevant properties that describe “Proposal”. This set includes 16 properties:
Property value types that are used in resource distance measurement function:
simple text field;
keywords field;
complex text field;
interval field;
simple numerical field.
uri – unique proposal textual identifier;
identity – textual short name of the proposal;
name – textual full name of the proposal;
status – textual field that takes one of the predefined values from the following set {“open”, “submitted”, “undereval”, “evaluated”, “accepted” and “rejected”};
startYear – field that contains 4 digits that present the start year of the project;
has_owner – unique textual identifier of the proposal owner;
has_host_organization – unique textual identifier of the host organization;
in_community – unique textual identifier of the community proposal belongs to;
sizeMoney – amount of money;
sizeMenYears – amount of men years;
duration – duration of the project in months;
numberOfPartners – amount of partners in the project;
description – textual field with a project description;
impact – textual field with a project impact;
valueChain – textual field with a set of related keywords;
networking – textual field with a project networking description.
description – keywords field, as a tokenized text from the value of former “description” property;
impact – keywords field, as a tokenized text from the value of former “impact” property;
networking – keywords field, as a tokenized text from the value of former “networking” property;
period – interval field, with interval beginning (as a amount of months converted from the project start year) and interval end (as a sum of interval beginning and value from “duration” property);
Proposal_org_own_com – complex text field with three sub fields (organization, owner and community). This combination could be useful if the values are correlated between each other. The possible values of the sub fields are collected from the available/used values of correspondent properties in the storage;
Proposal_org_own – complex text field with two sub fields (organization and owner);
Proposal_org_com – complex text field with two sub fields (organization and community);
Proposal_own_com – complex text field with two sub fields (owner and community).

22. WP-7: Inno-W case
Inno-W Company provided us access to their portal where we can create sample set of proposals. Following URL is used to retrieve the RDF source from the database.

23. Future opportunity WP-7: Inno-W case
Next step of the 4I (FOR EYE) Browser development will be concentrated on flexible possibility to add new adapters to the Browser and elaboration component based paradigm for further system development.

24. “Smart Semantic Middleware for Ubiquitous Computing”
UBIWARE Project
( )
“Smart Semantic Middleware for Ubiquitous Computing”
Industrial Cases:
Industrial Cases:
DELIVERABLE D3.2 Workpackage WP7
TASK T3.1_w7
case leader: Sergiy Nikitin
Metso Automation case

25. WP-7: Metso Automation case
What we have done last year
Web interface for querying
Seamless querying as it would have been a centralized solution
Virtual data storage
Adapter
Adapter
Adapter
RDF from Historian
DPM(APA)
MSSQL
DNA
diary

26. WP-7: Metso Automation case
An interface from last year

27. UBIWARE player GUI & components
A proposal for 3rd year
Apply configuration
immediately!
Configure
Your application
A configuration GUI for Metso case + +
Ontonuts
Configuration GUI
UBIWARE player GUI & components

28. Update components through GUI
Ontonuts Configuration GUI
O1 rdf:type :Donut.
O1 di:precondition {precondition is alwaystrue}.
O1 di:effect {B B ?x}.
O1 di:dataSource DB1.
O2 rdf:type :Donut.
O2 di:precondition {precondition is alwaystrue}.
O2 di:effect {C C ?y}.
O2 di:dataSource DB2.
DB1
B B 5
B B 7
B B 10
B B 13 …
Agent Beliefs
DB2
C C 5
C C 4
C C 8
C C 10 …

29. wp7: A new case architecture
A web-based User GUI
User agent
List of components
Agent Component Manager Java Script Application
Component updates
Component calls
DPMAnalysis
Ontonut
DNADiaryEntry
Ontonut
The interface allows:
Edit Ontonut components and update their properties
Specify call/query conditions
Run call/query and see the results
DNAComment
Ontonut
Ontonuts engine
DPM(APA)
MSSQL
DNA
diary

30. wp7: Agent Component/Ontonut Manager

31. WP-7: Metso Automation case
Future work
The development will continue towards support of new component types (Agent and Web service components)
Develop an editor for process chains from heterogeneous components
Keep interface generic as much as possible

32. Industrial cases: a broader look
Connect to data sources, filter results, configure components
(integrated view)
Connect to data sources, filter results, calculate statistics, configure rules
(integrated view)
Connect, Integrate, visualize
configure
and “play”
WP2
WP5
WP3
Data is available, visualize it from different perspectives, configure contexts
(integrated view)

33. UBIWARE 3.0 (2009-2010) vision of future platform (3-rd project year plan)
UBIWARE 3.0 supposed to be a platform for creating and executing configurable distributed systems based on generalized and reusable business scenarios, which heterogeneous components (actors) are not predefined but can be selected, replaced and configured in runtime. C C C C C C
SmartComments C

34. UBIWARE: Future UBIWARE Oy GERI (new Tekes application) PRIME (FP7)
GERI: Global Enterprise Resource Integration based on UBIWARE-driven Cloud Architecture
PRIME (FP7)
SOFIA 2.0

35. Project Related Publications
UBIWARE
Project Related Publications B
International Book Chapters 4 J
International Journal Papers 1 C
International Conference Papers 23 T
PhD and MSc Theses 3

36. UBIWARE publications up to 20.04.2010 (1)
Nagy M., Katasonov A., Khriyenko O. Nikitin S., Szydlowski M., Terziyan V., Challenges of Middleware for the Internet of Things, In: A. Rodić (ed.), Automation and Control – Theory and Practice, IN-TECH Publishing, Vienna, Austria, December 2009, ISBN , pp (Chapter XIV).
Katasonov A., Terziyan V., Using Semantic Technology to Enable Behavioural Coordination of Heterogeneous Systems, In: Gang Wu (ed.), Semantic Web, IN- TECH Publishing, Vienna, Austria, January 2010, ISBN , pp (Chapter VIII).
Terziyan V., Kaykova O., Zhovtobryukh D., UbiRoad: Semantic Middleware for Context-Aware Smart Road Environments, In: Proceedings of the Fifth International Conference on Internet and Web Applications and Services (ICIW-2010), May 9-15, 2010, Barcelona, Spain, IEEE CS Press, 8 pp. (to appear).
Khriyenko O., Nikitin S., Terziyan V., Context-Policy-Configuration: Paradigm of Intelligent Autonomous System Creation, In: Proceedings of the 12th International Conference on Enterprise Information Systems (ICEIS-2010), Funchal, Madeira, Portugal, 8-12 June, 2010, 8 pp. (to appear).
Nikitin S., Terziyan V., Nagy M., Mastering Intelligent Clouds: Engineering Intelligent Data Processing Services in the Cloud, In: Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics (ICINCO- 2010), Funchal, Madeira, Portugal, June, 2010, 8 pp. (to appear).
Nikitin S., Terziyan V., Lappalainen M., SOFIA: Agent Scenario for Forest Industry, In: Proceedings of the 12th International Conference on Enterprise Information Systems (ICEIS-2010), Funchal, Madeira, Portugal, 8-12 June, 2010, 8 pp. (to appear).
Khriyenko O., Terziyan V., Similarity/Closeness-Based Resource Browser, In: J.J. Zhang (Ed.), Proceedings of the Ninth IASTED International Conference on Visualization, Imaging and Image Processing (VIIP-2009), July 13-15, 2009, Cambridge, UK, ACTA Press, ISBN: , pp B B C C C C C

37. UBIWARE publications up to 20.04.2010 (2)
Kesäniemi J., Katasonov A., Terziyan V., An Observation Framework for Multi- Agent Systems, In: Proceedings of the Fifth International Conference on Autonomic and Autonomous Systems (ICAS 2009), April 21-25, 2009, Valencia, Spain, IEEE CS Press, pp
Katasonov A., Terziyan V., Semantic Approach to Dynamic Coordination in Autonomous Systems, In: Proceedings of the Fifth International Conference on Autonomic and Autonomous Systems (ICAS 2009), April 21-25, 2009, Valencia, Spain, IEEE CS Press, pp (best paper award) .
Terziyan V., Zhovtobryukh D., Katasonov A., Proactive Future Internet: Smart Semantic Middleware for Overlay Architecture, In: Proceedings of the Fifth International Conference on Networking and Services (ICNS-2009), April 21-25, 2009, Valencia, Spain, IEEE CS Press pp
Nikitin S., Katasonov A., Terziyan V., Ontonuts: Reusable Semantic Components for Multi-Agent Systems, In: Proceedings of the Fifth International Conference on Autonomic and Autonomous Systems (ICAS 2009), April 21-25, 2009, Valencia, Spain, IEEE CS Press, pp
Khriyenko O., Adaptive Semantic Web based Environment for Web Resources, In: Jyvaskyla Studies in Computing, PhD Thesis, Volume 97, Jyvaskyla University Printing House, 192 pp., December 13, 2008.
Bleier A., A Framework for Market-Based Coordination in Multi-Agent Systems, MSc Thesis, University of Osnabrück, September 30, 2008. C C C C T T

38. UBIWARE publications up to 20.04.2010 (3)
Terziyan V., Semantic Web Services for Smart Devices Based on Mobile Agents, In: D. Taniar (Ed.), Mobile Computing: Concepts, Methodologies, Tools, and Applications (6 volumes), IGI Global, November 2008, ISBN: , Vol. II, Chapter 2.22, pp
Terziyan V. and Katasonov A. (2008) Global Understanding Environment: Applying Semantic and Agent Technologies to Industrial Automation, In: Lytras, M. and Ordonez De Pablos, P. (eds) Emerging Topics and Technologies in Information Systems, IGI Global , 2009, ISBN: , pp (Chapter III).
Katasonov A. and Terziyan V. (2008) Semantic Agent Programming Language (S- APL): A Middleware Platform for the Semantic Web, In: Proc. 2nd IEEE Conference on Semantic Computing, August 4-7, 2008, Santa Clara, CA, USA, pp
Khriyenko O., Context-sensitive Visual Resource Browser, In: Proceedings of the IADIS International Conference on Computer Graphics and Visualization (CGV-2008), Amsterdam, The Netherlands, July 2008.
Katasonov A., Kaykova O., Khriyenko O., Nikitin S., Terziyan V., Smart Semantic Middleware for the Internet of Things, In: Proceedings of the 5-th International Conference on Informatics in Control, Automation and Robotics, May, 2008, Funchal, Madeira, Portugal, ISBN: , Volume ICSO, pp
Terziyan V., SmartResource - Proactive Self-Maintained Resources in Semantic Web: Lessons learned, In: International Journal of Smart Home, Special Issue on Future Generation Smart Space, Vol.2, No. 2, April 2008, SERSC Publisher, ISSN: , pp
Katasonov A. and Terziyan V. (2007) SmartResource Platform and Semantic Agent Programming Language (S-APL), In: Proceedings of the 5th Conference on Multi-Agent Technologies (MATES’07), September 24-26, 2007, Leipzig, Germany, LNAI 4687, pp B B C C C J C

39. UBIWARE publications up to 20.04.2010 (4)
Terziyan V., Predictive and Contextual Feature Separation for Bayesian Metanetworks, In: B. Apolloni et al. (Eds.), Proceedings of KES-2007 / WIRN-2007, Vietri sul Mare, Italy, September 12-14, Vol. III, Springer, LNAI 4694, 2007, pp. 634–644.
Khriyenko O., Context-sensitive Multidimensional Resource Visualization, In: Proceedings of the 7th IASTED International Conference on Visualization, Imaging, and Image Processing (VIIP 2007), Palma de Mallorca, Spain, August 2007.
Khriyenko O., 4I (FOR EYE) Multimedia: Intelligent semantically enhanced and context-aware multimedia browsing, In: Proceedings of the International Conference on Signal Processing and Multimedia Applications (SIGMAP-2007), Barcelona, Spain, July 2007.
Khriyenko O., 4I (FOR EYE) Technology: Intelligent Interface for Integrated Information, In: Proceedings of the 9th International Conference on Enterprise Information Systems (ICEIS-2007), Funchal, Madeira – Portugal, June 2007.
Salmenjoki K., Tsaruk Y., Terziyan V., Viitala M., Agent-Based Approach for Electricity Distribution Systems, In: Proceedings of the 9-th International Conference on Enterprise Information Systems, 12-16, June 2007, Funchal, Madeira, Portugal, ISBN: , pp
Nikitin S., Terziyan V., Pyotsia J., Data Integration Solution for Paper Industry - A Semantic Storing, Browsing and Annotation Mechanism for Online Fault Data, In: Proceedings of the 4th International Conference on Informatics in Control, Automation and Robotics (ICINCO), May 9-12, 2007, Angers, France, INSTICC Press, ISBN: , pp C C C C C C

40. UBIWARE publications up to 20.04.2010 (5)
Naumenko, A., Srirama, S., Secure Communication and Access Control for Mobile Web Service Provisioning, In: Proceedings of International Conference on Security of Information and Networks (SIN2007), 8-10th May, 2007.
Naumenko A., Semantics-Based Access Control in Business Networks, In: Jyvaskyla Studies in Computing, PhD Thesis, Volume 78, Jyvaskyla University Printing House, 215 pp., June 28, 2007.
Naumenko A., Katasonov A., Terziyan V., A Security Framework for Smart Ubiquitous Industrial Resources, In: R. Gonzalves, J.P. Muller, K. Mertins and M. Zelm (Eds.), In: Enterprise Interoperability II: New challenges and Approaches, Proceedings of the 3rd International Conference on Interoperability for Enterprise Software and Applications (IESA-07), March 28-30, 2007, Madeira Island, Portugal, Springer, pp
Naumenko A., SEMANTICS-BASED ACCESS CONTROL - Ontologies and Feasibility Study of Policy Enforcement Function, In: Proceedings of the 3rd International Conference on Web Information Systems and Technologies (WEBIST- 07), Barcelona, Spain - March 3-6, 2007, Volume Internet Technologies, INSTICC Press, pp
Khriyenko O., Coordination of the Distributed Proactive Smart Resource, In: Proceedings of the IASTED International Conference on Parallel and Distributed Computing and Networks (PDCN 2007) as part of the 25th IASTED International Multi-Conference on APPLIED INFORMATICS, Innsbruck, Austria, February, 2007, 7 pp. C T C C C

41. Recent News from UBIWARE Team

42. UBIWARE goes to east
Prof. Terziyan international teaching trip to Vietnam
Ha Noi and Ho Chi Minh ( – )

43. UBIWARE goes to east

44. Next Meetings
End of August – Final Checkpoint: D3.3

45. Obtain More Information about UBIWARE from:
Head of UBIWARE Industrial Consortium (Steering Committee Head) Dr. Jouni Pyötsiä, Metso Automation Oy.
, Tel.:
UBIWARE Contact Person Prof. Timo Tiihonen, Vice-Rector, University of Jyväskylä
, Tel.:
UBIWARE Project Leader Prof. Vagan Terziyan, Agora Center, University of Jyväskylä
, Tel.: