Co-funded by the European Union Semantic CMS Community Knowledge Interaction and Presentation Copyright IKS Consortium 1 DFKI GmbH. September, 2011

Page: Overview  Introduction  Semantic Web: Interaction with Content  Standards (RDF, RDFa, JSON-LD, …)  Semantic Interaction Patterns  What are patterns?  List of patterns  IKS Interaction with Knowledge  The Stack: Interaction & Presentation  VIE  Interaction Patterns & Widgets

Page: Overview  Introduction  Semantic Web: Interaction with Content  Standards (RDF, RDFa, JSON-LD, …)  Semantic Interaction Patterns  What are patterns?  List of patterns  IKS Interaction with Knowledge  The Stack: Interaction & Presentation  VIE  Interaction Patterns & Widgets

Page: Semantic Interaction: What is it?  Imagine you want want to plan a vacation in NY

Page: Semantic Interaction: What is it?  Imagine you want to plan a vacation in NY  You found the right package on a touristic portal

Page: Semantic Interaction: What is it?  Imagine you want to plan a vacation in NY  You found the right package on a touristic portal…  …and want to access additional information

Page: Semantic Interaction: What is it?  Imagine you want to plan a vacation in NY  You found the right package on a touristic portal…  …and want to access additional information  Usually you have to grab the information from many sources manually (i.e. looking in many web pages)

Page: Semantic Interaction: What is it?  Imagine you want to plan a vacation in NY  You found the right package on a touristic portal…  …and want to access additional information  Usually you have to grab the information manually (i.e. looking in many web pages)  With semantics you can access this information automatically (e.g., Terkait)

Page: Semantic Web: in general.  Motivation  Definition  Web of Data vs WWW

Page: Semantic Web: the potential.  Web of Data as a CMS  Web Communities as CMS Editors

Page: Integrate Data with the Web  WWW

Page: Integrate Data with the Web  WWW  DATA Silos

Page: Integrate Data with the Web  WWW  DATA Silos Web of Data

Page: The Entire Process  Exporting data (more datasets)  Grab information from your content (i.e., recognize the „entities“)  Merging your data  Merge it from different data  Conbine with different datasets/content  Use data to interact with (e.g., configure) web services  Publishing Semantics/Content/interaction  Enrich your content with dinamically generated, interactive information

Page: The Entire Process  Exporting data (more datasets)  Grab information from your content (i.e., recognize the „entities“)  Merging your data  Merge it from different data  Conbine with different datasets/content  Use data to interact with (e.g., configure) web services  Publishing Semantics/Content/interaction  Enrich your content with dinamically generated, interactive information

Page: The Entire Process  Exporting data (more datasets)  Grab information from your content (i.e., recognize the „entities“)  Merging your data  Merge it from different data  Conbine with different datasets/content  Use data to interact with (e.g., configure) web services  Publishing Semantics/Content/interaction  Enrich your content with dinamically generated, interactive information

Page: The Entire Process  Exporting data (more datasets)  Grab information from your content (i.e., recognize the „entities“)  Merging your data  Merge it from different data  Conbine with different datasets/content  Use data to interact with (e.g., configure) web services  Publishing Semantics/Content/interaction  Enrich your content with dinamically generated, interactive information

Page: Standard Resources  Web standards and accessibility resources  World Wide Web Consortium (W3C)  Web Standards Project  Web Accessibility in Mind  Tutorials, references, statistics, and forums  W3Schools  JavaScript Kit  The jQuery Project  HTML5 Demos  HTML5 Reset  Web Safe Font Tester  Web Style Guide  960 Grid System  HTML/XHTML code validators  W3C Markup Validator  W3C Link Checker  W3C Log Validator  WDG HTML Validator  CSS code validators  W3C CSS Validator  Browser compatibility verification  Browershots  Browser Cam

Page: Standard Resourses: Presentation  HTML5  Css3  XAML  SMIL  XUL

Page: Standard Resourses: Interaction  Java  Jscript libraries  Jquery  Backbone js  Popcorn js…  Php/perl/

Page: Standard Resourses: Annotation  RDF/OWL  RDFa  Microdata  Microformats  XML  JSON

Page: SKOS Technologies Perspective OWL2 APML iCal EMMA CCXML VoiceXML SSML MPEG7 SMIL XAML XUL AJAX SOAP WSDL Microdata Microformats RDFa HTML5 CSS3 RDFa API FOAF JavaScript JQuery SCXML RESTful

Page: Publish RDF: RDF + HTML  Plugins for  HTML + RDFa  HTML + Microformats  HTML + Microdata  … SubjectPredObject

Page: Overview  Introduction  Semantic Web: Interaction with Content  Standards (RDF, RDFa, JSON-LD, …)  Semantic Interaction Patterns  What are patterns?  List of patterns  IKS Interaction with Knowledge  The Stack: Interaction & Presentation  VIE  Interaction Patterns & Widgets

Page: AQCI Lifecycle

Page: AQCI Lifecycle  Author: “A user of the system can author (create) semantically enhanced content.”  Query: “A user can query for semantically enhanced content.”  Consume: “A user can consume semantically enhanced content.”  Interact: “A user can interact with the content at the level of his domain knowledge.”

Page: Interaction Patterns: Definition  Design pattern provide proven solutions to frequent design problems in a generative and human-readable format.  Interaction patterns (special case of design patterns) describes  recurring actions  a user performs  when interacting with a computer  to achieve a certain goal of a task.  These actions are  implicit if they arise from the discourse context - the previous actions of the user - and are called  explicit if they are directly triggered by the user (e.g., pushing a button). In the context of IKS, we focus the interaction patterns on interaction with content and moreover the interaction with the (ontological) knowledge that corresponds to this content element.  An interaction pattern consists of four parts that describe:  the problem  the pattern (i.e., the solution of the problem)  use cases for the pattern  how the pattern applies for the use cases

Page: Interaction Patterns

Page: Interaction Patterns  Interaction Pattern:  describes recurring actions  a user performs when interacting with a computer  to achieve a certain goal of a task.  Actions are  Implicit: arise from the discourse context (e.g., the previous actions of the user)  Explicit: triggered by the user (e.g., pushing a button).  An interaction pattern consists of four parts:  the problem  the pattern (i.e., the solution of the problem)  use cases for the pattern  how the pattern applies for the use cases

Page: Interaction Patterns  Interaction Pattern:  describes recurring actions  a user performs when interacting with a computer  to achieve a certain goal of a task.  Actions are  Implicit: arise from the discourse context (e.g., the previous actions of the user)  Explicit: triggered by the user (e.g., pushing a button).  An interaction pattern consists of four parts:  the problem  the pattern (i.e., the solution of the problem)  use cases for the pattern  how the pattern applies for the use cases

Page: Interaction Patterns  Interaction Pattern:  describes recurring actions  a user performs when interacting with a computer  to achieve a certain goal of a task.  Actions are  Implicit: arise from the discourse context (e.g., the previous actions of the user)  Explicit: triggered by the user (e.g., pushing a button).  An interaction pattern consists of four parts:  the problem  the pattern (i.e., the solution of the problem)  use cases for the pattern  how the pattern applies for the use cases

Page: Interaction Patterns  Interaction Pattern:  describes recurring actions  a user performs when interacting with a computer  to achieve a certain goal of a task.  Actions are  Implicit: arise from the discourse context (e.g., the previous actions of the user)  Explicit: triggered by the user (e.g., pushing a button).  An interaction pattern consists of four parts:  the problem  the pattern (i.e., the solution of the problem)  use cases for the pattern  how the pattern applies for the use cases

Page: Interaction Patterns  Interaction Pattern:  describes recurring actions  a user performs when interacting with a computer  to achieve a certain goal of a task.  Actions are  Implicit: arise from the discourse context (e.g., the previous actions of the user)  Explicit: triggered by the user (e.g., pushing a button).  An interaction pattern consists of four parts:  the problem  the pattern (i.e., the solution of the problem)  use cases for the pattern  how the pattern applies for the use cases

Page: Interaction Patterns  Interaction Pattern:  describes recurring actions  a user performs when interacting with a computer  to achieve a certain goal of a task.  Actions are  Implicit: arise from the discourse context (e.g., the previous actions of the user)  Explicit: triggered by the user (e.g., pushing a button).  An interaction pattern consists of four parts:  the problem  the pattern (i.e., the solution of the problem)  use cases for the pattern  how the pattern applies for the use cases

Page: Interaction Patterns: Basics Following the AQCI Lifecycle:  “Create”: An author/user of the system can create semantically enhanced content.  “Query”: An author/user can query for semantically enhanced content.  “Consume”: An author/user can consume semantically enhanced content.  “Interact”: An author/user can interact with the content at the level of his/her domain knowledge. DIMENTIONS Content Knowledge

Page: Interaction Patterns: IKS List  Manual annotation of content with knowledge Manual annotation of content with knowledge  Semi-Automatic annotation of content with knowledge Semi-Automatic annotation of content with knowledge  Fully-Automatic annotation of content with knowledge Fully-Automatic annotation of content with knowledge  Rectifying knowledge annotation Rectifying knowledge annotation  Linking of entities Linking of entities  Semi-automatic Extraction of Knowledge from Content repository Semi-automatic Extraction of Knowledge from Content repository  Automatic Extraction of Knowledge from Content repository Knowledge Content  Automatic generation of templates Automatic generation of templates  Autocompletion support for content Autocompletion support for content  Recommendation of content links (Duplicate: Query) Recommendation of content links (Duplicate: Query)  Faceted search Faceted search  Disambiguation of query Disambiguation of query  Using annotated content items for searching Using annotated content items for searching  Providing personalized/contextual search result filters Providing personalized/contextual search result filters  Recommendation of content links (Duplicate: Create) Recommendation of content links (Duplicate: Create)  Search and Suggest Service: Annotations for textual content Search and Suggest Service: Annotations for textual content Create Query

Page: Interaction Patterns: IKS List  Contextual rendering of content Contextual rendering of content  Highlighting of content of interest Highlighting of content of interest  Receive a stream of information/content of interest Receive a stream of information/content of interest  Browsing through entity hierarchy Browsing through entity hierarchy  Zoom in/out different data hierarchy levels along a tree Zoom in/out different data hierarchy levels along a tree  Visalizing content dependencies Visalizing content dependencies  Comparing content, based on the knowledge Comparing content, based on the knowledge  Recommendation of content links (Duplicate: Query) Recommendation of content links (Duplicate: Query)  Contextual activity pane Contextual activity pane  Contextual export interaction Contextual export interaction  Semantic Drag&Drop interaction Semantic Drag&Drop interaction  Registering and receiving updates of content changes Registering and receiving updates of content changes  Managing audits according to business rules Managing audits according to business rules  Assure a level of consistency of content according to business rules Assure a level of consistency of content according to business rules  Filtering content based on knowledge rules Filtering content based on knowledge rules  Automatic clustering of content/knowledge Automatic clustering of content/knowledge  Automatic summarization of content/knowledge Automatic summarization of content/knowledge  Exporting knowledge Exporting knowledge Consume Query

Page: Overview  Introduction  Semantic Web: Interaction with Content  Standards (RDF, RDFa, JSON-LD, …)  Semantic Interaction Patterns  What are patterns?  List of patterns  IKS Interaction with Knowledge  The Stack: Interaction & Presentation  VIE  Interaction Patterns & Widgets

Page: The Stack: Interaction & Presentation Functionality categories of the IKS stack’s layer of interaction and presentation:  Author: “A user of the system can author (create) semantically enhanced content.”  Query: “A user can query for semantically enhanced content.”  Consume: “A user can consume semantically enhanced content.”  Interact: “A user can interact with the content at the level of his domain knowledge.”

Page: Interaction with Content in IKS Common representation of content on JavaScript level  If Content expressed with RDFa the content model can be easily extracted into JavaScript. Using Backbone.js:  supplies structure to JavaScript-heavy applications by  providing models with key-value binding and custom events,  collections with a rich API of enumerable functions,  views with declarative event handling,  connects it all to existing applications over a RESTful JSON interface.  With Backbone, the content extracted from the RDFa-annotated HTML page is easily manageable via JavaScript.

Page: VIE  Pedigree:  Name: Vienna IKS Editable  Functionality: makes the content of web pages editable through annotations. Supports semantic-web developers in  Retrieval of semantic data  Storing semantic data  Accessing semantic web services (e.g., Apache Stanbol Enhancer)  Semantic markup (e.g., RDFa or Microdata)  Coordinates:  Basic concepts:  Development:

Page: It‘s about abstraction VIE - UI Widgets „VIE-W“ VIE - UI Widgets „VIE-W“ VIE „Edit your content w. Semantics“ VIE VIE-2 „Edit your Semantics“ VIE-2 (Semantic) Services (e.g., Stanbol Enhancer, - EntityHub, Zemanta,...) (Semantic) Services (e.g., Stanbol Enhancer, - EntityHub, Zemanta,...) (Semantic) Databases (e.g., DBPedia, Geonames,...) (Semantic) Databases (e.g., DBPedia, Geonames,...)

Page: VIE: UI Widgets UI Widgets On top of VIE we gathered a bunch of UI widgets in a library that help to simplifying embedding VIEs power into a webpage more directly.

Page: VIE Widgets  VIE-Widgets are a sort of jQuery UI Widgets in order to:  achive maximum portability  accelerating lerning curve Widgets

Page: UI Widget Example Description: The VIE Image Search widget search for images using semantic annotated content as parameter for the search. Once included in an HTML page, the developer can easily query and retrieve images from the photo service Flickr, based on the type-specific properties of the current entity in focus, e.g., if the current entity is a city it makes sense to start a geographic query, whereas, for persons, it would make sense to query for the name of that person. (

Page: Copyright IKS Consortium 46 W3C: Interaction and Semantics  Interaction  HTML5  JavaScript  JQuery  Semantic Web  OWL  RDF  RDFa  JSON July 5, 2011

Page: Copyright IKS Consortium 47 W3C: Interaction and Semantics  Interaction  HTML5  JavaScript  JQuery  Semantic Web  OWL  RDF  RDFa  JSON VIE July 5, 2011

Page: Copyright IKS Consortium 48 IKS: Coordinates  Stanbol  VIE  VIE2  Interaction Patterns  WIDGETS W3C | Technology and Society Domain | Semantic Web Activity | RDF Web Applications Working Group (RDFWA) July 5, 2011

Page: References                   knowledge.org/files/Tutorial_Knowledge_Interaction_Presentation.pptx knowledge.org/files/Tutorial_Knowledge_Interaction_Presentation.pptx