UMR 5205 An Introduction to Ubiquitous and Pervasive Computing Lionel Brunie National Institute of Applied Sciences (INSA) LIRIS Laboratory/DRIM Team – UMR CNRS 5205 Lyon, France

Master Course, Lyon, January Ubiquitous and Pervasive Computing 2 Contents of the Course Definitions and Main Characteristics Basic Issues Overview of some Research Propositions A Focus on Context Modeling and Context-Awareness

Master Course, Lyon, January Ubiquitous and Pervasive Computing Definitions Mobile  Includes mobile devices Context-aware  Considers the execution context Ubiquitous  Accessible from everywhere Pervasive  Associates ubiquity, mobility and context-awareness Ambient (intelligence)  Integrated within everyday life 3

Master Course, Lyon, January Ubiquitous and Pervasive Computing From S. Frénot A Pervasive System is First, a Distributed System! Data persistence Data delivery/exchange Data distribution Replication and consistence Interoperability Concurrent accesses “Legacy” systems integration Security and privacy 4

Master Course, Lyon, January Ubiquitous and Pervasive Computing A Pervasive System is also a Mobile System (and a Sensor Network) Discovery of the environment (services, devices, software…) Routing and delivery protocols Fault tolerance Auto-organization Service integration Security, Trust and Privacy … 5

Master Course, Lyon, January Ubiquitous and Pervasive Computing A Pervasive System is also a « User Centric » System Invisible « Smart » (do not interrupt me for nothing !) User preferences aware Context aware Self learning Pro-active Secure and privacy keeping 6

Master Course, Lyon, January Ubiquitous and Pervasive Computing A Pervasive System is also a Collaborative System Mobile/Ambient Social Networks Ambient social interactions Heterogeneity Mobility management Announces:  Modeling  Scalability and filtering  Semantics  Matching (publish-subscribe ?) Context Privacy 7

Master Course, Lyon, January Ubiquitous and Pervasive Computing A Pervasive System is also a Collaborative System Collective Intelligence - Community Context awareness and context sensibility Information fusion → alarms Sharing and confrontation of knowledge Provisioning/composition/integration of services Collaborative learning: histories, execution traces Semantic emergence Recommendation 8

Master Course, Lyon, January Ubiquitous and Pervasive Computing Basic Issues Discovery (Auto-)Organization and routing Security and privacy Context-awareness and user awareness (and modeling) Composition, execution and migration of services Adaptation (data, services, HMI) Data availability, delivery and access (cache, replication, persistence…) Mediation (data, services) and information/service sharing Traceability and history HMI – augmented reality Collective “intelligence”, semantic emergence, social networks (scalability – low energy consumption – “calm”) 9

Master Course, Lyon, January Ubiquitous and Pervasive Computing An Overview of Some Research Propositions 10

Master Course, Lyon, January Ubiquitous and Pervasive Computing Pervasive Middleware: the PerSE MW Adaptation context Models Context-awareness Proactivity Service composition 11

Master Course, Lyon, January Ubiquitous and Pervasive Computing Architecture of a PerSE Base 12

Master Course, Lyon, January Ubiquitous and Pervasive Computing PerSE Layers 13

Master Course, Lyon, January Ubiquitous and Pervasive Computing Access Control for Mobile Users: The Chameleon Chains of trust certificates: if A trusts B and B trusts C then A trusts C… to some level (and while considering subjectivity and access rights mapping) Multi-layered adaptive certificates (X316 certificate + FeMoS signature)  protection of sensible information  dynamic construction of the certificate and its signature Trust computing and reputation: cf. further course 14

Master Course, Lyon, January Ubiquitous and Pervasive Computing The Chameleon: Architecture 15

Master Course, Lyon, January Ubiquitous and Pervasive Computing Interface Adaptation and Context-aware Browsing 16

Master Course, Lyon, January Ubiquitous and Pervasive Computing Multimedia Content Adaptation 17

Master Course, Lyon, January Ubiquitous and Pervasive Computing A Special Focus on Context Modeling and Context-Awareness 18

Master Course, Lyon, January Ubiquitous and Pervasive Computing Context-awareness: Challenges Environment sensing  sensing  storage  communication Context-aware service  context reasoning  decision making  action trigger  collaboration Context data & its semantics Context models Action Context management  collection  organization  representation  storage  presentation 19

Master Course, Lyon, January Ubiquitous and Pervasive Computing Context representation What is context? (complementing definitions by Dey and Winogard)  Context: characteristics, relationships, properties  Context: interpretation (operational term)  Eg. Device has battery life of 3hrs: important only when we are on a trip => Context: How, Where, When, What, Who, and Which Examples  Bob locatedIn ReadingRoom  reportedBy Sensor5 (who reported it)  Bob locatedIn ReadingRoom  hasPrecision 85% (how accurate is it)  ReadingRoom locatedIn Library (where is it)  locatedIn isTransitive => Bob locatedIn Library 20

Master Course, Lyon, January Ubiquitous and Pervasive Computing Context: Issues and Approaches Context Representation  Markup scheme based approaches  Ontology based approaches Context Manipulation  Agent and widget based approach  Broker middleware based approach  Service oriented middleware based approach 21

Master Course, Lyon, January Ubiquitous and Pervasive Computing The EHRAM Model: an Example Activity Context Entity Device LectureStudentProfessorPhone GeographyBobAliceSPhone095 attends 85% hasAccuracy 1024 hasProfessor owns hasOwner (by inverse axiom) attends engagedIn locatedWith (by symmetric axiom) locatedWith isA InstanceOf isA Entity (& literals) Relation ( entity & attribute type relationships ) Axiomatic relation Metadata relation hasMemory Domain Layer Generic Layer Person Hierarchical relation 22

Master Course, Lyon, January Ubiquitous and Pervasive Computing Context management Objective: serialization of the EHRAM model for storage and processing of context data and its semantics 23

Master Course, Lyon, January Ubiquitous and Pervasive Computing Can we combine the best of the two worlds? Necessary FeaturesDatabase Approach Ontology Approach Formality  Management of large context data  Query optimization and processing  Scalability  Semantic support  Reasoning support   Context management 24

Master Course, Lyon, January Ubiquitous and Pervasive Computing Context dataContext semantics HCOM: Hybrid modeling approach An hybrid approach Join the results Process (Ontology) Process (Database) To separate Context data Context semantics HCoM: a Hybrid Context Management model HCoM separates data from the EHRAM model into Context database Rules HCoM filters out context data before integration (pruning) 25

Master Course, Lyon, January Ubiquitous and Pervasive Computing HCoM System Architecture 26

Master Course, Lyon, January Ubiquitous and Pervasive Computing Context Usage – Context Exchange – Context-Awareness Objective: domain independent context-aware platform CoCA: Collaborative Context-Aware service platform CoCA consists of  The context data models - HCoM/EHRAM  The RAID-Action engine  The collaboration manager Context ManagementContext RepresentationMotivationsState of the Art Context-Awareness Discussion/Conclusion 27

Master Course, Lyon, January Ubiquitous and Pervasive Computing The RAID-Action engine in CoCA Reasoning  The process of deriving new knowledge using rules, context data and its semantics.  Reasoning rules may be derived from the context semantics or can be defined based on domain policies, rules and regulations. Aggregation and Interpretation  Integrating numerous contexts into one to raise its level of abstraction. Decision  Decisions follow from reasoning and they are the major outcomes of the CoCA service. Actions  Actions are results of decisions and are executed by applications. Example Given: Students (>1) and a professor in a class room with a video projector switched on and connected to a PC running a power point application! Conclude: Lecture is going on in the room! Context ManagementContext RepresentationMotivationsState of the Art Context-Awareness Discussion/Conclusion 28

Master Course, Lyon, January Ubiquitous and Pervasive Computing Collaborations in CoCA – using JXTA protocols Bob_ Smartphone Peer12 Peer21 Peer22 Peer23 Rendezvous (Router) Peer2 Rendezvous (Router) Peer1 Discovery? Response+ Context Data Transfer Peer Group1 Peer Group2 CoCA peers  Self-organize into peer groups  Discover each other  Discover each other’s services and resources  Uses JXTA P2P protocol Discovery? Context ManagementContext RepresentationMotivationsState of the Art Context-Awareness Bob’s hand held device (Bob_Smartphone) has got a context message that says Bob’s professor is now in «Coffee Room». In order to perform reasoning and suggest some action to Bob, Bob_Smartphone needs some semantics on the concept “Coffee Room”. Now, Bob_Smartphone has the necessary information about the concept «Coffee Room» to perform reasoning and to suggest actions to its owner BoB Discussion/Conclusion 29

Master Course, Lyon, January Ubiquitous and Pervasive Computing CoCA Architecture 30

Master Course, Lyon, January Ubiquitous and Pervasive Computing Feedback on Context Modeling and Awareness A good point: it works It could work It can work in a closed/well-defined environment  interoperability issues  no lingua franca  semantic gap  trust and security issues  low resources devices  scalability  large intersection with the agenda of the Internet of Things! Handling uncertainty Handling trust and privacy 31

Master Course, Lyon, January Ubiquitous and Pervasive Computing Conclusion Ubiquitous computing => user centricity => context-awareness Ubiquitous computing => user centricity => content adaptation (cf. keynote) Key issues  application adaptability/flexibility  interoperability  scalability  standardization  identity  privacy 32

Master Course, Lyon, January Ubiquitous and Pervasive Computing Open Discussion (from keynote) The User Intention (i.e., the Why question): the Holy Graal of “calm IT”? Sensing the environment  Embedded sensors  Internet of Things? Next-Generation Internet?  Still widely open issues, esp. wrt inter-operability Modeling the context  The Babel Tower Context-Awareness, Tracing, Pro-Activity, Calm  sine qua non condition to a seamless integration into the user life  Quality of Experience?  User privacy? User control?  Personalization vs privacy  Pro-Activity ?  Calm: a technological issue or a psycho-social issue? 33