1. Sharena Paripatyadar

2.  What are the differences?

3.  Work ◦ Organized and structured tasks and activities ◦ Specific frameworks:  Efficiency, Productivity, Profit  Home ◦ “Free choice” environments ◦ But, still structured procedures ◦ Specific rooms with specific functionalities

4.  Smart Homes take advantage of standard procedures  Detect current state in environment and then determine what action to take

6.  Location based context  Appliance specific context  Shared context  Task specific context

7.  Knows where you are in the space  Why is this important?

8.  What appliance you are likely to be using  What task you may be performing  Where to display information  What you might do next

9.  HeatSink

10.  SeeSink  Determines temperature and water flow based on object placed under the sink  Using CCD camera

11.  How does SeeSink fit with the theories? ◦ Activity theory  Activity, Objects, Actions, Operations ◦ Dey:  Context can be represented and processed  Entities/Characteristic Info (context) ◦ Dourish:  Context is emergent and constantly changing

13.  Background ◦ Often use several appliances together or in sequence ◦ Redundant information may be carried between them

14.  KitchenSense ◦ Central database as shared knowledge base ◦ Annotates sensor input with most probable human activity ◦ Creates scenarios based on previous states of the environment  E.g. dirty dishes  dishwasher can turn on

16. Inputs Outputs

17.  How does this Shared Context fit with the theories? ◦ Activity theory  Activity, Objects, Actions, Operations ◦ Dey:  Context can be represented and processed  Entities/Characteristic Info (context) ◦ Dourish:  Context is emergent and constantly changing

18.  Step by step instructions presented to the user  Recipe projected onto kitchen surfaces ◦ No button pressing necessary  Tells user where to go for materials ◦ Knows the location of ingredients and tools

19.  Augmented Reality Interface for Kitchen ◦ Shows information directly on task being performed ◦ Designed to lessen users distraction

20.  Augmented Reality Interface for Kitchen ◦ Exogenous Clues  Little mental processing required  Using light on faucet to show cold/hot water

21.  Augmented Reality Interface for Kitchen ◦ Endogenous Clues  Used for more complex tasks  Arrow on counter surface pointing to location of desired object

22.  Augmented Reality Interface for Kitchen ◦ Serial/Parallel visual searching  Pop-out through illumination of cabinets

24.  How does Virtual Recipe & Augmented Reality Interface fit with the theories? ◦ Activity theory  Activity, Objects, Actions, Operations ◦ Dey:  Context can be represented and processed  Entities/Characteristic Info (context) ◦ Dourish:  Context is emergent and constantly changing

25.  How would you improve their Smart Kitchen?  What would you add or remove?  Will people use the technologies?

27.  Context desired: ◦ Who is where ◦ What they are doing  Focused Use Case: Elderly Care

28.  Smart Floor  Smart Floor tiles place strategically in home  Identify person by foot steps Wearable computer –

29.  Smart Audio Video Sensor  Arrays of cameras & microphones  Track and detect activities ◦ E.g. reading, computer activity, taking a phone message ◦ 98% accuracy

30.  Smart Shirt  Wearable garment to monitor vital signs of the human body  Able to sense, adapt, and respond to needs of the wearer and environment

31. 1. Support connection between elderly parents & adult children 2. Support ‘everyday cognition’, augmenting memory 3. Identify potential crisis situations

32.  How does the Aware Home fit with the theories? ◦ Activity theory  Activity, Objects, Actions, Operations ◦ Dey:  Context can be represented and processed  Entities/Characteristic Info (context) ◦ Dourish:  Context is emergent and constantly changing

33.  “Aware Home” suggests: ◦ Occupant control over the information and who sees it ◦ Controlled through a wearable computer  Do you think this addresses the issue?

35.  In the “Aware Home”:  Context: Any information that can be used to characterize the situation of an entity  An entity is a person, place, physical or computational object  Which theory does this relate to?

36.  Application-specific sensors ◦ Problems:  Application must deal with low level sensor details  Loss of generality and reuse  Use sever to hide sensor details ◦ Problems:  Application must poll server for context info  Need new server for each type of sensor

37.  Similar to Input: Widgets ◦ Context widget  Encapsulate piece of context  Independent of how context was sensed  Different from Input ◦ Source sensors are distributed, not one PC ◦ Sensor context is not in the form application requires ◦ Widgets are not part of the application

38.  Must support distributed input & different platforms  Must interpret context based on sensors  Must aggregate context widgets to provide complete context for an entity  Must store context history

40.  Uses discrete context  Need to support “sensor fusion” due to unreliability of sensors  Needs resource discovery to find widgets of interest  Automatically restarting of components that fail

41.  Smart Homes are Context Aware Applications  In the home, context is used to: ◦ Simplify tasks ◦ Ensure safety ◦ Increase efficiency ◦ Provide extra knowledge ◦ Conserve limited resources

42.  Mozer poses the idea: ◦ Novel interfaces are bad for home technology because: 1.people are satisfied with the current home controls 2.High learning curve for new technologies  He proposes uses existing switches but automating them: ◦ e.g. automatic light regulation

43.  MIT Media Lab and Georgia Tech “Aware Home” use novel interfaces  What do you think?