Sharena Paripatyadar

 What are the differences?

 Work ◦ Organized and structured tasks and activities ◦ Specific frameworks:  Efficiency, Productivity, Profit  Home ◦ “Free choice” environments ◦ But, still structured procedures ◦ Specific rooms with specific functionalities

 Smart Homes take advantage of standard procedures  Detect current state in environment and then determine what action to take

 Location based context  Appliance specific context  Shared context  Task specific context

 Knows where you are in the space  Why is this important?

 What appliance you are likely to be using  What task you may be performing  Where to display information  What you might do next

 HeatSink

 SeeSink  Determines temperature and water flow based on object placed under the sink  Using CCD camera

 How does SeeSink fit with the theories? ◦ Activity theory  Activity, Objects, Actions, Operations ◦ Dey:  Context can be represented and processed  Entities/Characteristic Info (context) ◦ Dourish:  Context is emergent and constantly changing

 Background ◦ Often use several appliances together or in sequence ◦ Redundant information may be carried between them

 KitchenSense ◦ Central database as shared knowledge base ◦ Annotates sensor input with most probable human activity ◦ Creates scenarios based on previous states of the environment  E.g. dirty dishes  dishwasher can turn on

Inputs Outputs

 How does this Shared Context fit with the theories? ◦ Activity theory  Activity, Objects, Actions, Operations ◦ Dey:  Context can be represented and processed  Entities/Characteristic Info (context) ◦ Dourish:  Context is emergent and constantly changing

 Step by step instructions presented to the user  Recipe projected onto kitchen surfaces ◦ No button pressing necessary  Tells user where to go for materials ◦ Knows the location of ingredients and tools

 Augmented Reality Interface for Kitchen ◦ Shows information directly on task being performed ◦ Designed to lessen users distraction

 Augmented Reality Interface for Kitchen ◦ Exogenous Clues  Little mental processing required  Using light on faucet to show cold/hot water

 Augmented Reality Interface for Kitchen ◦ Endogenous Clues  Used for more complex tasks  Arrow on counter surface pointing to location of desired object

 Augmented Reality Interface for Kitchen ◦ Serial/Parallel visual searching  Pop-out through illumination of cabinets

 How does Virtual Recipe & Augmented Reality Interface fit with the theories? ◦ Activity theory  Activity, Objects, Actions, Operations ◦ Dey:  Context can be represented and processed  Entities/Characteristic Info (context) ◦ Dourish:  Context is emergent and constantly changing

 How would you improve their Smart Kitchen?  What would you add or remove?  Will people use the technologies?

 Context desired: ◦ Who is where ◦ What they are doing  Focused Use Case: Elderly Care

 Smart Floor  Smart Floor tiles place strategically in home  Identify person by foot steps Wearable computer –

 Smart Audio Video Sensor  Arrays of cameras & microphones  Track and detect activities ◦ E.g. reading, computer activity, taking a phone message ◦ 98% accuracy

 Smart Shirt  Wearable garment to monitor vital signs of the human body  Able to sense, adapt, and respond to needs of the wearer and environment

1. Support connection between elderly parents & adult children 2. Support ‘everyday cognition’, augmenting memory 3. Identify potential crisis situations

 How does the Aware Home fit with the theories? ◦ Activity theory  Activity, Objects, Actions, Operations ◦ Dey:  Context can be represented and processed  Entities/Characteristic Info (context) ◦ Dourish:  Context is emergent and constantly changing

 “Aware Home” suggests: ◦ Occupant control over the information and who sees it ◦ Controlled through a wearable computer  Do you think this addresses the issue?

 In the “Aware Home”:  Context: Any information that can be used to characterize the situation of an entity  An entity is a person, place, physical or computational object  Which theory does this relate to?

 Application-specific sensors ◦ Problems:  Application must deal with low level sensor details  Loss of generality and reuse  Use sever to hide sensor details ◦ Problems:  Application must poll server for context info  Need new server for each type of sensor

 Similar to Input: Widgets ◦ Context widget  Encapsulate piece of context  Independent of how context was sensed  Different from Input ◦ Source sensors are distributed, not one PC ◦ Sensor context is not in the form application requires ◦ Widgets are not part of the application

 Must support distributed input & different platforms  Must interpret context based on sensors  Must aggregate context widgets to provide complete context for an entity  Must store context history

 Uses discrete context  Need to support “sensor fusion” due to unreliability of sensors  Needs resource discovery to find widgets of interest  Automatically restarting of components that fail

 Smart Homes are Context Aware Applications  In the home, context is used to: ◦ Simplify tasks ◦ Ensure safety ◦ Increase efficiency ◦ Provide extra knowledge ◦ Conserve limited resources

 Mozer poses the idea: ◦ Novel interfaces are bad for home technology because: 1.people are satisfied with the current home controls 2.High learning curve for new technologies  He proposes uses existing switches but automating them: ◦ e.g. automatic light regulation

 MIT Media Lab and Georgia Tech “Aware Home” use novel interfaces  What do you think?