1. MAS 963 - Ambient Intelligence Pattie Maes Pattie@media.mit.edu TA: David Bouchard Davidb@media.mit.edu

2. Ambient Intelligence: Vision Ambient Intelligence envisions a world where people are surrounded by intelligent and intuitive interfaces embedded in the everyday objects & physical environments around them. These interfaces recognize and respond to the presence and behaviors of an individual in a personalized and relevant way.

3. Ubiquitous Computing Intelligent Interfaces Context-aware Computing Merging of different bodies of work

4. Example Scenarios (1) Ambient semantics (H. Liu) “ enriching your every day experience ” Book tells you about friends/famous people that read/loved it Book tells you about particularly interesting passages Touching 2 books makes their connections appear

5. Example Scenarios (2) Objects with memory Objects that act as medium for messaging Objects that can tell you their relevant stories/history Eg. Readwear/writewear

6. Example Scenarios (3) Augmented physical environments Walking around town, system points out buildings/places of particular interest to a user (based on user ’ s interests) Books on a bookshelf can “ speak out ” to you (or posters in infinite corridor)

7. Vision (continued) Ambient Intelligence Technology is: “ Invisible ” (Weiser): Use/functions are immediately apparent Ubiquitous: Available anywhere, integrated in physical environment & objects around us Intelligent: Relevant to user & context-aware Unobtrusive Providing meaning (vs. knowledge vs. information)

8. Vision (continued) Radically rethink the human-computer interactive experience: Integrate digital world (information & services) and physical world (physical objects/environment) Make interfaces more responsive and proactive (objects & environment monitor user and (proactively) present information & services relevant to user’s current needs/interests)

9. Challenges Augment objects/environments with sensing, computing & networking capability Sense & model the user’s behavior (offline/online) Infer the user’s current interests/intentions Design (proactive) interfaces that offer value without being obnoxious, while being highly relevant Integrate these interfaces in user’s physical environment in seamless, natural way: On the body: cell phones, wearables In the environment: architecture, ether, objects

10. Goals for this Course Provide an overview of this new vision for HCI Read and discuss the most relevant articles in related areas: Smart Environments, Smart Networked Objects, Augmented Reality, Mixed Reality, Ubiquitous Computing, Pervasive Computing, Tangible Computing, Ambient Interfaces, Intelligent Interfaces, Context-based Systems, Personalization, Awareness systems, Wearable Computing, Smart materials. Focus on understanding enabling technologies and studying applications and experiments. To a lesser extend address the social-cultural impact. Come up with new ideas, start innovative projects in this area

11. How does this class differ from related Media Lab classes? Hiroshi Ishii’s “Tangible Interfaces” Giving physical form to digital information so that it becomes more easily manipulable and perceivable Joe Paradiso’s “Sensor Technologies for Interactive Environments” Focus on sensor technologies (& performance/events) Ted Selker’s “, Context-Aware Computing” Focus on context-aware systems in general (desktop as well as ubiquitous systems)

12. Requirements for the students Students are required to participate extensively in literature research and class discussions Read required readings ahead of class & prepare ½ page of questions & interesting points for discussion Review & present at least one topic in class Write 2 short “ scenarios ” papers (by 2/15 & 2/22) Suggest additional papers to read Suggest experiments & technologies to look at Students are required to design and implement an original project in this area and describe their project in a 3-page paper as well as make 2 presentation to the class 4/19 update & class discussion 5/17 final presentation & report

13. Schedule Feb 8 Class #1 Introduction to Ambient Intelligence (focus on Media Lab work) - Pattie Maes FORMS DUE Feb 15 Class #2 Future visions of HCI - Pattie Maes APPLICATION SCENARIOS PAPER DUE Feb 22 Class #3 Common Sense & Intelligent Interfaces - Henry Lieberman, Hugo Liu & Push Singh VISION SCENARIOS PAPER DUE Mar 1 Class #4 Location Based & Context-Aware Systems - Pattie Maes & students

14. Schedule (continued) Mar 8 Class #5 Ubiquitous Computing - Pattie Maes & students PROJECT PROPOSAL DUE Mar 15 Class #6 User Modeling, Personalization & Recommender Systems Discussion of project proposals - Pattie Maes & students Mar 22 Class #7 Tangible & Ambient Interfaces - Pattie Maes & students Mar 29 No Class (Spring Vacation) Yellow means requirements for students

15. Schedule (continued) Apr 5 Class #8 Augmented Reality/Mixed Realities - Pattie Maes & students Apr 12 Class #9 The meaning of Things - Invited Speaker Judith Donath Urban perspective - Invited speaker Federico Apr 19 Class #10 Intelligent Environments - Pattie Maes & students Project update discussion PROJECT UPDATE DUE (1 page) Apr 26 Class #11 Embedded Intelligence/Smart Objects - Pattie Maes & students

16. Schedule (continued) May 3 Class #12 Pervasive Computing & Wearables - Pattie Maes & students May 10 Class #13 Awareness systems - Pattie Maes & students May 17 Class #14 PROJECT PRESENTATION & FINAL PROJECT REPORT DUE Yellow means requirements for students

17. Reading List Intro to Ambient Intelligence: Ambient Intelligence, Fraunhofer Institute http://www.iuk.fhg.de/embedded_systems_eng.html http://www.iuk.fhg.de/embedded_systems_eng.html Ambient Intelligence in Home Lab, Philips Research http://www.research.philips.com/Assets/Downloadablefile/ambientintelligence-2456.pdf Scenarios for Ambient Intelligence in 2010 Ambient Intelligence, Weber et al editors (Concept videos)

18. Reading List (continued) Location-based & Context-aware systems: Special issue on Context-Aware Computing, IEEE Pervasive Computing, 2002 *** Context-based city & museum tour guides (Abowd, Cheverst, Reinhard, Petrelli) *** “Ubiquitous Systems in Interactive Museums”, Fleck et. Al. IEEE Pervasive Computing *** Reminder systems (Rhodes, Pentland & Devaul, Lamming...) *** “Virtual Graffiti" systems (Geonotes, HangingMessages, Ether Threads) ***

19. Reading List (continued) Interfaces with Common Sense, Intelligent Interfaces: Beating some Common Sense into Interactive Applications, Lieberman et. Al. http://web.media.mit.edu/~lieber/Lieberary/Common- Sense/Common-Sense-Intro.html Selected readings on Interfaces with Common Sense (Lieberman) Selected readings from IUI Proceedings

20. Reading List (continued) Ubiquitous Computing: papers by M. Weiser http://www.ubiq.com/hypertext/weiser/UIST94_4up.ps.http://www.ubiq.com/hypertext/weiser/UIST94_4up.ps http://www.ubiq.com/hypertext/weiser/ACMInteractions2.html http://www.ubiq.com/hypertext/weiser/UbiCompHotTopics.html "Open House", Weiser M., 1996 *** "Designing Calm Technology", M. Weiser and J. Seely Brown http://www.ubiq.com/hypertext/weiser/acmfuture2endnote.htm *** “The Human Experience”, Abowd, IEEE Pervasive Computing *** “Slow Technology”, Hallnas & Redstrom, http://civ.idc.cs.chalmers.se/projects/slowtech/papers/slowtech.pdf *** http://civ.idc.cs.chalmers.se/projects/slowtech/papers/slowtech.pdf "Ambient Agoras" project, www.AmbientAgoras.org, Fraunhofer Institute *** Selected papers from proceedings of Ubicomp 2001, 2002, 2003 ***

21. Reading List (continued) User Modeling, Personalization & Recommender Systems: Recommender Systems by Ungar http://www.cis.upenn.edu/~ungar/CF/ http://www.cis.upenn.edu/~ungar/CF/ Empirical Analysis of Predictive Algorithms for Collaborative Filtering http://www.research.microsoft.com/users/breese/cfalgs.htm l Recommender Systems by Resnick & Varian http://www.acm.org/pubs/cacm/MAR97/resnick.html http://www.acm.org/pubs/cacm/MAR97/resnick.html (work by Intille et al)

22. Reading List Tangible Interfaces: "Tangible Bits", Ishii H., CHI97 http://tangible.media.mit.edu/papers/Tangible_Bits_CHI97/Tangible_Bits_CHI97.pdf other papers by Ishii et. al. Ambient Interfaces: “Ambient Interfaces: Design Challenges and Recommendations”, Fraunhofer Institute http://www.uni- weimar.de/~gross/publ/hcii03_gross_amb_int.pdf papers by H. Ishii

23. Reading List (continued) The Meaning of Things: "The meaning of Things", Csikszentmihalyi "The Cultural Biography of Things", I. Kopytov "Culture and Consumption", "Mc Gracken, G "The Social Life of Things" Apadurai, A. e-lens and the digital city TBD

24. Reading List (continued) Augmented Reality/Mixed Realities : Augmented Reality: A New Way of Seeing, Steven K. Feiner, 2002 Introduction to Augmented Reality by J. Vallino http://www.cs.rochester.edu:80/u/vallino/research/AR/introduction.html http://www.cs.rochester.edu:80/u/vallino/research/AR/introduction.html Presence Journal special issue on AR, 1997 CACM Special issue on AR, 1993, Vol 36, #7 Animated & Electronic Paper Experiments (e.g. Wellner)

25. Reading List (continued) Intelligent Environments : Concept Homes http://www.research.philips.com/Assets/Downloadablefile/ambientintelligence-2456.pdf http://www.research.philips.com/Assets/Downloadablefile/ambientintelligence-2456.pdf Selected papers from “Intelligent Environments”, P. Froege Papers on Georgia Tech “Aware Home” http://www.cc.gatech.edu/fce/ahri/projects/index.html Papers on MIT Media Lab Smart Room experiments http://vismod.www.media.mit.edu/vismod/demos/smartroom/ Papers of MIT AI-lab Smart Room experiments http://oxygen.lcs.mit.edu/ http://oxygen.lcs.mit.edu/ and http://www.ai.mit.edu/projects/aire/http://www.ai.mit.edu/projects/aire/ Papers on Stanford iRoom http://iwork.stanford.edu http://iwork.stanford.edu Papers on MIT’s House-N

26. Reading List (continued) Embedded Intelligence/Smart Objects : Tutorial on RFID technology Objects with embedded sensors, computation, & networking Sensor & Actuator Networks, Special Issue of IEEE Pervasive Computing, Oct 2003 Mobility, Service Discovery, Auto Configuration and Ad-Hoc Networking Disappearing Hardware, R. Want et. Al. IEEE Pervasive Computing

27. Reading List (continued) Pervasive Computing and Wearables : Pervasive Computing Handbook, U. Hansmann Me++, W. Mitchell Papers from IEEE pervasive computing journal Wearable Computing Papers, MIT, CMU, UNC, Sony CSL Proceedings of the wearables conferences

28. To Do’s By tomorrow: return class form By next week (2/15): Check out class website Read required 2 readings and prepare ½ page questions & comments, email to pattie@ by 10am on Wed and put on wiki Write application scenarios paper (1 or 2 pages)

29. Required Readings That’s what friends are for: Ambient Intelligence and the Information Society of 2010 by Ducatel et.al. http://www.itas.fzk.de/e- society/preprints/esociety/Ducatel%20et%20al.pdfhttp://www.itas.fzk.de/e- society/preprints/esociety/Ducatel%20et%20al.pdf Social, Economic and ethical Implications of Ambient Intelligence and Ubiquitous Computing by Bohn et.al. http://www.vs.inf.ethz.ch/publ/papers/socialambient.pdf http://www.vs.inf.ethz.ch/publ/papers/socialambient.pdf Optional: Philips Password magazine, special issue on Ambient Intelligence http://www.research.philips.com/password/archive/23/downloads/pass word23.pdf http://www.research.philips.com/password/archive/23/downloads/pass word23.pdf

30. Application Scenarios Paper Envision novel applications of some of the following platforms: - Invisible Media gaze direction platform - Reachmedia RFID wristband - Augmented Mirror - Moving Portraits - I/O textiles - Ambient glasses & EMG - Dtouch printable visual markers

31. Practical Information Contact pattie@media.mit.edu, x3-7442, room E15-315 or davidb@media.mit.edu with any questionspattie@media.mit.edudavidb@media.mit.edu Website: http://courses.media.mit.edu/2006spring/mas96 3/ http://courses.media.mit.edu/2006spring/mas96 3/ Mailing list ambient-class@media.mit.edu will be set up in next 2 daysambient-class@media.mit.edu