1. Embodied Agents and Social Computing Tim Bickmore A ffective C omputing G roup MIT Media Laboratory

2. Overview  Intellectual Framework  Embodied Conversational Agents  Etiquette  Relational Agents

3. Intellectual Framework  Study human face-to-face conversation  Not just as inspiration, but as model  The best (only?) examples we have to draw from.  Human social cognition is built to work this way.  Relevant Disciplines  Linguistics/Discourse/Sociolinguistics  Sociology/Ethnomethodology  Social Psychology  Discourse-inspired models of collaboration

4. Research Methodology  Study human-human interaction  Build computational models  Evaluate models

5. Empirical Studies: Posture Shifts Monologues (0.06/s)Dialogues (0.07/s) ps/sps/intenergyps/sps/intenergy Inter- dseg 0.3400.8370.8320.3320.5330.844 intra- dseg 0.039 0.7010.053 0.723 Posture shifts with respect to discourse segment

6. Empirical Studies: Handheld ECAs

7. LEARNING COMPANION Embodied Conversational Agents MACK BEAT SAM REA

8. What does this have to do with Etiquette?  Etiquette is about upholding a tacit “social contract” in interaction  Following the rules governing face-to-face interaction is an important part of this contract  Gricean cooperativeness  Goffman’s “face”  Turn-taking, etc.  But, these are relatively static with respect to roles and relationships.

9. Etiquette  How do people negotiate changing roles?  How do people negotiate changing relationships?  How can our computers do these things?

10. Relational Agents  Computational artifacts designed to build and maintain long-term, social-emotional relationships with their users.

11. Motivating Example

12. Motivation  How do people benefit from social relationships?  Direct benefits  Instrumental, emotional, social support  Indirect benefits  Persuasion (e.g., sales)  Education (e.g., peer collaboration)  Health & Well-being  Helping (e.g., psychotherapy, behavior change)

13. Small Talk and Trust  Real Estate Sales Agent ECA  Modeled initial buyer/agent interview  Hypothesis:  Small talk leads to increased trust in agent TRUST TASKSOCIAL 7.5 7.0 6.5 6.0 5.5 5.0 INTRO EXTRO

14. Working Alliance and Behavior Change  Working alliance  A type of relationship  Measurable  Known mediating variable between relational activities and outcomes across a wide range of psychotherapeutic disciplines  Subscales:  Bond, Task, Goal

15. Application  Exercise Behavior Change  Relatively simple, brief duration  Several proven techniques exist that could be delivered by a software agent  Relevant to college subject population  Objectively measurable, real application  New guidelines are for daily exercise; gives subjects opportunity for daily interactions

16. Exercise Advisor

17. Relational Manipulations  “Kitchen Sink” approach  Small talk  Empathy exchanges (following Klein)  Talk about the relationship  Humor  Politeness & Forms of Address  Reciprocal self-disclosure  Continuity behaviors  Talking about past and future (requires memory)  Nonverbal immediacy behaviors

18. Nonverbal Behavior  Pre-compiled through BEAT RELATIONALNON-RELATIONAL ALL FRAMES +Gestures +Facial animation +Proximity +Gaze aways CONCERN HAPPY ENCOURAGE Concern face +Proximity Smile face +Proximity empathy small talk, greeting, farewell, humor, positive feedback encouragement

19. Experiment Wear pedometer Daily report of activity Daily interactions with agent IntakeInterventionFollowUp 7dRecall No contact with Ss Treatments: CONTROL / NON-RELATIONAL / RELATIONAL One-month intervention; one-month followup 100 Subjects 30 days Demographics Personality Stage of Change Self-Efficacy Decisional Balance System and agent evaluation Self-Efficacy Decisional Balance WAI

20. More Info http://www.media.mit.edu/~bickmore