1. Conversational Agents and Learning Outcomes: An Experimental Investigation Bob Heller Mike Proctor Athabasca University Research supported by Mission Critical Research Grant - Athabasca University EDMEDIA, Vancouver, 2007

2. Conversational agents as pedagogical agents AutoTutor - conversational intelligent tutor system (see Graesser, Wiemer-Hastings, Wiemer-Hastings, Kreuz, & Tutoring Research Group 1999) Embodied Conversational Agents - primacy of conversation (Cassells et al) Pedagogical Agent research juncture of HCI and educational psychology (Hadwin, Winne, & Nesbit, 2005)

3. The Persona Effect Pedagogical agents have the potential to increase the bandwidth of communication between students and computers and the computer’s ability to engage and motivate students (Johnson, Rickel, and Lester, 2000) Reeves & Nass The Media Equation

4. Evidence for Persona Effect

5. Objectives of the Present Study Learning Outcome Historical Figure replication

6. Method Participants Materials Procedure

7. Logical Interface

8. Chat Interface

9. Interface Evaluation Text InterfaceChat Interface n=28 n=31 M MSD t How enjoyable was this activity?3.432.872.32* How engaging was this activity3.433.190.79 How easy was this activity?3.113.190.32 Would you recommend this activity to others? 3.682.972.54* Overall, how would you rate this activity? 3.432.872.23* How useful is this interface for learning information about Jean Piaget? 4.223.422.80** How useful is this interface for remembering information about Jean Piaget?3.533.002.49* Table 1: Interface evaluation ratings based on a 5-point scale where higher numbers reflect positive experiences. Note: * - p <.05 ; ** - p <.01

10. TextChatp Pretest46.9%38.3%ns Content Exposure83.8%56.3%<.001 Exposed Content 67.4%56.8%<.05 Non-exposed Content 26.8%33.0%ns

11. Freudbot Piagetbot n=53 n=31 p How enjoyable was this activity? 2.922.87 ns How engaging was this activity? 3.083.19 ns Would you recommend this activity to others? 2.832.97 ns Overall, how would you rate this activity? 3.022.87 ns How useful is this interface for learning information about Freud/Piaget? 2.963.42 ns Table 2: Ratings based on a 5-point scale where higher numbers reflect positive experiences. Note: All t’s were non-significant Agent Evaluation

12. Discussion - the text-based interface was rated more positively and associated with better learning outcomes Limitations - orienting task biased towards text-based interface - degree of animation

13. Freudbot AIML Narrative format Speech Act theory

14. Freudbot findings

15. Conversational agents as pedagogical agents