Ruth Agada Dr. Jie Yan Bowie State University Computer Science Department S.O.A.R Summer Research Presentations September 15 th, 2009.

Introduction Computers have become an integral part of human lives. When it comes to education most of the software developed falls short of the real thing. They lack the effective communications that human teachers or storytellers have on users. Tutoring agent Too distracting Not engaging enough

Initial Phase Step 1 Develop original narratives that must contain six basic emotion targets

Intermediate Phase Step 2 We will videotape each storyteller recording each story in order to analyze their head movements and facial expressions; these analyses will inform the head movements and facial expressions of the virtual tutor in the experiment. Step 3 We annotated the facial expressions and head movements used by the actor at each key time frame.

Final Phase Step 4 We will build a database of the head movement algorithm to produce head movements similar to those produced by human storytellers at points of perceptual prominence within the stories. Step 5 Build a 3d animated model to mimic behavior of human storyteller.

Hypothesis Better comprehension, high retention rates and improved learning experience. Matching audio Head movements Facial expressions

Subject Testing Tested on Bowie State University students. Observing subject’s perception. To assess student: 12 survey questions on a 5 point Likert scale. Rated with a score range 1 – 5.

Result Proves hypothesis Fully animated storyteller elicited more positive results. Survey questions for this condition rated highest. And vice versa rated lowest.

Annotation Tool ELAN Linguistic Annotator ELAN is an annotation tool that allows you to create, edit, visualize and search annotations for video and audio data. It was developed at the Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands, with the aim to provide a sound technological basis for the annotation and exploitation of multi-media recordings.

Snapshot of ELAN

Animation Sequence Fully animated one of three stories – demo clip. Partially animating second story. Fear Expression (Actor/Virtual Agent)

Implications and Future Work Provide a new procedure for development for pedagogical agents. Extend the knowledge gained in the proposed experiments. To automate many of the procedures that are being implemented manually. Build a full body model.

Acknowledgements Thanks to: Dr. Yan. Department of Computer science. Research made possible through grants from: NSF: SGER: Research to Improve Communication by Pedagogical Agents (Award No. IIS ). Building Excellence in Teaching, Training, Education, and Research (B.E.T.T.E.R.).

References Hooper, S., & Rieber, L. P. (1995). Teaching with technology. In A. C. Ornstein (Ed.), Teaching: Theory into practice, (pp ). Needham Heights, MA: Allyn and Bacon. Sanger, Michael J. Computer Animations in Chemistry: What We Have Learned Weiss, Renee E., Dave S. Knowlton, and Gary R. Morrison. "Principles for using animation in computer-based instruction: theoretical heuristics for effective design." Computers in Human Behavior 18 (July 2002):