1. Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt, Rosalind W. Picard, Matthew S. Goodwin 1 MIT Media Lab 1 Northeastern University

3. Relevant Work Pen & paper o Flexible o Prone to errors o Slow Other tools for annotations o CareLog (Hayes et al. 2008) o Baby Steps (Kientz et al. 2009) o SymTrend, AutismTrack,… o Annotation Apps

4. Application http://affect.media.mit.edu/projectpages/ama/

5. Application: Events Summary

6. http://affect.media.mit.edu/projectpages/ama/ Application: Configuration

7. Portable Scalable Inexpensive Customizable Reliable Application: Benefits

8. Groden Center 8 class teachers (6 females, ages 23-37, 2 males, ages 32, 52) previous experience in behavior assessments using pen/paper annotations familiar with the use of tablet computers User Study

9. Instructions on how to use the system Customize activities and behavior settings for each student with the guidance of the instructor Annotate students’ activities and challenging behaviors in their classroom for half day Evaluate usability of application: SUS, 7- point Likert usability questionnaire, open- ended questions. User Study

10. Strongly Disagree Strongly Agree System Usability Scale - Score: 80.3 (std: 11) (Brooke, 1996) Results

11. Strongly Disagree Strongly Agree Results

12. No quantifiable impact on children's behaviors or school performance. One child especially enjoyed using the tablet in conjunction with the teacher. A smaller device could be a better option: “ Change the size of the tablet to one possibly a little bigger than a smart phone so staff can put it in a pocket if need to respond to student with two hands free. ” Other Findings

13. Future Work More systematic comparison between pen & paper method and the application Inclusion of wireless biosensors Infrastructure to share and visualize data

14. Mobile tool to easily capture and annotate challenging behaviors Application available online Potential benefits 1) Connecting stakeholders 2) Data-driven characterization of ASD 3) More personalized behavioral interventions http://affect.media.mit.edu/projectpages/ama/ Conclusions