1. Oh! Helping your child to learn Facial Expressions http://oh.cloudapp.net/oh Helping your child to learn Facial Expressions http://oh.cloudapp.net/oh

2. Our Team members  Justin > Kinect Development > main idea  Zong > Kinect Development  David > Audio input > Kinect Development  Marion > Social Media  Tebo > Reporting loop for Therapy and Parent Monitoring  Kelesy > Asset creation > UI Layout  Aimee Maree > Gamification > Team Strategy  Nick > Start-up strategy > Team Mentoring  Justin > Kinect Development > main idea  Zong > Kinect Development  David > Audio input > Kinect Development  Marion > Social Media  Tebo > Reporting loop for Therapy and Parent Monitoring  Kelesy > Asset creation > UI Layout  Aimee Maree > Gamification > Team Strategy  Nick > Start-up strategy > Team Mentoring

3. Our Mission  Help Teach Facial Expression

4. Key Areas  Aimed at Children 3 > 5  Early Intervention  Help them recognise facial expressions  Provide meta-data capture in order to create reports that can be shared between parents, therapists and teachers  Aimed at Children 3 > 5  Early Intervention  Help them recognise facial expressions  Provide meta-data capture in order to create reports that can be shared between parents, therapists and teachers

5. Adding interactivity to a proven method  In the past therapists, teachers and parents have used Flash Cards to teach Autistic Children facial expressions  There are now tablet applications that enable the Flash Card model to be used on a tablet to enable some touch interaction  We want to take that proven method and add some new features that suit todays modern immersive methods of education  Show that immersive technologies such as the Kinect can help foster new learning environments  In the past therapists, teachers and parents have used Flash Cards to teach Autistic Children facial expressions  There are now tablet applications that enable the Flash Card model to be used on a tablet to enable some touch interaction  We want to take that proven method and add some new features that suit todays modern immersive methods of education  Show that immersive technologies such as the Kinect can help foster new learning environments

6. What are we doing that is different  Adding a new level of interaction with the Kinect motion detection  Adding in a new level of reward systems  Allowing for a digital report to be captured and shared between selected parties to monitor the child’s progress  Allowing for a level of customisation to allow Therapists, Parents and Teachers a way to make the application personalised  To enable to Child to have a one on one relationship with the subject matter by way of seeing their own face as well as having rewards that they are interested in (aka Cars Video, MineCraft videos etc)  Adding a new level of interaction with the Kinect motion detection  Adding in a new level of reward systems  Allowing for a digital report to be captured and shared between selected parties to monitor the child’s progress  Allowing for a level of customisation to allow Therapists, Parents and Teachers a way to make the application personalised  To enable to Child to have a one on one relationship with the subject matter by way of seeing their own face as well as having rewards that they are interested in (aka Cars Video, MineCraft videos etc)

7. Why customisation is important?  At recent SXSW “Apps for Autism” presentation the main feedback from therapists and Parents was “We Want to Customise our applications”  At the Bing Fund “Apps for Autism” presentations we heard “Customisation is the key to tools and one thing we don’t see enough of”  Customisation enables the application to grow with the child and for them to see their own facial expressions  Rewards are customised through the selection of “You Tube” videos that the child relates to > For example “Steve’s” Child likes the Cars movie he can select a “You Tube” video of Cars  At recent SXSW “Apps for Autism” presentation the main feedback from therapists and Parents was “We Want to Customise our applications”  At the Bing Fund “Apps for Autism” presentations we heard “Customisation is the key to tools and one thing we don’t see enough of”  Customisation enables the application to grow with the child and for them to see their own facial expressions  Rewards are customised through the selection of “You Tube” videos that the child relates to > For example “Steve’s” Child likes the Cars movie he can select a “You Tube” video of Cars

8. Meta-Data collection and Reporting  Reports are collected at points through-out the apps  The reports are sent to the “Cloud”  At the Bing Fund “Apps for Autism” presentations we heard “Customisation is the key to tools and one thing we don’t see enough of”  Customisation enables the application to grow with the child and for them to see their own facial expressions  Reports are collected at points through-out the apps  The reports are sent to the “Cloud”  At the Bing Fund “Apps for Autism” presentations we heard “Customisation is the key to tools and one thing we don’t see enough of”  Customisation enables the application to grow with the child and for them to see their own facial expressions

9. Cognitive Aspects  Enabling a child to see their own Face making a facial expression  Enabling a child to understand the shape that represents an expression  Fostering neural paths between shapes and expression  Allowing for the child to categorise expressions and related shapes  Allowing a child to not just see a picture of a Smile but to see themselves Smiling to enable further pathway building and strengthing  Enabling a child to see their own Face making a facial expression  Enabling a child to understand the shape that represents an expression  Fostering neural paths between shapes and expression  Allowing for the child to categorise expressions and related shapes  Allowing a child to not just see a picture of a Smile but to see themselves Smiling to enable further pathway building and strengthing

10. Main Technologies  Kinect SDK > To provide an interactive interface for learning  HTML / CSS / JS > to provide animations and UI layout  Azure > to provide a centralised place for reporting and to enable Parent / Teacher / Therapist login  Windows Desktop Application > First prototype to run on a desktop, future builds can run in Metro 8 UI and Xbox Live  Kinect SDK > To provide an interactive interface for learning  HTML / CSS / JS > to provide animations and UI layout  Azure > to provide a centralised place for reporting and to enable Parent / Teacher / Therapist login  Windows Desktop Application > First prototype to run on a desktop, future builds can run in Metro 8 UI and Xbox Live

11. High level view of WorkFlow Three levels Animation Reward Game progression through levels Capture meta-data for therapists and parents to enable monitoring of a child's progression

12. Our Prototype

13. Resources What makes a Good Autism App  http://momswithapps.com/2010/08/04/c haracteristics-of-great-apps-for-kids-with- autism/ http://momswithapps.com/2010/08/04/c haracteristics-of-great-apps-for-kids-with- autism/  http://bridgingapps.org/2013/03/apps- for-autism-presentation-at-sxsw-13/ http://bridgingapps.org/2013/03/apps- for-autism-presentation-at-sxsw-13/  http://www.iidc.indiana.edu/?pageId=60 1 http://www.iidc.indiana.edu/?pageId=60 1 Autism Expert Bodies  http://bridgingapps.org http://bridgingapps.org  http://www.autismspeaks.org/ http://www.autismspeaks.org/  http://www.autismspectrum.org.au http://www.autismspectrum.org.au  http://globalautismawareness.blogspot.c om http://globalautismawareness.blogspot.c om  http://www.templegrandin.com/ http://www.templegrandin.com/