1. Project HealthLine Speech Interfaces For Healthcare Information Access In Underserved Communities Jahanzeb Sherwani, Rahul Tongia, Roni Rosenfeld School of Computer Science Carnegie Mellon University Mehtab Karim, Yousuf Memon Community Health Sciences Aga Khan University Jahanzeb Sherwani, Rahul Tongia, Roni Rosenfeld School of Computer Science Carnegie Mellon University Mehtab Karim, Yousuf Memon Community Health Sciences Aga Khan University

2. SLT4D Speech and Language Technology For Development Illiteracy and semi-literacy Written and unwritten languages Accessibility Technological Economical Social Illiteracy and semi-literacy Written and unwritten languages Accessibility Technological Economical Social Can Speech be a Compelling Technology For Under-Developed Populations?

3. Conventional IT for Development Source: http://www.usp.ac.fj/jica/ict_research/pfnet_case_study/research.htmlhttp://www.usp.ac.fj/jica/ict_research/pfnet_case_study/research.html

4. Conventional IT For Development Requires field deployment of many PCs Requires Internet connectivity (broadband for multimedia) Assumes literate users Users need to learn to use computers Restricted to languages with written form Requires system maintenance and upgrades at the user end Risk of accidental PC misuse Risk of computer viruses Requires field deployment of many PCs Requires Internet connectivity (broadband for multimedia) Assumes literate users Users need to learn to use computers Restricted to languages with written form Requires system maintenance and upgrades at the user end Risk of accidental PC misuse Risk of computer viruses

5. Speech Technologies (http://www.usaid.gov/locations/asia_near_east/features/phil_telcom11_03.html)http://www.usaid.gov/locations/asia_near_east/features/phil_telcom11_03.html

6. Speech Technologies Requires deployment of telephones only Already widely deployed! Literacy is not required (how do you spell Diarrhea?) Interaction is conversational – Requires less adaptation by users Any spoken language can be supported, including switching among languages in the same session System maintained and upgraded centrally No risk of accidental PC misuse No risk of computer viruses Requires deployment of telephones only Already widely deployed! Literacy is not required (how do you spell Diarrhea?) Interaction is conversational – Requires less adaptation by users Any spoken language can be supported, including switching among languages in the same session System maintained and upgraded centrally No risk of accidental PC misuse No risk of computer viruses

7. What Can Speech Do For Under-Served Communities? Information access Information entry Information sharing Access to services Access to automated decision-making processes … Information access Information entry Information sharing Access to services Access to automated decision-making processes …

8. Healthcare Information Access “Providing access to reliable health information for health workers in developing countries is potentially the single most cost-effective and achievable strategy for sustainable improvement in health care” – R. Smith, British Medical Journal (1997)

9. Access Mechanisms Health Information Community Health Worker speech text/images text/ images/ video

10. Access Through Speech Speech Interface Community Health Worker Health Information Speech System

11. Healthcare Delivery In Pakistan 180 million people Urdu is main language, but not first language! Acute shortage of M.D.s “Lady Health Workers” (LHWs) 100,000 Gov’t trained, first-line health workers In-home visits, triage and liaison Children’s health, reproductive health, childbirth,… “Lady Health Visitors” (LHVs) Better trained, typically stay at clinics Nurses, M.D.s 180 million people Urdu is main language, but not first language! Acute shortage of M.D.s “Lady Health Workers” (LHWs) 100,000 Gov’t trained, first-line health workers In-home visits, triage and liaison Children’s health, reproductive health, childbirth,… “Lady Health Visitors” (LHVs) Better trained, typically stay at clinics Nurses, M.D.s

12. Some Daunting Challenges Urdu Data Collection Urdu speech and acoustic models Lexicon Pronunciations Grammar and language model User training User testing Impact assessment Scale-up and dissemination Continuation funding! Urdu Data Collection Urdu speech and acoustic models Lexicon Pronunciations Grammar and language model User training User testing Impact assessment Scale-up and dissemination Continuation funding!

13. The Most Daunting Of All What are the true information needs of Community Healthcare Workers? Will Community Healthcare Workers use a system such as ours? Under what conditions? Contextual Inquiry and Needs Assessment are crucial What are the true information needs of Community Healthcare Workers? Will Community Healthcare Workers use a system such as ours? Under what conditions? Contextual Inquiry and Needs Assessment are crucial

14. Needs Assessment

15. Female-Mediated Needs Assessment

16. Interactions Styles For Healthcare Information Access 1. Diagnosis help through step-by-step interview 2. Open ended question answering system 3. Searching text resources by speech We prepared mock-up demonstrations for all 3 Potential uses Real-time diagnosis Offline diagnosis Offline training 1. Diagnosis help through step-by-step interview 2. Open ended question answering system 3. Searching text resources by speech We prepared mock-up demonstrations for all 3 Potential uses Real-time diagnosis Offline diagnosis Offline training

17. Demo 1 Diagnosis Through Interview

18. Thank you, Microsoft! For more information, see http://www.cs.cmu.edu/~healthline

19. © 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.