1. Copyright © 2012 Educational Testing Service. All rights reserved. Navigating Math Expressions with Synthetic Speech Lois Frankel Educational Testing Service (ETS) Susan Osterhaus Texas School for the Blind and Visually Impaired CEC April, 2014

2. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. What are we talking about? Math accessibility – big picture: – What is math accessibility? Grant Project & Goals Navigation: discussion and demonstration Project Status 2

3. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Math Accessibility Magnification Braille Speech – Customized for listener’s needs – Sync highlighting Navigation 3

4. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Math Accessibility Magnification Braille Speech – Customized for listener’s needs – Sync highlighting Navigation 4 MathML

5. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. IES ETS/DSI Project Background Goals What got left out Software that is part of the project 5

6. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Prior to IES ETS/DSI Project Speech – Limited choice of syntax/semantics – Difficult to author No Navigation Access limited to the Web 6

7. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Project Goals Middle/High school algebra Classroom-like synthesized speech “style”: ClearSpeak Customization features Interactive navigation Author in Word Playback in Word and in browsers 7

8. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Not Part of Project Braille Support for graphics *Authoring by people with visual impairment Solving math problems Tutoring/Curriculum 8

9. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Project Software for Math MathML Tools: – Authoring: MathType+Word – Audio rendering: MathPlayer Screen reader – Window-Eyes (MathType+Word & IE) 9

10. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Navigation Zooming & moving around Reading vs. describing Placemarkers & “Where am I?” 10

11. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. “Large” Expressions 11

12. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Zooming and Moving 12

13. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Reading vs. Describing 13

14. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Placemarkers & ‘Where am I’ 14

15. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Navigation Summary Read/Describe – Previous/Current/Next/Placemarker Move – Previous/Current/Next/Placemarker – Child/Parent (Zoom) 15

16. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Navigation Summary (2) 10 Placemarkers – Set/Read/Describe/Move Where am I? – One level & complete expression 16

17. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Accessible Authoring LaTeX to MathML conversion in Word MathML to LaTeX conversion in Word 17

18. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Project Status Development: – Done: ClearSpeak, Authoring, Nav, Word – Planned: Nav in tables, column arithmetic Studies – Done: ClearSpeak, Prosody – Planned: Nav, Authoring, Final Pilot 18

19. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Participation Opportunities Students who are Blind or Visually Impaired Teachers 19

20. Copyright © 2012 Educational Testing Service. All rights reserved.Copyright © 2014 Educational Testing Service. All rights reserved. Contact Information Lois Frankel: lfrankel@ets.orglfrankel@ets.org Susan Osterhaus: osterhauss@tsbvi.eduosterhauss@tsbvi.edu MathPlayer Alpha: beta@dessci.combeta@dessci.com The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R324A110355 to the Educational Testing Service. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education, nor those of the CEC. 20