1. Introduction and Motivation Speech recognition is cumbersome Document navigation and editing tasks rarely studied Commercial tools support two navigation methods “Move down five lines, move right four words” Go to The quick brown fox SLOW! FRUSTRATING! ERROR-PRONE! We say “Let the computer do the walking…”

2. Expert Interview Experience with speech recognition Satisfaction with speech recognition Suggestions for improvements Comments/opinions on our proposals

3. Navigation Proposals 1. Move down five lines, move right four words 2. Go to The quick brown fox 3. Go to page 3, paragraph 2, sentence 5, word 8, character 4. 4. Auto-scroll Go down… faster… faster… slower… stop Go right… faster… stop 5. Auto-scroll and pause at natural landmarks: section headers, paragraphs, and user- defined landmarks: middle of page, topic sentence

4. Navigation Proposals (Moving within a page) 6. Hierarchical Keypad Grid 7. Sunray 8. X-and-Y 123 456 789 1 2 3 6 7 5 4

5. Pilot Study Pre-interview Post-interview Video taped 3 Modes Keyboard+Mouse, SR, SpeedNav™ 4 subjects Navigate document Forward  Short, medium, long Backwards  Medium Then, highlight short stretch of text 3 Documents Familiar Read once Unknown How do we ensure that subjects’ familiar documents are matched? Will document retention affect repeated task performance? Non-impaired Novice SR Motor-impaired Novice SR Non-impaired SR expert Motor-impaired SR expert

6. Evaluation Metrics Navigation Errors Undershoot Overshoot Inappropriate scroll speed Highlighting Errors Start position incorrect  #chars, words, sentences End position incorrect  #chars, words, sentences Command recognition errors Time to completion Number of commands spoken Number of words spoken Subjective approval Training time Fatigue Should application record timestamps of user to make timing easier? Measure long distance (between screen) navigation technique separately from short distance (on same screen) navigation?

7. Design Questions Cursor Default scroll in Word leaves cursor at bottom -- can’t read what’s below the screen! Scroll with cursor on left margin, right margin, or center? How might position affect ability to scan left and right? Cursor movement draws the eye; keep cursor stationary and move document instead? Sunray Option: Can people follow diagonal cursor movement? Speed Need various starting speeds and speed multipliers. User- controllable? Speech recognition adds one second delay! Causes overshoot!  User must anticipate when to stop.