1. Introduction and Motivation Speech recognition is cumbersome Not enough study of document navigation and editing tasks Current tools support two navigation methods “Move down five lines, move right four words” Go to The quick brown fox SLOW! FRUSTRATING! ERROR-PRONE! We say, let the computer do the walking…

2. Project Stages Design Poster Expert Interview Pilot Study Analysis and Redesign Rerun study Final Paper and Poster

3. Expert Interview Experience with speech recognition Satisfaction with speech recognition Suggestions for improvements Comments/opinions on our proposed solutions

4. Task One Finding text on another page Move down five lines, move right four words Go to The quick brown fox Go to page 3, paragraph 2, sentence 5, word 8, character 4. Auto-scroll Go down… faster… faster… slower… stop Go right… faster… stop Auto-scroll and pause at natural landmarks: section headers, paragraphs, and user-defined landmarks: middle of page, topic sentence

5. Task Two Finding text within a page Hierarchical Keypad Grid Sunray X-and-Y Move down five lines, move right four words Go to The quick brown fox Go to page 3, paragraph 2, sentence 5, word 8, character 4. Auto-scroll Go down… faster… faster… slower… stop Go right… faster… stop Auto-scroll and pause at natural landmarks: section headers, paragraphs, and user-defined landmarks: middle of page, topic sentence 123 456 789 1 2 3 6 7 5 4

6. Pilot Study Pre-interview Post-interview Video taped 3 Modes Keyboard+Mouse, VR, SpeedNav™ 4 subjects Navigate document Forward  Short, medium, long Backwards  Medium Then, highlight short stretch of text 3 Documents Familiar Read once Unknown Non-impaired Novice SR Motor-impaired SR expert Non-impaired SR expert Motor-impaired SR expert

7. Metrics Time to completion Number of errors Finding:  Overshoot  saying faster instead of slower, vice versa Selection:  Start position incorrect (#chars, words, sentences)  End position incorrect (#chars, words, sentences) Recognition error in command Navigational estimation error Number of commands spoken Number of words spoken Subjective approval Training time

8. Evaluation Metrics Navigation Error Undershoot Overshoot Inappropriate scroll speed Highlighting Error Start position incorrect  #chars, words, sentences End position incorrect  #chars, words, sentences Recognition error in commands Time to completion Number of commands spoken Number of words spoken Subjective approval Training time Fatigue

9. Design Questions Cursor Default scroll in Word leaves cursor at bottom -- can’t read what’s below the screen! Scroll with cursor on left margin, right margin, or center? How might position affect ability to scan left and right? Cursor movement draws the eye; keep cursor stationary and move document instead? Sunray Option: Can people follow diagonal cursor movement? Speed Need various starting speeds and speed multipliers. User-controllable? Speech recognition adds one second delay! Causes overshoot!  User must anticipate when to stop. Cognitive Issues How do we ensure that subjects’ documents are matched? Will document retention affect repeated task performance? Measurements Should application record timestamps of user to make timing easier on us? Measure long distance (between screen) navigation technique separately from short distance (on same screen) navigation?