Introduction and Motivation Speech recognition is cumbersome Not enough study of document navigation and editing tasks Current tools support two navigation methods “Move down five lines, move right four words” Go to The quick brown fox SLOW! FRUSTRATING! ERROR-PRONE! We say, let the computer do the walking…
Project Stages Design Poster Expert Interview Pilot Study Analysis and Redesign Rerun study Final Paper and Poster
Expert Interview Experience with speech recognition Satisfaction with speech recognition Suggestions for improvements Comments/opinions on our proposed solutions
Task One Finding text on another page Move down five lines, move right four words Go to The quick brown fox Go to page 3, paragraph 2, sentence 5, word 8, character 4. Auto-scroll Go down… faster… faster… slower… stop Go right… faster… stop Auto-scroll and pause at natural landmarks: section headers, paragraphs, and user-defined landmarks: middle of page, topic sentence
Task Two Finding text within a page Hierarchical Keypad Grid Sunray X-and-Y Move down five lines, move right four words Go to The quick brown fox Go to page 3, paragraph 2, sentence 5, word 8, character 4. Auto-scroll Go down… faster… faster… slower… stop Go right… faster… stop Auto-scroll and pause at natural landmarks: section headers, paragraphs, and user-defined landmarks: middle of page, topic sentence
Pilot Study Pre-interview Post-interview Video taped 3 Modes Keyboard+Mouse, VR, SpeedNav™ 4 subjects Navigate document Forward Short, medium, long Backwards Medium Then, highlight short stretch of text 3 Documents Familiar Read once Unknown Non-impaired Novice SR Motor-impaired SR expert Non-impaired SR expert Motor-impaired SR expert
Metrics Time to completion Number of errors Finding: Overshoot saying faster instead of slower, vice versa Selection: Start position incorrect (#chars, words, sentences) End position incorrect (#chars, words, sentences) Recognition error in command Navigational estimation error Number of commands spoken Number of words spoken Subjective approval Training time
Evaluation Metrics Navigation Error Undershoot Overshoot Inappropriate scroll speed Highlighting Error Start position incorrect #chars, words, sentences End position incorrect #chars, words, sentences Recognition error in commands Time to completion Number of commands spoken Number of words spoken Subjective approval Training time Fatigue
Design Questions Cursor Default scroll in Word leaves cursor at bottom -- can’t read what’s below the screen! Scroll with cursor on left margin, right margin, or center? How might position affect ability to scan left and right? Cursor movement draws the eye; keep cursor stationary and move document instead? Sunray Option: Can people follow diagonal cursor movement? Speed Need various starting speeds and speed multipliers. User-controllable? Speech recognition adds one second delay! Causes overshoot! User must anticipate when to stop. Cognitive Issues How do we ensure that subjects’ documents are matched? Will document retention affect repeated task performance? Measurements Should application record timestamps of user to make timing easier on us? Measure long distance (between screen) navigation technique separately from short distance (on same screen) navigation?