1. Scientific Advisory Group Meeting May 7, 2004

2. Scientific Advisory Group Meeting May 7, 2004 Access to Technical Education Through Sign Language Interpreting: Issues and Answers What are the interactions of of student characteristics, interpreter characteristics, and settings? –Do student preferences and skills matter? –Does interpreting level the playing field?

3. Scientific Advisory Group Meeting May 7, 2004 Do Student Preferences and Skills Matter? No.

4. Scientific Advisory Group Meeting May 7, 2004 Predictors of Comprehension (Signed and Written Tests) Generally not: –ASL skill –English skill –Interpreting match –Reading ability –Academic qualifications (including RIT vs. NTID) –Hearing aids and implants –Degree of hearing loss –Deaf vs. hearing parents –Age began signing –No “question by hearing status interaction”

5. Scientific Advisory Group Meeting May 7, 2004 Not for comprehension (of college students, in single lectures, without other support services) with STEM or non-STEM content Longer-term (course, semester, program)? –Student and interpreter comfort? –Motivation? –Variability (within and across students)? Do Student Preferences and Skills Matter?

6. Scientific Advisory Group Meeting May 7, 2004 Does Interpreting Level the Playing Field? No.

7. Scientific Advisory Group Meeting May 7, 2004 Predictors of Comprehension (Signed and Written Tests) Generally not: –ASL skill –English skill –Interpreting match –Reading ability –Academic qualifications (including RIT vs. NTID) –Hearing aids and implants –Degree of hearing loss –Deaf vs. hearing parents –Age began signing –No “question by hearing status interaction”

8. Scientific Advisory Group Meeting May 7, 2004 Does Interpreting Level the Playing Field? It’s not about interpreting or student sign skills Likely indicates poor K-12 preparation (including interpreting) –May be a function of “mediated instruction” Emphasizes the importance of other support services (tutoring, notes, etc.) Reflects the challenges of mainstream education –And we don’t know about direct instruction

9. Scientific Advisory Group Meeting May 7, 2004 Eliminating Communication and Technological Barriers to STEM Education What are the benefits and challenges to deaf students of visual materials in the classroom? How do characteristics of students, interpreters, instructors, and settings interact?

10. Scientific Advisory Group Meeting May 7, 2004 Eliminating Communication and Technological Barriers to STEM Education Where did all this come from?

11. Scientific Advisory Group Meeting May 7, 2004 Eliminating Communication and Technological Barriers to STEM Education Year 1 –Methodology –Benefits accruing to deaf students and skilled signers

12. Scientific Advisory Group Meeting May 7, 2004 Year 1: Methodology –Eyetracking Why do we make eye movements? Why do we care?

13. Scientific Advisory Group Meeting May 7, 2004 Why make eye movements? The visual world contains a vast amount of information: - Limited sensor & wiring capacity - Limited neural resources - Limited bandwidth (1 kHz neural spike trains)

14. Scientific Advisory Group Meeting May 7, 2004 Why make eye movements? The visual world contains a vast amount of information: - Limited sensor & wiring capacity - Limited neural resources - Limited bandwidth (1 kHz neural spike trains) Given these limitations; - compromise between field-of-view and acuity

15. Scientific Advisory Group Meeting May 7, 2004 … far more information than can be captured in real time by a biological system with bandwidth limitations imposed by relatively slow transmission rates. In humans the problem was solved by having two retinas; rods that offered wide field of view and scotopic sensitivity, and cones that … The Foveal Compromise

16. Scientific Advisory Group Meeting May 7, 2004 a The Foveal Compromise

17. Scientific Advisory Group Meeting May 7, 2004 … far more iomnoratifn athn cna eb cuatrepd ni arel tmie yb a biological system whit nbwtdiadh lisnitatiom iopsemd yb relatively slow rtaminsisosn tersa. Ei uhamsn hte rpboelm was solved by hvagin wto nretais; rsod taht feroefd ediew field of wive adn stopioc steysitnivi, dan sonce taht … The Foveal Compromise

18. Scientific Advisory Group Meeting May 7, 2004 The Dual Retina In humans the problem was solved by having two retinas: Rods that offered wide field of view (and night vision) Cones that provide high acuity (and color vision)

19. Scientific Advisory Group Meeting May 7, 2004 Acuity is highest at the fovea; a depression in the center of the retina where the high-acuity cones are concentrated. The Dual Retina

20. Scientific Advisory Group Meeting May 7, 2004 Stare at the ‘x’ and do not move your eyes X The Foveal Compromise

21. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

22. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

23. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

24. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

25. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

26. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

27. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

28. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

29. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

30. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

31. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

32. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

33. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

34. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

35. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

36. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

37. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

38. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

39. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

40. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

41. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

42. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

43. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

44. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

45. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

46. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

47. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

48. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

49. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

50. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

51. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

52. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

53. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

54. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

55. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

56. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

57. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

58. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

59. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

60. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

61. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

62. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

63. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

64. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

65. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

66. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

67. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

68. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

69. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

70. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

71. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

72. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

73. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

74. Scientific Advisory Group Meeting May 7, 2004 X The Foveal Compromise

75. Scientific Advisory Group Meeting May 7, 2004 X Peripheral specialization: Motion

76. Scientific Advisory Group Meeting May 7, 2004 X Peripheral specialization: Motion

77. Scientific Advisory Group Meeting May 7, 2004

78. (fovea covers <0.1% of the field) Serial Execution

79. Scientific Advisory Group Meeting May 7, 2004 Serial Execution

80. Scientific Advisory Group Meeting May 7, 2004 Serial Execution

81. Scientific Advisory Group Meeting May 7, 2004 Serial Execution

82. Scientific Advisory Group Meeting May 7, 2004

83. Eyetracking Methods

84. Scientific Advisory Group Meeting May 7, 2004 RIT’s Wearable Eyetracker

85. Scientific Advisory Group Meeting May 7, 2004

87. Skilled

88. Scientific Advisory Group Meeting May 7, 2004 Skilled

89. Scientific Advisory Group Meeting May 7, 2004 Skilled Newbie Hearing “Live”

90. Scientific Advisory Group Meeting May 7, 2004 Memorex

91. Scientific Advisory Group Meeting May 7, 2004

92. LiveMemorex Skilled

93. Scientific Advisory Group Meeting May 7, 2004

94. “Display” “Interpreter” “Instructor” Videotape Coding

95. Scientific Advisory Group Meeting May 7, 2004

96. Experiment 1: Fixation Durations

97. Scientific Advisory Group Meeting May 7, 2004 37 % 1% 38% 0% 12% 13% Instructor Interpreter Display First-order transition probability

98. Scientific Advisory Group Meeting May 7, 2004 String Comparisons: Levenshtein distance ?

99. Scientific Advisory Group Meeting May 7, 2004 String Comparisons: Levenshtein distance ?

100. Scientific Advisory Group Meeting May 7, 2004 String Comparisons: Levenshtein distance ?

101. Scientific Advisory Group Meeting May 7, 2004 String Comparisons: Levenshtein distance ? [4 substitutions]

102. Scientific Advisory Group Meeting May 7, 2004 String Comparisons: Levenshtein distance < [4 substitutions][5 substitutions]

103. Scientific Advisory Group Meeting May 7, 2004 String Comparisons: Levenshtein distance < > [4 substitutions][5 substitutions] [1 deletion]

104. Scientific Advisory Group Meeting May 7, 2004 String Comparisons: Levenshtein distance “Costs” are imposed for each: Substitution Insertion Deletion Identical strings have Levenshtein distance = 0 Different strings have Levenshtein distance < 1 <

105. Scientific Advisory Group Meeting May 7, 2004

107. Experiment 1: Comprehension