1. The User Interface Design for the Sign Language Interpreter in a Remote Sign Language Interpretation System Hiroki Minagawa, Ichiro Naito, Nobuko Kato, Hiroshi Murakami, and Yasushi Ishihara Tsukuba College of Technology, Japan E-mail: minagawa@a.tsukuba-tech.ac.jp ①

2. Concept The Necessity of Remote Sign Language Interpretation The number of interpreters is not enough. Special knowledge is required of interpreters. (Ex. Lecture of University) The Spread of Broadband Networks The Necessity of Considering a System Design ②

3. Experiment System No Time Delay No Quality Loss ③ Experiment SystemAssumed System InternetAudioVideo Deaf Person Hearing Person Interpreter

4. Deaf Person - Hearing Person ④ Deaf Person Hearing Person Usual InterpretationRemote Interpretation Interpretation Room Voice AudioVideo Sign Language Interpreter

5. ⑤ Usual InterpretationRemote Interpretation Interpretation Room Scene Deaf Person Hearing Person Interpreter Realized System

6. Results ○ Remote interpretation was successful. ○ The feeling of refusal to the system was lost as it was used. (Interpreter, Deaf Person, Hearing Person) ○ A scenery monitor was necessary for the interpreter. ○ The interpreter found the hearing person ’ s appearance well. × Interpretation could not be obtained while the deaf person was not looking at the monitor. × Eye contact was difficult for the interpreter. ⑥

7. Hearing Lecturer - Deaf Students ⑦ Usual InterpretationRemote Interpretation Interpretation Room Deaf Students Hearing Lecturer Interpreter Voice Sign Language

8. ⑧ Lecture Room Deaf Students Hearing Lecturer Lecture Note Interpreter Interpretation Room Scene Realized System Interpretation Supporters

9. Results ○ Remote interpretation was successful. ○ A scenery monitor of the lecture room was necessary for the interpreter as a main monitor. ○ The interpreter found the lecturer ’ s appearance well. × The character on a white board could not be read. × The interpreter sometimes mistook right and left. ○ Merit of Remote Sign Language Interpretation ○ The interpretation supporters could read two or more students' sign language. ○ The lecture note could be placed near the interpreter. ⑨

10. ⑩ Usual InterpretationRemote Interpretation Interpretation Room Deaf Lecturer Hearing Students Interpreter Voice Sign Language Deaf Lecturer - Hearing Students

11. ⑪ Lecture Note Deaf Lecturer Hearing Students Interpreter Lecture Room Interpretation Room Scene Realized System Interpretation Supporters

12. Results ○ Remote interpretation was successful. ○ A scenery monitor of the students was necessary for the interpreter. ○ The interpreter was able to see students' expression. × Interpretation failed when the lecturer disappeared from the monitor. × Interpretation could not be obtained while the lecturer had turned to the white board. ⑫

13. Other Applications Multi-point Meeting With Sign Language Possibility of a Low Cost Remote Sign Language Interpretation System ⑬

14. ⑭ Personal Sign Language Interpreter Pocket Interpreter Secret Interpreter

15. Future Subjects The Method of the Information Support for the Interpreter Hearing Person ’ s Expression Relation Between the Deaf Person and the Hearing Person Detailed Information on the Scene As a Lecture Note How to Show the Interpreter ’ s Video to the Deaf Person Actual System Design Sign Language Interpretation Server System Mobile Client System Estimation of Total Cost ⑮