Presentation is loading. Please wait.

Presentation is loading. Please wait.

Identifying American Sign Language Attributes Using ASL Novices on Mechanical Turk By Kyle Rector.

Similar presentations


Presentation on theme: "Identifying American Sign Language Attributes Using ASL Novices on Mechanical Turk By Kyle Rector."— Presentation transcript:

1 Identifying American Sign Language Attributes Using ASL Novices on Mechanical Turk By Kyle Rector

2 My experience with ASL

3 English to ASL Dictionaries

4 Can ASL be put in a database?

5 Written forms of ASL

6 ASL to English Dictionaries

7 Can I use ASL novices? Grosjean and Lane (1977) non signer can distinguish a pause for phrase boundaries or sentence ends Gibet, Courty, Duarte (2011) ASL signer observed animations of French signed language to see if they could replicate LSF

8 Socially Computed Scripts to Support Social Problem Solving Skills

9 Real-Time Captioning by Groups of Non-Experts

10 AudioWiz: Nearly Real-time Audio Transcriptions

11 Better Vocabularies for Assistive Communication Aids: Connecting Terms using Semantic Networks and Untrained Annotators

12 How are those last projects similar?

13 Identifying American Sign Language Attributes Using ASL Novices on Mechanical Turk By Kyle Rector

14 What are ASL Attributes?

15 Identifying American Sign Language Attributes Using ASL Novices on Mechanical Turk By Kyle Rector

16 Research Questions – Is it possible to have ASL novices identify attributes of a sign? – How accurate are ASL novices when identifying parameters? – What attributes of a visual language are easier or harder to solve with lay people? – What types questions are needed to get this data?

17 How can a novice do this? 33 Handshapes 10 Locations 9 Orientations 30 Movements 6 Relative Positions

18

19

20

21

22

23 Mechanical Turk 50 words 72 questions 3 people 2 cents per person $216 total Answered overnight!

24 ASL Expert http://asl2eng.cs.washington.edu Same 50 words Finished over an average of 4.5 hours

25 Evaluation - differences Handshape: #:54 %:3.27 Location: #:34 %:6.8 Orientation: #:213 %:47.33 Movement: #:143 %:20.43 Relation: #:44 %:14.67 Total: #:488 %:13.56

26 Understanding the differences

27 ASL Novice errors Completely missed it Crowd undecided Close resemblance Confused relative position and movement

28 ASL Expert errors Completely missed it Close resemblance ASL Experience

29 Is this sustainable? “I liked that they were different and I'm interested in sign language so I found them interesting. I did these awhile back and just came back looking for more to do and found this! :)” “They were interesting and quick. I suppose if I was in contact with any one who used sign language I might pick up a few words.”

30 Future Work Use technology or ASL Experts to compensate – Orientation – Movement Only use possible combinations of attributes – How do we determine what these are?

31 Future Work Put this data into ASL to English dictionary Close resemblance in hand shapes or locations – search metric http://asl2eng.cs.washington.edu

32 Conclusion Getting data from novices, good or bad is useful for future applications Orientation is very hard for novices to comprehend ASL Experts entering a term in the dictionary seems easy, but can be costly

33 Thank you! Advisor: Richard Ladner Research Assistant: Travis Smith Grad students: Shiri Azenkot, Lydia Chilton, Supasorn Suwajanakorn


Download ppt "Identifying American Sign Language Attributes Using ASL Novices on Mechanical Turk By Kyle Rector."

Similar presentations


Ads by Google