CMPS 261 – Project Proposal Visually Representing American Sign Language Translations Victor Geislinger

Background/Motivation ● American Sign Language (ASL) ● Fingerspelling (FS) ● Handshapes – Basis of language

Background/Motivation ● Interpreters – Emergency – Inaccessible – Expensive ● Learning Tool – Feedback

Method ● Collect Data via Leap Motion Controller – Focus on hand(s)/finger(s) – Real time capture

Method ● Categorize individual letters – Form hard to determine ● Classify group shapes – Easier to guess – “Autocorrect” feature

Method ● Transitions sometimes exist as one unit – “J” and “Z” – Double letters – “I-L-Y” – “A-I-R” – “B-U-S”

Output ● Gives interpreted word/sentence ● Color coded to give likely letter from shape group

Output ● Features other possible guesses – Given by opacity, position, and/or hierarchy tree ● Gives timeline of duration of letter – Possibly used to visually see speed of speech

Potential Issues/Challenges ● Identifying letters from same group – Difficult/impossible to do with current technology ● Differences in style/accent ● Transition lengths ● Output might have to many possibilities