1. Arabic Sign Language Recognition Mohamed Mohandes King Fahd University of Petroleum and Minerals mohandes@kfupm.edu.sa

2. OUTILNE Introduction Sign Language Recognition Sign Language Recognition Translation of text to sign language Conclusion and future work

3. Importance of Sign Language Arabic sign language (ARSL) is different from spoken Arabic language in terms of grammars, vocabulary, and delivery. ARSL is the natural language for deaf like spoken language to vocal Sign language is different from country to other (Australia, UK, USA) 100,000 deaf and hearing impaired in KSA

4. Objectives Using Computers to make life of deaf easier and integrating them in the society : Translating ARSL to spoken language Translating ARSL to spoken language Translating Arabic speech to ARSL Translating Arabic speech to ARSL

5. ARSL Recognition Image based Requires special set up for camera Requires special set up for camera Heavy computational load to extract hands Heavy computational load to extract hands Electronic-Glove based Inconvenience of gloves Inconvenience of gloves Ease of signal extractions Ease of signal extractions

6. Translating ARSL to Speech سلمان

7. System Components

8. CyberGlove CyberGlove

9. CyberGlove 22 sensors Light weight Flexible

10. Tracking System

11. Sensor signals for two different words

12. Coordinates of word الله Coordinates of word مع السلامة

13. المنظمة العربية للتربية والثقافة والعلوم الاتحاد العربي للهيئات العاملة في رعاية الصم الاشارات المعتمدة

14. 1300 signs 344 single handed

15. Data Collection 6880 Samples6880 samples 20 samples from every sign: 15 for training and 5 for testing 344 single handed signs

16. Support Vector Machine

17. SVM

18. System Performance Time segments and Principle Component Analysis for feature extraction Correct recognition rate of 98.33%

19. Analysis of Misclassified Signs Frames of sign of letter “س” Frames of sign of letter “ش”

20. Analysis of Misclassified Signs Frames from the sign “employee” Frames from the sign “Down syndrome”

21. Analysis in Feature space Hand shape of “employee” Hand shape of “Down syndrome”

22. Translating Speech to ARSL سلمان ســـــــــــلمان

23. Conclusions and Future work Developed a Real-time single-handed Arabic sign language recognition system with accuracy of 98.33% Working on two-handed signs recognition Developing our own smart glove for Arabic Sign Language Mapping of signs to roots for speech to sign translation