1. Dr. ElSayed Eissa Hemayed
8/8/2018
Hatet3’ayyar
Supervisor:
Dr. ElSayed Eissa Hemayed
2/3/2010

2. Team Members Marwa Ibrahim Lamey. Mayada Ibrahim Aly.
8/8/2018
Team Members
Marwa Ibrahim Lamey.
Mayada Ibrahim Aly.
Mona Sherif Ahmed.
Suad Mohamed Barakat.
Hatet3’ayyar
2/3/2010

3. Agenda Introduction Project Overview Tools Time Plan 2/3/2010 8/8/2018
Hatet3’ayyar
Time Plan
2/3/2010

4. Introduction Intro. Overview Tools Time Plan 2/3/2010 8/8/2018
Hatet3’ayyar
Time Plan
2/3/2010

5. Can’t we help them interacting with the community!??...
8/8/2018
Background
Fact: There exists 5 million deaf persons in Egypt
Can’t we help them interacting with the community!??...
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

6. What about deaf children?
8/8/2018
Problem definition
Hearing children can be taught many lessons and morals through stories.
What about deaf children?
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

7. This is not always the picture
8/8/2018
This is not always the picture
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
Al Amal School- Resala Charity
2/3/2010

8. Project Overview Intro. Overview Tools Time Plan 2/3/2010 8/8/2018
Hatet3’ayyar
Time Plan
2/3/2010

9. Our Scope
8/8/2018
Our prototype is to translate a category of children stories to the sign language in real time
Goal: To minimize the gap between hearing parents or teachers and deaf children
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

10. Description Input: Arabic story speech signal
8/8/2018
Description
Input: Arabic story speech signal
Output: A 3D character performing the sign language
Type: Desktop Application
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

11. Market Survey iCommunicator IBM SiSi King Fahd University Intro.
8/8/2018
Market Survey
iCommunicator
IBM SiSi
King Fahd University
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

12. SIGNlator Uniqueness Arabic speech recognition
8/8/2018
SIGNlator Uniqueness
Arabic speech recognition
Start from speech and end up with sign language
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

13. SIGNlator Features
8/8/2018
Translation of Arabic speech to sign language in real time.
Translation of Arabic text to sign language.
Learning mode.
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

14. القاموس الاشاري العربي للصم
8/8/2018
Block Diagram
Intro.
Text to Sign language
القاموس الاشاري العربي للصم
Overview
Recognizer
Graphics module
Tools
Hatet3’ayyar
Time Plan
Controller
2/3/2010

15. Automatic Speech Recognition-Architecture
8/8/2018
Automatic Speech Recognition-Architecture
Recognizer
Intro.
Language Model
Recognizer
Overview
Feature Extraction
Search
Audio
Words
Tools
Hatet3’ayyar
Time Plan
Acoustic Model
Dictionary

16. القاموس الاشاري العربي للصم
8/8/2018
Block Diagram
Intro.
Text to Sign language
القاموس الاشاري العربي للصم
Overview
Recognizer
Graphics module
Tools
Hatet3’ayyar
Time Plan
Controller
2/3/2010

17. Challenges Tackling a new field Phonemes of Arabic language.
8/8/2018
Challenges
Tackling a new field
Phonemes of Arabic language.
Prepare the training set.
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

18. Future Work Change the program type to be mobile application.
8/8/2018
Future Work
Change the program type to be mobile application.
Integrate with “Sound of Signs “Project
Intro.
Overview
Tools
Hatet3’ayyar
Time Plan
2/3/2010

19. Tools Recognizer : HTK Text to Sign language:
8/8/2018
Tools
Recognizer :
Text to Sign language:
C# using Microsoft Visual Studio 2008
SQL Server 2005
Graphics module:
GUI:
Intro.
HTK
Overview
Tools
Hatet3’ayyar
Quest3D 4.0
Time Plan
Expression Studio 2 ( Blend)
2/3/2010

20. Implementation & Testing
8/8/2018
Time Plan
Brain Storming
Working Period
84 days
Market Research
Idle period
25 d
Design
34d
Mid-Terms 6d
Design
18d
Finals
8/7/09
30/9/09
38days
Implementation
1/10/09
26/10/09
43days
Mid-Terms
27/10/09
30/11/09
Integration
16d
Implementation & Testing
5/12/09
11/12/09
13d
12/12/09
30/12/09
14d
Finals
1/1/10
8/2/10
Testing
Hatet3’ayyar
51 days
9/2/10
24/3/10 7d
Doc
25/3/10
10/4/10 6d
11/4/10
24/4/10
25/4/10
9/5/10
10/5/10
30/6/10
1/7/10
8/7/09
9/7/10
15/7/10
2/3/2010

21. agile solutions, real result
8/8/2018
Sponsors
agile solutions, real result
Hatet3’ayyar
2/3/2010

22. 8/8/2018
Thank you T H A N K Y O U
Hatet3’ayyar
2/3/2010

23. ASR Categories Our Choice!!
8/8/2018
Unlimited words can be recognized if added to the dictionary.
Less accurate but still acceptable accuracy
Very high accuracy
Maximum 150 words.
Intro.
Overview
Word Based
Phoneme Based
Isolated Words
Continuous Speech
Tools
Hatet3’ayyar
Time Plan
Our Choice!!

24. Causes of deafness Not necessary to be born for deaf parents
9.6% Pregnancy-Related causes
8.4% Post-Natal causes
28% Genetic causes
54% Unknown causes
Not necessary to be born for deaf parents