Simultaneous Translation services via Cellphone technology NWU IT-ES/NWU IT-ELD Simultaneous Translation services via Cellphone technology Presented by: Tinus Steenkamp Tinus.Steenkamp@NWU.ac.za

The current language scenario in the world By Rick Noack and Lazaro Gamio: April 23, 2015 

Source:Ethologue:Languages of the world,Eighteent edition Language diversity-South Africa according to the Greenberg index (88) Source:Ethologue:Languages of the world,Eighteent edition

SOUTH AFRICAN LANGUAGES 2011 South African context: SOUTH AFRICAN LANGUAGES 2011 Language Number of speakers* % of total Afrikaans 6 855 082 13.5% English 4 892 623 9.6% isiNdebele 1 090 223 2.1% isiXhosa 8 154 258 16% isiZulu 11 587 374 22.7% Sepedi 4 618 576 9.1% Sesotho 3 849 563 7.6% Setswana 4 067 248 8% Sign language 234 655 0.5% SiSwati 1 297 046 2.5% Tshivenda 1 209 388 2.4% Xitsonga 2 277 148 4.5% Other 828 258 1.6% TOTAL 50 961 443** 100% Besides the 11 official languages, scores of others – African, European, Asian – are spoken in South Africa, as the country lies at the crossroads of southern Africa Source: Census 2011

NWU Language policy depicts amongst other things: Special attention to demographical needs English and Afrikaans are primary languages for tuition Concerned efforts are made at each of the NWU campuses to (i) implement Setswana and Sesotho for teaching-learning purposes; (ii) to monitor the effectiveness hereof and (iii) to report annually to IM on the progress and outcomes of these projects Where classes are not presented in Afrikaans Educational Interpreting Services (EIS) are provided mainly into English in one or more teaching programmes in each of the faculties at the Potchefstroom Campus. In some instances, EIS are also provided into Afrikaans and Setswana. Upon admission, students are duly informed of the availability of EIS in teaching programmes and they need to take into account the language consequences if they migrate between programmes. Institutional language policy Oct 2012

Customer where the need pertains NWU LANGUAGE DIRECTORATE The Educational Interpreting Service at the North-West University provides interpreting services in a variety of modules at the NWU, as well as non-academic interpreting on request. BEng BPharm BCur LLB BA Political and Social Studies BCom International Trade BCom Human Resource Management BCom CA BSc Actuarial Studies Bachelor's in Social Work BEd (Foundation and Intermediate phase) BSc Nutrition BA and BA Hons (Theology) BA Communication Diploma in Sports Science

HOW DOES INTERPRETING WORK? Students hand in their student cards at the interpreter in class in exchange for an earphone (these earphones are cleaned with medical alcohol swabs after each use). Students can sit anywhere in the class and use the earphone to listen to the interpreting. Students then hear the interpreted version of the class at the same time as the rest of the class and can thus participate in class, ask questions, etc. At the end of the lecture, they return their earphones in exchange for their student cards

Cons: Current methods utilized Fixed connections in designated classrooms Wireless earpieces Cons: Costly (especially wireless) Labour intensive (installation, distribution, collections and cleaning) Slow roll out-Depending on availability of classrooms Not agile (should urgent need arise for the service)

Solution paradigm shift : Translators already exists N.W.U. IT Ecar 2016 Student technology survey indicated that 75.2 % of participants owns a Android Phone 84.2 % owns a laptop Predominantly (+- 91 %) connects 1-2 devices simultaneously Prefers to follow activities on handheld devices (> 60 % perceive this as extremely important-academically) Relates to a overall good experience with wireless technology on campus

Why not utilize the current trend to solve an old problem? No problem but what are the challenges? What medium to use (Software based I e. VLC,app etc.)? What source will be applicable (PC ,IPad )? How to manage the operating system (network management )? How will the setup work ( operational method)? Simultaneous connections are possible > demand? Easier to use for the service provider? How will it be accepted by the current user? What if the user does nor have a smart device? What if Wi-Fi goes down or phone battery goes flat ?

Where are we? http://196.252.90.247:8090/english.mp3 What medium to use (Software based i.e. VLC etc)- HTTP via Web browser of choice What source will be applicable (PC ,Ipad,Off the shelf)? - Raspberry Pi How to manage the operating system(network management )- Hardware switch on/off How will the setup work ( operational method)? QR code or streaming URL Simultaneous connections are possible > demand? Dry run proofed stable with 102 connections Easier to use for the service provider? Positive translator feedback How will it be accepted by the current user? To be tested and evaluated What if the user does nor have a smart device? (Aim is to release pressure on current system) What if Wi-Fi goes down or phone battery goes flat ? Still in process

+ = End Product: The answer http://196.252.90.247:8090/english.mp3 The answer + = End Product: Translation services that utilizes a small Raspberry Pi (3) to convey speech to the participant via a given URL/QR by using the preferred web browser chosen by the participant /device owner In other words: You will receive the lecture in the alternative language in the same manner that u will listen to your favourite radio station.

Concerns still on the table: Connectivity – and availability of Wi-fi Power utilization of device Time delay in processing the speech Client/student acceptance Service provider go ahead http://196.252.90.247:8090/english.mp3

Little bit of resource stats http://196.252.90.247:8090/english.mp3 Number of connections: 66 Bandwidth in use: 21440k Memory Usage: 346Mb out of 923Mb FFmpeg memory usage: 35Kb CPU usage: 35% average Number of connections: 102 Bandwidth in use: 32320k Memory Usage: 373Mb out of 923Mb FFmpeg memory usage: 37Kb CPU usage: 40% average

Concerns noted: http://196.252.90.247:8090/english.mp3 Project still in preliminary phase and are concerns still treated as in process. Preliminary tests indicate that: Delay between translator and user could be shorter-Service provider Good user experience after tests during departmental meeting measured-Positive feedback Easy use of interface-QR code URL code send out or displayed on screen Clear sound experienced User can use recording app to record classroom translation Streamed at 320 kb/s and 102 consecutive connections where recorded with success

What is next? http://196.252.90.247:8090/english.mp3 Determine corrective measurements on feedback from preliminary tests Beta test to follow within controlled environment Determine and apply corrective measurements obtained from beta test concerns Run another test to determine success of corrective measures taken Collaborate with users and service provider on the outcome of beta and other tests Feedback from test and clients will determine the way forward

Aimed and but not limited to: The aim of this project is to ease the pressure on the current resources utilized by and for translation services. The project is currently not aiming at replacing excising measures but rather relieving pressure due to high user demands. We do however take note of other possible solutions presented by this project such as: Recording live classroom lectures for own use Meeting translation with foreign clients Across campus meeting translation Student participation despite absenteeism due to : Illness Family responsibilities etc. Other responsibilities

Benefit to blended learning Personalized-Language of better understanding Portable-Not limited to physical environment Empowering Not excluding-Inclusive and accessibility Second channel for lecture capturing Quality control remotely