EVALUATION OF USER HABITS FOR CREATING AUDITORY REPRESENTATIONS OF DIFFERENT SOFTWARE APPLICATIONS FOR BLIND PERSONS Wersényi György SZÉCHENYI ISTVÁN UNIVERSITY, Department of Telecommunications H-9026, Győr, Egyetem tér 1., Hungary Tel.: Fax: Abstract Blind and visually disabled persons use special software environments – such as Windows-Eyes, JAWS, screen-readers, text-to-speech programs – to access personal computers. These software solutions may offer sound samples for a better orientation. Besides speech, there are auditory icons, earcons or spearcons as possible extension of visual information. Finding the optimal mapping between (visual) events on the screen and their auditory representation is a difficult task. In the frame of the GUIB (Graphical User Interface for Blind Persons) project we started a survey for blind persons as well as for users with normal vision to investigate their user habits and needs, in order to find the most important software applications and sub-functions. Questionnaires were filled in and evaluated to determine the most important and popular applications to be extended with sound representations in the future. Introduction GUIB project: virtual audio display for visually disabled –30-40 most important applications, functions –Linking, creating: earcons, auditory icons, spearcons –Testing and implementation (JAWS) Subjects Blind persons and visually not impaired for comparison Two different questionnaires (to download), JAWS-friendly Budapest/Hungary and Leipzig/Germany 10 females, 50 male (all with normal vision) Everyday users Ranking by giving points from 1 to 5 Results (average) Internet access: 1. Arrows back and forward (4,2 points) 2. Open/close new browser tab (3,9) 3. Typing URL address (3,85) 4. Open/close new browser window (3,8) 5. Save/open picture or link (3,6) 6. Home button (3,5) 7. Favorites, bookmarks (3,37) 8. Re-read/refresh actual site (3,35) 9. Print (3,32) 10. Find on this screen (3,2) 11. Stop downloading actual site (2,8) client 1. Delete mail (4,2) 2. Download new mails from server (4,19) 3. Compose new mail (4,18) 4. Send composed mail (4,18) 5. Reply (4,15) 6. Attach (3,7) 7. Forward mail (3,4) 8. Address book (3,37) 9. Reply all (3,1) 10. Save draft mail (3) 11. Print mail (3) Navigation and file handling My Computer (3,4), Windows Explorer (2,4) Total Commander / Windows Commander (4,25). 1. Copy files (4,6) 2. Delete files (4,4) 3. Delete folder (4,25) 4. Make a folder (4,2) 5. Move files (4,1) 6. Rename files (4) Document handling Word (4,2) PDF reader (3,8) Excel (3,7) Power Point presentation (2,8) Notepad (2,4) Front Page (1,9) 1. Save file (4,3) 2. Open file (4,2) 3. New document (4,1) 4. Copy/paste/cut (4) 5. Save as (3,9) 6. Format text: italic, bold, underline (3,8) 7. Select/select all (3,7) 8. Print (3,7) 9. Fonts, Font size (3,6) 10. Repeat/undo last command (3,6) 11. Grammatical corrections, spelling (3,2) 12. Search/replace (3,2) Other applications Media content viewers: Windows Media Player (3,7). The most popular player is Winamp (4) for audio, and the BSPlayer for video. Messenger services: Windows/MSN Messenger is the winning application (3,7), Skype (2,6). On the other hand, ICQ (1,6) and chatting (2) are out of interests. Download managers and accelerators (e.g. getRight) and DC clients are mostly used by the young, male adults (2,7 points each). Different torrent clients (3,1) are used most frequently. Virus/spam killer (4,1), but only in a very user-friendly way (automatic installation and maintaining). Other important applications include: CD/DVD burning software (3,7), image viewer and handling (4) and ZIP/RAR compressors (3,3). From the built-in services of Windows XP the following applications are frequently used: Printers (3,8), Control Panel (3,4), My documents folder (3,2), Paint (3,1), Search for files or folders (3). The command prompt (2,8), the calculator (2,7) and the Help (2,1) is only seldom accessed NEED FOR GAMING AND ENTERTAINMENT! Summary Figure 1 (left). Spectral representation of the word “print” (in Hungarian). Original recording (top) and compressed spearcon (bottom) in 16 bits, Hz resolution. Introduction to blind users (in Hungarian) Original recording of a male speaker Compressed with MATLAB Spectral evaluation: 16 bits resolution and at least Hz of sampling frequency is required. Using Hz is recommended to avoid noisy spearcons. A text-to-speech application (SpeakBoard) was also used to save wave files, but listeners preferred original recordings of a human speaker. Longer sentences (more than 3-4 words) become unintelligible after compression, so this method is not suited for creating spearcons longer than 1-2 words. It is always recommended to truncate the samples before compression to remove unnecessary silence at start. Sonification (?) for shrinking and growing windows? A detailed survey has been started to investigate user habits under MS Windows environment. 60 users with normal vision evaluated different applications and their functions. Meanwhile, an on-line, easy- access questionnaire is being filled in by blind users. The goal is to find the most important feature that has to be represented by sound events (auditory icons, earcons, spearcons) as well. These can be then implemented under JAWS or maybe used for the GUIB project and for extended virtual simulation (spatial distribution with HRTF filtering etc.). Blind users support the creation of a collection of sounds and spearcons for a faster and better accessibility to personal computers. Future works include synthesis, recording and evaluation of different sound samples and spearcons. Hungarian spearcons Figure 2 (right). Spectral representation of the word “print” (in Hungarian). Compressed spearcon in 16 bits, Hz resolution (top) and in 8 bits, Hz resolution (bottom).