Listen/Java Edward L. Gilmore II Bryan P. Strait Aditya P. Mathur Purdue University

2 Introduction What is Listen/Java? Motivation Overall architecture Future experiments Demonstrations

3 What is Listen/Java? A tool for mapping program events to sound. Provides automated code instrumentation to investigate use of sound in computing environments. Listen Specification Language (LSL): language for specifying aural events. LSL/Java is an evolution of prior work done with LSL/C.

4 Motivation Investigate the usefulness of sound in various software engineering-related tasks. Use program auralization to improve quality of simulations of telephone networks, mechanical systems, and biological systems. Data analysis using aural cues. Development of programming environments for visually handicapped. Research in novel approaches to music composition.

5 LSL/Java Environment: Java source file (J) LSL spec. file Instrumented Java file (J’) LSL parser Generates table of program events to be auralized Java parser decorates parse tree based on table Listen Java parserListenEvent table javac Compilation

6 Instrumented File Overview ListenSoundManager.play (ListenEvent); Instrumented file ListenMediaManager class ListenEvent class JavaSound API includes

7 Future Experiments Defibrillator  Heart events corresponding to embedded program events can be auralized to monitor heart status Network monitoring Software testing & debugging

8 Demos 1) Program flow -  Learning objective: to identify when a program has entered and exited a while loop. 2) Variable access -  Learning objective: to identify when a specific variable has been used.