August 7, 2003 BITS C461/IS C341 Software Engineering1 Jlisten: A Tool for Program Auralization Last Update: August 6, 2003 Aditya Mathur

August 7, 2003 BITS C461/IS C341 Software Engineering2 What is program auralization? Program auralization refers to the task of mapping program events and activities to sounds. Program events: “Sonification” is another term for “auralization.” Execution begins Control enters a loop. Method check_balance is invoked. Variable her_balance becomes greater than $1 million.

August 7, 2003 BITS C461/IS C341 Software Engineering3 Program events Execution begins Control enters a loop. Method check_balance is invoked. Variable her_balance becomes greater than $1 million.

August 7, 2003 BITS C461/IS C341 Software Engineering4 Program activities Method detect_intrusion is executing. Loop starting at label sort_begin is executing.

August 7, 2003 BITS C461/IS C341 Software Engineering5 Why auralize? An auralized program can be “heard” while it executes. Hearing the execution of an auralized program enables the detection of mapped events and activities. Sound serves as a complement to printed or other visual media. Sound allows the detection of events without having to “dig” into the program through a debugging or other tool.

August 7, 2003 BITS C461/IS C341 Software Engineering6 Past work in program auralization Listen project at Purdue: Originally by Boardman and Mathur. Several other (data) sonification projects at Georgia Tech, U of Illinois, Northumbria University, Sante Fe institute, etc

August 7, 2003 BITS C461/IS C341 Software Engineering7 Jlisten: How does it work?

August 7, 2003 BITS C461/IS C341 Software Engineering8 Sample LSL spec [1] /*********************************************************************** * *File:sort.lsl *Author:David B. Boardman *Date:Aug 1994 * *For the bubble, insertion, and selection sort, this *specification auralizes the begin and end of a *program, the number of comparisons, and the *element swapped. * ************************************************************************/

August 7, 2003 BITS C461/IS C341 Software Engineering9 Sample LSL spec [2] begin auralspec specmodule temp begin temp syncto mmabs q = 60; notify rule = prog_begin using begin_snd; notify rule = prog_end using end_snd; notify rule = while_body_begin using sticks_snd in func = "insert_sort"; notify rule = while_statement_exit using sticks_snd in func = "insert_sort";

August 7, 2003 BITS C461/IS C341 Software Engineering10 Sample LSL spec [3] notify rule = for_body_begin using sticks_snd in func = "bubble_sort" and func = "selection_sort"; dtrack temp when rule = function_entry:"exchange" until rule = function_return:"exchange" using flute2_snd; end temp; end auralspec.

August 7, 2003 BITS C461/IS C341 Software Engineering11 Your tasks Understand the problem well. Perform requirement analysis. Make good use of information and components already available to you. Design the Jlisten system. Prototype Jlisten and have fun with it! Can a program be mapped to Music? Let us investigate through experimentation!