Soundscapes James Martin

Overview Problem Statement Proposed Solution Solution Created (Modules, Model, Pics) Testing Looking Back See It in Action Q&A

Problem Statement Create a music visualization program that renders the visual display in real time and reacts to the music that is playing.

Proposed Solution Processing - Platform Jsyn - Sound Jogl – 3D Visuals in OpenGL L-Systems – Data structure for Visuals

Solution Created Processing – Platform Three Modules Interface Interface Sound – ESS Sound – ESS Graphics – Uses Spectrum Analysis Data Graphics – Uses Spectrum Analysis Data

System Model Input Music file(s) read in from a default directory Sound Module Control audio playback and analysis Output Music is output from program through sound card to speakers Interface Acts as input to sound module for user controls Visualization Module Graphics are generated based on input Output Graphics are output from program through video card to display Wav or MP3 Global Variables Digital Signal Function calls Digital Signal

Interface Module Simple Cultural Clues Cultural CluesDragable Able to be hidden

Sound Module Uses ESS – Plug-in for Processing Load and Play Music Spectrum Analysis Uses Fast Fourier Transform Algorithm Uses Fast Fourier Transform Algorithm Extracts Frequency Data from Waveform

Graphics Module Draws Images to screen Uses Data from Spectrum Analysis Look at Code…? Code

Pictures

Pictures

Pictures

Pictures

Pictures

Pictures

Pictures

Pictures

Testing Interface Module Button Functionality Button Functionality Play and Stop work as described Dragability DragabilityDragable Stays intact Cannot be dragged off screen Concealability Concealability Interface can be hidden with any keystroke Interface can be shown with any keystroke Interface is not interactive when hidden

Testing Sound Module Song Playback Song Playback Proper song plays Song plays to length (< 2:51) Song plays smooth

Testing Graphics Module Visualizations Visualizations Look as desired Play smooth

Testing System Interface & Sound Interface & Sound Buttons and sound playback are linked Sound & Graphics Sound & Graphics Visualization matches beat Graphics and Interface Graphics and Interface Buttons and visualization are linked

Looking Back Conclusions Learn (Positive and Negative) Do the Same? Do Differently? Open Problems Extension(s)

Prototype Behold!