1. Virtual Instrument Design and Animation Cynthia Bruyns Robert Taylor Carlo Séquin University of California at Berkeley

2. Aim  To provide an environment for evaluating the sound qualities of modeled simple idiophones Images courtesy of Steve Reinmuth

3. Aim  To recreate the object’s sound in an interactive environment  To be able to use these sounds to extend synthesis for computer music Modeled ObjectsMode Activation

4. Previous Sound Generation Research Stochastic  Serra, X. et al. 1990  Cook, P. 2001 Textures  van den Doel, K. et al. 2001  Di Fillipo, D. et al. 2000 Analytic  Smith, J. 1992  Cook, P. 1995 Modal  Morrison, J. et al. 1993  O’Brien, J. et al. 2001 Methods for sound synthesis for graphics

5. Geometric Models  Simple or complex shapes  Multiple resolutions are generated  Can use thin or solid models

6. Physical Model

7. Modal Formulation

8. Mode Shapes (exaggerated)

9. Modal Activation  Load model geometry into viewer program.  Choose materials parameters.  Select several strike locations on the model – and map to keys of a midi keyboard.  PLAY ! – Key velocity determines intensity of strike.

10. Interactive Sound Generation  Software created as an Audio Unit plug-in  Can be used in AU host applications  This allows for sound generation in a composing environment Strike Location

11. Sound Validation Synthesized sounds were compared with actual object sound generation  Square plate  Aluminum  Steel  Rectangular plate  Aluminum  Odd shaped plates  Aluminum ModelReal

12. Measurement Setup  Sound dampened room  Selection after transients  FFT analysis of identical time intervals Time (seconds) Frequency (Hz) Amplitude (dB) Analysis Window ?

13. Square (Aluminum) Frequency (Hz) Sound Pressure Level (dB/Hz) 60 40 20 100 200 500 1000 2000 Materials Model

14. Square (Steel) Frequency (Hz) Sound Pressure Level (dB/Hz) 60 40 20 100 200 500 1000 2000 Materials Model

15. Rectangle (Aluminum) Frequency (Hz) Sound Pressure Level (dB/Hz) 60 40 20 100 200 500 1000 2000 Materials Model ?

16. Frequency (Hz) Sound Pressure Level (dB/Hz) 60 40 20 100 200 500 1000 2000 Materials Model Odd Shaped Plates - “S”

17. Odd Shaped Plates - “G” Frequency (Hz) Sound Pressure Level (dB/Hz) 60 40 20 100 200 500 1000 2000 Materials Model

18. Demo Plate

19. Demo Odd Shape

20. Summary and Discussion  System for generating “ringing” sounds  More “natural” => more interesting  Real-time generation of strike-sounds.  System may become predictive enough to allow interactive design of new “bells”  Real-time shape modifications an re-analysis ?  Extensions:  Non-linear phenomena during initial strike  Include coupling with environment (air).

21. Acknowledgements Apple Computer Ruzena Basjcy David Bindel Jon Drukman Justin Maxwell James McCartney Kim Silverman Bill Stewart