3-D Sound and Spatial Audio MUS_TECH 348. Cathedral / Concert Hall / Theater Sound Altar / Stage / Screen Spiritual / Emotional World Subjective Music.

Slides:



Advertisements
Similar presentations
Pitch, Timbre, Source Separation, and the Myths of Sound Localization
Advertisements

3-D Sound and Spatial Audio MUS_TECH 348. Multi-Loudspeaker Reproduction: Surround Sound.
SYN-AUD-CON Acoustic Test and Measurement Seminar The Early Sound Field: Properties, Perceptual Attributes, and Measurement Methods NEIL THOMPSON SHADE.
Basic Acoustics Inverse square law Reinforcement/cancellation
Psychoacoustics Perception of Direction AUD202 Audio and Acoustics Theory.
1 3D sound reproduction with “OPSODIS” and its commercial applications Takashi Takeuchi, PhD Chief Technical Officer OPSODIS Limited Institute of Sound.
Effects. Dynamic Range Processors Fixed Time Delay Effects Variable Time Delay Effects Reverberation Effects Time and Pitch Changing Effects Distortion.
Spatial Perception of Audio J. D. (jj) Johnston Neural Audio Corporation.
Spatial Perception of Audio vs. The Home Theatre
Listening Tests and Evaluation of Simulated Sound Fields Using VibeStudio Designer Wersényi György Hesham Fouad SZÉCHENYI ISTVÁN UNIVERSITY, Hungary VRSonic,
3-D Sound and Spatial Audio MUS_TECH 348. Psychology of Spatial Hearing There are acoustic events that take place in the environment. These can give rise.
Auditorium Acoustics Chapter 23. Sound Propagation Free field sound pressure proportional to 1/r SPL drops 6 dB with every doubling of distance. Indoors.
Interference and beats. Objectives Investigate and analyze characteristics of waves, including frequency and amplitude. Investigate and analyze behaviors.
3-D Sound and Spatial Audio MUS_TECH 348. Wightman & Kistler (1989) Headphone simulation of free-field listening I. Stimulus synthesis II. Psychophysical.
3-D Sound and Spatial Audio MUS_TECH 348. Environmental Acoustics and Computational Simulation.
ELEC 407 DSP Project Algorithmic Reverberation – A Hybrid Approach Combining Moorer’s reverberator with simulated room IR reflection modeling Will McFarland.
Back to Stereo: Stereo Imaging and Mic Techniques Huber, Ch. 4 Eargle, Ch. 11, 12.
PREDICTION OF ROOM ACOUSTICS PARAMETERS
Auralization Lauri Savioja (Tapio Lokki) Helsinki University of Technology, TKK.
A.Diederich – International University Bremen – USC – MMM – Spring 2005 Rhythm and timing  Clarke, E.F. Rhythm and timing in music. In Deutsch, D. Chapter.
PH 105 Dr. Cecilia Vogel Lecture 4. OUTLINE  Room Acoustics  concert hall properties.
1 Manipulating Digital Audio. 2 Digital Manipulation  Extremely powerful manipulation techniques  Cut and paste  Filtering  Frequency domain manipulation.
STUDIOS AND LISTENING ROOMS
Binaural Sound Localization and Filtering By: Dan Hauer Advisor: Dr. Brian D. Huggins 6 December 2005.
DSP Term Project By: Ashley Downs And Jeff Malen By: Ashley Downs And Jeff Malen.
3-D Sound and Spatial Audio MUS_TECH 348. Multi-Loudspeaker Reproduction: Surround Sound.
3-D Sound and Spatial Audio MUS_TECH 348. What are Some Options for Creating DTFs?
L INKWITZ L AB Accurate sound reproduction from two loudspeakers in a living room 13-Nov-07 (1) Siegfried Linkwitz.
1 Recording Fundamentals INART 258 Fundamentals of MIDI & Digital Audio Mark BalloraMark Ballora, instructor 1.
Binaural Sonification of Disparity Maps Alfonso Alba, Carlos Zubieta, Edgar Arce Facultad de Ciencias Universidad Autónoma de San Luis Potosí.
Spatial Perception of Audio vs. The Home Theatre James D. Johnston Chief Scientist, DTS, Inc.
Improved 3D Sound Delivered to Headphones Using Wavelets By Ozlem KALINLI EE-Systems University of Southern California December 4, 2003.
SOUND IN THE WORLD AROUND US. OVERVIEW OF QUESTIONS What makes it possible to tell where a sound is coming from in space? When we are listening to a number.
LINKWITZ LAB What are the On-axis & Off-axis
Rumsey Chapter 16 Day 3. Overview  Stereo = 2.0 (two discreet channels)  THREE-DIMENSIONAL, even though only two channels  Stereo listening is affected.
3-D Sound and Spatial Audio MUS_TECH 348. Main Types of Errors Front-back reversals Angle error Some Experimental Results Most front-back errors are front-to-back.
speech, played several metres from the listener in a room - seems to have the same phonetic content as when played nearby - that is, perception is constant.
Developing a model to explain and stimulate the perception of sounds in three dimensions David Kraljevich and Chris Dove.
 Space… the sonic frontier. Perception of Direction  Spatial/Binaural Localization  Capability of the two ears to localize a sound source within an.
L INKWITZ L AB S e n s i b l e R e p r o d u c t i o n & R e c o r d i n g o f A u d i t o r y S c e n e s Hearing Spatial Detail in Stereo Recordings.
Jens Blauert, Bochum Binaural Hearing and Human Sound Localization.
MONO SOUND. In everyday life we listen with two ears. As we compare these two separate sound images of the external world, they build a three dimensional.
3-D Sound and Spatial Audio
3-D Sound and Spatial Audio MUS_TECH 348. Stereo Loudspeaker Reproduction.
Time Based Processors. Reverb source:
PSYC Auditory Science Spatial Hearing Chris Plack.
3-D Sound and Spatial Audio MUS_TECH 348. Environmental Acoustics, Perception and Audio Processing: Envelopment.
Fletcher’s band-widening experiment (1940)
SPATIAL HEARING Ability to locate the direction of a sound. Ability to locate the direction of a sound. Localization: In free field Localization: In free.
Interference and beats Pg. 47. Objectives Investigate and analyze characteristics of waves, including frequency and amplitude. Investigate and analyze.
3-D Sound and Spatial Audio MUS_TECH 348. What do these terms mean? Both terms are very general. “3-D sound” usually implies the perception of point sources.
Emotional response to sound Influence of spatial determinants Master’s Thesis in the Master’s programme in Sound and Vibration Fredrik Hagman Presented.
CS 445/656 Computer & New Media
Auditory Localization in Rooms: Acoustic Analysis and Behavior
PSYCHOACOUSTICS A branch of psychophysics
Precedence-based speech segregation in a virtual auditory environment
PREDICTION OF ROOM ACOUSTICS PARAMETERS
What is stereophony? Stereos = solid (having dimensions: length width, height) Phonics = study of sound stereophony (stereo) is an aural illusion – a.
3D sound reproduction with “OPSODIS” and its commercial applications
Interference and beats
Brought to you by Mike and Mike Inc.
FM Hearing-Aid Device Checkpoint 1
Voice Removal from Music
Spatial Perception of Audio vs. The Home Theatre
Volume 62, Issue 1, Pages (April 2009)
PREDICTION OF ROOM ACOUSTICS PARAMETERS
Hearing Spatial Detail
Volume 62, Issue 1, Pages (April 2009)
Audio and Speech Computers & New Media.
3-D Sound and Spatial Audio
Presentation transcript:

3-D Sound and Spatial Audio MUS_TECH 348

Cathedral / Concert Hall / Theater Sound Altar / Stage / Screen Spiritual / Emotional World Subjective Music Ambience Cultural Context of Spaciousness

Environmental Acoustics, Perception, and Audio Applications

Distance Perception We already discussed that Chowning makes use of the fact that in very reverberant environments like concert halls, perceived distance varies in proportion to indirect/direct sound ratio. The absolute sound intensity and the relative sound intensity (changing as 1/distance) are cues in themselves.

Distance Perception Most environments have little or no reverberation in the way we discuss it in concert halls. In these environments, changes in distance can be cued by changes in the timing of low- order reflections. Consider too,

Distance Perception Most important is the time interval of the initial gap between the sound and first- order reflections. For example, as a sound moves farther away, the gap becomes smaller.

Distance Perception We know that distance judgments can be influenced by sound intensity, relative intensity, HRTFs, the indirect-to- direct energy ratio, and the timing of first-order reflections. In addition, distance judgments can be influenced by cognitive factors like knowledge of the sound source or likely distances given the context. It seems that distance judgment is multi-faceted.

Position Perception Early reflections also constitute an element of realism for simulated acoustic spaces independent of distance perception.

The kind of interaural decorrelation of that is experienced in concert hall reverberation is an important aspect of audio applications. Interaural decorrelation can be created in a variety of ways. Decorrelation Revisited

Multichannel Reverb Reverb L R Stereo reverb units produce output channels that are uncorrelated in order for the listener to experience some degree of spaciousness. uncorrelated outputs Pro Audio Decorrelation

Decorrelation by Reverb Reverb L R Pro Audio Decorrelation Stereo reverb is typically used in combination with the source signal. diffuse field

Decorrelation by Detuning Pitch Shift L R Pro Audio Decorrelation A related spatial effect somewhere between spatially diffuse reverberation and dual images can be created by detuning one channnel.

Studio Decorrelation by Recording Record the same performance twice Put one on left and one on right Pro Audio Decorrelation Recording a performance twice creates similar dual image effect.

The degree of perceived ‘spaciousness’ and the effectiveness of many of these effects are predicted by level of interaural decorrelation. The objective measure of correlation (and decorrelation) is the cross-correlation measure, Ω(∆t), and the cross-correlation index (peak of the cross-correlation measure). Decorrelation in Audio where ∆t represents a temporal offset between y 1 (t) and y 2 (t).

Examples of correlation measure: Decorrelation in Audio

Five Effects of Decorrelation on Stereo Imagery 1. the timbral coloration and combing associated with constructive and destructive interference of multiple delayed signals is perceptually eliminated, 2. decorrelated channels of sound produce diffuse sound fields (akin to the late field of reverberant concert halls), 3. decorrelated channels produce externalization in headphone reproduction, 4. the position of the sound field does not undergo image shift with changes in the position of the listener relative to stereo loudspeakers, 5. the precedence effect which causes the collapse of the image into the nearest loudspeaker is defeated enabling one to present the same sound signal from multiple loudspeakers. Decorrelation in Audio

Effect #1 the timbral coloration and combing associated with constructive and destructive interference of multiple delayed signals is perceptually eliminated

Decorrelation in Audio Effect #2 decorrelated channels of sound produce diffuse sound fields (akin to the late field of reverberant concert halls),

Decorrelation in Audio Effect #3 decorrelated channels produce externalization in headphone reproduction

Decorrelation in Audio Effect #4 the position of the sound field does not undergo image shift with changes in the position of the listener relative to stereo loudspeakers

Decorrelation in Audio Effect #4

Decorrelation in Audio Effect #5 the precedence effect which causes the collapse of the image into the nearest loudspeaker is defeated enabling one to present the same sound signal from multiple loudspeakers

Decorrelation in Audio Effect #5

Decorrelation in Audio

Another Distance Effect A constant phase offset (rather than cross-correlation index) creates an impression of changing image distance. Like HRTF reproduction, this distance effect depends on how close the listener is to the sweet spot.