Interactive Sound Rendering Session5: Simulating Diffraction Paul Calamia P. Calamia, M. Lin, D. Manocha, L. Savioja, N. Tsingos.

Slides:



Advertisements
Similar presentations
Exploration of advanced lighting and shading techniques
Advertisements

Data Communication lecture10
Computer graphics & visualization Global Illumination Effects.
Physically Based Sound Modeling Class #13 (Feb 24) Doug James, CMU.
Dynamic Occlusion Analysis in Optical Flow Fields
3D Graphics Rendering and Terrain Modeling
Advanced Computer Graphics
Session: Computational Wave Propagation: Basic Theory Igel H., Fichtner A., Käser M., Virieux J., Seriani G., Capdeville Y., Moczo P.  The finite-difference.
Reflection Based Scatter Updated for Odeon 12 Reflection Based Scatter A scattering method that combines Roughness and Diffraction effects Claus Lynge.
Advanced Computer Graphics (Spring 2005) COMS 4162, Lectures 18, 19: Monte Carlo Integration Ravi Ramamoorthi Acknowledgements.
Interactive Sound Rendering SIGGRAPH 2009 Dinesh Manocha UNC Chapel Hill
Advanced Computer Graphics (Spring 2005) COMS 4162, Lecture 21: Image-Based Rendering Ravi Ramamoorthi
Ray Casting Ray-Surface Intersections Barycentric Coordinates Reflection and Transmission [Shirley, Ch.9] Ray Tracing Handouts Ray Casting Ray-Surface.
Geometric Sound Propagation Anish Chandak & Dinesh Manocha UNC Chapel Hill
Perceptual Audio Rendering Nicolas Tsingos Dolby Laboratories
7M836 Animation & Rendering
EELE 5490, Fall, 2009 Wireless Communications
Project Presentation: March 9, 2006
CSCE 641 Computer Graphics: Radiosity Jinxiang Chai.
Acceleration on many-cores CPUs and GPUs Dinesh Manocha Lauri Savioja.
Modeling Fluid Phenomena -Vinay Bondhugula (25 th & 27 th April 2006)
Real-time wave acoustics for games Nikunj Raghuvanshi Microsoft Research.
Foundations of Computer Graphics (Spring 2010) CS 184, Lecture 21: Radiosity
CSCE 641 Computer Graphics: Radiosity Jinxiang Chai.
High Frequency Techniques in Electromagnetics Ayhan Altıntaş Bilkent University, Dept. of Electrical Engineering, Ankara, Turkey
Precomputed Wave Simulation for Real-Time Sound Propagation of Dynamic Sources in Complex Scenes Nikunj Raghuvanshi †‡, John Snyder †, Ravish Mehra ‡,
ANISH CHANDAK COMP 770 (SPRING’09) An Introduction to Sound Rendering © Copyright 2009 Anish Chandak.
Physics and Sound Zhimin & Dave. Motivation Physical simulation Games Movies Special effects.
CS 445 / 645: Introductory Computer Graphics
Neighborhood Operations
Implementation of 2D FDTD
Technology and Historical Overview. Introduction to 3d Computer Graphics  3D computer graphics is the science, study, and method of projecting a mathematical.
01/28/05© 2005 University of Wisconsin Last Time Improving Monte Carlo Efficiency.
CS447/ Realistic Rendering -- Radiosity Methods-- Introduction to 2D and 3D Computer Graphics.
Digital Sound Ming C. Lin Department of Computer Science University of North Carolina
Audio Systems Survey of Methods for Modelling Sound Propagation in Interactive Virtual Environments Ben Tagger Andriana Machaira.
10th AIAA/CEAS Aeroacoustics Conference, Manchester, UK, May, Refraction Corrections for Surface Integral Methods in Jet Aeroacoustics FongLoon.
Interactive acoustic modeling of virtual environments Nicolas Tsingos Nicolas TsingosREVES-INRIA.
Propagation Models Large scale models predict behavior averaged over distances >>  Function of distance & significant environmental features, roughly.
Quick survey about PRT Valentin JANIAUT KAIST (Korea Advanced Institute of Science and Technology)
Introduction to Radiosity Geometry Group Discussion Session Jiajian (John) Chen 9/10/2007.
The Boundary Element Method (and Barrier Designs)
Global Illumination: Radiosity, Photon Mapping & Path Tracing Rama Hoetzlein, 2009 Lecture Notes Cornell University.
- Laboratoire d'InfoRmatique en Image et Systèmes d'information
Lai-Ching Ma & Raj Mittra Electromagnetic Communication Laboratory
1 Temporal Radiance Caching P. Gautron K. Bouatouch S. Pattanaik.
Real-Time Depth Buffer Based Ambient Occlusion
Pure Path Tracing: the Good and the Bad Path tracing concentrates on important paths only –Those that hit the eye –Those from bright emitters/reflectors.
CSCE 441: Computer Graphics Ray Tracing
Local Illumination and Shading
Remcom Inc. 315 S. Allen St., Suite 416  State College, PA  USA Tel:  Fax:   ©
Non-Linear Kernel-Based Precomputed Light Transport Paul Green MIT Jan Kautz MIT Wojciech Matusik MIT Frédo Durand MIT Henrik Wann Jensen UCSD.
Image Features (I) Dr. Chang Shu COMP 4900C Winter 2008.
Graphics Lecture 14: Slide 1 Interactive Computer Graphics Lecture 14: Radiosity - Computational Issues.
CS552: Computer Graphics Lecture 33: Illumination and Shading.
Toward Real-Time Global Illumination. Global Illumination == Offline? Ray Tracing and Radiosity are inherently slow. Speedup possible by: –Brute-force:
Toward Real-Time Global Illumination. Project Ideas Distributed ray tracing Extension of the radiosity assignment Translucency (subsurface scattering)
Simulation of the acoustics of coupled rooms by numerical resolution of a diffusion equation V. Valeau a, J. Picaut b, A. Sakout a, A. Billon a a LEPTAB,
Drasko Masovic Doctoral Forum
Radio Coverage Prediction in Picocell Indoor Networks
3D Graphics Rendering PPT By Ricardo Veguilla.
Hybrid Ray Tracing of Massive Models
Using Flow Textures to Visualize Unsteady Vector Fields
Vehicle Segmentation and Tracking in the Presence of Occlusions
CSc4820/6820 Computer Graphics Algorithms Ying Zhu Georgia State University Radiosity.
Visibility Computations
CSCE 441 Computer Graphics: Radiosity
CSc4820/6820 Computer Graphics Algorithms Ying Zhu Georgia State University Lecture 25 Radiosity.
Real-time Global Illumination with precomputed probe
Presentation transcript:

Interactive Sound Rendering Session5: Simulating Diffraction Paul Calamia P. Calamia, M. Lin, D. Manocha, L. Savioja, N. Tsingos

Overview  Motivation: Why Diffraction?  Simulation Methods  Frequency Domain: Uniform Theory of Diffraction (UTD)  Time Domain: Biot-Tolstoy-Medwin Formulation (BTM)  Acceleration Techniques  UTD: Frequency Interpolation  BTM: Edge Subdivision  Both: Path Culling  Implementation Example: UTD with Frustum Tracing  Additional Resources

Motivation  Wavelengths of audible sounds can be comparable to (or larger than) object dimensions so diffraction is an important acoustic propagation phenomenon  Unlike wave-based simulation techniques, geometrical-acoustics (GA) techniques omit diffraction  Incorrect reflection behavior from small surfaces  No propagation around occluders / into shadow zones  Sound-field discontinuities at reflection and shadow boundaries

Continuity of Sound Fields with Diffraction  Example: reflection from a faceted arch with and without diffraction  Even with low- resolution geometry, GA + diffraction yields a continuous sound field Images courtesy of Peter Svensson, NTNU

Propagation into Shadow Zones  Example: propagation at a street crossing  Diffraction from the corner allows propagation into areas without line of sight to the source Images courtesy of Peter Svensson, NTNU

Propagation into Shadow Zones  Example: propagation at a street crossing  Diffraction from the corner allows propagation into areas without line of sight to the source  Note the continuous wavefronts too Images courtesy of Peter Svensson, NTNU

Common Diffraction Methods  Uniform Theory of Diffraction (UTD)  Keller ’62, Kouyoumjian and Pathak ‘74  Typically used in the frequency domain although a time-domain formulation exists  Assumptions  Ideal wedge surfaces (perfectly rigid or soft)  High frequency  Infinitely long edges  Far-field source and receiver  For acoustic simulations see Tsingos et al. ’01, Antonacci et al. ’04, Taylor et al. ‘09

Uniform Theory of Diffraction  UTD gives the diffracted pressure as a function of incident pressure, distance attenuation, and a diffraction coefficient  Angle of diffraction = angle of incidence (θ d = θ i )  Ray-like paths on a cone of diffraction Images from Tsingos et al., ‘01

Uniform Theory of Diffraction (UTD)

Common Diffraction Methods  Biot-Tolstoy-Medwin (BTM)  Biot and Tolstoy ’52, Medwin ’81, Svensson et al. ‘99  Typically used in the time domain although a frequency-domain formulation exists  Assumptions  Ideal wedge surfaces (perfectly rigid or soft)  Point-source insonification  For acoustic simulations see Torres et al. ’01, Lokki et al. ’02, Calamia et al. ’07 and ‘08

Biot-Tolstoy-Medwin Diffration (BTM)  Wedge   W = exterior wedge angle  ν = π/θ W is the wedge index  Source and Receiver: Edge-Aligned Cylindrical Coordinates ( r, , z )  r = radial distance from the edge   = angle measured from a face  z = distance along the edge  Other  m = dist. from source to edge point  l = dist. from receiver to edge point  A = apex point, point of shortest path from S to R through the line containing the edge

Biot-Tolstoy-Medwin Diffration (BTM)

 Four terms in UTD and BTM  When θ W > π, two shadow boundaries and two reflection boundaries  When θ W ≤ π, only reflection boundaries but inter-reflections (order 2, 3, …) are possible  Each diffraction term is associated with a “zone boundary”  Geometrical-acoustics sound field is discontinuous  Diffracted field has a complimentary discontinuity to compensate Numerical Challenge: Zone-Boundary Singularity UTD: BTM: At the boundaries:

Numerical Challenge: Zone-Boundary Singularity Reflection Boundary Shadow Boundary Source Position

Numerical Challenge: Zone-Boundary Singularity Reflection Boundary Shadow Boundary Source Position Normalized Amplitude

Numerical Challenge: Zone-Boundary Singularity  Approximations exist to allow for numerically robust implementations  BTM (Svensson and Calamia, Acustica ’06): Serial expansion around the apex point  UTD (Kouyoumjian and Pathak ’74): Approximation valid in the “neighborhood” of the zone boundaries

Acceleration Techniques  Reduce computation for each diffraction component  UTD: Frequency Interpolation  BTM: Edge Subdivision  Reduce the number of diffraction components through path culling  Shadow Zone  Zone-Boundary Proximity

Frequency Interpolation  Magnitude of diffraction transfer function typically is smooth  Phase typically is ~linear  Compute UTD coefficients at a limited number of frequencies (e.g. octave-band center frequencies 63, 125, 250, …, 8k, 16k Hz) and interpolate Frequency (Hz) Magnitude (dB re. 1)

Edge Subdivision for Discrete-Time IRs  Sample-aligned edge segments: one for each IR sample  Pros  Accurate  Good with approx for sample n 0  Cons  Slow to compute  Must be recalculated when S or R moves n2n2 n1n1 n1n1 n0n0 n2n2 S R

Edge Subdivision for Discrete-Time IRs  Even edge segments  Pros  Trivial to compute  Independent of S and R positions  Cons  No explicit boundaries for n 0 → harder to handle singularity  Requires a scheme for multi-sample distribution S R S R

Edge Subdivision for Discrete-Time IRs  Hybrid Subdivision  Use a small number of sample-aligned segments around the apex point  High accuracy for the impulsive (high energy) onset  Easy to use with approximations for h(n 0 )  Use even segments for the rest of the edge  Can be precomputed  Limited recalculation for moving source or receiver n2n2 n1n1 n1n1 n0n0 n2n2

Hybrid Edge Subdivision Example  m x 1.2 m rigid panels  Interpanel spacing 0.5 m  5 m above 2 source and 2 receiver positions  Evaluate  The number of sample-aligned segments: 1 – 10  The size of the even segments: maximum sample span of 40, 100, and 300  The numerical integration technique  1-Point (midpoint)  3-Point (Simpson’s Rule)  5-Point (Compound Simpson’s Rule with Romberg Extrapolation)

Hybrid Edge Subdivision S/RZone Segment Norm.Max. PairSizeInteg.SizeInteg.Proc.Error (samples) Time(dB) 141-point1001-point all5-pointN/A

Path Culling Significant Growth in Paths Due to Diffraction

Path Culling  Option 1: For each wedge, compute diffraction only for paths in the shadow zone  Intuition: Sound field in the “illuminated” area around a wedge will be dominated by direct propagation and/or reflections, shadow zone will receive limited energy without diffraction  Pro: Allows propagation around obstacles  Con: Ignores GA discontinuity at reflection boundary  Implementations described in Tsingos et al. ’01, Antonacci et al. ’04, Taylor et al. ’09

Path Culling  Option 2: Compute diffraction only when amplitude is “significant”  Intuition: numerically/perceptually significant diffracted paths are those with highest amplitude and/or energy, typically those with the receiver close to a zone boundary  Pro: Eliminates large discontinuities in the simulated sound field  Con: Does not allow for propagation deep into shadow zones  Implementation described in Calamia et al. ‘08

Path Culling Reflection Boundary Shadow Boundary Source Position  Significant variation in diffraction strength (~220 dB in this example)  Predict relative size based on proximity to a zone boundary and apex-point status

Path Culling Results  Numerical and subjective evaluation in a simple concert-hall model ABX tests comparing full IRs with culled IRs, 17 subjects An angular threshold of 24° culls ~92% of the diffracted components

Simulation Example: Frustum Tracing  Goals  Find propagation paths around edges  Render at interactive rates  Allow dynamic sources, receivers, and geometry  Method  Frustum tracing with dynamic BVH acceleration  Diffraction only in the shadow region  Diffraction paths computed with UTD

Step 1: Identify Edge Types (Preprocess)  Mark possible diffracting edges  Exterior edges  Disconnected edges

Step 2: Propagate Frusta  Propagate frusta from source through scene

Step 2: Propagate Frusta  Propagate frusta from source through scene  When diffracting edges are encountered, make diffraction frustum

Step 3: Auralization  If receiver is inside frustum  Calculate path back to source  Attenuate path with UTD coefficient and add to IR  Convolve audio with IR  Output final audio sample

System Demo

Future Work  Direct comparison of UTD and BTM  Numerical accuracy  Computation time  Subjective Tests  Limited subjective tests of auralization with diffraction  Static scenes  Torres et al. JASA ‘01  Calamia et al. Acustica ‘08  Dynamic scenes  None

Additional Resources  F. Antonacci, M. Foco, A. Sarti, and S. Tubaro, “Fast modeling of acoustic reflections and diffraction in complex environments using visibility diagrams. In Proc. 12th European Signal Processing Conference (EUSIPCO ‘04), pp ,  P. Calamia, B. Markham, and U. P. Svensson, “Diffraction culling for virtual-acoustic simulations,” Acta Acustica united with Acustica, Special Issue on Virtual Acoustics, 94(6), pp ,  P. Calamia and U. P. Svensson, “Fast time-domain edge-diffraction calculations for interactive acoustic simulations,” EURASIP Journal on Advances in Signal Processing, Special Issue on Spatial Sound and Virtual Acoustics, Article ID 63560,  A. Chandak, C. Lauterbach, M. Taylor, Z. Ren, and D. Manocha, “ADFrustum: Adaptive frustum tracing for interactive sound propagation,” IEEE Trans. on Visualization and Computer Graphics, 14, pp ,  R. Kouyoumjian and P. Pathak, “A uniform geometrical theory of diffraction for an edge in a perfectly conducting surface. In Proc. IEEE, vol. 62, pp , 1974.

Additional Resources  T. Lokki, U. P. Svensson, and L. Savioja, “An efficient auralization of edge diffraction,” In Proc. Aud. Engr. Soc. 21st Intl. Conf. on Architectural Acoustics and Sound Reinforcement, pp ,  D. Schröder and A. Pohl, “Real-time hybrid simulation method including edge diffraction,” In Proc. EAA Symposium on Auralization, Otaniemi,  U. P. Svensson, R. I. Fred, and J. Vanderkooy, “An analytic secondary-source model of edge diffraction impulse responses,” J. Acoust. Soc. Am., 106(5), pp ,  U. P. Svensson and P. Calamia, “Edge-diffraction impulse responses near specular-zone and shadow-zone boundaries,” Acta Acustica united with Acustica, 92(4), pp ,  M. Taylor, A. Chandak, Z. Ren, C. Lauterbach, and D. Manocha, “Fast edge-diffraction for sound propagation in complex virtual environments,” In Proc. EAA Symposium on Auralization, Otaniemi, 2009.

Additional Resources  R. Torres, U. P. Svensson, and M. Kleiner, “Computation of edge diffraction for more accurate room acoustics auralization,” J. Acoust. Soc. Am., 109(2), pp ,  N. Tsingos, T. Funkhouser, A. Ngan, and I. Carlbom, “Modeling acoustics in virtual environments using the Uniform Theory of Diffraction,” In Proc. ACM Computer Graphics (SIGGRAPH ’01), pp ,  N. Tsingos, I. Carlbom, G. Elko, T. Funkhouser, and R. Kubli, “Validation of acoustical simulations in the Bell Labs box,” IEEE Computer Graphics and Applications, 22(4), pp ,  N. Tsingos and J.-D. Gascuel, “Soundtracks for computer animation: Sound rendering in dynamic environments with occlusions,” In Proc. Graphics Interface97, Kelowna, BC,  N. Tsingos and J.-D. Gascuel, “Fast rendering of sound occlusion and diffraction effects for virtual acoustic environments,” In Proc. 104th Aud. Engr. Soc. Conv., Preprint no