Granular Synthesis in Next- Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul Vancouver Film School Game Audio Instructor.

Slides:



Advertisements
Similar presentations
University of California, Santa Barbara An Integrated System of 3D Motion Tracker and Spatialized Sound Synthesizer John Thompson (Music) Mary Li (ECE)
Advertisements

4/1/2017 4:16 PM.
Sound Synthesis Part II: Oscillators, Additive Synthesis & Modulation.
David Meredith Minim David Meredith
Voiceprint System Development Design, implement, test unique voiceprint biometric system Research Day Presentation, May 3 rd 2013 Rahul Raj (Team Lead),
Easily extensible unix software for spectral analysis, display modification, and synthesis of musical sounds James W. Beauchamp School of Music Dept.
Computational Rhythm and Beat Analysis Nick Berkner.
Effects. Dynamic Range Processors Fixed Time Delay Effects Variable Time Delay Effects Reverberation Effects Time and Pitch Changing Effects Distortion.
Web:: VideoGameAudio.com : info{at}videoGameAudio.com Advanced Granular Synthesis for Next-Generation Games Game Developer's Conference 2007 San.
I Power Higher Computing Multimedia technology Audio.
What makes a musical sound? Pitch n Hz * 2 = n + an octave n Hz * ( …) = n + a semitone The 12-note equal-tempered chromatic scale is customary,
Time-scale and pitch modification Algorithms review Alexey Lukin.
Pitch Shifting and Dynamic Filtering Rossum (1992a) Digital sampling instrument for digital audio data; Rossum (1992b) Dynamic digital IIR audio filter.
Granular Synthesis in Next- Generation Games Game Developer's Conference 2006 San Jose Leonard J. Paul Vancouver Film School Game Audio Instructor lpaul.
Chapter 7 Principles of Analog Synthesis and Voltage Control Contents Understanding Musical Sound Electronic Sound Generation Voltage Control Fundamentals.
SYED SYAHRIL TRADITIONAL MUSICAL INSTRUMENT SIMULATOR FOR GUITAR1.
Speech in Multimedia Hao Jiang Computer Science Department Boston College Oct. 9, 2007.
Sample vs. Tick Absolute timeline Unchanging, regardless of tempo – Samples – Min:Secs – Time Code – Feet + Frames Relative timeline Change dynamically.
Particle Synthesis A unified model for granular synthesis Øyvind Brandtsegg Sigurd Saue Thom Johansen.
EE2F1 Speech & Audio Technology Sept. 26, 2002 SLIDE 1 THE UNIVERSITY OF BIRMINGHAM ELECTRONIC, ELECTRICAL & COMPUTER ENGINEERING Digital Systems & Vision.
Chapter 6.9 Audio Design and Production. 2 Overview Game audio has evolved Started out as simple bleeps & bloops Improvements in technology have placed.
Effects in frequency domain Stefania Serafin Music Informatics Fall 2004.
1 Manipulating Digital Audio. 2 Digital Manipulation  Extremely powerful manipulation techniques  Cut and paste  Filtering  Frequency domain manipulation.
Game Audio Mark Peskir November 14, 2005 ITCS 5010.
Using Sound in Games Alex Baumann Outline 3D Spatialization Getting and Editing Sounds Using Sounds in Games Music in Games Example Videos.
Human Psychoacoustics shows ‘tuning’ for frequencies of speech If a tree falls in the forest and no one is there to hear it, will it make a sound?
A Full Frequency Masking Vocoder for Legal Eavesdropping Conversation Recording R. F. B. Sotero Filho, H. M. de Oliveira (qPGOM), R. Campello de Souza.
2 Outline Digital music The power of FPGA The “DigitalSynth” project –Hardware –Software Conclusion Demo.
Sub-band Mixing and Addition of Digital Effects for Consumer Audio ELECTRICAL & ELECTRONIC ENGINEERING FINAL YEAR PROJECTS 2012/2013 Presented by Fionn.
 Granular Synthesis: an overview. Overview  Sounds are made up of a large number of particles!  Examples of granular sounds Leaves Traffic Babbling.
LE 460 L Acoustics and Experimental Phonetics L-13
The Music of Sound: Strategies and Tools for Creating Music with Digital Audio Dr. Daniel Hosken Assistant Professor of Music Technology California State.
Radio production worktext.  Analog to Digital  Analog signal – continuously variable electrical signal whose shape is determined by the shape of the.
GODIAN MABINDAH RUTHERFORD UNUSI RICHARD MWANGI.  Differential coding operates by making numbers small. This is a major goal in compression technology:
Copyright 2004 Ken Greenebaum Introduction to Interactive Sound Synthesis Lecture 17:Wavetable Synthesis Ken Greenebaum.
EE Audio Signals and Systems Effects Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Video Game Audio Prototyping with Half-Life 2 :: Granulation Leonard J. Paul VideoGameAudio.com.
Preprocessing Ch2, v.5a1 Chapter 2 : Preprocessing of audio signals in time and frequency domain  Time framing  Frequency model  Fourier transform 
Granular Synthesis. Pre-Class Music Jon Nelson Scatter.
Reason Devices Subtractor. Oscillators Select Waveform The Subtractor has two oscillators that can be used as sound sources for your patches Tuning Mix:
Motion in Sound: Designing Sound for Interactive Dance Performance Dr. Dan Hosken Associate Professor of Music California State University, Northridge.
Copyright © 2011 by Denny Lin1 Computer Music Synthesis Chapter 6 Based on “Excerpt from Designing Sound” by Andy Farnell Slides by Denny Lin.
WP4 – Sound Object Identification WP5 – Enriched Access Tools.
Subtractive Sound Synthesis. Subtractive Synthesis Involves subtracting frequency components from a complex tone to produce a desired sound Why is it.
Image Processing Architecture, © 2001, 2002, 2003 Oleh TretiakPage 1 ECE-C490 Image Processing Architecture MP-3 Compression Course Review Oleh Tretiak.
Chapter 12 The Principles of Computer Music Contents Digital Audio Processing Noise Reduction Audio Compression Digital Rights Management (DRM)
ECE 5525 Osama Saraireh Fall 2005 Dr. Veton Kepuska
Quiz 1 Review. Analog Synthesis Overview Sound is created by controlling electrical current within synthesizer, and amplifying result. Basic components:
University of California, Santa Barbara An Integrated System of 3D Motion Tracker and Spatialized Sound Synthesizer John Thompson (Music) Mary Li (ECE)
MMDB-8 J. Teuhola Audio databases About digital audio: Advent of digital audio CD in Order of magnitude improvement in overall sound quality.
Thanks / Acknowledgements  Professor Heinrich Taube (UIUC)   Professor Hernando Lopez-Lezcano (Stanford) 
School of Engineering and Applied Sciences EE113D: DSP Design Fall 2006.
Copyright © 2011 by Denny Lin1 Simple Synthesizer Part 3 Based on Floss Manuals (Pure Data) “Building a Simple Synthesizer” By Derek Holzer Slides by Denny.
Time Based Processors. Reverb source:
Time Compression/Expansion Independent of Pitch. Listening Dies Irae from Requiem, by Michel Chion (1973)
Java Sound and DSP Instructor Rob Nash Readings: Cat Chapter 3 on loops What is DSP? What does sound have.
Harvestworks Part 1: ChucK basics Rebecca Fiebrink Princeton University 1.
Measurement and Instrumentation
Interactive Sound Design Leonard J. Paul Lotus Audio -^-._.-^-._.- VideoGameAudio.com.
1 Particle Synthesis A unified model for granular synthesis Øyvind Brandtsegg Sigurd Saue Thom Johansen.
VideoGameAudio.com info {at} VideoGameAudio.com SIAT – Simon Fraser University Surrey, BC 1 Video Game Audio Leonard J. Paul VideoGameAudio.c om.
1 Tempo Induction and Beat Tracking for Audio Signals MUMT 611, February 2005 Assignment 3 Paul Kolesnik.
Spectrum Analysis and Processing
CS 591 S1 – Computational Audio
Vocoders.
A unified model for granular synthesis
1 Vocoders. 2 The Channel Vocoder (analyzer) : The channel vocoder employs a bank of bandpass filters,  Each having a bandwidth between 100 HZ and 300.
Voice Removal from Music
Developing a Versatile Audio Synthesizer TJHSST Computer Systems Lab
Sound Periodic Functions. Developing a Music Sequencer/Synthesizer Victor Shepardson Computer Systems Lab
Presentation transcript:

Granular Synthesis in Next- Generation Games Game Developer's Conference March 2006 San Jose Leonard J. Paul Vancouver Film School Game Audio Instructor lpaul {at} vfs.com x4035

Grain Production 0 ms250 ms500 ms 200 ms205 ms210 ms Envelope 200 ms205 ms210 ms x = Original Waveform 10ms Segment Envelope function Grain output  Source  Granular  Grain

Granular Synthesis Flowchart ENV OSC Amp 1/dur Grain envelope Grain Waveform Grain Voice 1 Freq Grain Voice n... Multi-channel Output

Granular Density Spectrogram 

Granular Parameters 1) Selection order (forwards/reverse or freeze) 2) Pitch shift (playback rate) 3) Amplitude range 4) Spatialization / panning (static/dynamic) 5) Grain duration 6) Grain density (number of grains/second or number of grain voices) 7) Envelope (ASR shape, attack/release slope or windowing function) 8) DSP effect (reverb, filtering etc.) 9) Feedback amount (for granular delay lines)     Source     

Grain Segmentation 0 sec 2.5 secs Nuts ! It's com - pany pro - pa - gan - da Split into natural length sizes similar to syllables to improve granulation  Source  No Segmentation  With Segmentation

Dialogue  Independent control over pitch and tempo  Segmentation  Phase vocoder  Examples   Source Pitch and tempo variations 

Sound Effects  Delay-line granulation effect  Synthesis techniques  Scraping, skidding and sliding  Ambiances  Examples   Source   

Crowd Engines  Granular cross-fading / morphing  Crowd intensities  Chaining between chunks  Reduction of identifiable loop elements  Examples 

Car Engines  Segmentation  Layering  RPM bands  Pitch-shifting  Examples   Source

Music  Techniques and aesthetics  Real-time vs. pre-rendered  Grain quantization  Software tools  Examples   The CorporationGranular Impulse

Granular Effects  Techniques  Delay-line granulation  Granular reverb  Examples 

Granular Surround  History of use of diffusion in performance  Grain speaker assignment  Trajectories  Examples

Granular Particle Effects Control Parameters Particle Physics Parameters: vel, pos, etc.. Granular Synthesis

Granular Software

CloudGenerator for Mac Curtis Roads & John Alexander 1996

Granular Footsteps in Java Chirag Mehta

Natural Wavelet Grain Segmentation in Java Reynald Hoskinson

Synthesis Toolkit Perry R. Cook & Gary P. Scavone

AudioMulch Ross Bencina

Max/MSP Granular Synthesis

Pure Data Granular Synthesis

Implementation  Prototyping  Integration into game audio tools and libraries  Pure Data demos and prototyping techniques  Source code examples

Granular Software AudioMulch Fruity Loops Ableton Live KTGranulator VST Plugin Propellerhead's Reason CloudGenerator Granular Footfall Synthesis Natural Wavelet Segmentation Synthesis Toolkit (STK) Max/MSP Pure Data ftp://ftp.create.ucsb.edu/pub/CloudGenerator

Granular Source Code Nick Fell's Grantab for Pure Data Ross Bencina's Implementation of Granular Synthesis Frank Barknecht's Pure Data Port of SyncGrain SyncGrain SndObj Library by Victor Lazzarini Amber

Questions? lpaul {at} vfs.com