1/20 System Overview Cyclic mo-cap data (walking, running..) Cyclic mo-cap data (walking, running..) Music / Sound (audio) Music / Sound (audio) Resulting Animation Resulting Animation Motion Editing 1. Stretching 2. Spikes Motion Editing 1. Stretching 2. Spikes Extracting Percussive Events Modification of the existing motion Addition of the new gestures

2/20 Demo: Stretching Mo-cap walking Bass drum tracks Mo-cap walking Bass drum tracks

3/20 Motion Editing: Stretching Overview Musical events (Audio segments) Cyclic mo-cap data (walking, running..) Divided mo-cap data (motion segments) StretchingJoining Resulting Animation Resulting Animation

4/20 Motion Editing: Stretching 1. Defining motion segments Cyclic mo-cap data (walking, running..) Cyclic mo-cap data (walking, running..) Smoothing (Low-pass Filtering) Smoothing (Low-pass Filtering) Smoothing (Low-pass Filtering) Smoothing (Low-pass Filtering) Smoothing (Low-pass Filtering) A selected motion channel A smoothed motion channel Motion frames that define motion segments Calculating First derivatives Divided mo-cap data (walking, running..) Divided mo-cap data (walking, running..) Dividing all motion channels to segments

5/20 Motion Editing: Stretching 2. Stretching motion segments Stretching motion segments Divided mo-cap data (walking, running..) Divided mo-cap data (walking, running..) Musical events (Audio segments) Musical events (Audio segments) Resulting Animation Resulting Animation Joining Automatically detected

6/20 Demo: Stretching 3 different mo-cap animations Bass drum tracks 3 different mo-cap animations Bass drum tracks

7/20 Demo: Spikes Mo-cap standing Drum track Mo-cap standing Drum track

8/20 Motion Editing: Spikes Overview Musical events (Audio segments) Adding Spikes Smoothing (Low-pass Filtering) Mo-cap data Resulting Animation Automatically detected

9/20 Motion Editing: Spikes 1. Decomposing original data and adding spikes Musical events (Audio segments) Musical events (Audio segments) Spiked mo-cap data Adding spikes to a selected channel Mo-cap data Decomposition into frequency bands

10/20 Motion Editing: Spikes 2. Smoothing and reconstructing spikes Spiked mo-cap data Filtering Resulting Animation Resulting Animation Reconstruction

11/20 Motion Editing: Spikes 3. Comparison between the results Decomposition + Spikes + Filtering + Reconstruction Decomposition + Spikes + Filtering + Reconstruction Original + Spikes + Filtering Original + Spikes + Filtering Original

12/20 Demo: Spikes Mo-cap standing Drum track Mo-cap standing Drum track

13/20 Audio Analysis Music Intervention by the user Spectrum Analysis (8 bands)

14/20 8 frequency bands FilteringThreshold Percussive Events Percussive Events Percussive Events Percussive Events Intervention by the user Percussive Events Percussive Events Downsampling Musical events (Percussive events) Musical events (Percussive events)