Beat Tracking (節拍追蹤) 張智星 (Roger Jang) jang@mirlab.org http://mirlab.org/jang 多媒體資訊檢索實驗室 清華大學 資訊工程系
Beat Tracking (節拍追蹤) 目標: 技術困難點: Tempo estimation: 計算音訊音樂的節奏 如何計算onset的位置 如何辨識鼓聲的重複出現性 如何達到即時辨識的效果 如何移植到微控制器(玩具或機器人應用)
Flowchart Audio signal Onset strength estimation Tempo curve generation Beat tracking Beat positions
Available Datasets MIREX 2006 MCK Dataset : 160 pieces with marked up beat locations as constant tempo. Original Mixed MIREX 2009 MAZ Dataset : a subset of 367 pieces with marked up beat locations as time-varying tempo. Original Mixed
Performance Index Performance Evaluation function: F-measure - the standard calculation as used in onset evaluation but with a 70ms window. Cemgil - beat accuracy is calculated using a Gaussian error function with 40ms standard deviation. Goto - binary decision of correct or incorrect tracking based on statistical properties of a beat error sequence. PScore - McKinney's impulse train cross-correlation method as used in 2006. CMLc, CMLt, AMLc, AMLt - continuity-based evaluation methods based on the longest continuously correctly tracked section. D, Dg - information based criteria based on analysis of a beat error histogram.
MIREX 2010 Result: MCK Dataset Algorithm ID BES3~4 GP3~6 LGG1~2 MRVCC1~2 NW1 TL2 ZTC1 Contributors Sebastian Böck, Florian Eyben, Bjoern Schuller. Geoffroy Peeters. João Lobato Oliveira, Fabien Gouyon, Luis Gustavo Martins. Raul Mata Campos, Francisco Jose Rodriguez Serrano, Pedro Vera-Candeas, Julio José Carabias-Orti, Francisco Jesus Canadas Quesada. Nicolas Wack, Eduard Aylon. Tsung-Chi Lee. Yongwei Zhu, Hui Li Tan, Lekha Chaisorn.
MIREX 2010 Result: MAZ Dataset Algorithm ID BES3~4 GP3~6 LGG1~2 MRVCC1~2 NW1 TL2 ZTC1 Contributors Sebastian Böck, Florian Eyben, Bjoern Schuller. Geoffroy Peeters. João Lobato Oliveira, Fabien Gouyon, Luis Gustavo Martins. Raul Mata Campos, Francisco Jose Rodriguez Serrano, Pedro Vera-Candeas, Julio José Carabias-Orti, Francisco Jesus Canadas Quesada. Nicolas Wack, Eduard Aylon. Tsung-Chi Lee. Yongwei Zhu, Hui Li Tan, Lekha Chaisorn.
Applications and Demos Potential applications Toys Robots Interactive music Music analysis and classification Demos Beat tracking of constant-tempo music
節拍追蹤:應用面 可能應用面 玩具 機器人 互動音樂 音樂分析與分類