1. Audio Train/Test: Mood Classification - MIREX08 Dataset SubIDParticipantsAccuracy JJ1Ming-Ju Wu, Jyh-Shing Roger Jang0.68 PP1Renato Panda, Rui Pedro Paiva0.68 CJ1Pei-Hsuan Chou, Jyh-Shing Roger Jang0.68 JJ2Ming-Ju Wu, Jyh-Shing Roger Jang0.68 PRP3 Renato Panda, Bruno Rocha, Rui Pedro Paiva 0.68 PP2Renato Panda, Rui Pedro Paiva0.67 PRP4 Renato Panda, Bruno Rocha, Rui Pedro Paiva 0.67 BBLJK4 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.66 BBLJK2 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.66 SSKS1 Klaus Seyerlehner, Markus Schedl, Peter Knees, Reinhard Sonnleitner 0.66 PRP1 Renato Panda, Bruno Rocha, Rui Pedro Paiva 0.65 CJ2Pei-Hsuan Chou, Jyh-Shing Roger Jang0.65 BBLJK1 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.65 KDKA2 Patrick Kramer, Christian Dittmar, Johannes Krasser, Jakob Abesser 0.64 KDKA1 Patrick Kramer, Christian Dittmar, Johannes Krasser, Jakob Abesser 0.62 BBLJK3 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.60 BBLJK5 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.58 DS1Dan Stowell0.49 DM3Franz de Leon, Kirk Martinez0.49 DM4Franz de Leon, Kirk Martinez0.49 RPP1 Bruno Rocha, Renato Panda, Rui Pedro Paiva 0.48 PRP2 Renato Panda, Bruno Rocha, Rui Pedro Paiva 0.47 RPP2 Bruno Rocha, Renato Panda, Rui Pedro Paiva 0.29 Audio Train/Test: Composer Classification - MIREX08 Dataset SubIDParticipantsAccuracy JJ2Ming-Ju Wu, Jyh-Shing Roger Jang0.65 SSKS1 Klaus Seyerlehner, Markus Schedl, Peter Knees, Reinhard Sonnleitner 0.67 JJ1Ming-Ju Wu, Jyh-Shing Roger Jang0.65 BBLJK4 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.51 BBLJK3 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.40 DM3Franz de Leon, Kirk Martinez0.68 BBLJK2 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.65 DM4Franz de Leon, Kirk Martinez0.70 BBLJK1 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.70 DS1Dan Stowell0.44 CJ1Pei-Hsuan Chou, Jyh-Shing Roger Jang0.65 AP1Aggelos Pikrakis0.50 CJ2Pei-Hsuan Chou, Jyh-Shing Roger Jang0.67 BBLJK5 Karam Byun, Seung Ryoel Baek, Jong-S eol Lee, Sei-jin Jang, Moo Young Kim 0.41 Audio Train/Test: Latin Classification - MIREX08 Dataset SubIDParticipantsAccuracy AP1Aggelos Pikrakis0.78 SSKS1 Klaus Seyerlehner, Markus Schedl, Peter Knees, Reinhard Sonnleitner 0.76 JJ2Ming-Ju Wu, Jyh-Shing Roger Jang0.72 JJ1Ming-Ju Wu, Jyh-Shing Roger Jang0.72 CJ2Pei-Hsuan Chou, Jyh-Shing Roger Jang0.72 BBLJK2 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.68 CJ1Pei-Hsuan Chou, Jyh-Shing Roger Jang0.68 BBLJK1 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.66 BBLJK4 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.62 BBLJK5 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.60 BBLJK3 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.58 DS1Dan Stowell0.57 Audio Train/Test: Genre Classification(Mixed)-MIREX08 Dataset SubIDParticipantsAccuracy JJ1Ming-Ju Wu, Jyh-Shing Roger Jang0.76 JJ2Ming-Ju Wu, Jyh-Shing Roger Jang0.76 SSKS1 Klaus Seyerlehner, Markus Schedl, Peter Knees, Reinhard Sonnleitner 0.75 BBLJK1 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.74 BBLJK2 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.73 BBLJK4 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.70 BBLJK5 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.66 BBLJK3 Karam Byun, Seung Ryoel Baek, Jong-Seol Lee, Sei-jin Jang, Moo Young Kim 0.63 DS1Dan Stowell0.58 CJ2Pei-Hsuan Chou, Jyh-Shing Roger Jang0.31 CJ1Pei-Hsuan Chou, Jyh-Shing Roger Jang0.31 MIREX 2013 Evaluation Results J. Stephen Downie & IMIRSEL University of Illinois at Urbana-Champaign email: jdownie@illinois.edu Audio Tempo Estimation SubIDParticipantsP-Score CDF3 Chris Cannam, Matthew Davies, Luis Figueira 0.74 GKC4 Aggelos Gkiokas, Vassilis Katsouros, George Carayannis 0.82 SB7Sebastian Böck0.80 FW3Fu-Hai Frank Wu0.83 ES4 Florian Eyben, Felix Weninger, Giacomo Ferroni, Björn Schuller 0.58 OL1Olivier Lartillot0.82 ES2Florian Eyben, Björn Schuller0.36 EWFS2 Florian Eyben, Felix Weninger, Giacomo Ferroni, Björn Schuller 0.48 EF1Anders Elowsson, Anders Friberg0.86 CB2Chris Baume0.61 HS1Hendrik Schreiber0.76 Real-time Audio to Score Alignment SubIDParticipantsTotal Precision CVRCR1 Julio Jose Carabias-Orti, Francisco Jose Rodriguez-Serrano, Pedro Vera-Candeas, Pablo Cabañas-Molero, Nicolas Ruiz-Reye s 0.87 CJ5ChunTa Chen, Jyh-Shing Roger Jang0.67 Audio Music Similarity SubIDParticipants Avg. Fine Score SS2Klaus Seyerlehner, Markus Schedl55.21 SSPK Klaus Seyerlehner, Markus Schedl, Tim Pohle, Peter Knees 54.10 PS1Tim Pohle, Dominik Schnitzer53.81 DM2Franz de Leon, Kirk Martinez48.07 GKC2 Aggelos Gkiokas, Vassilis Katsouros, George Carayannis 48.05 DM1Franz de Leon, Kirk Martinez46.26 GKC1 Aggelos Gkiokas, Vassilis Katsouros, George Carayannis 43.80 RA1Roman Aliyev18.86 Audio Key detection SubIDParticipants Weighted Key Score CF3Chris Cannam, Luis Figueira0.87 GP4Geoffroy Peeters0.82 PP5Johan Pauwels, Geoffroy Peeters0.81 Symbolic Music Similarity SubIDParticipants Avg. Fine Score (0-1) JU1Julián Urbano0.61 JU2Julián Urbano0.61 JU3Julián Urbano0.61 RTBB1 Carles Roig, Lorenzo J. Tardón,Ana María Barbancho, Isabel Barbancho 0.34 YHKH1 Sakurako Yazawa, Yuhei Hasegawa, Kouhei Kanamori, Masatoshi Hamanaka 0.21 Multi-F0 Estimation SubIDParticipantsAccuracy BW1Emmanouil Benetos, Tillman Weyde0.66 CDM1Tian Cheng, Simon Dixon, Matthias Mauch0.62 CDM2Tian Cheng, Simon Dixon, Matthias Mauch0.62 Multi-F0 Note Tracking - Mixed Dataset SubIDParticipants Avg. F-measure Onset Only Avg. Overlap BW2 Emmanouil Benetos, Tillman Weyde0.550.88 CDM3 Tian Cheng, Simon Dixon, Matthias Mauch0.510.86 BW3 Emmanouil Benetos, Tillman Weyde0.480.88 Multi-F0 Note Tracking - Piano Only SubIDParticipants Avg. F-measure Onset Only Avg. Overlap BW3 Emmanouil Benetos, Tillman Weyde0.610.83 CDM3 Tian Cheng, Simon Dixon, Matthias Mauch0.570.79 BW2 Emmanouil Benetos, Tillman Weyde0.540.83 Query By Singing/Humming SubIDParticipants Task1A Hidden MRRTask1A MRRTask1B MRRTask1C MRRTask2 SC BS1Bartłomiej StasiakNA 8.91 BS2Bartłomiej Stasiak0.550.59NA BS3Bartłomiej StasiakNA 0.910.71NA BS4Bartłomiej StasiakNA 0.930.71NA BS5Bartłomiej StasiakNA 0.560.45NA MR1Music Radar0.930.960.970.729.52 LNL1Peng Li, Yuan Nie, Xiaoyan Li0.860.900.930.81NA YJ1Tzu-chun Yeh, Jyh-Shing Roger Jang0.910.930.880.407.00 YJ2Tzu-chun Yeh, Jyh-Shing Roger Jang0.880.920.470.206.84 Audio Onset Detection SubIDParticipants Avg. F-measure SB2Sebastian Böck0.87 SB1Sebastian Böck0.87 SB4Sebastian Böck0.81 SB3Sebastian Böck0.80 CSF1 Chris Cannam, Dan Stowell, Luis Figueira 0.66 ZHZD1 Zhengchen Zhang, Dong-yan Huang, Renbo Zhao, Minghui Dong 0.82 FMEGS1 Giacomo Ferroni, Erik Marchi, Florian Eyben, Leonardo Gabrielli, Stefano Squartini, Björn Schuller 0.80 CF4Chris Cannam, Luis Figueira0.73 FMESS1 Giacomo Ferroni, Erik Marchi, Florian Eyben, Stefano Squartini, Björn Schuller 0.81 CB1Chris Baume0.63 MTB1 Emilio Molina Martínez, Lorenzo J. Tardón, Isabel Barbancho, Ana María Barbancho 0.38

2. MIREX 2013 Evaluation Results J. Stephen Downie & IMIRSEL University of Illinois at Urbana-Champaign email: jdownie@illinois.edu Audio Melody Extraction Overall Accuracy SubIDParticipantsMIREX'05ADC'04INDIAN'08 SL1Liming Song, Ming Li0.540.580.63 CF1Chris Cannam, Luis Figueira0.470.670.58 YJ3Tzu-chun Yeh, Jyh-Shing Roger Jang0.360.420.51 YJ4Tzu-chun Yeh, Jyh-Shing Roger Jang0.520.460.70 Audio Melody Extraction Overall Accuracy SubIDParticipantsMIREX'09 0dbMIREX'09 +5dbMIREX'09 -5db SL1Liming Song, Ming Li0.640.730.50 CF1Chris Cannam, Luis Figueira0.460.540.39 YJ3Tzu-chun Yeh, Jyh-Shing Roger Jang0.520.550.44 YJ4Tzu-chun Yeh, Jyh-Shing Roger Jang0.540.580.44 Structural Segmentation - MIREX '09 SubIDParticipants MIREX 09 F-measure MIREX 10 RWC/Quaero SB@3sec MIREX 10 RWC/RWC F-measure Salami F-measure RBH3 Bruno Rocha, Niels Bogaards, Aline Honingh 0.470.540.480.49 RBH2 Bruno Rocha, Niels Bogaards, Aline Honingh 0.460.670.480.47 RBH1 Bruno Rocha, Niels Bogaards, Aline Honingh 0.460.670.47 MP1Brian McFee, Danile P.W. Ellis0.470.570.420.40 RBH4 Bruno Rocha, Niels Bogaards, Aline Honingh 0.470.540.480.47 MP2Brian McFee, Danile P.W. Ellis0.460.590.420.37 CF5Chris Cannam, Luis Figueira0.510.610.520.45 CF6 Chris Cannam, Luis Figueira, Matthias Mauch 0.610.490.580.55 Audio Beat Tracking F-Measure SubIDParticipantsMCKMAZSMC FW4Fu-Hai Frank Wu49.8842.2431.00 ZDBG1 Jose Zapata, Matthew Davies, Dmitry Bogdanov, Emilia Gómez 52.0053.0037.95 FW2Fu-Hai Frank Wu50.1841.1631.30 FW1Fu-Hai Frank Wu44.0766.9935.19 KFRO1 Maksim Khadkevich, Thomas Fillon, Gaël Richard, Maurizio Omologo 51.5034.8832.48 CDF2Chris Cannam, Simon Dixon, Luis Figueira52.8849.6233.66 CDF1Chris Cannam, Simon Dixon, Luis Figueira52.4541.9530.34 GP3Geoffroy Peeters50.3247.0235.17 DP1Brian McFee, Danile P.W. Ellis27.8634.3921.03 SB6Sebastian Böck59.0460.1552.44 GKC3Aggelos Gkiokas, Vassilis Katsouros, George Carayannis51.4336.2433.41 GP1Geoffroy Peeters49.6155.5636.89 SB5Sebastian Böck58.2149.0747.12 GP2Geoffroy Peeters50.0949.1236.36 ES3Florian Eyben, Björn Schuller45.1837.7327.83 ES1Florian Eyben, Björn Schuller40.8543.2529.49 EWFS1 Florian Eyben, Felix Weninger, Giacomo Ferroni, Björn Schuller 26.2226.1721.75 FK1Florian Krebs57.6852.8641.56 Discovery of Repeated Themes and Sections SubIDParticipantsTask VersionR_estP_estR_occP_occLog Runtime NF2Oriol Nieto, Morwaread FarboodSymbolic, Polyphonic0.370.490.480.612.46 DM10David MeredithSymbolic, Polyphonic0.580.570.810.532.96 DM9David MeredithSymbolic, Polyphonic0.340.200.170.222.95 DM8David MeredithSymbolic, Polyphonic0.610.420.720.512.95 DM7David MeredithSymbolic, Polyphonic0.490.59 0.464.05 DM6David MeredithSymbolic, Polyphonic0.250.180.00 4.09 DM5David MeredithSymbolic, Polyphonic0.410.330.480.364.06 NF1Oriol Nieto, Morwaread FarboodSymbolic, Monophonic0.420.470.410.592.03 DM10David MeredithSymbolic, Monophonic0.650.550.770.542.21 DM9David MeredithSymbolic, Monophonic0.450.290.360.572.25 DM8David MeredithSymbolic, Monophonic0.560.420.570.662.29 DM7David MeredithSymbolic, Monophonic0.530.570.760.683.21 DM6David MeredithSymbolic, Monophonic0.370.320.400.493.19 DM5David MeredithSymbolic, Monophonic0.440.380.590.663.20 NF4Oriol Nieto, Morwaread FarboodAudio, Polyphonic0.220.280.010.071.56 NF3Oriol Nieto, Morwaread FarboodAudio, Monophonic0.380.490.110.411.79 Special Thanks to: The Andrew W. Mellon Foundation, the National Science Foundation (Grant No. NSF IIS-0327371 and No. NSF IIS-0328471), IMIRSEL members (C. Maden, K. Choi, Y. Hao, R. Aktar, J. Downie, A. Ehmann, M. Bay, P. Organisciak, & C. Willis), the content providers, Evalutron graders, the MIR community, and the ISMIR 2013 organizing committee Audio Chord Esitimation - MirexChord2009 SubIDParticipantsRootMajMin Bass Sevenths Sevenths Bass Mean directional Hamming measure Mean under-segmentation Mean over-segmentation CB3Taemin Cho, Juan P. Bello84.4781.7879.1268.9566.460.850.130.08 CB4Taemin Cho, Juan P. Bello83.7482.1979.3968.7266.210.840.140.08 CF2Chris Cannam, Luis Figueira78.5675.4172.4854.6752.260.820.130.14 KO1Maksim Khadkevich, Maurizio Omologo82.9382.1979.6176.0473.430.840.140.09 KO2Maksim Khadkevich, Maurizio Omologo84.2683.9581.3880.1777.380.860.130.08 NG1Nikolay Glazyrin77.1975.2872.4465.7063.140.790.180.12 NG2Nikolay Glazyrin72.8470.9368.1243.0041.350.790.170.16 NMSD1Yizhao Ni, Matt Mcvicar, Raul Santos-Rodriguez, Tijl De Bie82.5380.7278.1466.0863.770.830.150.10 NMSD2Yizhao Ni, Matt Mcvicar, Raul Santos-Rodriguez, Tijl De Bie83.0081.4978.6668.8466.210.830.140.10 PP3Johan Pauwels, Geoffroy Peeters76.6775.1472.0966.5163.720.810.160.12 PP4Johan Pauwels, Geoffroy Peeters75.3272.8169.9261.0258.290.800.180.11 SB8Nikolaas Steenbergen, John Ashley Burgoyne9.377.477.066.606.220.400.080.60 Audio Chord Esitimation - BillboardTest2012 SubIDParticipantsRootMajMin Bass Sevenths Sevenths Bass Mean directional Hamming measure Mean under-segmentation Mean over-segmentation CB3Taemin Cho, Juan P. Bello78.7276.7574.7265.1763.110.810.160.11 CF2Chris Cannam, Luis Figueira74.0872.2270.2155.3553.390.800.150.17 KO1Maksim Khadkevich, Maurizio Omologo77.3875.5873.5157.6855.820.800.170.13 KO2Maksim Khadkevich, Maurizio Omologo77.8176.2574.3362.1860.240.800.180.11 NG1Nikolay Glazyrin72.6871.2268.9751.7049.800.790.180.14 NG2Nikolay Glazyrin68.6767.0964.9948.3246.750.780.17 NMSD1Yizhao Ni, Matt Mcvicar, Raul Santos-Rodriguez, Tijl De Bie77.7076.1074.2264.1862.280.790.180.14 NMSD2Yizhao Ni, Matt Mcvicar, Raul Santos-Rodriguez, Tijl De Bie77.3276.2674.3864.7062.640.780.180.14 PP3Johan Pauwels, Geoffroy Peeters74.0072.7770.4452.7250.770.790.16 PP4Johan Pauwels, Geoffroy Peeters72.6670.3968.1454.7252.610.790.180.13 SB8Nikolaas Steenbergen, John Ashley Burgoyne8.526.356.154.814.730.360.080.64 Audio Chord Esitimation - BillboardTest2013 SubIDParticipantsRootMajMin Bass Sevenths Sevenths Bass Mean directional Hamming measure Mean under-segmentation Mean over-segmentation CB3Taemin Cho, Juan P. Bello75.7572.1470.0758.1356.160.780.190.11 CF2Chris Cannam, Luis Figueira71.0567.4065.3349.0647.250.770.17 NG1Nikolay Glazyrin70.8767.0864.7648.7046.630.750.210.14 NG2Nikolay Glazyrin67.0563.1161.0843.7842.740.750.190.17 NMSD1Yizhao Ni, Matt Mcvicar, Raul Santos-Rodriguez, Tijl De Bie74.5071.2969.2058.5156.560.760.210.14 NMSD2Yizhao Ni, Matt Mcvicar, Raul Santos-Rodriguez, Tijl De Bie74.6271.5469.4759.4657.530.750.210.14 PP3Johan Pauwels, Geoffroy Peeters70.5267.9765.5850.4848.390.760.180.16 PP4Johan Pauwels, Geoffroy Peeters69.5966.2663.9451.6249.610.750.220.13 SB8Nikolaas Steenbergen, John Ashley Burgoyne9.126.616.445.255.110.350.080.65