Theoretical and Methodological Fundaments of Music Annotation Theoretical and Methodological Fundaments of Music Annotation Institute for Psychoacoustics and Electronic Music (IPEM) Dept. Of Musicology University Ghent, Belgium Promotor: Prof. Dr. Marc Leman

Presentation overview 1. Problem specification 2. Masters’ thesis research 3. Research perspectives

1. Problem specification Strong need for annotated music databases, in order to train and develop intelligent MIR systems

(Lesaffre, 2003)

1. Problem specification Strong need for annotated music databases, in order to train and develop intelligent MIR systems  No general methodological framework for music annotation  No general theoretical framework for music annotation

2. Masters’ thesis research Theoretical research Methodological research

2. Masters’ thesis research Theoretical research

2. Masters’ thesis research Theoretical research  Music annotation = detailed description, via specific methods and techniques, of musical content  Musical content = those parameters & concepts which make people evaluate certain informationstreams as musical entities

? (Lesaffre, et al., 2003)

2. Masters’ thesis research Theoretical research  from an ecological point of view: music is not reducable to low level concepts  constant interaction between different abstraction levels

2. Masters’ thesis research Methodological research

2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber  High level music annotation of polyphonic music, through melody imitation

2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber

2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber Annotationtool for Qbv: - Automatic segmentation - Automatic pitchannotation

2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber Annotation method: Praat Annotated queries: vocal queries + instrumental queries

2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber Auditive evaluation (Sonar) Statistical evaluation

2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber Improve performance

Total 15.39% Results for instrumental queries

2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation

2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation How to extract different melodylines from polyphonic music?

2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation 8 trained singers were asked to imitate main melodylines and bass lines (and other melodylines they considered important) from 10 popular songs

2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation - Good imitations of main melodylines - Good imitations of other relevant melodylines, but no consistency in choosing other relevant melodies - Bad imitations of bass lines

2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation  melody imitations serving as reference material for training MIR systems?

3. Research perspectives What is musical content? How to handle this musical content in a MIR context? How to annotate musical audio and what are possible underlying theories?  developing annotated music databases