1. Theoretical and Methodological Fundaments of Music Annotation Theoretical and Methodological Fundaments of Music Annotation Frederik.Styns@ugent.be Institute for Psychoacoustics and Electronic Music (IPEM) Dept. Of Musicology University Ghent, Belgium Promotor: Prof. Dr. Marc Leman

2. Presentation overview 1. Problem specification 2. Masters’ thesis research 3. Research perspectives

3. 1. Problem specification Strong need for annotated music databases, in order to train and develop intelligent MIR systems

4. (Lesaffre, 2003)

5. 1. Problem specification Strong need for annotated music databases, in order to train and develop intelligent MIR systems  No general methodological framework for music annotation  No general theoretical framework for music annotation

6. 2. Masters’ thesis research Theoretical research Methodological research

7. 2. Masters’ thesis research Theoretical research

8. 2. Masters’ thesis research Theoretical research  Music annotation = detailed description, via specific methods and techniques, of musical content  Musical content = those parameters & concepts which make people evaluate certain informationstreams as musical entities

9. ? (Lesaffre, et al., 2003)

10. 2. Masters’ thesis research Theoretical research  from an ecological point of view: music is not reducable to low level concepts  constant interaction between different abstraction levels

12. 2. Masters’ thesis research Methodological research

13. 2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber  High level music annotation of polyphonic music, through melody imitation

14. 2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber

15. 2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber Annotationtool for Qbv: - Automatic segmentation - Automatic pitchannotation

16. 2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber Annotation method: Praat Annotated queries: vocal queries + instrumental queries

17. 2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber Auditive evaluation (Sonar) Statistical evaluation

20. 2. Masters’ thesis research Methodological research  Manual low level music annotation for testing and training the MAMI-Melodytranscriber Improve performance

21. Total 15.39% Results for instrumental queries

22. 2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation

23. 2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation How to extract different melodylines from polyphonic music?

24. 2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation 8 trained singers were asked to imitate main melodylines and bass lines (and other melodylines they considered important) from 10 popular songs

25. 2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation - Good imitations of main melodylines - Good imitations of other relevant melodylines, but no consistency in choosing other relevant melodies - Bad imitations of bass lines

26. 2. Masters’ thesis research Methodological research  High level annotation of polyphonic music, through melody imitation  melody imitations serving as reference material for training MIR systems?

27. 3. Research perspectives What is musical content? How to handle this musical content in a MIR context? How to annotate musical audio and what are possible underlying theories?  developing annotated music databases