WITCHCRAFT Towards Integration of MIR and Folk Song Research Peter van Kranenburg, J ö rg Garbers, Anja Volk, Frans Wiering, Louis P. Grijp, Remco C. Veltkamp

2 ISMIR Towards Integration of MIR and folk Song Research Introduction: Purpose Present our approach to improve cooperation between Music Information Retrieval and Folk Song Research (Musicology)

3 ISMIR Towards Integration of MIR and folk Song Research Introduction: Central Question How to retrieve related folk song melodies from a large database?

4 ISMIR Towards Integration of MIR and folk Song Research Folk Song Research Needed Knowledge about Folk Song Melodies Provided by Folk Song Research (Volksliedkunde)

5 ISMIR Towards Integration of MIR and folk Song Research Folk Song Research Most important feature of folk songs: Oral Transmission

6 ISMIR Towards Integration of MIR and folk Song Research Folk Song Research: Major Tasks Classification Group together melodies that share some features Identification To which ‘tune-family’ does this melody belong?

7 ISMIR Towards Integration of MIR and folk Song Research Folk Song Research: Classification Classification  Krohn (early 20th c.) Cadence tones  Bart ó k, Kod á ly (first half 20th c.) Number of lines Cadence tones Number of syllables in each line Ambitus  Dutch Archive of Folk Songs (mid 20th c.) Accent tones

8 ISMIR Towards Integration of MIR and folk Song Research Folk Songs in MIR Folk Songs in Music Information Retrieval  Online search engines  ISMIR  Other studies

9 ISMIR Towards Integration of MIR and folk Song Research Folk Songs in MIR: Search Engines Search Engines  Danish Folklore Archives  Digital Archive of Finnish Folk Tunes  Themefinder  MELDEX  Musipedia Very limited knowledge about oral variation incorporated

10 ISMIR Towards Integration of MIR and folk Song Research Folk Songs in MIR: ISMIR and Essen ISMIR proceedings : 8 studies employing the Essen folk song collection. None of these because of specific interest in folk songs.

11 ISMIR Towards Integration of MIR and folk Song Research Folk songs in MIR: Other Contour approach  Juh á sz (2000, 2002, 2004, 2006)  Huron (1995) Segmentation  Juh á sz (2004)  Bod (2002) Repeating Patterns  Conklin and Anagnostopoulou (2001) Geographic data  Toiviainen and Eerola (2003)  Aarden and Huron (2001)

12 ISMIR Towards Integration of MIR and folk Song Research Integration and Cooperation For building a search engine Integrate knowledge from Folk Song Research with knowledge and methods from Music Information Retrieval

13 ISMIR Towards Integration of MIR and folk Song Research Evaluation How to evaluate a search engine for folk song melodies? A ground truth is based on choices, assumptions, hypotheses, theories about music, musical intuition, etc. Ground TruthEvaluate the musical model

14 ISMIR Towards Integration of MIR and folk Song Research Music Information Retrieval Folk Song Research Activities and Role Model Musical Modeling Implementationevaluation deployment Music Information Retrieval Folk Song Research Computational Musicology

15 ISMIR Towards Integration of MIR and folk Song Research Role Model: Folk Song Research Tasks:  Defining concepts precisely  Evaluate implemented models  Effort to understand possibilities and limitations of computational approach Interest:Folk Music Methods:Musicological

16 ISMIR Towards Integration of MIR and folk Song Research Role Model: Music Information Retrieval Delivers:  Software components  Interface components  User models  Features ... Interest:Music Information Systems Methods:Computer Science

17 ISMIR Towards Integration of MIR and folk Song Research Role Model: Computational Musicology Tasks  Deconstruct Folk Song Research concepts  Enable Folk Song Research to evaluate the implemented models  Pack software components into libraries & toolboxes  Provide frameworks Interest:(Folk) Music Methods:Computer Science

18 ISMIR Towards Integration of MIR and folk Song Research Integration The MIR community could gain much from pursuing the Computational Musicology-role more ambitiously. And Musicology as well

19 ISMIR Towards Integration of MIR and folk Song Research Future Directions  Use concepts from Folk Song Research Most important: tune-family model  Use features from Folk Song Research  Develop new models for oral variation in collaboration with folk song researchers  Iteratively improve these musical models, thus avoiding the problem of ground truth This will result in an increasing understanding of the concepts of Folk Song Research, thus in improved search engines.

20 ISMIR Towards Integration of MIR and folk Song Research Questions? Further Reading: