1. Fundamentals of Music Processing Chapter 7: Content-Based Audio Retrieval Meinard Müller International Audio Laboratories Erlangen www.music-processing.de

2. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 2 Book: Fundamentals of Music Processing Meinard Müller Fundamentals of Music Processing Audio, Analysis, Algorithms, Applications 483 p., 249 illus., 30 illus. in color, hardcover ISBN: 978-3-319-21944-8 Springer, 2015 Accompanying website: www.music-processing.de

3. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 3 Chapter 7: Content-Based Audio Retrieval 7.1Audio Identification 7.2Audio Matching 7.3Version Identification 7.4Further Notes One important topic in information retrieval is concerned with the development of search engines that enable users to explore music collections in a flexible and intuitive way. In Chapter 7, we discuss audio retrieval strategies that follow the query-by-example paradigm: given an audio query, the task is to retrieve all documents that are somehow similar or related to the query. Starting with audio identification, a technique used in many commercial applications such as Shazam, we study various retrieval strategies to handle different degrees of similarity. Furthermore, considering efficiency issues, we discuss fundamental indexing techniques based on inverted lists—a concept originally used in text retrieval.

4. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 4 7 Content-Based Audio Retrieval Teaser

5. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 5 7 Content-Based Audio Retrieval Fig. 7.1

6. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 6 7.1 Audio Identification Fig. 7.2

7. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 7 7.1 Audio Identification Fig. 7.3

8. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 8 7.1 Audio Identification Fig. 7.4

9. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 9 7.1 Audio Identification Fig. 7.5

10. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 10 7.1 Audio Identification Fig. 7.5

11. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 11 7.1 Audio Identification Fig. 7.5

12. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 12 7.1 Audio Identification Fig. 7.5

13. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 13 7.1 Audio Identification Fig. 7.5

14. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 14 7.1 Audio Identification Fig. 7.6

15. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 15 7.1 Audio Identification Fig. 7.7

16. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 16 7.2 Audio Matching Fig. 7.8

17. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 17 7.2 Audio Matching Fig. 7.9

18. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 18 7.2 Audio Matching Fig. 7.10 Time (samples)

19. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 19 7.2 Audio Matching Fig. 7.11

20. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 20 7.2 Audio Matching Fig. 7.12

21. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 21 7.2 Audio Matching Fig. 7.13

22. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 22 7.2 Audio Matching Fig. 7.14

23. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 23 7.2 Audio Matching Fig. 7.14 Sequence X Sequence Y

24. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 24 7.2 Audio Matching Fig. 7.14 Sequence X Sequence Y

25. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 25 7.2 Audio Matching Fig. 7.15

26. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 26 7.2 Audio Matching Fig. 7.16

27. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 27 7.2 Audio Matching Fig. 7.16

28. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 28 7.2 Audio Matching Fig. 7.16

29. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 29 7.2 Audio Matching Fig. 7.16

30. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 30 7.2 Audio Matching Fig. 7.16

31. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 31 7.2 Audio Matching Fig. 7.16

32. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 32 7.3 Version Identification Fig. 7.17

33. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 33 7.3 Version Identification Fig. 7.18

34. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 34 7.3 Version Identification Fig. 7.19 Time (seconds)

35. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 35 7.3 Version Identification Fig. 7.19 Time (seconds)

36. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 36 7.3 Version Identification Fig. 7.19 Time (seconds)

37. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 37 7.3 Version Identification Fig. 7.20

38. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 38 7.3 Version Identification Fig. 7.21

39. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 39 7.4 Further Notes Fig. 7.22

40. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 40 7.4 Further Notes Table 7.1

41. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 41 7.4 Further Notes Fig. 7.23

42. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 42 7.4 Further Notes Fig. 7.23

43. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 43 7.4 Further Notes Fig. 7.23

44. Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 44 7.4 Further Notes Fig. 7.23