Fundamentals of Music Processing Chapter 7: Content-Based Audio Retrieval Meinard Müller International Audio Laboratories Erlangen www.music-processing.de.

Slides:



Advertisements
Similar presentations
Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki
Advertisements

Information Retrieval in Practice
Chapter 5: Introduction to Information Retrieval
Fig. 4-1, p Fig. 4-2, p. 109 Fig. 4-3, p. 110.
Slide 1Fig. 2.1a, p.25. Slide 2Fig. 2.1b, p.25 Slide 3Table 2.1, p.25.
R2 Library Features and Functionality Overview. The R2 Library  The R2 Library is an electronic database that enables access to digital book content.
Slide 1Fig. 22.1, p.669. Slide 2Fig. 22.3, p.670.
Slide 1Fig. 17.1, p.513. Slide 2Table 17.1, p.514.
Slide 1Fig. 19.1, p Slide 2Fig. 19.2, p. 583.
Slide 1Fig. 21.1, p.641. Slide 2Fig. 21.2, p.642.
P.464. Table 13-1, p.465 Fig. 13-1, p.466 Fig. 13-2, p.467.
1 Texmex – November 15 th, 2005 Strategy for the future Global goal “Understand” (= structure…) TV and other MM documents Prepare these documents for applications.
Fig. 11-1, p p. 360 Fig. 11-2, p. 361 Fig. 11-3, p. 361.
1 Oct 30, 2006 LogicSQL-based Enterprise Archive and Search System How to organize the information and make it accessible and useful ? Li-Yan Yuan.
Chapter 11 Beyond Bag of Words. Question Answering n Providing answers instead of ranked lists of documents n Older QA systems generated answers n Current.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide
Table 6-1, p Fig. 6-1, p. 162 p. 163 Fig. 6-2, p. 164.
© Franz Kurfess Project Topics 1 Topics for Master’s Projects and Theses -- Winter Franz J. Kurfess Computer Science Department Cal Poly.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide
Modern Information Retrieval Chapter 5 Query Operations.
Efficient Search in Large Textual Collections with Redundancy Jiangong Zhang and Torsten Suel Review by Newton Alex
Agent Technology for e-Commerce
Advance Information Retrieval Topics Hassan Bashiri.
Modern Information Retrieval Chapter 1 Introduction.
Modern Information Retrieval Chapter 2 Modeling. Can keywords be used to represent a document or a query? keywords as query and matching as query processing.
Interface for the University Library Catalogue Implementing Direct Manipulation Proposal 4.
Databases Chapter 11.
Chapter 5: Information Retrieval and Web Search
Chapter 5 Application Software.
© Paradigm Publishing, Inc. 5-1 Chapter 5 Application Software Chapter 5 Application Software.
Search Engines and Information Retrieval Chapter 1.
Fundamentals of Music Processing Chapter 1: Music Representations Meinard Müller International Audio Laboratories Erlangen
Chapter 7 Web Content Mining Xxxxxx. Introduction Web-content mining techniques are used to discover useful information from content on the web – textual.
Thanks to Bill Arms, Marti Hearst Documents. Last time Size of information –Continues to grow IR an old field, goes back to the ‘40s IR iterative process.
The College of Saint Rose CSC 460 / CIS 560 – Search and Information Retrieval David Goldschmidt, Ph.D. from Search Engines: Information Retrieval in Practice,
Fundamentals of Music Processing
Chapter 6: Information Retrieval and Web Search
© Paradigm Publishing Inc. 5-1 Chapter 5 Application Software.
GUIDED BY DR. A. J. AGRAWAL Search Engine By Chetan R. Rathod.
Structure of IR Systems INST 734 Module 1 Doug Oard.
The College of Saint Rose CSC 460 / CIS 560 – Search and Information Retrieval David Goldschmidt, Ph.D. from Search Engines: Information Retrieval in Practice,
NC WiseOwl eBooks K-8 NC WiseOwl eBooks K-8 Search for eBooks on your topic from this large collection of current titles. eBooks K-8 Search for eBooks.
Tan Apaydin and Hakan Ferhatosmanoglu IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, VOL. 18, NO. 11, NOVEMBER 2006.
Chapter 8 Evaluating Search Engine. Evaluation n Evaluation is key to building effective and efficient search engines  Measurement usually carried out.
2005/12/021 Fast Image Retrieval Using Low Frequency DCT Coefficients Dept. of Computer Engineering Tatung University Presenter: Yo-Ping Huang ( 黃有評 )
March 31, 1998NSF IDM 98, Group F1 Group F Multi-modal Issues, Systems and Applications.
1 Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP Reporter: 林浩棟.
Introduction to Information Retrieval Example of information need in the context of the world wide web: “Find all documents containing information on computer.
Multi-object Similarity Query Evaluation Michal Batko.
Comparing Document Segmentation for Passage Retrieval in Question Answering Jorg Tiedemann University of Groningen presented by: Moy’awiah Al-Shannaq
User Modeling and Recommender Systems: Introduction to recommender systems Adolfo Ruiz Calleja 06/09/2014.
Generating Query Substitutions Alicia Wood. What is the problem to be solved?
Query by Image and Video Content: The QBIC System M. Flickner et al. IEEE Computer Special Issue on Content-Based Retrieval Vol. 28, No. 9, September 1995.
KNOWLEDGE MANAGEMENT UNIT II KNOWLEDGE MANAGEMENT AND TECHNOLOGY 1.
Fundamentals of Music Processing Chapter 3: Music Synchronization Meinard Müller International Audio Laboratories Erlangen
Text Illustrations To Accompany Fundamentals of Engineering Thermodynamics, 6 th Edition Michael J. Moran, The Ohio State Univ. Howard N. Shapiro, Wayne.
Fundamentals of Music Processing Chapter 5: Chord Recognition Meinard Müller International Audio Laboratories Erlangen
© 2017 by McGraw-Hill Education. This proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Information Retrieval in Practice
Query Methods Simple SQL Statements Start ….
Introduction to Music Information Retrieval (MIR)
Fundamentals of Music Processing
Chapter 4 - Case Study Clustering
Data Mining Chapter 6 Search Engines
Topics discussed in this section:
Chapter 5: Information Retrieval and Web Search
EFFICIENCY OF MrSID Chapter 6. Slide 41
Information Retrieval and Web Design
Information Retrieval and Web Design
Introduction to information retrieval
Presentation transcript:

Fundamentals of Music Processing Chapter 7: Content-Based Audio Retrieval Meinard Müller International Audio Laboratories Erlangen

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 2 Book: Fundamentals of Music Processing Meinard Müller Fundamentals of Music Processing Audio, Analysis, Algorithms, Applications 483 p., 249 illus., 30 illus. in color, hardcover ISBN: Springer, 2015 Accompanying website:

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 3 Chapter 7: Content-Based Audio Retrieval 7.1Audio Identification 7.2Audio Matching 7.3Version Identification 7.4Further Notes One important topic in information retrieval is concerned with the development of search engines that enable users to explore music collections in a flexible and intuitive way. In Chapter 7, we discuss audio retrieval strategies that follow the query-by-example paradigm: given an audio query, the task is to retrieve all documents that are somehow similar or related to the query. Starting with audio identification, a technique used in many commercial applications such as Shazam, we study various retrieval strategies to handle different degrees of similarity. Furthermore, considering efficiency issues, we discuss fundamental indexing techniques based on inverted lists—a concept originally used in text retrieval.

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 4 7 Content-Based Audio Retrieval Teaser

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide 5 7 Content-Based Audio Retrieval Fig. 7.1

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.2

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.3

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.4

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.5

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.5

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.5

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.5

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.5

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.6

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Identification Fig. 7.7

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.8

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.9

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig Time (samples)

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.11

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.12

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.13

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.14

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig Sequence X Sequence Y

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig Sequence X Sequence Y

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.15

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.16

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.16

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.16

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.16

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.16

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Audio Matching Fig. 7.16

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Version Identification Fig. 7.17

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Version Identification Fig. 7.18

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Version Identification Fig Time (seconds)

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Version Identification Fig Time (seconds)

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Version Identification Fig Time (seconds)

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Version Identification Fig. 7.20

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Version Identification Fig. 7.21

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Further Notes Fig. 7.22

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Further Notes Table 7.1

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Further Notes Fig. 7.23

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Further Notes Fig. 7.23

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Further Notes Fig. 7.23

Meinard Müller: Fundamentals of Music Processing © Springer International Publishing Switzerland, 2015 Chapter 7: Content-Based Audio Retrieval Slide Further Notes Fig. 7.23