Evaluation in Music Information Retrieval

Urbano, Julián; Schedl, Markus; Serra, Xavier
December 2013
Journal of Intelligent Information Systems;Dec2013, Vol. 41 Issue 3, p345
Academic Journal
The field of Music Information Retrieval has always acknowledged the need for rigorous scientific evaluations, and several efforts have set out to develop and provide the infrastructure, technology and methodologies needed to carry out these evaluations. The community has enormously gained from these evaluation forums, but we have reached a point where we are stuck with evaluation frameworks that do not allow us to improve as much and as well as we want. The community recently acknowledged this problem and showed interest in addressing it, though it is not clear what to do to improve the situation. We argue that a good place to start is again the Text IR field. Based on a formalization of the evaluation process, this paper presents a survey of past evaluation work in the context of Text IR, from the point of view of validity, reliability and efficiency of the experiments. We show the problems that our community currently has in terms of evaluation, point to several lines of research to improve it and make various proposals in that line.


Related Articles

  • CLASSIFICATION OF NORTH INDIAN MUSICAL INSTRUMENTS USING SPECTRAL FEATURES. Kumari, M.; Kumar, P.; Solanki, S. S. // Computer Science & Telecommunications;2010, Vol. 29 Issue 6, p11 

    Musical instrument recognition finds its application in the field of Musical Information Retrieval such as automatic tagging, cataloguing of music for search engine, automatic musical transcription, genre classification etc. The present work has been emphasized on the identification of different...

  • INTERMEDIATE A PERSPECTIVE ON DADGAD. Gold, Jude // Guitar Player;Sep2008, Vol. 42 Issue 9, p125 

    The article presents the A minor key brief musical arrangement derived from the book "UNDERSTANDING DADGAD," an intermediate guide for guitarists.

  • STEAL THIS ARRANGEMENT.  // Keyboard;Jan2011, Vol. 37 Issue 1, p44 

    The article offers step-by-step instructions for copping the arrangement from various dance remixes without changing the music itself.

  • DEAR DRAMATIST. SENDROFF, MARK // Dramatist;Jan/Feb2013, Vol. 15 Issue 3, p3 

    A letter to the editor is presented in response to Ralph Sevush's article "Making Arrangements With Orchestrators."

  • Corrections.  // Lute Society of America Quarterly;Winter2012, Vol. 47 Issue 4, p46 

    A correction to the article "Guitar Transcription" that was published in the September 2012 issue is presented.

  • Arrangement-Bausteine.  // Musik und Bildung;jul-sep2011, Issue 3, p27 

    The article presents sheet music with arrangement blocks for Agogo-Tamborim.

  • CELESTIAL SPIN. Skilz // Remix;Sep2003, Vol. 5 Issue 9, p54 

    Offers ideas on executing a two-click orbit scratch in music recording. Features of a sampler relevant to a two-click orbit scratch; Procedures for the scratch technique; Importance of speed and time to executing the technique.

  • FREEDOM OF CHOICE!  // Guitar Player;Feb2005, Vol. 39 Issue 2, p129 

    Provides information on the free song transcription offered by "Guitar Player" magazine and Musicnotes.com.

  • From the Editor. Persellin, Diane // General Music Today;Sep2007, Vol. 21 Issue 1, p3 

    The article discusses various reports published within the issue, including one by Jeffrey Bush on composing and arranging in middle school general music and another by Chris Judah-Lauder on collaborative work in upper elementary and middle school students.


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics