TITLE

Classification accuracy is not enough: On the evaluation of music genre recognition systems

AUTHOR(S)
Sturm, Bob L.
PUB. DATE
December 2013
SOURCE
Journal of Intelligent Information Systems;Dec2013, Vol. 41 Issue 3, p371
SOURCE TYPE
Academic Journal
DOC. TYPE
Article
ABSTRACT
We argue that an evaluation of system behavior at the level of the music is required to usefully address the fundamental problems of music genre recognition (MGR), and indeed other tasks of music information retrieval, such as autotagging. A recent review of works in MGR since 1995 shows that most (82 %) measure the capacity of a system to recognize genre by its classification accuracy. After reviewing evaluation in MGR, we show that neither classification accuracy, nor recall and precision, nor confusion tables, necessarily reflect the capacity of a system to recognize genre in musical signals. Hence, such figures of merit cannot be used to reliably rank, promote or discount the genre recognition performance of MGR systems if genre recognition (rather than identification by irrelevant confounding factors) is the objective. This motivates the development of a richer experimental toolbox for evaluating any system designed to intelligently extract information from music signals.
ACCESSION #
91913101

 

Related Articles

  • Exploring Performance-Based Music Attributes for Stylometric Analysis. Bellaachia, Abdellghani; Jimenez, Edward // World Academy of Science, Engineering & Technology;Jul2009, Issue 31, p509 

    Music Information Retrieval (MIR) and modern data mining techniques are applied to identify style markers in midi music for stylometric analysis and author attribution. Over 100 attributes are extracted from a library of 2830 songs then mined using supervised learning data mining techniques. Two...

  • Semantics discovery in social tagging systems: A review. Jabeen, Fouzia; Khusro, Shah; Majid, Amna; Rauf, Azhar // Multimedia Tools & Applications;Jan2016, Vol. 75 Issue 1, p573 

    Web 2.0 has brought many collaborative and novel applications which transformed the web as a medium and resulted in its exponential growth. Tagging systems are one of these killer applications. Tags are in free-form but represent the link between objective information and users' cognitive...

  • AN ONTOLOGY-BASED INTELLIGENT INFORMATION RETRIEVAL METHOD FOR DOCUMENT RETRIEVAL. YADAV, POONAM; SINGH, R. P. // International Journal of Engineering Science & Technology;Sep2012, Vol. 4 Issue 9, p3970 

    The document retrieval is one of the fast growing and complex research area in the field of information retrieval. In this paper, we proposed an ontology-based method for document retrieval. The ontology defined in our proposed approach gives extra freedom to choose between the documents and...

  • AN ONTOLOGY-BASED INTELLIGENT INFORMATION RETRIEVAL METHOD FOR DOCUMENT RETRIEVAL. YADAV, POONAM; SINGH, R. P. // International Journal of Engineering Science & Technology;Sep2012, Vol. 4 Issue 9, p3970 

    The document retrieval is one of the fast growing and complex research area in the field of information retrieval. In this paper, we proposed an ontology-based method for document retrieval. The ontology defined in our proposed approach gives extra freedom to choose between the documents and...

  • AN ONTOLOGY-BASED INTELLIGENT INFORMATION RETRIEVAL METHOD FOR DOCUMENT RETRIEVAL. YADAV, POONAM; SINGH, R. P. // International Journal of Engineering Science & Technology;Sep2012, Vol. 4 Issue 9, p3970 

    The document retrieval is one of the fast growing and complex research area in the field of information retrieval. In this paper, we proposed an ontology-based method for document retrieval. The ontology defined in our proposed approach gives extra freedom to choose between the documents and...

  • Improving Graph-based Approaches for Personalized Tag Recommendation. Ramezani, Maryam // Journal of Emerging Technologies in Web Intelligence;May2011, Vol. 3 Issue 2, p168 

    Social tagging applications allow users to annotate online resources, resulting in a complex network of interrelated users, resources and tags often called a Folksonomy. A folksonomy is often represented as a hyper-graph in which each hyper-edge connects a user, resource and tag. This tripartite...

  • IEEE 1588 Precision Time Protocol. simpson, wes // TV Technology;3/6/2013, Vol. 31 Issue 5, p24 

    In this article, the author discusses the precision time protocol (PTP) IEEE 1588 officially named as "Standard for a Precision Clock Synchronization Protocol for Networked Measurement and ControlSystems" designed for industrial automation systems. According to him, PTP can be used to deliver...

  • A Novel Image Reconstruction Algorithm Based on Concatenated Dictionary. Zhe Liu; Xiaoxian Zhen; Cong Ma // Journal of Computers;Feb2012, Vol. 7 Issue 2, p444 

    Image sparse representation plays a vital role in the process of image reconstruction. In recent years, several pioneering works suggested that signals/images could be represented sparsely with a redundant dictionary. The selection of components from the dictionary directly influences the...

  • A Measuring Method for Angular Displacement Based on Correlation Algorithm. Ping Yan; Yan He; Runzhong Yi; Fei Liu; Guorong Chen // Journal of Computers;Oct2012, Vol. 7 Issue 10, p2376 

    The existing angular displacement measurement methods rely on the manufacturing precision of the fixedplate and moving-plate with high manufacturing cost, and it is difficult to overcome a static error and drift for the static measurement method. A kind of angular displacement measuring method...

Share

Read the Article

Courtesy of VIRGINIA BEACH PUBLIC LIBRARY AND SYSTEM

Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics