Evaluation in music information retrieval

The field of Music Information Retrieval has always acknowledged the need for rigorous scientific evaluations, and several efforts have set out to develop and provide the infrastructure, technology and methodologies needed to carry out these evaluations. The community has enormously gained from thes...

Descripción completa

Detalles Bibliográficos
Autores: Urbano, Julián, Schedl, Markus, Serra, Xavier
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2013
País:España
Institución:Universitat Pompeu Fabra
Repositorio:Repositorio Digital de la UPF
OAI Identifier:oai:repositori.upf.edu:10230/34901
Acceso en línea:http://hdl.handle.net/10230/34901
http://dx.doi.org/10.1007/s10844-013-0249-4
Access Level:acceso abierto
Palabra clave:Music Information Retrieval
Text Information Retrieval
Evaluation and Experimentation Survey
id ES_2bd4f2542e52f5a42d5d759d868724be
oai_identifier_str oai:repositori.upf.edu:10230/34901
network_acronym_str ES
network_name_str España
repository_id_str
spelling Evaluation in music information retrievalUrbano, JuliánSchedl, MarkusSerra, XavierMusic Information RetrievalText Information RetrievalEvaluation and Experimentation SurveyThe field of Music Information Retrieval has always acknowledged the need for rigorous scientific evaluations, and several efforts have set out to develop and provide the infrastructure, technology and methodologies needed to carry out these evaluations. The community has enormously gained from these evaluation forums, but we have reached a point where we are stuck with evaluation frameworks that do not allow us to improve as much and as well as we want. The community recently acknowledged this problem and showed interest in addressing it, though it is not clear what to do to improve the situation. We argue that a good place to start is again the Text IR field. Based on a formalization of the evaluation process, this paper presents a survey of past evaluation work in the context of Text IR, from the point of view of validity, reliability and efficiency of the experiments. We show the problems that our community currently has in terms of evaluation, point to several lines of research to improve it and make various proposals in that line.Springer201820182013info:eu-repo/semantics/articleinfo:eu-repo/semantics/acceptedVersionapplication/pdfapplication/pdfhttp://hdl.handle.net/10230/34901http://dx.doi.org/10.1007/s10844-013-0249-4reponame:Repositorio Digital de la UPFinstname:Universitat Pompeu FabraInglésJournal of Intelligent Information Systems. 2013;41(3):345-69.© Springer The final publication is available at Springer via http://dx.doi.org/10.1007/s10844-013-0249-4info:eu-repo/semantics/openAccessoai:repositori.upf.edu:10230/349012026-06-12T07:21:37Z
dc.title.none.fl_str_mv Evaluation in music information retrieval
title Evaluation in music information retrieval
spellingShingle Evaluation in music information retrieval
Urbano, Julián
Music Information Retrieval
Text Information Retrieval
Evaluation and Experimentation Survey
title_short Evaluation in music information retrieval
title_full Evaluation in music information retrieval
title_fullStr Evaluation in music information retrieval
title_full_unstemmed Evaluation in music information retrieval
title_sort Evaluation in music information retrieval
dc.creator.none.fl_str_mv Urbano, Julián
Schedl, Markus
Serra, Xavier
author Urbano, Julián
author_facet Urbano, Julián
Schedl, Markus
Serra, Xavier
author_role author
author2 Schedl, Markus
Serra, Xavier
author2_role author
author
dc.subject.none.fl_str_mv Music Information Retrieval
Text Information Retrieval
Evaluation and Experimentation Survey
topic Music Information Retrieval
Text Information Retrieval
Evaluation and Experimentation Survey
description The field of Music Information Retrieval has always acknowledged the need for rigorous scientific evaluations, and several efforts have set out to develop and provide the infrastructure, technology and methodologies needed to carry out these evaluations. The community has enormously gained from these evaluation forums, but we have reached a point where we are stuck with evaluation frameworks that do not allow us to improve as much and as well as we want. The community recently acknowledged this problem and showed interest in addressing it, though it is not clear what to do to improve the situation. We argue that a good place to start is again the Text IR field. Based on a formalization of the evaluation process, this paper presents a survey of past evaluation work in the context of Text IR, from the point of view of validity, reliability and efficiency of the experiments. We show the problems that our community currently has in terms of evaluation, point to several lines of research to improve it and make various proposals in that line.
publishDate 2013
dc.date.none.fl_str_mv 2013
2018
2018
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/acceptedVersion
format article
status_str acceptedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/34901
http://dx.doi.org/10.1007/s10844-013-0249-4
url http://hdl.handle.net/10230/34901
http://dx.doi.org/10.1007/s10844-013-0249-4
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Journal of Intelligent Information Systems. 2013;41(3):345-69.
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Springer
publisher.none.fl_str_mv Springer
dc.source.none.fl_str_mv reponame:Repositorio Digital de la UPF
instname:Universitat Pompeu Fabra
instname_str Universitat Pompeu Fabra
reponame_str Repositorio Digital de la UPF
collection Repositorio Digital de la UPF
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869405188327997440
score 15.812455

Similares en LA Referencia