Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations

Query-by-example spoken term detection (QbE STD) aims at retrieving data from a speech repository given an acoustic query containing the term of interest as input. Nowadays, it is receiving much interest due to the large volume of multimedia information. This paper presents the systems submitted to...

Descripción completa

Detalles Bibliográficos
Autores: Tejedor, Javier, Toledano, Doroteo T., Lopez-Otero, Paula, Docío-Fernández, Laura, García-Mateo, Carmen García
Tipo de recurso: artículo
Fecha de publicación:2016
País:España
Institución:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/674372
Acceso en línea:http://hdl.handle.net/10486/674372
https://dx.doi.org/10.1186/s13636-016-0080-2
Access Level:acceso abierto
Palabra clave:Query-by-example spoken term detection
International evaluation
Search on spontaneous speech
Telecomunicaciones
id ES_e25e5de2f453ffc0f3693171f34b9a69
oai_identifier_str oai:repositorio.uam.es:10486/674372
network_acronym_str ES
network_name_str España
repository_id_str
spelling Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluationsTejedor, JavierToledano, Doroteo T.Lopez-Otero, PaulaDocío-Fernández, LauraGarcía-Mateo, Carmen GarcíaQuery-by-example spoken term detectionInternational evaluationSearch on spontaneous speechTelecomunicacionesQuery-by-example spoken term detection (QbE STD) aims at retrieving data from a speech repository given an acoustic query containing the term of interest as input. Nowadays, it is receiving much interest due to the large volume of multimedia information. This paper presents the systems submitted to the ALBAYZIN QbE STD 2014 evaluation held as a part of the ALBAYZIN 2014 Evaluation campaign within the context of the IberSPEECH 2014 conference. This is the second QbE STD evaluation in Spanish, which allows us to evaluate the progress in this technology for this language. The evaluation consists in retrieving the speech files that contain the input queries, indicating the start and end times where the input queries were found, along with a score value that reflects the confidence given to the detection of the query. Evaluation is conducted on a Spanish spontaneous speech database containing a set of talks from workshops, which amount to about 7 h of speech. We present the database, the evaluation metric, the systems submitted to the evaluation, the results, and compare this second evaluation with the first ALBAYZIN QbE STD evaluation held in 2012. Four different research groups took part in the evaluations held in 2012 and 2014. In 2014, new multi-word and foreign queries were added to the single-word and in-language queries used in 2012. Systems submitted to the second evaluation are hybrid systems which integrate letter transcription- and template matching-based systems. Despite the significant improvement obtained by the systems submitted to this second evaluation compared to those of the first evaluation, results still show the difficulty of this task and indicate that there is still room for improvement.This research was funded by the Spanish Government ('SpeechTech4All Project' TEC2012 38939 C03 01 and 'CMC-V2 Project' TEC2012 37585 C02 01), the Galician Government through the research contract GRC2014/024 (Modalidade: Grupos de Referencia Competitiva 2014) and 'AtlantTIC Project' CN2012/160, and also by the Spanish Government and the European Regional Development Fund (ERDF) under project TACTICA.Springer International PublishingDepartamento de Tecnología Electrónica y de las ComunicacionesEscuela Politécnica SuperiorAnálisis y Tratamiento de Voz y Señales Biométricas (ING EPS-002)20162016-12-01research articlehttp://purl.org/coar/resource_type/c_2df8fbb1VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10486/674372https://dx.doi.org/10.1186/s13636-016-0080-2reponame:Biblos-e Archivo. Repositorio Institucional de la UAMinstname:Universidad Autónoma de MadridInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:repositorio.uam.es:10486/6743722026-06-23T12:46:27Z
dc.title.none.fl_str_mv Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
title Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
spellingShingle Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
Tejedor, Javier
Query-by-example spoken term detection
International evaluation
Search on spontaneous speech
Telecomunicaciones
title_short Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
title_full Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
title_fullStr Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
title_full_unstemmed Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
title_sort Comparison of ALBAYZIN query-by-example spoken term detection 2012 and 2014 evaluations
dc.creator.none.fl_str_mv Tejedor, Javier
Toledano, Doroteo T.
Lopez-Otero, Paula
Docío-Fernández, Laura
García-Mateo, Carmen García
author Tejedor, Javier
author_facet Tejedor, Javier
Toledano, Doroteo T.
Lopez-Otero, Paula
Docío-Fernández, Laura
García-Mateo, Carmen García
author_role author
author2 Toledano, Doroteo T.
Lopez-Otero, Paula
Docío-Fernández, Laura
García-Mateo, Carmen García
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Departamento de Tecnología Electrónica y de las Comunicaciones
Escuela Politécnica Superior
Análisis y Tratamiento de Voz y Señales Biométricas (ING EPS-002)
dc.subject.none.fl_str_mv Query-by-example spoken term detection
International evaluation
Search on spontaneous speech
Telecomunicaciones
topic Query-by-example spoken term detection
International evaluation
Search on spontaneous speech
Telecomunicaciones
description Query-by-example spoken term detection (QbE STD) aims at retrieving data from a speech repository given an acoustic query containing the term of interest as input. Nowadays, it is receiving much interest due to the large volume of multimedia information. This paper presents the systems submitted to the ALBAYZIN QbE STD 2014 evaluation held as a part of the ALBAYZIN 2014 Evaluation campaign within the context of the IberSPEECH 2014 conference. This is the second QbE STD evaluation in Spanish, which allows us to evaluate the progress in this technology for this language. The evaluation consists in retrieving the speech files that contain the input queries, indicating the start and end times where the input queries were found, along with a score value that reflects the confidence given to the detection of the query. Evaluation is conducted on a Spanish spontaneous speech database containing a set of talks from workshops, which amount to about 7 h of speech. We present the database, the evaluation metric, the systems submitted to the evaluation, the results, and compare this second evaluation with the first ALBAYZIN QbE STD evaluation held in 2012. Four different research groups took part in the evaluations held in 2012 and 2014. In 2014, new multi-word and foreign queries were added to the single-word and in-language queries used in 2012. Systems submitted to the second evaluation are hybrid systems which integrate letter transcription- and template matching-based systems. Despite the significant improvement obtained by the systems submitted to this second evaluation compared to those of the first evaluation, results still show the difficulty of this task and indicate that there is still room for improvement.
publishDate 2016
dc.date.none.fl_str_mv 2016
2016-12-01
dc.type.none.fl_str_mv research article
http://purl.org/coar/resource_type/c_2df8fbb1
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/10486/674372
https://dx.doi.org/10.1186/s13636-016-0080-2
url http://hdl.handle.net/10486/674372
https://dx.doi.org/10.1186/s13636-016-0080-2
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Springer International Publishing
publisher.none.fl_str_mv Springer International Publishing
dc.source.none.fl_str_mv reponame:Biblos-e Archivo. Repositorio Institucional de la UAM
instname:Universidad Autónoma de Madrid
instname_str Universidad Autónoma de Madrid
reponame_str Biblos-e Archivo. Repositorio Institucional de la UAM
collection Biblos-e Archivo. Repositorio Institucional de la UAM
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869422379113906176
score 15,198674