Multimodal output combination for transcribing historical handwritten documents

Transcription of digitalised historical documents is an interesting task in the document analysis area. This transcription can be achieved by using Handwritten Text Recognition (HTR) on digitalised pages or by using Automatic Speech Recognition (ASR) on the dictation of contents. Moreover, another o...

ver descrição completa

Detalhes bibliográficos
Autores: GRANELL, EMILIO|||0000-0001-5782-7568, Martínez-Hinarejos, Carlos-D.|||0000-0002-6139-2891
Formato: capítulo de livro
Fecha de publicación:2015
País:España
Recursos:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/65730
Acesso em linha:https://riunet.upv.es/handle/10251/65730
Access Level:acceso abierto
Palavra-chave:Document analysis and transcription
Handwritten text recognition
Automatic speech recognition
Confusion Networks combination
Recognition outputs combination
LENGUAJES Y SISTEMAS INFORMATICOS
id ES_49ad365a540d05bfbf452b9d49e56c00
oai_identifier_str oai:riunet.upv.es:10251/65730
network_acronym_str ES
network_name_str España
repository_id_str
spelling Multimodal output combination for transcribing historical handwritten documentsGRANELL, EMILIO|||0000-0001-5782-7568Martínez-Hinarejos, Carlos-D.|||0000-0002-6139-2891Document analysis and transcriptionHandwritten text recognitionAutomatic speech recognitionConfusion Networks combinationRecognition outputs combinationLENGUAJES Y SISTEMAS INFORMATICOSTranscription of digitalised historical documents is an interesting task in the document analysis area. This transcription can be achieved by using Handwritten Text Recognition (HTR) on digitalised pages or by using Automatic Speech Recognition (ASR) on the dictation of contents. Moreover, another option is using both systems in a multimodal combination to obtain a draft transcription, given that combining the outputs of different recognition systems will generally improve the recognition accuracy. In this work, we present a new combination method based on Confusion Network. We check its effectiveness for transcribing a Spanish historical book. Results on both unimodal combination with different optical (for HTR) and acoustic (for ASR) models, and multimodal combination, show a relative reduction of Word and Character Error Rate of 14.3% and 16.6%, respectively, over the HTR baseline.Work partially supported by European Union -7th FP, under grant 600707 (tranScriptorium), and by the Spanish MEC under projects STraDA (TIN2012-37475-C02-01), Active2Trans (TIN2012-31723), and SmartWays (RTC-2014-1466-4).SpringerDepartamento de Sistemas Informáticos y ComputaciónEscuela Politécnica Superior de GandiaEscuela Técnica Superior de Ingeniería InformáticaCentro de Investigación Pattern Recognition and Human Language TechnologyEuropean CommissionMinisterio de Ciencia e InnovaciónRepositorio Institucional de la Universitat Politècnica de València Riunet20152015-08-25book parthttp://purl.org/coar/resource_type/c_3248VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/bookPartapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/65730reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengEuropean Commission https://doi.org/10.13039/501100000780 FP7 600707 tranScriptoriumMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2012-37475-C02-01 SEARCH IN TRANSCRIBED MANUSCRIPTS AND DOCUMENT AUGMENTATIONMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2012-31723 INTERACCION ACTIVA PARA TRANSCRIPCION DE HABLA Y TRADUCCIONMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 RTC-2014-1466-4Q4618002BC.VALENCIANA SMART WAYS - DESARROLLO DE UNA PLATAFORMA TECNOLÓGICA ORIENTADA A LA EFICIENCIA DE LOS RECURSOS EN EL CAMPO DE LAS NUEVAS TECNOLOGÍAS INTERNET OF THINGSopen accesshttp://purl.org/coar/access_right/c_abf2Reserva de todos los derechoshttp://rightsstatements.org/vocab/InC/1.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/657302026-06-13T07:49:27Z
dc.title.none.fl_str_mv Multimodal output combination for transcribing historical handwritten documents
title Multimodal output combination for transcribing historical handwritten documents
spellingShingle Multimodal output combination for transcribing historical handwritten documents
GRANELL, EMILIO|||0000-0001-5782-7568
Document analysis and transcription
Handwritten text recognition
Automatic speech recognition
Confusion Networks combination
Recognition outputs combination
LENGUAJES Y SISTEMAS INFORMATICOS
title_short Multimodal output combination for transcribing historical handwritten documents
title_full Multimodal output combination for transcribing historical handwritten documents
title_fullStr Multimodal output combination for transcribing historical handwritten documents
title_full_unstemmed Multimodal output combination for transcribing historical handwritten documents
title_sort Multimodal output combination for transcribing historical handwritten documents
dc.creator.none.fl_str_mv GRANELL, EMILIO|||0000-0001-5782-7568
Martínez-Hinarejos, Carlos-D.|||0000-0002-6139-2891
author GRANELL, EMILIO|||0000-0001-5782-7568
author_facet GRANELL, EMILIO|||0000-0001-5782-7568
Martínez-Hinarejos, Carlos-D.|||0000-0002-6139-2891
author_role author
author2 Martínez-Hinarejos, Carlos-D.|||0000-0002-6139-2891
author2_role author
dc.contributor.none.fl_str_mv Departamento de Sistemas Informáticos y Computación
Escuela Politécnica Superior de Gandia
Escuela Técnica Superior de Ingeniería Informática
Centro de Investigación Pattern Recognition and Human Language Technology
European Commission
Ministerio de Ciencia e Innovación
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Document analysis and transcription
Handwritten text recognition
Automatic speech recognition
Confusion Networks combination
Recognition outputs combination
LENGUAJES Y SISTEMAS INFORMATICOS
topic Document analysis and transcription
Handwritten text recognition
Automatic speech recognition
Confusion Networks combination
Recognition outputs combination
LENGUAJES Y SISTEMAS INFORMATICOS
description Transcription of digitalised historical documents is an interesting task in the document analysis area. This transcription can be achieved by using Handwritten Text Recognition (HTR) on digitalised pages or by using Automatic Speech Recognition (ASR) on the dictation of contents. Moreover, another option is using both systems in a multimodal combination to obtain a draft transcription, given that combining the outputs of different recognition systems will generally improve the recognition accuracy. In this work, we present a new combination method based on Confusion Network. We check its effectiveness for transcribing a Spanish historical book. Results on both unimodal combination with different optical (for HTR) and acoustic (for ASR) models, and multimodal combination, show a relative reduction of Word and Character Error Rate of 14.3% and 16.6%, respectively, over the HTR baseline.
publishDate 2015
dc.date.none.fl_str_mv 2015
2015-08-25
dc.type.none.fl_str_mv book part
http://purl.org/coar/resource_type/c_3248
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/bookPart
format bookPart
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/65730
url https://riunet.upv.es/handle/10251/65730
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv European Commission https://doi.org/10.13039/501100000780 FP7 600707 tranScriptorium
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2012-37475-C02-01 SEARCH IN TRANSCRIBED MANUSCRIPTS AND DOCUMENT AUGMENTATION
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2012-31723 INTERACCION ACTIVA PARA TRANSCRIPCION DE HABLA Y TRADUCCION
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 RTC-2014-1466-4Q4618002BC.VALENCIANA SMART WAYS - DESARROLLO DE UNA PLATAFORMA TECNOLÓGICA ORIENTADA A LA EFICIENCIA DE LOS RECURSOS EN EL CAMPO DE LAS NUEVAS TECNOLOGÍAS INTERNET OF THINGS
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Springer
publisher.none.fl_str_mv Springer
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869407439059681280
score 15,198674

Registos relacionados