M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study

Treball de fi de màster en Lingüística Teòrica i Aplicada. Directors: Prof. Pilar Prieto, Dr. Patrick Louis Rohrer

Detalles Bibliográficos
Autor: Tütüncübasi, Ulya
Tipo de recurso: tesis de maestría
Fecha de publicación:2023
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10230/58008
Acceso en línea:http://hdl.handle.net/10230/58008
Access Level:acceso abierto
Palabra clave:MultiModal MultiDimensional (M3D) Labeling System
Training Program
Evaluation
Usability
Acceptability
Feasibility
Efectiveness System Usability Scale
Reliability
id ES_b56b1d63495d5ff79d4d8e89ac0f96d2
oai_identifier_str oai:recercat.cat:10230/58008
network_acronym_str ES
network_name_str España
repository_id_str
spelling M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods studyTütüncübasi, UlyaMultiModal MultiDimensional (M3D) Labeling SystemTraining ProgramEvaluationUsabilityAcceptabilityFeasibilityEfectiveness System Usability ScaleReliabilityTreball de fi de màster en Lingüística Teòrica i Aplicada. Directors: Prof. Pilar Prieto, Dr. Patrick Louis RohrerVarious gesture labeling systems aim to establish guidelines on how to systematically assess and annotate gestures. However, there is a lack of resources that provide guidance and training on the proper use of the labeling systems. To address this gap, the present study aims to (a) collaboratively develop an online training program for the M3D gesture labeling system (Rohrer et al., 2023) using the ADDIE paradigm (Branch, 2009) and (b) to evaluate its usability, acceptability, feasibility and effectiveness. Developing a training program for gesture annotation is essential for advancing the field of gesture studies, equally important is conducting an evaluative process to ensure the program’s high quality nature. The evaluation will employ a mixed-methods approach, using the System Usability Scale (SUS) (Brooke, 2013) for usability assessment, an ADDIE questionnaire and an in-house questionnaire for acceptability, a starting-and-completion ratio for feasibility and an inter-annotator reliability assessment for effectiveness. Thirteen participants took part in the evaluation. The results show that the program has achieved a remarkable degree of usability, especially in terms of ease of use, complexity and integration of functionalities, reaching an overall score of “Excellent”, with individual scores ranging from 70-97.7 on a 1-100 scale. In terms of acceptability, it was found to enhance the participants’ skills (M= 4.90, SD= 0.316), learning material was perceived as supporting the learning process (M= 4.90, SD= 0.316) and value was added by visual material (M= 5.00, SD= 0.00). The starting-and-completion ratio stands at 13:10. Effectiveness shows high inter-annotator reliability results for Gesture Phases and Gesture Referentiality. Overall, the projects’ results represent a major advancement for gesture studies, offering for the first time an online gesture annotation training program which moves the field towards a more standardized approach to assessing gesture in multimodal corpora.202320232023info:eu-repo/semantics/masterThesisapplication/pdfapplication/pdfhttp://hdl.handle.net/10230/58008reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésLlicència CC Reconeixement-NoComercial-SenseObraDerivada 4.0 Internacional (CC BY-NC-ND 4.0)https://creativecommons.org/licenses/by-nc-nd/4.0/deed.cainfo:eu-repo/semantics/openAccessoai:recercat.cat:10230/580082026-05-29T05:05:01Z
dc.title.none.fl_str_mv M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study
title M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study
spellingShingle M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study
Tütüncübasi, Ulya
MultiModal MultiDimensional (M3D) Labeling System
Training Program
Evaluation
Usability
Acceptability
Feasibility
Efectiveness System Usability Scale
Reliability
title_short M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study
title_full M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study
title_fullStr M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study
title_full_unstemmed M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study
title_sort M3D Gesture Labeling: developing and evaluating a training program for gesture annotation - a mixed-methods study
dc.creator.none.fl_str_mv Tütüncübasi, Ulya
author Tütüncübasi, Ulya
author_facet Tütüncübasi, Ulya
author_role author
dc.subject.none.fl_str_mv MultiModal MultiDimensional (M3D) Labeling System
Training Program
Evaluation
Usability
Acceptability
Feasibility
Efectiveness System Usability Scale
Reliability
topic MultiModal MultiDimensional (M3D) Labeling System
Training Program
Evaluation
Usability
Acceptability
Feasibility
Efectiveness System Usability Scale
Reliability
description Treball de fi de màster en Lingüística Teòrica i Aplicada. Directors: Prof. Pilar Prieto, Dr. Patrick Louis Rohrer
publishDate 2023
dc.date.none.fl_str_mv 2023
2023
2023
dc.type.none.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/58008
url http://hdl.handle.net/10230/58008
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.rights.none.fl_str_mv Llicència CC Reconeixement-NoComercial-SenseObraDerivada 4.0 Internacional (CC BY-NC-ND 4.0)
https://creativecommons.org/licenses/by-nc-nd/4.0/deed.ca
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Llicència CC Reconeixement-NoComercial-SenseObraDerivada 4.0 Internacional (CC BY-NC-ND 4.0)
https://creativecommons.org/licenses/by-nc-nd/4.0/deed.ca
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.source.none.fl_str_mv reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869417361518362624
score 15,812455

Similares en LA Referencia