Supporting user-perceived usability benchmarking through a developed quantitative metric

Most user-centered assessment activities for ensuring usability are principally focused on performing formative evaluations, enrolling users to complete different tasks and thus obtaining indicators such as effectiveness and efficiency. However, when considering broader scenarios, such as in User Ex...

Descripción completa

Detalles Bibliográficos
Autores: Veral, Roberto, Macías Iglesias, José Antonio
Tipo de recurso: artículo
Fecha de publicación:2019
País:España
Institución:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/694885
Acceso en línea:http://hdl.handle.net/10486/694885
https://dx.doi.org/10.1016/j.ijhcs.2018.09.012
Access Level:acceso abierto
Palabra clave:Reaction Cards
Software metric, Software quality
User Experience
User perceived satisfaction
User-centered development
Informática
id ES_91df1f02fef0a33510ae96d4fd8e99a3
oai_identifier_str oai:repositorio.uam.es:10486/694885
network_acronym_str ES
network_name_str España
repository_id_str
spelling Supporting user-perceived usability benchmarking through a developed quantitative metricVeral, RobertoMacías Iglesias, José AntonioReaction CardsSoftware metric, Software qualityUser ExperienceUser perceived satisfactionUser-centered developmentInformáticaMost user-centered assessment activities for ensuring usability are principally focused on performing formative evaluations, enrolling users to complete different tasks and thus obtaining indicators such as effectiveness and efficiency. However, when considering broader scenarios, such as in User Experience (UX) assessments, user perceived satisfaction (or perceived usability) is even much more relevant. There are different methods for measuring user perception, however most of them are mainly qualitative and based on individual assessments, providing little specific support to carry out comparisons–i.e., benchmarking on user-perceived usability. In this paper, we propose a quantitative metric to achieve comparative evaluations of usability perception based on Reaction Cards, a popular method for obtaining the user's subjective satisfaction in UX assessments. The metric was developed through an empirical study. Additionally, it has been validated with usability experts. Besides, we provide a supporting tool based on the developed metric, featuring a framework to store historical evaluations in order to obtain charts and benchmark levels for comparing perceived usability from different artifacts such as software products, applications categories, services, mockups, prototypes and so on. Furthermore, an evaluation involving usability professionals was achieved, providing satisfactory results to answer research questions, thus demonstrating the suitability of the approach proposedThis work was partially supported by the Spanish Government[grant number TIN2014-52129-R]; and the Madrid Research Council [grant number S2013/ICE-2715]ElsevierDepartamento de Ingeniería InformáticaEscuela Politécnica Superior20192019-02-01research articlehttp://purl.org/coar/resource_type/c_2df8fbb1AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10486/694885https://dx.doi.org/10.1016/j.ijhcs.2018.09.012reponame:Biblos-e Archivo. Repositorio Institucional de la UAMinstname:Universidad Autónoma de MadridInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:repositorio.uam.es:10486/6948852026-06-23T12:46:27Z
dc.title.none.fl_str_mv Supporting user-perceived usability benchmarking through a developed quantitative metric
title Supporting user-perceived usability benchmarking through a developed quantitative metric
spellingShingle Supporting user-perceived usability benchmarking through a developed quantitative metric
Veral, Roberto
Reaction Cards
Software metric, Software quality
User Experience
User perceived satisfaction
User-centered development
Informática
title_short Supporting user-perceived usability benchmarking through a developed quantitative metric
title_full Supporting user-perceived usability benchmarking through a developed quantitative metric
title_fullStr Supporting user-perceived usability benchmarking through a developed quantitative metric
title_full_unstemmed Supporting user-perceived usability benchmarking through a developed quantitative metric
title_sort Supporting user-perceived usability benchmarking through a developed quantitative metric
dc.creator.none.fl_str_mv Veral, Roberto
Macías Iglesias, José Antonio
author Veral, Roberto
author_facet Veral, Roberto
Macías Iglesias, José Antonio
author_role author
author2 Macías Iglesias, José Antonio
author2_role author
dc.contributor.none.fl_str_mv Departamento de Ingeniería Informática
Escuela Politécnica Superior
dc.subject.none.fl_str_mv Reaction Cards
Software metric, Software quality
User Experience
User perceived satisfaction
User-centered development
Informática
topic Reaction Cards
Software metric, Software quality
User Experience
User perceived satisfaction
User-centered development
Informática
description Most user-centered assessment activities for ensuring usability are principally focused on performing formative evaluations, enrolling users to complete different tasks and thus obtaining indicators such as effectiveness and efficiency. However, when considering broader scenarios, such as in User Experience (UX) assessments, user perceived satisfaction (or perceived usability) is even much more relevant. There are different methods for measuring user perception, however most of them are mainly qualitative and based on individual assessments, providing little specific support to carry out comparisons–i.e., benchmarking on user-perceived usability. In this paper, we propose a quantitative metric to achieve comparative evaluations of usability perception based on Reaction Cards, a popular method for obtaining the user's subjective satisfaction in UX assessments. The metric was developed through an empirical study. Additionally, it has been validated with usability experts. Besides, we provide a supporting tool based on the developed metric, featuring a framework to store historical evaluations in order to obtain charts and benchmark levels for comparing perceived usability from different artifacts such as software products, applications categories, services, mockups, prototypes and so on. Furthermore, an evaluation involving usability professionals was achieved, providing satisfactory results to answer research questions, thus demonstrating the suitability of the approach proposed
publishDate 2019
dc.date.none.fl_str_mv 2019
2019-02-01
dc.type.none.fl_str_mv research article
http://purl.org/coar/resource_type/c_2df8fbb1
AM
http://purl.org/coar/version/c_ab4af688f83e57aa
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv http://hdl.handle.net/10486/694885
https://dx.doi.org/10.1016/j.ijhcs.2018.09.012
url http://hdl.handle.net/10486/694885
https://dx.doi.org/10.1016/j.ijhcs.2018.09.012
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:Biblos-e Archivo. Repositorio Institucional de la UAM
instname:Universidad Autónoma de Madrid
instname_str Universidad Autónoma de Madrid
reponame_str Biblos-e Archivo. Repositorio Institucional de la UAM
collection Biblos-e Archivo. Repositorio Institucional de la UAM
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869413425187127296
score 15.301629