Supporting user-perceived usability benchmarking through a developed quantitative metric
Most user-centered assessment activities for ensuring usability are principally focused on performing formative evaluations, enrolling users to complete different tasks and thus obtaining indicators such as effectiveness and efficiency. However, when considering broader scenarios, such as in User Ex...
| Autores: | , |
|---|---|
| Tipo de recurso: | artículo |
| Fecha de publicación: | 2019 |
| País: | España |
| Institución: | Universidad Autónoma de Madrid |
| Repositorio: | Biblos-e Archivo. Repositorio Institucional de la UAM |
| Idioma: | inglés |
| OAI Identifier: | oai:repositorio.uam.es:10486/694885 |
| Acceso en línea: | http://hdl.handle.net/10486/694885 https://dx.doi.org/10.1016/j.ijhcs.2018.09.012 |
| Access Level: | acceso abierto |
| Palabra clave: | Reaction Cards Software metric, Software quality User Experience User perceived satisfaction User-centered development Informática |
| id |
ES_91df1f02fef0a33510ae96d4fd8e99a3 |
|---|---|
| oai_identifier_str |
oai:repositorio.uam.es:10486/694885 |
| network_acronym_str |
ES |
| network_name_str |
España |
| repository_id_str |
|
| spelling |
Supporting user-perceived usability benchmarking through a developed quantitative metricVeral, RobertoMacías Iglesias, José AntonioReaction CardsSoftware metric, Software qualityUser ExperienceUser perceived satisfactionUser-centered developmentInformáticaMost user-centered assessment activities for ensuring usability are principally focused on performing formative evaluations, enrolling users to complete different tasks and thus obtaining indicators such as effectiveness and efficiency. However, when considering broader scenarios, such as in User Experience (UX) assessments, user perceived satisfaction (or perceived usability) is even much more relevant. There are different methods for measuring user perception, however most of them are mainly qualitative and based on individual assessments, providing little specific support to carry out comparisons–i.e., benchmarking on user-perceived usability. In this paper, we propose a quantitative metric to achieve comparative evaluations of usability perception based on Reaction Cards, a popular method for obtaining the user's subjective satisfaction in UX assessments. The metric was developed through an empirical study. Additionally, it has been validated with usability experts. Besides, we provide a supporting tool based on the developed metric, featuring a framework to store historical evaluations in order to obtain charts and benchmark levels for comparing perceived usability from different artifacts such as software products, applications categories, services, mockups, prototypes and so on. Furthermore, an evaluation involving usability professionals was achieved, providing satisfactory results to answer research questions, thus demonstrating the suitability of the approach proposedThis work was partially supported by the Spanish Government[grant number TIN2014-52129-R]; and the Madrid Research Council [grant number S2013/ICE-2715]ElsevierDepartamento de Ingeniería InformáticaEscuela Politécnica Superior20192019-02-01research articlehttp://purl.org/coar/resource_type/c_2df8fbb1AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10486/694885https://dx.doi.org/10.1016/j.ijhcs.2018.09.012reponame:Biblos-e Archivo. Repositorio Institucional de la UAMinstname:Universidad Autónoma de MadridInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:repositorio.uam.es:10486/6948852026-06-23T12:46:27Z |
| dc.title.none.fl_str_mv |
Supporting user-perceived usability benchmarking through a developed quantitative metric |
| title |
Supporting user-perceived usability benchmarking through a developed quantitative metric |
| spellingShingle |
Supporting user-perceived usability benchmarking through a developed quantitative metric Veral, Roberto Reaction Cards Software metric, Software quality User Experience User perceived satisfaction User-centered development Informática |
| title_short |
Supporting user-perceived usability benchmarking through a developed quantitative metric |
| title_full |
Supporting user-perceived usability benchmarking through a developed quantitative metric |
| title_fullStr |
Supporting user-perceived usability benchmarking through a developed quantitative metric |
| title_full_unstemmed |
Supporting user-perceived usability benchmarking through a developed quantitative metric |
| title_sort |
Supporting user-perceived usability benchmarking through a developed quantitative metric |
| dc.creator.none.fl_str_mv |
Veral, Roberto Macías Iglesias, José Antonio |
| author |
Veral, Roberto |
| author_facet |
Veral, Roberto Macías Iglesias, José Antonio |
| author_role |
author |
| author2 |
Macías Iglesias, José Antonio |
| author2_role |
author |
| dc.contributor.none.fl_str_mv |
Departamento de Ingeniería Informática Escuela Politécnica Superior |
| dc.subject.none.fl_str_mv |
Reaction Cards Software metric, Software quality User Experience User perceived satisfaction User-centered development Informática |
| topic |
Reaction Cards Software metric, Software quality User Experience User perceived satisfaction User-centered development Informática |
| description |
Most user-centered assessment activities for ensuring usability are principally focused on performing formative evaluations, enrolling users to complete different tasks and thus obtaining indicators such as effectiveness and efficiency. However, when considering broader scenarios, such as in User Experience (UX) assessments, user perceived satisfaction (or perceived usability) is even much more relevant. There are different methods for measuring user perception, however most of them are mainly qualitative and based on individual assessments, providing little specific support to carry out comparisons–i.e., benchmarking on user-perceived usability. In this paper, we propose a quantitative metric to achieve comparative evaluations of usability perception based on Reaction Cards, a popular method for obtaining the user's subjective satisfaction in UX assessments. The metric was developed through an empirical study. Additionally, it has been validated with usability experts. Besides, we provide a supporting tool based on the developed metric, featuring a framework to store historical evaluations in order to obtain charts and benchmark levels for comparing perceived usability from different artifacts such as software products, applications categories, services, mockups, prototypes and so on. Furthermore, an evaluation involving usability professionals was achieved, providing satisfactory results to answer research questions, thus demonstrating the suitability of the approach proposed |
| publishDate |
2019 |
| dc.date.none.fl_str_mv |
2019 2019-02-01 |
| dc.type.none.fl_str_mv |
research article http://purl.org/coar/resource_type/c_2df8fbb1 AM http://purl.org/coar/version/c_ab4af688f83e57aa |
| dc.type.openaire.fl_str_mv |
info:eu-repo/semantics/article |
| format |
article |
| dc.identifier.none.fl_str_mv |
http://hdl.handle.net/10486/694885 https://dx.doi.org/10.1016/j.ijhcs.2018.09.012 |
| url |
http://hdl.handle.net/10486/694885 https://dx.doi.org/10.1016/j.ijhcs.2018.09.012 |
| dc.language.none.fl_str_mv |
Inglés eng |
| language_invalid_str_mv |
Inglés |
| language |
eng |
| dc.rights.none.fl_str_mv |
open access http://purl.org/coar/access_right/c_abf2 |
| dc.rights.openaire.fl_str_mv |
info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
open access http://purl.org/coar/access_right/c_abf2 |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
application/pdf |
| dc.publisher.none.fl_str_mv |
Elsevier |
| publisher.none.fl_str_mv |
Elsevier |
| dc.source.none.fl_str_mv |
reponame:Biblos-e Archivo. Repositorio Institucional de la UAM instname:Universidad Autónoma de Madrid |
| instname_str |
Universidad Autónoma de Madrid |
| reponame_str |
Biblos-e Archivo. Repositorio Institucional de la UAM |
| collection |
Biblos-e Archivo. Repositorio Institucional de la UAM |
| repository.name.fl_str_mv |
|
| repository.mail.fl_str_mv |
|
| _version_ |
1869413425187127296 |
| score |
15.301629 |