Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework

Forced-choice (FC) questionnaires have gained increasing attention as a strategy to reduce social desirability in self-reports, supported by advancements in confirmatory models that address the ipsativity of FC test scores. However, these models assume a known dimensionality and structure, which can...

ver descrição completa

Detalhes bibliográficos
Autores: Graña, Diego F., Schames Kreitchmann, Rodrigo, Sorrel, Miguel A., Garrido, Luis E., Abad, Francisco J.
Formato: artículo
Fecha de publicación:2025
País:España
Recursos:Universidad Nacional de Educación a Distancia
Repositorio:e-spacio (DSpace). Repositorio Institucional de la UNED
Idioma:inglés
OAI Identifier:oai:dnet:e-spacio(ds_::3be1de398dacdc8e9a5cb66c008c197c
Acesso em linha:https://hdl.handle.net/20.500.14468/32546
Access Level:acceso abierto
Palavra-chave:6106 Psicología experimental
forced-choice
validity
dimensionality assessment
factor analysis
id ES_ab94429a8f790a819b408f7fdcb9ee7b
oai_identifier_str oai:dnet:e-spacio(ds_::3be1de398dacdc8e9a5cb66c008c197c
network_acronym_str ES
network_name_str España
repository_id_str
spelling Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory FrameworkGraña, Diego F.Schames Kreitchmann, RodrigoSorrel, Miguel A.Garrido, Luis E.Abad, Francisco J.6106 Psicología experimentalforced-choicevaliditydimensionality assessmentfactor analysisForced-choice (FC) questionnaires have gained increasing attention as a strategy to reduce social desirability in self-reports, supported by advancements in confirmatory models that address the ipsativity of FC test scores. However, these models assume a known dimensionality and structure, which can be overly restrictive or fail to fit the data adequately. Consequently, exploratory models can be required, with accurate dimensionality assessment as a critical first step. FC questionnaires also pose unique challenges for dimensionality assessment, due to their inherently complex multidimensional structures. Despite this, no prior studies have systematically evaluated dimensionality assessment methods for FC data. To fill this gap, the present study examines five commonly used methods: the Kaiser Criterion, Empirical Kaiser Criterion, Parallel Analysis (PA), Hull Method, and Exploratory Graph Analysis. A Monte Carlo simulation study was conducted, manipulating key design features of FC questionnaires, such as the number of dimensions, items per dimension, response formats (e.g., binary vs. graded), and block composition (e.g., inclusion of heteropolar and unidimensional blocks), as well as factor loadings, inter-factor correlations, and sample size. Results showed that the Maximal Kaiser Criterion and PA methods outperformed the others, achieving higher accuracy and lower bias. Performance improved particularly when heteropolar or unidimensional blocks were included or when the questionnaire length increased. These findings emphasize the importance of thoughtful FC test design and provide practical recommendations for improving dimensionality assessment in this format.SAGE PublicationsAgencia Estatal de Investigacióne-Spacio UNED20262026-05-0820252025-09-0820252025-09-08journal articlehttp://purl.org/coar/resource_type/c_6501info:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/20.500.14468/32546reponame:e-spacio (DSpace). Repositorio Institucional de la UNEDinstname:Universidad Nacional de Educación a DistanciaInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by-nc-nd/4.0/deed.esoai:dnet:e-spacio(ds_::3be1de398dacdc8e9a5cb66c008c197c2026-06-15T06:41:27Z
dc.title.none.fl_str_mv Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework
title Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework
spellingShingle Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework
Graña, Diego F.
6106 Psicología experimental
forced-choice
validity
dimensionality assessment
factor analysis
title_short Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework
title_full Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework
title_fullStr Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework
title_full_unstemmed Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework
title_sort Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework
dc.creator.none.fl_str_mv Graña, Diego F.
Schames Kreitchmann, Rodrigo
Sorrel, Miguel A.
Garrido, Luis E.
Abad, Francisco J.
author Graña, Diego F.
author_facet Graña, Diego F.
Schames Kreitchmann, Rodrigo
Sorrel, Miguel A.
Garrido, Luis E.
Abad, Francisco J.
author_role author
author2 Schames Kreitchmann, Rodrigo
Sorrel, Miguel A.
Garrido, Luis E.
Abad, Francisco J.
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Agencia Estatal de Investigación
e-Spacio UNED
dc.subject.none.fl_str_mv 6106 Psicología experimental
forced-choice
validity
dimensionality assessment
factor analysis
topic 6106 Psicología experimental
forced-choice
validity
dimensionality assessment
factor analysis
description Forced-choice (FC) questionnaires have gained increasing attention as a strategy to reduce social desirability in self-reports, supported by advancements in confirmatory models that address the ipsativity of FC test scores. However, these models assume a known dimensionality and structure, which can be overly restrictive or fail to fit the data adequately. Consequently, exploratory models can be required, with accurate dimensionality assessment as a critical first step. FC questionnaires also pose unique challenges for dimensionality assessment, due to their inherently complex multidimensional structures. Despite this, no prior studies have systematically evaluated dimensionality assessment methods for FC data. To fill this gap, the present study examines five commonly used methods: the Kaiser Criterion, Empirical Kaiser Criterion, Parallel Analysis (PA), Hull Method, and Exploratory Graph Analysis. A Monte Carlo simulation study was conducted, manipulating key design features of FC questionnaires, such as the number of dimensions, items per dimension, response formats (e.g., binary vs. graded), and block composition (e.g., inclusion of heteropolar and unidimensional blocks), as well as factor loadings, inter-factor correlations, and sample size. Results showed that the Maximal Kaiser Criterion and PA methods outperformed the others, achieving higher accuracy and lower bias. Performance improved particularly when heteropolar or unidimensional blocks were included or when the questionnaire length increased. These findings emphasize the importance of thoughtful FC test design and provide practical recommendations for improving dimensionality assessment in this format.
publishDate 2025
dc.date.none.fl_str_mv 2025
2025-09-08
2025
2025-09-08
2026
2026-05-08
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/20.500.14468/32546
url https://hdl.handle.net/20.500.14468/32546
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
info:eu-repo/semantics/openAccess
http://creativecommons.org/licenses/by-nc-nd/4.0/deed.es
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
http://creativecommons.org/licenses/by-nc-nd/4.0/deed.es
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv SAGE Publications
publisher.none.fl_str_mv SAGE Publications
dc.source.none.fl_str_mv reponame:e-spacio (DSpace). Repositorio Institucional de la UNED
instname:Universidad Nacional de Educación a Distancia
instname_str Universidad Nacional de Educación a Distancia
reponame_str e-spacio (DSpace). Repositorio Institucional de la UNED
collection e-spacio (DSpace). Repositorio Institucional de la UNED
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869416281484034048
score 15,198674

Registos relacionados