The impact of reading fluency level on interactive information retrieval

Given an information need and the corresponding set of documents retrieved, it is known that user assessments for such documents differ from one user to another. One frequent reason that is put forward is the discordance between text complexity and user reading fluency. We explore this relationship...

ver descrição completa

Detalhes bibliográficos
Autores: Martínez-Santiago, Fernando, Torres-García, Alejandro A., Montejo-Ráez, Arturo, Gutiérrez-Palma, Nicolás
Formato: artículo
Estado:Versión publicada
Fecha de publicación:2021
País:España
Recursos:Universidad de Jaén
Repositorio:RUJA. Repositorio Institucional de la Producción Científica de la Universidad de Jaén
OAI Identifier:oai:ruja.ujaen.es:10953/1989
Acesso em linha:https://link.springer.com/article/10.1007/s10209-021-00826-y
https://hdl.handle.net/10953/1989
Access Level:acceso abierto
Palavra-chave:Electroencephalography
Interactive information retrieval
Neuro-information retrieval
Reading comprehension
Reading fluency
User assessments
Descrição
Resumo:Given an information need and the corresponding set of documents retrieved, it is known that user assessments for such documents differ from one user to another. One frequent reason that is put forward is the discordance between text complexity and user reading fluency. We explore this relationship from three different dimensions: quantitative features, subjective-assessed difficulty, and reader/text factors. In order to evaluate quantitative features, we wondered whether it is possible to find differences between documents that are evaluated by the user and those that are ignored according to the complexity of the document. Secondly, a task related to the evaluation of the relevance of short texts is proposed. For this end, users evaluated the relevance of these short texts by answering 20 queries. Documents complexity and relevance assessments were done previously by some human experts. Then, the relationship between participants assessments, experts assessments and document complexity is studied. Finally, a third experimentation was performed under the prism of neuro-Information Retrieval: while the participants were monitored with an electroencephalogram (EEG) headset, we tried to find a correlation among EEG signal, text difficulty and the level of comprehension of texts being read during the EEG recording. In light of the results obtained, we found some weak evidence showing that users responded to queries according to text complexity and user’s reading fluency. For the second and third group of experiments, we administered a sub-test from the Woodcock Reading Mastery Test to ensure that participants had a roughly average reading fluency. Nevertheless, we think that additional variables should be studied in the future in order to achieve a sound explanation of the interaction between text complexity and user profile.