Young learners' processing of multimodal input and its impact on reading comprehension: An eye-tracking study

Theories of multimedia learning suggest that learners can form better referential connections when verbal and visual materials are presented simultaneously. Furthermore, the addition of auditory input in reading-while-listening conditions benefits performance on a variety of linguistic tasks. Howeve...

ver descrição completa

Detalhes bibliográficos
Autores: Pellicer-Sánchez, Ana, Tragant Mestres, Elsa, Conkiln, Kathy, Rodgers, Michael, Serrano Serrano, Raquel, Llanes Baró, Àngels
Formato: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2020
País:España
Recursos:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:2445/171064
Acesso em linha:https://hdl.handle.net/2445/171064
Access Level:acceso abierto
Palavra-chave:Ensenyament de llengües
Moviments oculars
Adquisició d'una segona llengua
Language teaching
Eye movements
Second language acquisition
Descrição
Resumo:Theories of multimedia learning suggest that learners can form better referential connections when verbal and visual materials are presented simultaneously. Furthermore, the addition of auditory input in reading-while-listening conditions benefits performance on a variety of linguistic tasks. However, little research has been conducted on the processing of multimedia input (written text and images) with and without accompanying audio. Eye movements were recorded during young L2 learners' (N = 30) processing of a multimedia story text in reading-only and reading-while-listening conditions in order to investigate looking patterns and their relationship with comprehension using a multiple-choice comprehension test. Analysis of the eye movement data showed that the presence of audio in reading-while-listening conditions allowed learners to look at the image more often. Processing time on text was related to lower levels of comprehension, whereas processing time on images was positively related to comprehension.