Please use this identifier to cite or link to this item: http://hdl.handle.net/10125/44706

Enhancing multimodal literacy using augmented reality

File Size Format  
24 1 10125-44706.pdf 513.26 kB Adobe PDF View/Open

Item Summary

Title:Enhancing multimodal literacy using augmented reality
Authors:Yeh, Hui-Chin
Tseng, Sheng-Shiang
Contributors:Greg Kessler (editor)
Keywords:Augmented Reality
EFL Students
Multimodal Literacy
Multimodal Media
Date Issued:01 Feb 2020
Publisher:University of Hawaii National Foreign Language Resource Center
Center for Language & Technology
(co-sponsored by Center for Open Educational Resources and Language Learning, University of Texas at Austin)
Citation:Yeh, H.-C. & Tseng, S.-S., (2020). Enhancing Multimodal Literacy using Augmented Reality. Language Learning & Technology, 24 (1), 27–37. https://doi.org/10125/44706
Abstract:Augmented reality (AR) technology has been used to successfully improve traditional literacy. However, there has been a paradigm shift in literacy education from traditional literacy to multimodal literacy. Little research has explored how students establish effective multimodal meaning-making using AR technology. This study is an investigation of how EFL college students use different multimodal modes to communicate with others using AR technology. Participants were 52 English as a Foreign Language (EFL) students. The collected data included (a) pre-and post-administrations of a multimodal literacy survey, (b) students’ use of different modes to introduce tourist spots within the location-based AR app, and (c) students’ reflection essays. The results demonstrated that the modes which students used were categorized into visual and auditory forms. The visual mode was composed of visual effects, images, and animations, whose functions were to focus viewers’ attention on what is important, provide concrete ideas, process complex information, and promote engagement. The auditory mode consisted of background music and sound effects, which were used to arouse emotional feelings and enhance immersive experiences. The results also revealed that creating the content in a location-based AR app with the combination of different multimodal media significantly improved students’ multimodal literacy.
URI:http://hdl.handle.net/10125/44706
ISSN:1094-3501
DOI:10125/44706
Journal:Language Learning & Technology
Volume:24
Issue/Number:1
Appears in Collections: Volume 24 Number 1, February 2020


Please email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.

Items in ScholarSpace are protected by copyright, with all rights reserved, unless otherwise indicated.