Dialogue systems for language learning: A meta-analysis

Simple item page
dc.contributor.authorBibauw, Serge
dc.contributor.authorVan den Noortgate, Wim
dc.contributor.authorFrançois, Thomas
dc.contributor.authorDesmet, Piet
dc.date.accessioned2022-08-12T19:01:25Z
dc.date.available2022-08-12T19:01:25Z
dc.date.copyright2022
dc.date.issued2022-08-15
dc.description.abstractThe present study offers a meta-analysis of effectiveness studies on dialogue-based CALL, systems affording a learner practice in a foreign language (L2) by interacting with a conversational agent (“bot”). Through a systematic inclusion and exclusion process, we identified 17 relevant meta-analyzable studies. We made use of Morris and DeShon’s (2002) formulas to compute comparable effect sizes across designs, including k = 100 individual effect sizes, which were analyzed through a multilevel random-effects model. Results confirm that dialogue-based CALL practice had a significant medium effect size on L2 proficiency development (d = 0.58). We performed extensive moderator analyses to explore the relative effectiveness on several learning outcomes of different types and features of dialogue-based CALL (type of interaction, modality, constraints, feedback, agent embodiment, gamification). Our study confirms the effectiveness of form-focused and goal-oriented systems, system-guided interactions, corrective feedback provision, and gamification features. Effects for lower proficiency learners, and on vocabulary, morphosyntax, holistic proficiency, and accuracy are established. Finally, we discuss expected evolutions in dialogue-based CALL and the language learning opportunities it offers.
dc.formatArticle
dc.format.extent24
dc.identifier.citationBibauw, S., Van den Noortgate, W., François, F., & Desmet, P. (2022). Dialogue systems for language learning: A meta-analysis. Language Learning & Technology, 26(1), 1–24. https://hdl.handle.net/10125/73488
dc.identifier.issn1094-3501
dc.identifier.urihttps://hdl.handle.net/10125/73488
dc.languageeng
dc.publisherUniversity of Hawaii National Foreign Language Resource Center
dc.publisherCenter for Language & Technology
dc.publisher(co-sponsored by Center for Open Educational Resources and Language Learning, University of Texas at Austin)
dc.rights.licenseCreative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectMeta-analysis, Dialogue System, Chatbot, Dialogue-based CALL
dc.titleDialogue systems for language learning: A meta-analysis
dc.typeArticle
dcterms.typeText
prism.endingpage24
prism.number1
prism.publicationnameLanguage Learning & Technology
prism.startingpage1
prism.volume26

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
26_01_10125-73488.pdf
Size:
806.25 KB
Format:
Adobe Portable Document Format
Download

Collections

Volume 26 Number 1, 2022