dynamic-assessment
Filtering by topic dynamic-assessment(2)Clear all filters
- PaperRELC Journal9 Jul 2026
Using dynamic feedback from customized LLM-powered chatbots in EFL argumentative writing
Yi Chen
This teaching practice implemented two custom-built LLM-powered chatbots to provide interactive dynamic feedback in an undergraduate English for Academic Purposes course. The intervention supported EFL students' argumentative writing through an iterative multi-draft process focusing on argumentation quality and linguistic accuracy. The article argues that such chatbots can deliver instruction-aligned feedback at scale while instructors remain essential to address limitations.
Original abstract
With the growing use of large language models (LLMs) in English as a foreign language (EFL) teaching, balancing teacher control over instructional focus with students’ autonomy in using artificial intelligence chatbots while ensuring more dynamic interaction have become key pedagogical concerns. This article reports on an innovative teaching practice implemented in a foundation undergraduate English for Academic Purposes course, which featured interactive feedback, including chatbot-mediated dynamic assessment, delivered through two custom-built LLM-powered chatbots. The intervention aimed to support students’ argumentative writing with specific reference to argumentation quality and linguistic accuracy, through an iterative multi-draft process. Drawing on observation and critical reflection on this practicum, the article argues that customized LLM-powered chatbots can provide dynamic, instruction-aligned feedback at scale to scaffold EFL learners’ writing process, while instructors remain essential in the loop to address the limitations of automated feedback. The article concludes with suggestions for refining this approach in future practice.
- PaperLanguage Testing26 Jun 2026
Developing and Validating a Computerized Dynamic Diagnostic Assessment of Pragmatic Competence for Chinese Learners of English
Qi Lu, Ying Chen, Lianrui Yang
This study developed and validated a computerized dynamic diagnostic assessment of pragmatic competence (CDDA-P) for Chinese learners of English, focusing on refusals. Using empirically-derived response options from a corpus of 335 language users, the assessment diagnosed learners' strengths, weaknesses, and zones of proximal development, leading to significant improvement in pragmatic performance after mediation.
Original abstract
Recent initiatives have sought to integrate dynamic assessment and diagnostic assessment to facilitate language learning. Extending this line of innovation, the present study uses the example of refusals to illustrate the development and validation of a computerized dynamic diagnostic assessment of pragmatic competence (CDDA-P). To enhance the authenticity of assessed pragmatic performance, a bottom-up approach was adopted in item design, in which response options were empirically derived from a corpus of productions by 335 language users. The effectiveness of the CDDA-P was examined from three key perspectives: its ability to diagnose learners’ strengths and weaknesses, to identify their zones of proximal development (ZPDs) and learning potential, and to promote the development of learners’ pragmatic performance. A pretest–immediate posttest-delayed posttest design was employed to track changes in 66 Chinese learners’ performance before and after the implementation of the CDDA-P. Findings reveal that the CDDA-P can provide a fine-grained diagnosis of learners’ strengths and weaknesses in performing L2 refusals and identify their diverse ZPDs and learning potential. Furthermore, learners demonstrated significant improvement after mediation. This study presents both theoretical and methodological implications for the development of integrated dynamic and diagnostic language assessment, while also offering insights into promoting L2 pragmatic competence through assessment.