research-synthesis
Filtering by topic research-synthesis(2)Clear all filters
- PaperTESOL Quarterly7 Jul 2026
Rethinking Quality in L2 Research Synthesis: Collective Initiative Toward Developing Validated Tools to Assess Methodological Rigor of Primary Studies
Yushi Kashimura
The paper calls for the development and validation of field-specific appraisal tools to assess the methodological rigor of primary studies in L2 research syntheses. It identifies five key limitations of current tools and proposes the Delphi method as a promising approach to establish expert consensus on methodological criteria.
Original abstract
This Research Issues paper calls for the development and validation of field‐specific appraisal tools for the methodological rigor of primary studies included in research syntheses. The methodological quality of primary studies serves as a foundation for conducting robust syntheses, interpreting their findings, and deriving empirically grounded implications for theory, methodology, and practice. However, although the evaluation of methodological rigor using appraisal tools is strongly encouraged, such tools currently available to second language (L2) researchers are limited in at least five aspects: (a) they are not specific to L2 studies, (b) they offer limited coverage of the range of research designs, analytic approaches, and subfields represented in primary studies, (c) their developmental and validation processes lack transparency, (d) practical guidance for their application is insufficiently defined, and (e) explicit consideration of open science principles is absent. In light of these limitations, the L2 research community currently lacks validated field‐specific tools to support researchers engaged in secondary research. To address this gap, the present paper calls for a collective initiative to develop and validate such tools. Specifically, it argues that the Delphi method represents a promising approach for systematically establishing expert consensus on the methodological criteria required for rigorous appraisal.
- PaperERIC — ELT & TESOL1 Jan 2026
Research Synthesis in TESOL
Sin Wang Chong
Research synthesis systematically consolidates evidence to inform TESOL practice and policy, but remains emergent in the field. This article reviews its history and typologies, introduces the SMART (Synthesis Methods and Reporting Tool) framework, and proposes future directions including ethical digital tool use, a 'small lens' approach for contextual relevance, and diversification of syntheses.
Original abstract
Research synthesis plays a pivotal role in bridging the gap between research and practice in TESOL by systematically consolidating evidence to inform decision-making, policy, and pedagogy. Although well established in disciplines such as Medicine and Education, research synthesis remains emergent in TESOL, where its relevance continues to grow alongside methodological diversification. Through illustrative examples, this article provides an overview of the history, typologies, and methodological developments of research synthesis in TESOL, including the introduction of SMART (Synthesis Methods and Reporting Tool). The article identifies future directions for research synthesis in TESOL, which include appropriate, ethical, and inclusive use of digital tools in research synthesis; a "small lens" approach to conducting research synthesis to enhance contextual relevance and reduce research waste; and the need to diversify, replicate, and update existing research syntheses in the field.