research-impact
Filtering by topic research-impact(1)Clear all filters
- PaperERIC — Assessment & second language1 Jan 2026
Extrinsic Drivers of Scientific Impact in Second Language Assessment: A Bibliometric Path Analysis
Sai Zhang, Vahid Aryadoust
Seven extrinsic factors—self-citations, article age, journal CiteScore, number of countries, number of authors, open access, and research topic—significantly influence citation counts in second language assessment, independent of research quality. A path analysis of 447 papers from 2018–2022 explained 57.75% of citation variance, with the model showing excellent fit. The findings highlight systemic biases in citation-based research evaluation within language assessment.
Original abstract
This study examined how multiple factors, independent of research quality, influence the scientific impact of language assessment articles. A total of 447 papers published between 2018 and 2022 were investigated using a path analysis approach to identify both direct and indirect ways in which extrinsic factors affect citation counts. A conceptual path model was constructed based on existing literature and assessed using a comprehensive bibliometric dataset. The final model showed an excellent fit to the data (X[superscript 2] = 65.6, df = 52, p = 0.097; standardized root mean square residual [SRMR] = 0.034, root mean square error of approximation [RMSEA] = 0.024, comparative fit index [CFI] = 0.980, Tucker-Lewis index [TLI] = 0.970) and accounted for 57.75% of the variance in citation counts (R[superscript 2] = 0.5775, p < 0.001). Among nine examined factors, seven demonstrated significant direct or indirect effects on citation counts: number of self-citations, article age, journal CiteScore, number of countries, number of authors, open access, and research topic. Based on these findings, the study deepens our understanding of citation practices and offers broader implications for citation-based research evaluation in language assessment.