generalizability
Filtering by topic generalizability(1)Clear all filters
- PaperJournal of Learning Analytics14 Mar 2026
Modelability as a Strategy for Improving the Generalizability and Scalability of Predictive Models
Alice Xu, Yunyi Zhang, Adam Blake, James Stigler
Introduces the concept of 'modelability'—a learning ecosystem designed for developing generalizable predictive models. Outlines three design principles and demonstrates their application through CourseKata, a platform that enabled early prediction models of student grades that generalized across institutions.
Original abstract
Learning analytics has the potential to enhance education through data-informed decision-making, but persistent challenges around generalizability and scalability continue to limit its real-world impact. In this paper, we introduce the concept of a modelable world: a learning ecosystem purposefully designed to support the development of predictive models that generalize across diverse contexts. We outline three core design principles of modelability: (1) valid and interpretable measurements, (2) scalable and stable implementation, and (3) a collaborative research–practice–technology ecosystem. We then illustrate how these principles can be operationalized in the real world through a case study of CourseKata, a platform offering a fully instrumented online textbook adopted across a wide range of institutions and disciplines. Using CourseKata data, we developed early prediction models of students’ final course grades using behavioral measures and tested the model generalizability across institutions (something rarely done in the modeling literature). Results show that a system designed with modelability in mind can produce predictive models that generalize effectively across diverse educational contexts.