teaching-evaluation
Filtering by topic teaching-evaluation(1)Clear all filters
- PaperarXiv — Language & NLP (cs.CL)13 Jul 2026
A Durability and Cross-Language Transfer Benchmark for a Validated Teaching-Feedback Classification Protocol
Esteban U. Vega Barajas
A validated protocol for classifying teaching-evaluation comments by category and sentiment was tested for durability and cross-language transfer. Using Spanish and English corpora, the study compared sparse lexical features, frozen transformer embeddings, and prompted LLMs, finding the protocol durable: a 2026 frontier model achieved the highest thematic F1 on Spanish but showed no sentiment advantage over cheaper models, and English sentiment performance was descriptively similar across models. Results indicate that model choice for this task is a deployment decision rather than a property of the protocol.
Original abstract
Institutions collect far more open-ended teaching-evaluation feedback than they read. A prior study introduced a validated protocol for classifying such comments by thematic category and sentiment, built from a documented annotation guide, an intra-annotator reliability measurement, stratified cross-validation, and a held-out evaluation on a Spanish institutional corpus with a frozen-encoder design. Two questions limit its reuse: whether a protocol fixed to 2019-era frozen embeddings stays competitive as representation methods advance, and whether it transfers to a second language. We re-run it on the original Spanish data across three representation generations, sparse lexical features, frozen transformer embeddings, and prompted large language models, and transfer its sentiment task to English with a balanced 45,000-comment corpus checked against an aspect-labeled education dataset. Treating paired comparisons as descriptive, we find the protocol durable: a 2026 frontier model posts the highest thematic F1 on the hardest Spanish task, yet shows no sentiment advantage over a cheap model and no descriptive separation from it on English, so model choice is a deployment decision, not a property of the method.