Jessica Vitale
2025
Using Whisper Embeddings for Audio-Only Latent Token Classification of Classroom Management Practices
Wesley Griffith Morris
|
Jessica Vitale
|
Isabel Arvelo
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
In this study, we developed a textless NLP system using a fine-tuned Whisper encoder to identify classroom management practices from noisy classroom recordings. The model segments teacher speech from non-teacher speech and performs multi-label classification of classroom practices, achieving acceptable accuracy without requiring transcript generation.