Collin Lynch
Author directory2026
Measuring Writing Proficiency Through Keystroke Process Data: A Cross-School Generalizability Study
Damilola Babalola | Naga Buddarapu | Caleb Scott | Piotr Mitros | Paul Deane | Collin Lynch
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Damilola Babalola | Naga Buddarapu | Caleb Scott | Piotr Mitros | Paul Deane | Collin Lynch
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Using a year of authentic Grade 7–8 writing from two U.S. middle schools (8,576 documents, 423 students), we test whether keystroke features correlate with English Language Arts proficiency, form interpretable latent dimensions, and vary by gender. Fluency and engagement features reliably index proficiency by Grade 8, though generalizability varies.
Two Uses of Human-scored Anchors: Few-shot Direct Scoring and Anchor-based Comparative Grading
Prashreet Poudel | Huayue Gu | Collin Lynch | Zhikai Gao
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Prashreet Poudel | Huayue Gu | Collin Lynch | Zhikai Gao
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
This study evaluates direct few-shot scoring and anchor based comparative judgment for LLM essay grading. Using human scored anchor essays, we compare their accuracy and stability. Although both approaches produce competitive scores, comparative judgments demonstrate better stability and consistency, suggesting it as a better alternative for grading writing assessment.
2022
FabKG: A Knowledge graph of Manufacturing Science domain utilizing structured and unconventional unstructured knowledge source
Aman Kumar | Akshay Bharadwaj | Binil Starly | Collin Lynch
Proceedings of the Workshop on Structured and Unstructured Knowledge Integration (SUKI)
Aman Kumar | Akshay Bharadwaj | Binil Starly | Collin Lynch
Proceedings of the Workshop on Structured and Unstructured Knowledge Integration (SUKI)
As the demands for large-scale information processing have grown, knowledge graph-based approaches have gained prominence for representing general and domain knowledge. The development of such general representations is essential, particularly in domains such as manufacturing which intelligent processes and adaptive education can enhance. Despite the continuous accumulation of text in these domains, the lack of structured data has created information extraction and knowledge transfer barriers. In this paper, we report on work towards developing robust knowledge graphs based upon entity and relation data for both commercial and educational uses. To create the FabKG (Manufacturing knowledge graph), we have utilized textbook index words, research paper keywords, FabNER (manufacturing NER), to extract a sub knowledge base contained within Wikidata. Moreover, we propose a novel crowdsourcing method for KG creation by leveraging student notes, which contain invaluable information but are not captured as meaningful information, excluding their use in personal preparation for learning and written exams. We have created a knowledge graph containing 65000+ triples using all data sources. We have also shown the use case of domain-specific question answering and expression/formula-based question answering for educational purposes.