LLM Agents as Computational Typologists

Changbing Yang, Christopher Hammerly, Freda Shi, Jian Zhu


Abstract
Linguistic typology relies on expert analysis of reference grammars across languages, making large-scale crosslinguistic comparison labor-intensive and unscalable. We introduce AutoTypologist, an LLM agent for evidence-grounded typological analysis over reference grammars. The agent is capable of retrieving relevant grammar sections, analyzing interlinear glossed text (IGT), and iteratively reasoning over typological hypotheses using a ReAct-style workflow. We evaluate the system on Typological Feature Coding against expert annotations and Typological Hypothesis Testing with typological universals using 25 open-source reference grammars. Operating under different information constraints in Typological Feature Coding, the agent can synthesize information from reference grammar prose but still faces challenges with only IGTs in the target language. In Typological Hypothesis Testing, the agent can synthesize crosslinguistic evidence and identify both supporting cases and counterexamples. These findings suggest that LLM agents can support scalable and inspectable typological analysis, while still requiring expert validation.
Anthology ID:
2026.emnlp-main.514
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
11790–11815
Language:
URL:
https://aclanthology.org/2026.emnlp-main.514/
DOI:
Bibkey:
Cite (ACL):
Changbing Yang, Christopher Hammerly, Freda Shi, and Jian Zhu. 2026. LLM Agents as Computational Typologists. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 11790–11815, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LLM Agents as Computational Typologists (Yang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.514.pdf