Koushik Ahamed Tonmoy
Author directory2026
From Language Specifications to Executable Turing Machines: Evaluating LLMs as Computational Machine Designers
Shahriyar Zaman Ridoy | S. M. Muhtasimul Hasan | Azmine Toushik Wasi | Kinga Tshering | Koushik Ahamed Tonmoy | Md Mosaddek Khan
Findings of the Association for Computational Linguistics: EMNLP 2026
Shahriyar Zaman Ridoy | S. M. Muhtasimul Hasan | Azmine Toushik Wasi | Kinga Tshering | Koushik Ahamed Tonmoy | Md Mosaddek Khan
Findings of the Association for Computational Linguistics: EMNLP 2026
Recognizing a formal language does not imply the ability to construct the computation that decides it. We operationalize this distinction as an executable benchmark for language-model reasoning: given a formal-language specification, an LLM must synthesize a deterministic or nondeterministic Turing machine that decides the language. We introduce TMEval, a benchmark of 253 language specifications across 7 structural categories spanning context-free and non-context-free phenomena. Each language includes 600 oracle-labeled membership tests, and every output is evaluated as an executable artifact rather than a textual response. Our pipeline enforces a strict output contract, validates machine construction, executes each buildable machine, and assigns one of four outcomes: static_fail, build_fail, semantic_mismatch, or exact_pass. Across eight LLMs, 2,024 model–language candidates, and up to 1,214,400 behavioral evaluations, only 11.12% exactly pass all tests. More than half fail before execution, over one-third implement the wrong language, and 75 languages remain unsolved by all systems. Failure depends less on the context-free/non-context-free boundary than on the operational structure required to realize the specification. TMEval reveals a substantial gap between formal-language recognition and machine-checked symbolic construction. TMEval is available at https://turing-machineeval.github.io/.
Geo-spatial and Geo-temporal Reasoning in Vision-Language and Large Language Models : A Review
Shahriyar Zaman Ridoy | Azmine Toushik Wasi | Koushik Ahamed Tonmoy | Md Rizwan Parvez
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Shahriyar Zaman Ridoy | Azmine Toushik Wasi | Koushik Ahamed Tonmoy | Md Rizwan Parvez
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Geo-spatial and geo-temporal reasoning require models to determine not only what information is present but also where and when it applies, which is critical for applications such as crisis response, environmental monitoring, and urban planning. This review surveys recent advances in vision–language models (VLMs) and large language models (LLMs) that address geographically and temporally grounded reasoning across tasks including image geolocation, spatiotemporal question answering, language-guided navigation, and Earth observation. We organize the literature through a structured analysis covering task families, input modalities, model architectures, and reasoning paradigms, highlighting how perception, retrieval, tool use, and intermediate reasoning steps contribute to system performance. The survey further synthesizes existing datasets and benchmarks, identifying common evaluation pitfalls such as spatial granularity mismatch, temporal drift, geographic bias, and potential data leakage. Finally, we outline key research challenges and opportunities for developing robust, verifiable, and time-aware geo-spatial AI systems while addressing broader concerns related to fairness, bias, and location privacy.