Anh Trac Duc Dinh
Author directory2026
Causal Episodic Memory for Feedback-Driven Agent Repair
Khang Nhat Hoang Vo | Tam Minh | Anh Trac Duc Dinh | Thuyen Vinh Ha Bui | Tho Quan
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Khang Nhat Hoang Vo | Tam Minh | Anh Trac Duc Dinh | Thuyen Vinh Ha Bui | Tho Quan
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
LLM agents that repair failures often discard successful corrections, forcing later episodes to rediscover similar solutions. We study whether finalized repair outcomes can improve subsequent Text-to-SQL episodes without parameter updates. We introduce MERIT, a training-free agent that maintains an online dual-polarity memory of oracle-verified corrections and observed unsuccessful directions. Under oracle-assisted benchmark feedback, only memories from earlier finalized episodes are eligible for retrieval. A deterministic classifier assigns a coarse failure type, which conditions a hybrid lexical-dense retriever before the frozen model generates each revision. Using Qwen2.5-7B-Instruct with identical initial predictions and repair budgets, MERIT improves execution accuracy over stateless iterative repair from 66.34% to 69.79% on Spider and from 47.35% to 48.44% on BIRD. Paired analyses provide clear evidence for the Spider gain but weaker evidence on BIRD. MERIT is not reliably separated from untyped dynamic retrieval on either benchmark, while Reflexion-style memory reaches 51.24% on BIRD at substantially higher inference cost. Ablations show that negative memory contributes modestly, the value of type conditioning and lexical-dense ranking is dataset dependent, and schema-local experience provides the most consistent benefit. These results clarify when causal cross-query memory improves repair and when broader memory representations remain preferable. Our implementation is available here: https://github.com/nhatkhangcs/merit
Transporting Concepts Across Languages: Optimal Transport Toward English-Level Performance in Multilingual LLMs
Anh Trac Duc Dinh | Anh Duc Le | Tho Quan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Anh Trac Duc Dinh | Anh Duc Le | Tho Quan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large language models (LLMs) exhibit strong English performance due to its dominance in pretraining data, yet remain inconsistent across non-English languages. Existing cross-lingual alignment methods rely on contrastive objectives that symmetrically perturb English representations, inadvertently degrading the proficiency they use as a reference. We propose an Optimal Transport (OT) framework that maps non-English hidden-state distributions toward English at middle transformer layers via entropy-regularised Sinkhorn iterations, while an English consistency regularisation term keeps the alignment anchor stationary. This asymmetric formulation preserves English performance by construction. Experiments on XNLI, XQuAD, and MMMLU show that our method delivers strong cross-lingual transfer while successfully avoiding the English performance degradation observed in the contrastive baseline.
When Morphology Hides in Plain Sight: Breaking the Isolation in Vietnamese and Beyond
Anh Trac Duc Dinh | Khang Hoang Nhat Vo | Tai Tien Ta | Vinh Cong Doan | Tho Quan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Anh Trac Duc Dinh | Khang Hoang Nhat Vo | Tai Tien Ta | Vinh Cong Doan | Tho Quan
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
In isolating languages such as Vietnamese, core morphological structure is encoded not by inflection but by the composition and ordering of monosyllabic morphemes, yet standard Transformer encoders largely overlook this signal. We introduce HuTieuBERT, a morpheme-aware Transformer that augments a pretrained Vietnamese encoder with two lightweight inductive biases: (i) Adaptive Boundary-Token Fusion, which integrates BMES-based morpheme boundary embeddings into token representations via a learnable gate, and (ii) a Morpheme-Aware Attention Bias, which injects a fixed structural attention matrix into early self-attention layers while minimally perturbing the pretrained attention geometry. Across a suite of Vietnamese POS, NER, and sentence-level classification benchmarks, HuTieuBERT consistently outperforms strong baselines, with the largest gains on syntactic tasks. Hyperparameter ablations show a broad regime in which structural biases improve accuracy without destabilizing representations. Applying the same design to ChineseBERT (Chinese-BERT-wwm) yields MAChineseBERT, which improves F1 and produces more balanced tag distributions on Chinese POS and NER, suggesting that explicit morpheme-aware attention is a portable and effective strategy for modeling isolating languages.