PeMA-KGQA: A Multi-Agent LLM Framework for Persian Knowledge Graph Question Answering

Kimia Hosseini, Mohammad Hosseini, Saeedeh Momtazi


Abstract
Knowledge Graph Question Answering (KGQA) is particularly challenging for Persian, a complex and low-resource language with significant ambiguity. To address this, we introduce PeMA-KGQA (Persian Multi-Agent Knowledge Graph Question Answering), the first multi-agent LLM framework for Persian KGQA, arguing that an agent-based approach is essential for robust reasoning. Our system operates on FarsBase and is evaluated on both the ParsSimpleQA (one-hop) and PeCoQ (compositional) benchmarks. The framework employs a plan-and-execute paradigm where a dedicated Planner agent first decomposes a question into a structured executable plan using a toolbox of operators. Subsequent specialized agents—an Entity Grounder, a Relation Selector, and a Path Scorer—then execute this plan, effectively grounding mentions, selecting relations, and scoring reasoning paths to produce the final answer. This multi-agent decomposition provides a transparent and interpretable reasoning trace. PeMA-KGQA sets a new state-of-the-art on ParsSimpleQA with 21.14% improvement in Hits@5 and achieves 80.67% in Hits@5 on the complex multi-hop questions of PeCoQ.
Anthology ID:
2026.findings-aacl.30
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
560–579
Language:
URL:
https://aclanthology.org/2026.findings-aacl.30/
DOI:
Bibkey:
Cite (ACL):
Kimia Hosseini, Mohammad Hosseini, and Saeedeh Momtazi. 2026. PeMA-KGQA: A Multi-Agent LLM Framework for Persian Knowledge Graph Question Answering. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 560–579, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
PeMA-KGQA: A Multi-Agent LLM Framework for Persian Knowledge Graph Question Answering (Hosseini et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.30.pdf