Thanh-Trung Do
Author directory2026
REAP: Relation-Aware Elicitation and Parsing for Closed-Book Knowledge Base Construction from LLMs
Thanh-Dan Bui | Thanh-Trung Do | Tuan-Phong Nguyen
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
Thanh-Dan Bui | Thanh-Trung Do | Tuan-Phong Nguyen
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
We present the REAP system for the AKBC Shared Task 2026 on constructing knowledge bases from language models in a closed-book setting, subject to a budget of at most 32B parameters and no model fine-tuning. Our system combines structured chain-of-thought reasoning, relation-specific query strategies, and a reasoning-based empty-set gate to elicit parametric knowledge, followed by direct extraction into valid JSON arrays. On the test set, the system, built on the Mistral-Small-24B-Instruct-2501 model, achieves a macro-F1 score of 0.62, with particularly strong results on countryLandBordersCountry (F1 = 0.95), companyTradesAtStockExchange (F1 = 0.73), and hasArea (F1 = 0.77). Our code is publicly available at https://github.com/yammdd/AKBC-Shared-Task-2026.