CoDA-NAS: Pattern Knowledge-Based Cross-Task Neural Architecture Search with LLM Agents

Hao-Qun Huang, Kai-Chun Wu, Hsin-Yu Wang, Chun-Wei Tsai


Abstract
Recent studies increasingly employ large language models (LLMs) for neural architecture search (NAS); however, they typically rely on in-context learning, struggle to turn past evaluations into accumulated knowledge, and often suffer from structural hallucinations. Motivated by the observation that a search process should systematically accumulate past experience to guide future exploration, we propose CoDA-NAS, a cooperative dual-agent framework that investigates natural language as a medium for structural knowledge. At the core of our framework is a pattern knowledge base (PKB) that extracts, validates, and maintains design patterns from evaluated architectures. These patterns are retrieved as soft priors to guide the searcher agent instead of memoryless generation. The searcher agent employs a structured reasoning constraint to tightly align the generated topological outputs with these semantic concepts, thereby mitigating hallucinations. To ensure empirical reliability, an integrated lightweight predictor agent provides independent numerical validation. By applying a t-test, statistically verified knowledge enters the PKB, effectively curbing the spread of incorrect rules. Experimental results show that under strict search limits, CoDA-NAS achieves competitive performance using only a local open-weights model. Furthermore, the extracted text-based patterns generalize well to new tasks, establishing natural language as a reliable and robust medium for transferring architectural knowledge.
Anthology ID:
2026.realm-1.93
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1324–1339
Language:
URL:
https://aclanthology.org/2026.realm-1.93/
DOI:
Bibkey:
Cite (ACL):
Hao-Qun Huang, Kai-Chun Wu, Hsin-Yu Wang, and Chun-Wei Tsai. 2026. CoDA-NAS: Pattern Knowledge-Based Cross-Task Neural Architecture Search with LLM Agents. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 1324–1339, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CoDA-NAS: Pattern Knowledge-Based Cross-Task Neural Architecture Search with LLM Agents (Huang et al., REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.93.pdf