ConceptWeave: Concept-Driven Prompting through Adaptive Semantic Infilling

Atul Kumar Singh, Rahul Mishra


Abstract
Conventional prompting and prompt-based finetuning offer only weak semantic structure, leaving models to derive task-specific reasoning from limited cues. Existing techniques, such as using demonstrations, chain-of-thought prompting, or retrieval augmentation, can improve performance, but often at the cost of longer, more redundant prompts, higher inference overhead, and reliance on external knowledge sources. We present ConceptWeave, a novel concept-centric prompt-based finetuning approach built on adaptive semantic infilling. Instead of depending on external resources, it extracts concise, task-relevant concepts directly from a small portion of downstream data and organizes them into a dynamically evolving hierarchical memory. During fine-tuning, ConceptWeave identifies informative spans in the input through semantic alignment and augments them with corresponding concept representations, enabling fine-grained, localized conditioning of the model. As training progresses, the concepts are continuously refined and structured into a hierarchy that supports efficient retrieval while preserving semantic richness and scalability. We validate ConceptWeave across a range of NLP tasks, including misinformation detection, question answering, sentiment analysis, and hate speech classification, where it consistently outperforms strong baselines and recent state-of-the-art methods.
Anthology ID:
2026.aacl-long.187
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4190–4207
Language:
URL:
https://aclanthology.org/2026.aacl-long.187/
DOI:
Bibkey:
Cite (ACL):
Atul Kumar Singh and Rahul Mishra. 2026. ConceptWeave: Concept-Driven Prompting through Adaptive Semantic Infilling. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4190–4207, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
ConceptWeave: Concept-Driven Prompting through Adaptive Semantic Infilling (Singh & Mishra, AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.187.pdf