Prompting Strategies for Conceptual Ideation in Problem Solving

Chris Bates, Ian Perera


Abstract
LLMs have improved at executing well-specified chains of reasoning but remain weak at conceptual ideation, which identifies what is worth reasoning about in the first place. We cast this as bilevel optimization over (i) a compact hypothesis space 𝛩⊆𝛩0 and (ii) a point 𝜃∈𝛩, and derive a domain-agnostic prompting strategy — Generate-𝛩 — that makes hypothesis-space construction an explicit pre-solving step. On two challenging puzzle domains, Generate-𝛩 matches or exceeds the max-thinking variant of the same base model (Claude Opus 4.6 or DeepSeek-v3.2/v4) and outperforms reasonable prompting baselines. These results suggest our method works well in tasks that are well-represented in the training set but nonetheless require creativity to solve new instances. Based on our formalism, we propose extensions for solving less familiar tasks as well. Results may provide insight into strategies learned by “reasoning” models during training. Our prompting strategy (or extensions thereof) could be integrated with RL training to produce better exploratory data for reasoning models in ideation-heavy tasks.
Anthology ID:
2026.realm-1.97
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1389–1403
Language:
URL:
https://aclanthology.org/2026.realm-1.97/
DOI:
Bibkey:
Cite (ACL):
Chris Bates and Ian Perera. 2026. Prompting Strategies for Conceptual Ideation in Problem Solving. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 1389–1403, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Prompting Strategies for Conceptual Ideation in Problem Solving (Bates & Perera, REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.97.pdf