Chris Bates
Author directory2026
Prompting Strategies for Conceptual Ideation in Problem Solving
Chris Bates | Ian Perera
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Chris Bates | Ian Perera
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
LLMs have improved at executing well-specified chains of reasoning but remain weak at conceptual ideation, which identifies what is worth reasoning about in the first place. We cast this as bilevel optimization over (i) a compact hypothesis space π©βπ©0 and (ii) a point πβπ©, and derive a domain-agnostic prompting strategy β Generate-π© β that makes hypothesis-space construction an explicit pre-solving step. On two challenging puzzle domains, Generate-π© matches or exceeds the max-thinking variant of the same base model (Claude Opus 4.6 or DeepSeek-v3.2/v4) and outperforms reasonable prompting baselines. These results suggest our method works well in tasks that are well-represented in the training set but nonetheless require creativity to solve new instances. Based on our formalism, we propose extensions for solving less familiar tasks as well. Results may provide insight into strategies learned by βreasoningβ models during training. Our prompting strategy (or extensions thereof) could be integrated with RL training to produce better exploratory data for reasoning models in ideation-heavy tasks.