LatentDemandBench: A Contamination-Resistant Diagnostic for Pre-Recognition Product–Need Ranking in Synthetic Economies

Avinash Goutham Aluguvelly


Abstract
An existing product may meet an unmet need before the market recognises the connection. Testing whether a language model can identify such opportunities is difficult when historical outcomes may already be in its training data. We introduce LatentDemandBench, a contamination-resistant benchmark that generates fictional economies with known realisation probabilities and noisy documentary evidence. Solvers rank product–need pairings by their chance of realisation within a fixed horizon. Market commentary is generated separately from realisation, allowing us to evaluate ranking both among discussed pairings and where market attention supplies no ordering. On 30 matched economies, two frontier models beat a mention-count control but trail a supervised logistic ranker using fourteen features recovered from the same dossiers by a template-aware parser. The stronger model, GPT-5.6-TERRA, scores 0.669 in top-K-imputed AUC, with a paired reference-minus-model gap of +0.047 [+0.025, +0.074]. Aggregating three completions under the same final top-K budget yields 0.659, leaving a reference gap of +0.058 [+0.031, +0.095]. The deficit is not uniform: an exploratory analysis finds it smaller on unmentioned pairings than on those already discussed. We release the generator, harness and artifacts to support evaluation on fresh economies
Anthology ID:
2026.finnlp-1.29
Volume:
Proceedings of the 11th Workshop on Financial Technology and Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Jimin Huang, Yongjae Lee, Sophia Ananiadou, Hsin-Hsi Chen, Hiroya Takamura, Chung-Chi Chen
Venues:
FinNLP | WS
SIG:
SIGFinTech
Publisher:
Association for Computational Linguistics
Note:
Pages:
351–372
Language:
URL:
https://aclanthology.org/2026.finnlp-1.29/
DOI:
Bibkey:
Cite (ACL):
Avinash Goutham Aluguvelly. 2026. LatentDemandBench: A Contamination-Resistant Diagnostic for Pre-Recognition Product–Need Ranking in Synthetic Economies. In Proceedings of the 11th Workshop on Financial Technology and Natural Language Processing, pages 351–372, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LatentDemandBench: A Contamination-Resistant Diagnostic for Pre-Recognition Product–Need Ranking in Synthetic Economies (Aluguvelly, FinNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.finnlp-1.29.pdf