Dmytro Zamriy
2026
Belief Propagation in LLM World Models: Measuring Strategic Information Bias with Prediction Markets
Mykola Khandoga | Yevhen Kostiuk | Anton Polishko | Yurii Filipchuk | Kostiantyn Kozlov | Dmytro Zamriy | Artur Kiulian
Proceedings of the Fifth Ukrainian Natural Language Processing Conference (UNLP 2026)
Mykola Khandoga | Yevhen Kostiuk | Anton Polishko | Yurii Filipchuk | Kostiantyn Kozlov | Dmytro Zamriy | Artur Kiulian
Proceedings of the Fifth Ukrainian Natural Language Processing Conference (UNLP 2026)
Every information ecosystem produces beliefs that shape strategic decisions. Both human analysts and AI systems inherit the blind spots of their information sources. We show that LLMs, combined with prediction markets, function as a calibrated instrument for measuring how far ecosystem-induced beliefs fall from reality: LLMs extract the beliefs a text corpus implies, and prediction markets provide a ground truth proxy against which to quantify the error.We isolate the bias contribution of specific text through ablation: varying information context while holding the model fixed, with a contaminated model that knows actual outcomes as control. Applied to 111 Ukraine-related prediction markets (~93,000 predictions, four models), we find that English news context systematically biases territorial predictions, wrong 64–72% of the time (p 10{-6}). A contaminated model that knows actual outcomes shows the same error rate, indicating the bias originates primarily in the text. Supplementing with Ukrainian military-analytical sources partially corrects the distortion.We show that the distortion originates primarily in the sources, not the models. Consistent across four architectures, it will persist in any system that processes them and propagate into downstream decisions.