You Can Tell Who’s Asking: What the Web’s Questions Are Made Of, and Where They Come From

Calvin Zhou, Vincent McCloskey, Krishna Srinivasan


Abstract
Questions scraped from the web are used across academia and industry as a proxy for what people want to know. Across QA training data, retrieval benchmarks, and content strategy, questions on a page are assumed to reflect human intent. We test this assumption at scale by extracting 13.4B question occurrences across 110 FineWeb snapshots (2013-2025), and report three findings. First, you can tell who is asking: provenance (the host/page of questions) leaves a signal in question form, and a logistic model can separate genuine user questions from templated/manufactured ones at AUC 0.725 via length and surrounding context rather than question type, though only 0.554 against commerce FAQ writing. Second, question frequency does not measure demand: the most-frequent questions are boilerplate/templated (over 70% of the top thousand), so occurrence counts measure how often a string was published and not how often it was asked. Third, over twelve years the genuine share of occurrences fell by 79% (42-56% after controlling for crawl composition), with question length and context decreasing. We present the first diachronic, occurrence-level measurement of web question provenance, and find the crawlable web’s questions have shifted from being asked by humans toward manufactured for machines to read.
Anthology ID:
2026.wac-1.22
Volume:
Proceedings of the 13th Web-as-Corpus Workshop
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pedro Ortiz Suarez, Laurie Burchell, Nikola Ljubešić, Yves Scherrer, Veronika Laippala, Vuk Dinić, Thom Vaughan
Venues:
WAC | WS
SIG:
SIGWAC
Publisher:
Association for Computational Linguistics
Note:
Pages:
224–237
Language:
URL:
https://aclanthology.org/2026.wac-1.22/
DOI:
Bibkey:
Cite (ACL):
Calvin Zhou, Vincent McCloskey, and Krishna Srinivasan. 2026. You Can Tell Who’s Asking: What the Web’s Questions Are Made Of, and Where They Come From. In Proceedings of the 13th Web-as-Corpus Workshop, pages 224–237, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
You Can Tell Who’s Asking: What the Web’s Questions Are Made Of, and Where They Come From (Zhou et al., WAC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wac-1.22.pdf