Pranavi Tadivalasa

Author directory

2026

DocSem requires systems to answer quantitative questions over document images while returning the evidence supporting each prediction. We present Retrieve, Reason, Verify, a modular system that separates document transcription, evidence localization, numerical reasoning, deterministic execution, and selective multi-model verification. Under controlled evidence grounding on 217 validation instances, Qwen3.8-Max achieves 98.62% Joint Exact Accuracy. Combining Qwen3.8-Max and GPT-5.6 Sol as independent solvers, with Gemini 3.1 Pro invoked only when their numerical predictions disagree, improves validation performance to 99.08%. On the 1,730-instance hidden test set, which exhibits more challenging visual and grounding conditions, including degraded document quality, non-uniform evidence identifiers, and multiple plausible evidence passages, the complete end-to-end pipeline achieves 32.7% Joint Exact Accuracy. A manual audit of 50 hidden-test instances finds that the system-selected evidence differs from the manually identified evidence in 34 cases, whereas only two cases produce different numerical answers when the evidence agrees. These observations suggest that, within the audited sample, errors are concentrated more strongly in document grounding than in downstream numerical computation once the relevant evidence has been established.