Manav Munjal
Author directory2026
MortarBench: Evaluating Mortgage Loan Origination Agents
Matthew Toles | Yunan Lu | Manav Munjal | Bojun Liu | Yuanhao Deng | Stephanie Selig | Derek Rindner | Cheng Li | Zhou Yu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Matthew Toles | Yunan Lu | Manav Munjal | Bojun Liu | Yuanhao Deng | Stephanie Selig | Derek Rindner | Cheng Li | Zhou Yu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Loan origination is the process by which a lender creates a new loan, from application and underwriting through approval and funding. This process serves a critical role in evaluating the eligibility and level of risk posed by an applicant. Recently, firms have begun using mortgage loan agents to augment human loan officers, despite a lack of any public benchmark. To fill this gap, we present MortarBench, a loan origination agent benchmark. MortarBench uses a financial data synthesis and mutation pipeline to generate examples with broad edge case coverage that match real-world distributions and questions. We find that state-of-the-art large language models (LLMs) perform poorly, with closed-source models achieving at most 80.8% F1 accuracy. We also discover systematic biases in LLM perception of foreignness related to non-English names. Noting these weaknesses, we introduce CRIT, a confidence calibration framework. Our method increases peak F1 accuracy to 83.6% while improving risk management steering and reducing bias.