XQDT: eXplainable and Quantitative Data-Text Alignment Metric with Feedback Signals

Kun Efimov-Zhang, Yifei Song, Claire Gardent


Abstract
Evaluating data-text alignment remains challenging: existing metrics often provide limited explanations for the scores, while prompt-based LLM-as-Judge methods can be expensive and unreliable. We present an end-to-end explainable evaluation metric that fine-tunes a language model to identify omitted, extra, incorrect, and correct data units in a data-text pair. These local judgements are aggregated into precision, recall, and F1 scores, providing both fine-grained diagnostic feedback and an interpretable measure of alignment quality. Across benchmarks, our fine-tuned models outperform LLM-as-Judge methods in error prediction and achieve competitive precision, recall, and F1 scores, while maintaining strong correlation with human judgements. Beyond evaluation, our verifier outputs also provide useful feedback signals for downstream correction and refinement, supporting alignment-oriented improvement of data-to-text and text-to-data. Code and resources are available at https://github.com/guihuzhang/xqdt.
Anthology ID:
2026.emnlp-main.397
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
9121–9157
Language:
URL:
https://aclanthology.org/2026.emnlp-main.397/
DOI:
Bibkey:
Cite (ACL):
Kun Efimov-Zhang, Yifei Song, and Claire Gardent. 2026. XQDT: eXplainable and Quantitative Data-Text Alignment Metric with Feedback Signals. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 9121–9157, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
XQDT: eXplainable and Quantitative Data-Text Alignment Metric with Feedback Signals (Efimov-Zhang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.397.pdf