From Proprietary to Public: Dataset Declassification for Question Answering

Stefano Campese, Alessandro Moschitti, Ivano Lauriola


Abstract
Training Question Answering (QA) systems on real customer interaction data is often infeasible to reproduce or share due to privacy and intellectual property constraints. We introduce dataset declassification, a framework that replaces proprietary QA datasets with public, semantically equivalent counterparts that preserve training and evaluation utility while satisfying typical legal and privacy requirements. The approach maps proprietary questions to public equivalents via large-scale retrieval and reconstructs answers from domain-matched corpora using LLM-based annotation. Experiments on four QA benchmarks show that models trained and evaluated on declassified datasets achieve performance within 𝛥 ≈ 0 of the original data. The method targets datasets whose underlying information needs already exist in public knowledge sources (e.g., knowledge available on the web and used by public-facing services). We further provide explicit applicability conditions showing that declassification succeeds when sufficient semantic overlap exists between proprietary and public corpora, and degrades predictably when it does not.
Anthology ID:
2026.findings-emnlp.1112
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
23526–23541
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1112/
DOI:
Bibkey:
Cite (ACL):
Stefano Campese, Alessandro Moschitti, and Ivano Lauriola. 2026. From Proprietary to Public: Dataset Declassification for Question Answering. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 23526–23541, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
From Proprietary to Public: Dataset Declassification for Question Answering (Campese et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1112.pdf