Flipper: An Extended Document-Level Financial Dataset for Training and Evaluation with Annotated Discourse Phenomena

Mariam Nakhlé, Rachel Atherly, Gabriela nicole Gonzalez Saez, Marco Dinarelli, Raheel Qader, Hervé Blanchon


Abstract
We present a new resource for Machine Translation (MT), namely a training and evaluation dataset containing parallel sections issued from authentic documents in the financial domain. We cover five language pairs: English-French, English-Spanish, English-German, English-Italian and French-Spanish. The total number of parallel sections is 122k and the number of tokens is 118M (source and target combined). MT has improved greatly in recent years, but certain phenomena still cause errors, particularly when context spans beyond a single sentence. Errors can lead to mistranslated pronouns, incorrect gender or number agreement, and inconsistent terminology, which can be especially problematic in high-stakes domains like finance. We therefore construct the dataset at document level (rather than sentence-level alignment) and also produce fine-grained annotations of context-sensitive phenomena. The annotation was performed using preexisting tools and custom scripts. The annotated phenomena are: formality, gender, terminology consistency, verb form and sentence reordering. This aims to improve document-level evaluation of MT models by enabling evaluation solely on texts containing a particular phenomenon of interest. Our primary contribution is the creation and public release of Flipper, a multilingual document-level parallel dataset in the financial domain, designed to support both training and targeted evaluation of context-sensitive machine translation.
Anthology ID:
2026.fnp-1.7
Volume:
The 7th Financial Narrative Processing Workshop
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Mo El-Haj, Antonio Moreno Sandoval, Ana Garcia-Serrano, Chung-Chi Chen, Paul Rayson, Yanco Amor Torterolo Orta, Paloma Martinez, Jordi Porta
Venues:
FNP | WS
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
78–86
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-fnp-07
DOI:
10.63317/22f2djwbns96
Bibkey:
Cite (ACL):
Mariam Nakhlé, Rachel Atherly, Gabriela nicole Gonzalez Saez, Marco Dinarelli, Raheel Qader, and Hervé Blanchon. 2026. Flipper: An Extended Document-Level Financial Dataset for Training and Evaluation with Annotated Discourse Phenomena. In The 7th Financial Narrative Processing Workshop, pages 78–86, Palma de Mallorca, Spain. European Language Resources Association (ELRA).
Cite (Informal):
Flipper: An Extended Document-Level Financial Dataset for Training and Evaluation with Annotated Discourse Phenomena (Nakhlé et al., FNP 2026)
Copy Citation: