EVALIGN: Visual Evaluation of Translation Alignment Models

Tariq Yousef, Gerhard Heyer, Stefan Jänicke


Abstract
This paper presents EvAlign, a visual analytics framework for quantitative and qualitative evaluation of automatic translation alignment models. EvAlign offers various visualization views enabling developers to visualize their models’ predictions and compare the performance of their models with other baseline and state-of-the-art models. Through different search and filter functions, researchers and practitioners can also inspect the frequent alignment errors and their positions. EvAlign hosts nine gold standard datasets and the predictions of multiple alignment models. The tool is extendable, and adding additional datasets and models is straightforward. EvAlign can be deployed and used locally and is available on GitHub.
Anthology ID:
2023.eacl-demo.31
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Danilo Croce, Luca Soldaini
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
277–297
Language:
URL:
https://aclanthology.org/2023.eacl-demo.31
DOI:
10.18653/v1/2023.eacl-demo.31
Bibkey:
Cite (ACL):
Tariq Yousef, Gerhard Heyer, and Stefan Jänicke. 2023. EVALIGN: Visual Evaluation of Translation Alignment Models. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, pages 277–297, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
EVALIGN: Visual Evaluation of Translation Alignment Models (Yousef et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-demo.31.pdf
Video:
 https://aclanthology.org/2023.eacl-demo.31.mp4