Maria Carmen Staiano
Author directory2026
UniOR-MT: An Agentic Pipeline for Terminology Translation
Antonio Castaldo | Giulia Speranza | Maria Carmen Staiano | Petra Giommarelli | Johanna Monti | Maria Pia Di Buono
Proceedings of the Eleventh Conference on Machine Translation
Antonio Castaldo | Giulia Speranza | Maria Carmen Staiano | Petra Giommarelli | Johanna Monti | Maria Pia Di Buono
Proceedings of the Eleventh Conference on Machine Translation
We present UniOR-MT, an agentic terminology-aware machine translation pipeline developed for the WMT 2026 Terminology Translation Shared Task. We compare five progressively enriched translation paths, each adding one component to isolate its individual contribution. We additionally submit a mixed system that selects, among the five candidate paths, the best candidate using a combined measure of terminology accuracy and document-level quality estimation. Evaluation results show that incorporating a bilingual glossary provides the most consistent benefit, while additional post-editing steps yield limited improvements, and can even degrade translation quality for Spanish–Basque in the official evaluation. The final system, which includes iterative QA feedback and a stronger fallback model, achieves the highest docCOMET scores in our internal evaluation.
SIREN: Situation-aware Index for Response and Emergency ActioNability in Crisis Translation
Maria Carmen Staiano | Lifeng Han | Johanna Monti | Francesca Chiusaroli
Proceedings of the First Workshop on Language Technologies for Crisis Preparedness and Response
Maria Carmen Staiano | Lifeng Han | Johanna Monti | Francesca Chiusaroli
Proceedings of the First Workshop on Language Technologies for Crisis Preparedness and Response
Machine translation (MT) is increasingly utilized in multilingual crisis communication, yet conventional evaluation does not directly assess whether translated emergency messages preserve their actionability. We introduce SIREN (Situation-aware Index for Response and Emergency ActioNability), a human evaluation framework assessing whether translation choices compromise protective action, directive force, and urgency of the source text. We evaluate SIREN in two complementary settings. At the error level, we apply it to HOPE-annotated Italian–English translations produced by ChatGPT-4o and Google Translate: 31.63% and 48.73% of errors, respectively, compromise actionability, predominantly by affecting the protective action. At the message level, we evaluate English–French translations produced by TranslateGemma-4B and Google Translate, with actionability preserved in 85.34% and 92.67% of translations, respectively. TranslateGemma-4B failures predominantly weaken directive force, whereas Google Translate failures more often compromise protective actions and receive Major impact ratings. These findings show that translation systems can differ not only in how often actionability is lost, but also in the nature and functional impact of these failures. Alongside SIREN, we contribute an English–French crisis-translation resource with human actionability annotations and post-edited reference translations, supporting further research on function-oriented evaluation for crisis communication. Our experimental data is available at: https://github.com/mcstaiano/SIREN.
Translating Under Pressure: Domain-Aware LLMs for Crisis Communication
Antonio Castaldo | Maria Carmen Staiano | Johanna Monti | Sheila Castilho | Francesca Chiusaroli
Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1)
Antonio Castaldo | Maria Carmen Staiano | Johanna Monti | Sheila Castilho | Francesca Chiusaroli
Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1)
Timely and reliable multilingual communication is critical during natural and human-induced disasters, but developing effective solutions for crisis communication is limited by the scarcity of curated parallel data. We propose a domain-adaptive pipeline that expands a small reference corpus, by retrieving and filtering data from general corpora. We use the resulting dataset to fine-tune a small language model for crisis-domain translation and then apply preference optimization to bias outputs toward CEFR A2-level English. Automatic and human evaluation shows that this approach improves readability, while maintaining strong adequacy. Our results indicate that simplified English, combined with domain adaptation, can function as a practical lingua franca for emergency communication when full multilingual coverage is not feasible.
2025
ITALERT: Assessing the Quality of LLMs and NMT in Translating Italian Emergency Response Text
Maria Carmen Staiano | Lifeng Han | Johanna Monti | Francesca Chiusaroli
Proceedings of Machine Translation Summit XX: Volume 1
Maria Carmen Staiano | Lifeng Han | Johanna Monti | Francesca Chiusaroli
Proceedings of Machine Translation Summit XX: Volume 1
This paper presents the outcomes of an initial investigation into the performance of Large Language Models (LLMs) and Neural Machine Translation (NMT) systems in translating high-stakes messages. The research employed a novel bilingual corpus, ITALERT (Italian Emergency Response Text) and applied a human-centric post-editing based metric (HOPE) to assess translation quality systematically. The initial dataset contains eleven texts in Italian and their corresponding English translations, both extracted from the national communication campaign website of the Italian Civil Protection Department. The texts deal with eight crisis scenarios: flooding, earthquake, forest fire, volcanic eruption, tsunami, industrial accident, nuclear risk, and dam failure. The dataset has been carefully compiled to ensure usability and clarity for evaluating machine translation (MT) systems in crisis settings. Our findings show that current LLMs and NMT models, such as ChatGPT (OpenAI’s GPT-4o model) and Google MT, face limitations in translating emergency texts, particularly in maintaining the appropriate register, resolving context ambiguities, and managing domain-specific terminology.