Elisabeth Maier

Also published as: Elisabeth Mager


2022

pdf bib
AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages
Abteen Ebrahimi | Manuel Mager | Arturo Oncevay | Vishrav Chaudhary | Luis Chiruzzo | Angela Fan | John Ortega | Ricardo Ramos | Annette Rios | Ivan Vladimir Meza Ruiz | Gustavo Giménez-Lugo | Elisabeth Mager | Graham Neubig | Alexis Palmer | Rolando Coto-Solano | Thang Vu | Katharina Kann
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Pretrained multilingual models are able to perform cross-lingual transfer in a zero-shot setting, even for languages unseen during pretraining. However, prior work evaluating performance on unseen languages has largely been limited to low-level, syntactic tasks, and it remains unclear if zero-shot learning of high-level, semantic tasks is possible for unseen languages. To explore this question, we present AmericasNLI, an extension of XNLI (Conneau et al., 2018) to 10 Indigenous languages of the Americas. We conduct experiments with XLM-R, testing multiple zero-shot and translation-based approaches. Additionally, we explore model adaptation via continued pretraining and provide an analysis of the dataset by considering hypothesis-only models. We find that XLM-R’s zero-shot performance is poor for all 10 languages, with an average performance of 38.48%. Continued pretraining offers improvements, with an average accuracy of 43.85%. Surprisingly, training on poorly translated data by far outperforms all other methods with an accuracy of 49.12%.

pdf bib
BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages
Manuel Mager | Arturo Oncevay | Elisabeth Mager | Katharina Kann | Thang Vu
Findings of the Association for Computational Linguistics: ACL 2022

Morphologically-rich polysynthetic languages present a challenge for NLP systems due to data sparsity, and a common strategy to handle this issue is to apply subword segmentation. We investigate a wide variety of supervised and unsupervised morphological segmentation methods for four polysynthetic languages: Nahuatl, Raramuri, Shipibo-Konibo, and Wixarika. Then, we compare the morphologically inspired segmentation methods against Byte-Pair Encodings (BPEs) as inputs for machine translation (MT) when translating to and from Spanish. We show that for all language pairs except for Nahuatl, an unsupervised morphological segmentation algorithm outperforms BPEs consistently and that, although supervised methods achieve better segmentation scores, they under-perform in MT challenges. Finally, we contribute two new morphological segmentation datasets for Raramuri and Shipibo-Konibo, and a parallel corpus for Raramuri–Spanish.

2018

pdf bib
Lost in Translation: Analysis of Information Loss During Machine Translation Between Polysynthetic and Fusional Languages
Manuel Mager | Elisabeth Mager | Alfonso Medina-Urrea | Ivan Vladimir Meza Ruiz | Katharina Kann
Proceedings of the Workshop on Computational Modeling of Polysynthetic Languages

Machine translation from polysynthetic to fusional languages is a challenging task, which gets further complicated by the limited amount of parallel text available. Thus, translation performance is far from the state of the art for high-resource and more intensively studied language pairs. To shed light on the phenomena which hamper automatic translation to and from polysynthetic languages, we study translations from three low-resource, polysynthetic languages (Nahuatl, Wixarika and Yorem Nokki) into Spanish and vice versa. Doing so, we find that in a morpheme-to-morpheme alignment an important amount of information contained in polysynthetic morphemes has no Spanish counterpart, and its translation is often omitted. We further conduct a qualitative analysis and, thus, identify morpheme types that are commonly hard to align or ignored in the translation process.

2004

pdf bib
How to Disassemble Alphabetical Processions - Morphological Treatment of Unknown Words
Stephan Bopp | Sandro Pedrazzini | Elisabeth Maier
Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC’04)

2003

pdf bib
Scalability in MT systems
Elisabeth Maier | Anthony Clarke
Proceedings of Machine Translation Summit IX: Papers

In this paper we show why scalability is one of the most important aspects for the evaluation of Machine Translation (MT) systems and what scalability entails in the framework of MT. We illustrate the issue of scalability by reporting about an MT solution, which has been chosen in the course of a thorough hands-on evaluation and which in the meantime has been developed from a pilot system to a MT turnkey solution for mid-to large-scale enterprises.

2002

pdf bib
A report on the experiences of implementing an MT system for use in a commercial environment
Anthony Clarke | Elisabeth Maier | Hans-Udo Stadler
Proceedings of the 5th Conference of the Association for Machine Translation in the Americas: User Studies

This paper describes the process of implementing a machine translation system (MT system) and the problems and pitfalls encountered within this process at CLS Corporate Language Services AG, a language solutions provider for the Swiss financial services industry, in particular UBS AG and Zurich Financial Services. The implementation was based on the perceived requirements of large organizations, which is why the focus was more on practical rather than academic aspects. The paper can be roughly divided into three parts: (1) definition of the implementation process, co-ordination and execution, (2) implementation plan and customer/user management, (3) monitoring of the MT system and related maintenance after going live.

2001

pdf bib
Evaluation of machine translation systems at CLS Corporate Language Services AG
Elisabeth Maier | Anthony Clarke | Hans-Udo Stadler
Proceedings of Machine Translation Summit VIII

This paper describes the evaluation of Machine Translation (MT) System for use in a large company. To take into account the specific requirements of such an environment, a pragmatic approach for the evaluation was developed. It consists of five steps ranging from a specification of the evaluation process to the integration of the chosen MT system in a given infrastructure. The process includes a specification of MT evaluation criteria relevant to systems which have to be employed for a large customer base. The paper also shows the results of such an evaluation study which was recently carried out at CLS Corporate Language Services AG, where COMPRENDIUM is in the meantime being employed as corporate MT system.

2000

pdf bib
Terms Specification and Extraction within a Linguistic-based Intranet Service
Sandro Pedrazzini | Elisabeth Maier | Dierk König
Proceedings of the Second International Conference on Language Resources and Evaluation (LREC’00)

1997

pdf bib
Clarification Dialogues as Measure to Increase Robustness in a Spoken Dialogue System
Elisabeth Maier | Norbert Reithinger | Jan Alexandersson
Interactive Spoken Dialog Systems: Bringing Speech and NLP Together in Real Applications

pdf bib
Insights into the Dialogue Processing of VERBMOBIL
Jan Alexandersson | Norbert Reithinger | Elisabeth Maier
Fifth Conference on Applied Natural Language Processing

1995

pdf bib
A Robust and Efficient Three-Layered Dialogue Component for a Speech-to-Speech Translation System
Jan Alexandersson | Elisabeth Maier | Norbert Reithinger
Seventh Conference of the European Chapter of the Association for Computational Linguistics

pdf bib
Utilizing Statistical Dialogue Act Processing in Verbrnobil
Norbert Reithinger | Elisabeth Maier
33rd Annual Meeting of the Association for Computational Linguistics

1994

pdf bib
Generating Cooperative System Responses in Information Retrieval Dialogues
Markus Fischer | Elisabeth Maier | Adelheit Stein
Proceedings of the Seventh International Workshop on Natural Language Generation

1993

pdf bib
The Representation of Interdependencies between Communicative Goals and Rhetorical Relations in the Framework of Multimedia Document Generation
Elisabeth Maier
Intentionality and Structure in Discourse Relations

pdf bib
Textual Constraints, Rhetorical RElations and Communicative Goals and Rhetorical Relations in the Framework of Multimedia Document Generation
Elisabeth Maier
Intentionality and Structure in Discourse Relations