David Steele


2018

pdf bib
Vis-Eval Metric Viewer: A Visualisation Tool for Inspecting and Evaluating Metric Scores of Machine Translation Output
David Steele | Lucia Specia
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations

Machine Translation systems are usually evaluated and compared using automated evaluation metrics such as BLEU and METEOR to score the generated translations against human translations. However, the interaction with the output from the metrics is relatively limited and results are commonly a single score along with a few additional statistics. Whilst this may be enough for system comparison it does not provide much useful feedback or a means for inspecting translations and their respective scores. VisEval Metric Viewer VEMV is a tool designed to provide visualisation of multiple evaluation scores so they can be easily interpreted by a user. VEMV takes in the source, reference, and hypothesis files as parameters, and scores the hypotheses using several popular evaluation metrics simultaneously. Scores are produced at both the sentence and dataset level and results are written locally to a series of HTML files that can be viewed on a web browser. The individual scored sentences can easily be inspected using powerful search and selection functions and results can be visualised with graphical representations of the scores and distributions.

2016

pdf bib
Predicting and Using Implicit Discourse Elements in Chinese-English Translation
David Steele | Lucia Specia
Proceedings of the 19th Annual Conference of the European Association for Machine Translation

2015

pdf bib
Improving the Translation of Discourse Markers for Chinese into English
David Steele
Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop

pdf bib
Sheffield Systems for the Finnish-English WMT Translation Task
David Steele | Karin Sim Smith | Lucia Specia
Proceedings of the Tenth Workshop on Statistical Machine Translation

pdf bib
WA-Continuum: Visualising Word Alignments across Multiple Parallel Sentences Simultaneously
David Steele | Lucia Specia
Proceedings of ACL-IJCNLP 2015 System Demonstrations