Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines
Lara Shoana Schlüter, Ekaterina Lapshinova-Koltunski, Sylvia Jaki
Correct Metadata for
Abstract
The present paper focuses on the analysis of automatic subtitles produced with three different systems. We compare the outputs among each other paying attention to the categories of quality derived from audio-visual translation quality research. Besides that, we also consider comprehensibility of the produced subtitles. Additionally, we analyse the automatic evaluation scores to assess the overall quality. Our results show that automatically generated subtitles subtitles remain below human standards in quality and comprehensibility.- Anthology ID:
- 2026.eamt-1.53
- Volume:
- Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1)
- Month:
- June
- Year:
- 2026
- Address:
- Tilburg, The Netherlands
- Editors:
- Dimitar Shterionov, Eva Vanmassenhove, Mirella De Sisto, Fred Blain, Javad Pourmostafa Roshan Sharami, Lisa Lepp, Chiara Manna, Argentina Anna Rescigno, Alina Karakanta, Ayla Rigouts Terryn, Manuel Lardelli, Natalia Resende, Elena Murgolo, Janiça Hackenbuchner, Anna Zaretskaya, Miquel Esplà-Gomis, Thierry Etchegoyhen, Dagmar Gromann, Rachel Bawden, Barry Haddow, Sara Szoc, Mikel Forcada, Helena Moniz
- Venue:
- EAMT
- SIG:
- Publisher:
- European Association for Machine Translation
- Note:
- Pages:
- 826–838
- Language:
- URL:
- https://aclanthology.org/2026.eamt-1.53/
- DOI:
- Bibkey:
- Cite (ACL):
- Lara Shoana Schlüter, Ekaterina Lapshinova-Koltunski, and Sylvia Jaki. 2026. Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines. In Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1), pages 826–838, Tilburg, The Netherlands. European Association for Machine Translation.
- Cite (Informal):
- Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines (Schlüter et al., EAMT 2026)
- Copy Citation:
- PDF:
- https://aclanthology.org/2026.eamt-1.53.pdf
Export citation
@inproceedings{schluter-etal-2026-quality,
title = "Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines",
author = {Schl{\"u}ter, Lara Shoana and
Lapshinova-Koltunski, Ekaterina and
Jaki, Sylvia},
editor = "Shterionov, Dimitar and
Vanmassenhove, Eva and
De Sisto, Mirella and
Blain, Fred and
Pourmostafa Roshan Sharami, Javad and
Lepp, Lisa and
Manna, Chiara and
Rescigno, Argentina Anna and
Karakanta, Alina and
Rigouts Terryn, Ayla and
Lardelli, Manuel and
Resende, Natalia and
Murgolo, Elena and
Hackenbuchner, Jani{\c{c}}a and
Zaretskaya, Anna and
Espl{\`a}-Gomis, Miquel and
Etchegoyhen, Thierry and
Gromann, Dagmar and
Bawden, Rachel and
Haddow, Barry and
Szoc, Sara and
Forcada, Mikel and
Moniz, Helena",
booktitle = "Proceedings of the 26th Annual Conference of the {E}uropean Association for Machine Translation (Volume 1)",
month = jun,
year = "2026",
address = "Tilburg, The Netherlands",
publisher = "European Association for Machine Translation",
url = "https://aclanthology.org/2026.eamt-1.53/",
pages = "826--838",
ISBN = "9789403901411",
abstract = "The present paper focuses on the analysis of automatic subtitles produced with three different systems. We compare the outputs among each other paying attention to the categories of quality derived from audio-visual translation quality research. Besides that, we also consider comprehensibility of the produced subtitles. Additionally, we analyse the automatic evaluation scores to assess the overall quality. Our results show that automatically generated subtitles subtitles remain below human standards in quality and comprehensibility."
}<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="schluter-etal-2026-quality">
<titleInfo>
<title>Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines</title>
</titleInfo>
<name type="personal">
<namePart type="given">Lara</namePart>
<namePart type="given">Shoana</namePart>
<namePart type="family">Schlüter</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Ekaterina</namePart>
<namePart type="family">Lapshinova-Koltunski</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Sylvia</namePart>
<namePart type="family">Jaki</namePart>
<role>
<roleTerm authority="marcrelator" type="text">author</roleTerm>
</role>
</name>
<originInfo>
<dateIssued>2026-06</dateIssued>
</originInfo>
<typeOfResource>text</typeOfResource>
<relatedItem type="host">
<titleInfo>
<title>Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1)</title>
</titleInfo>
<name type="personal">
<namePart type="given">Dimitar</namePart>
<namePart type="family">Shterionov</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Eva</namePart>
<namePart type="family">Vanmassenhove</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Mirella</namePart>
<namePart type="family">De Sisto</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Fred</namePart>
<namePart type="family">Blain</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Javad</namePart>
<namePart type="family">Pourmostafa Roshan Sharami</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Lisa</namePart>
<namePart type="family">Lepp</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Chiara</namePart>
<namePart type="family">Manna</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Argentina</namePart>
<namePart type="given">Anna</namePart>
<namePart type="family">Rescigno</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Alina</namePart>
<namePart type="family">Karakanta</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Ayla</namePart>
<namePart type="family">Rigouts Terryn</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Manuel</namePart>
<namePart type="family">Lardelli</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Natalia</namePart>
<namePart type="family">Resende</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Elena</namePart>
<namePart type="family">Murgolo</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Janiça</namePart>
<namePart type="family">Hackenbuchner</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Anna</namePart>
<namePart type="family">Zaretskaya</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Miquel</namePart>
<namePart type="family">Esplà-Gomis</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Thierry</namePart>
<namePart type="family">Etchegoyhen</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Dagmar</namePart>
<namePart type="family">Gromann</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Rachel</namePart>
<namePart type="family">Bawden</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Barry</namePart>
<namePart type="family">Haddow</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Sara</namePart>
<namePart type="family">Szoc</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Mikel</namePart>
<namePart type="family">Forcada</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<name type="personal">
<namePart type="given">Helena</namePart>
<namePart type="family">Moniz</namePart>
<role>
<roleTerm authority="marcrelator" type="text">editor</roleTerm>
</role>
</name>
<originInfo>
<publisher>European Association for Machine Translation</publisher>
<place>
<placeTerm type="text">Tilburg, The Netherlands</placeTerm>
</place>
</originInfo>
<genre authority="marcgt">conference publication</genre>
<identifier type="isbn">9789403901411</identifier>
</relatedItem>
<abstract>The present paper focuses on the analysis of automatic subtitles produced with three different systems. We compare the outputs among each other paying attention to the categories of quality derived from audio-visual translation quality research. Besides that, we also consider comprehensibility of the produced subtitles. Additionally, we analyse the automatic evaluation scores to assess the overall quality. Our results show that automatically generated subtitles subtitles remain below human standards in quality and comprehensibility.</abstract>
<identifier type="citekey">schluter-etal-2026-quality</identifier>
<location>
<url>https://aclanthology.org/2026.eamt-1.53/</url>
</location>
<part>
<date>2026-06</date>
<extent unit="page">
<start>826</start>
<end>838</end>
</extent>
</part>
</mods>
</modsCollection>
%0 Conference Proceedings %T Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines %A Schlüter, Lara Shoana %A Lapshinova-Koltunski, Ekaterina %A Jaki, Sylvia %Y Shterionov, Dimitar %Y Vanmassenhove, Eva %Y De Sisto, Mirella %Y Blain, Fred %Y Pourmostafa Roshan Sharami, Javad %Y Lepp, Lisa %Y Manna, Chiara %Y Rescigno, Argentina Anna %Y Karakanta, Alina %Y Rigouts Terryn, Ayla %Y Lardelli, Manuel %Y Resende, Natalia %Y Murgolo, Elena %Y Hackenbuchner, Janiça %Y Zaretskaya, Anna %Y Esplà-Gomis, Miquel %Y Etchegoyhen, Thierry %Y Gromann, Dagmar %Y Bawden, Rachel %Y Haddow, Barry %Y Szoc, Sara %Y Forcada, Mikel %Y Moniz, Helena %S Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1) %D 2026 %8 June %I European Association for Machine Translation %C Tilburg, The Netherlands %@ 9789403901411 %F schluter-etal-2026-quality %X The present paper focuses on the analysis of automatic subtitles produced with three different systems. We compare the outputs among each other paying attention to the categories of quality derived from audio-visual translation quality research. Besides that, we also consider comprehensibility of the produced subtitles. Additionally, we analyse the automatic evaluation scores to assess the overall quality. Our results show that automatically generated subtitles subtitles remain below human standards in quality and comprehensibility. %U https://aclanthology.org/2026.eamt-1.53/ %P 826-838
Markdown (Informal)
[Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines](https://aclanthology.org/2026.eamt-1.53/) (Schlüter et al., EAMT 2026)
- Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines (Schlüter et al., EAMT 2026)
ACL
- Lara Shoana Schlüter, Ekaterina Lapshinova-Koltunski, and Sylvia Jaki. 2026. Quality and Comprehensibility of Interlingual Subtitles Produced by Humans or with Machines. In Proceedings of the 26th Annual Conference of the European Association for Machine Translation (Volume 1), pages 826–838, Tilburg, The Netherlands. European Association for Machine Translation.