Moa Lidén
Author directory2026
Text-Based Veracity Assessment of Verbal Statements in Swedish
Clara Gustafsson | Moa Lidén | Joakim Nivre
Findings of the Association for Computational Linguistics: EMNLP 2026
Clara Gustafsson | Moa Lidén | Joakim Nivre
Findings of the Association for Computational Linguistics: EMNLP 2026
Determining the veracity of a verbal statement is a frequent and challenging task for legal practitioners. The Swedish Supreme Court has proposed a set of truth-indicative reliability criteria for assessing verbal statements in the Swedish legal system. LLMs’ growing ability to reason and handle complex tasks raises questions about how they perform veracity judgments of verbal statements. In this study, we explore this question on a novel Swedish mock-crime dataset. We compare simple prompting to a two-step method in which the LLM is first asked to assess the reliability criteria and then perform a criteria-informed veracity judgment. We find that accuracy is at chance level under both conditions, but that the two-step method often leads to a more reasonable truth bias and reduces models’ overconfidence. Further analysis indicates that criteria assessments predict final judgments, but not ground truth. We also find that the statement category (true or false and confession or denial) matters to overall performance and the effect of two-step prompting.
Search