2024
pdf
bib
abs
Improving Explainable Fact-Checking via Sentence-Level Factual Reasoning
Francielle Vargas
|
Isadora Salles
|
Diego Alves
|
Ameeta Agrawal
|
Thiago A. S. Pardo
|
Fabrício Benevenuto
Proceedings of the Seventh Fact Extraction and VERification Workshop (FEVER)
Most existing fact-checking systems are unable to explain their decisions by providing relevant rationales (justifications) for their predictions. It highlights a lack of transparency that poses significant risks, such as the prevalence of unexpected biases, which may increase political polarization due to limitations in impartiality. To address this critical gap, we introduce SEntence-Level FActual Reasoning (SELFAR), aimed at improving explainable fact-checking. SELFAR relies on fact extraction and verification by predicting the news source reliability and factuality (veracity) of news articles or claims at the sentence level, generating post-hoc explanations using SHAP/LIME and zero-shot prompts. Our experiments show that unreliable news stories predominantly consist of subjective statements, in contrast to reliable ones. Consequently, predicting unreliable news articles at the sentence level by analyzing impartiality and subjectivity is a promising approach for fact extraction and improving explainable fact-checking. Furthermore, LIME outperforms SHAP in explaining predictions on reliability. Additionally, while zero-shot prompts provide highly readable explanations and achieve an accuracy of 0.71 in predicting factuality, their tendency to hallucinate remains a challenge. Lastly, this paper also presents the first study on explainable fact-checking in the Portuguese language.
2023
pdf
bib
Construções sintaticas do português que desafiam a tarefa de parsing: uma analise qualitativa
Magali S. Duran
|
Maria das Graças V. Nunes
|
Thiago A. S. Pardo
Proceedings of the 2nd Edition of the Universal Dependencies Brazilian Festival
2020
pdf
bib
abs
NILC at WebNLG+: Pretrained Sequence-to-Sequence Models on RDF-to-Text Generation
Marco Antonio Sobrevilla Cabezudo
|
Thiago A. S. Pardo
Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+)
This paper describes the submission by the NILC Computational Linguistics research group of the University of São Paulo/Brazil to the RDF-to-Text task for English at the WebNLG+ challenge. The success of the current pretrained models like BERT or GPT-2 in text-to-text generation tasks is well-known, however, its application/success on data-totext generation has not been well-studied and proven. This way, we explore how good a pretrained model, in particular BART, performs on the data-to-text generation task. The results obtained were worse than the baseline and other systems in almost all automatic measures. However, the human evaluation shows better results for our system. Besides, results suggest that BART may generate paraphrases of reference texts.
2015
pdf
bib
Joint semantic discourse models for automatic multi-document summarization
Paula C. Figueira Cardoso
|
Thiago A. S. Pardo
Proceedings of the 10th Brazilian Symposium in Information and Human Language Technology
pdf
bib
On Strategies of Human Multi-Document Summarization
Renata Tironi de Camargo
|
Ariani Di Felippo
|
Thiago A. S. Pardo
Proceedings of the 10th Brazilian Symposium in Information and Human Language Technology
pdf
bib
Enriching entity grids and graphs with discourse relations: the impact in local coherence evaluation
Márcio de S. Dias
|
Thiago A. S. Pardo
Proceedings of the 10th Brazilian Symposium in Information and Human Language Technology
2013
pdf
bib
Subtopic Annotation in a Corpus of News Texts: Steps Towards Automatic Subtopic Segmentation
Paula C. F. Cardoso
|
Maite Taboada
|
Thiago A. S. Pardo
Proceedings of the 9th Brazilian Symposium in Information and Human Language Technology
2007
pdf
bib
Extractive Automatic Summarization: Does more Linguistic Knowledge Make a Difference?
Daniel S. Leite
|
Lucia H. M. Rino
|
Thiago A. S. Pardo
|
Maria das Graças V. Nunes
Proceedings of the Second Workshop on TextGraphs: Graph-Based Algorithms for Natural Language Processing