Mohammed Abdul Khaliq
2024
RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models
Mohammed Abdul Khaliq
|
Paul Yu-Chun Chang
|
Mingyang Ma
|
Bernhard Pflugfelder
|
Filip Miletić
Proceedings of the Seventh Fact Extraction and VERification Workshop (FEVER)
The escalating challenge of misinformation, particularly in political discourse, requires advanced fact-checking solutions; this is even clearer in the more complex scenario of multimodal claims. We tackle this issue using a multimodal large language model in conjunction with retrieval-augmented generation (RAG), and introduce two novel reasoning techniques: Chain of RAG (CoRAG) and Tree of RAG (ToRAG). They fact-check multimodal claims by extracting both textual and image content, retrieving external information, and reasoning subsequent questions to be answered based on prior evidence. We achieve a weighted F1-score of 0.85, surpassing a baseline reasoning technique by 0.14 points. Human evaluation confirms that the vast majority of our generated fact-check explanations contain all information from gold standard data.
2022
Identifying Human Needs through Social Media: A study on Indian cities during COVID-19
Sunny Rai
|
Rohan Joseph
|
Prakruti Singh Thakur
|
Mohammed Abdul Khaliq
Proceedings of the Tenth International Workshop on Natural Language Processing for Social Media
In this paper, we present a minimally-supervised approach to identify human needs expressed in tweets. Taking inspiration from Frustration-Aggression theory, we trained RoBERTa model to classify tweets expressing frustration which serves as an indicator of unmet needs. Although the notion of frustration is highly subjective and complex, the findings support the use of pretrained language model in identifying tweets with unmet needs. Our study reveals the major causes behind feeling frustrated during the lockdown and the second wave of the COVID-19 pandemic in India. Our proposed approach can be useful in timely identification and prioritization of emerging human needs in the event of a crisis.
Search
Co-authors
- Sunny Rai 1
- Rohan Joseph 1
- Prakruti Singh Thakur 1
- Paul Yu-Chun Chang 1
- Mingyang Ma 1
- show all...