Detecting deepfakes and false ads through analysis of text and social engineering techniques

Alicja Martinek, Ewelina Bartuzi-Trokielewicz


Abstract
Existing deepfake detection algorithm frequently fail to successfully identify fabricated materials. These algorithms primarily focus on technical analysis of video and audio, often neglecting the meaning of content itself. In this paper, we introduce a novel approach that emphasizes the analysis of text-based transcripts, particularly those from AI-generated deepfake advertisements, placing the text content at the center of attention. Our method combines linguistic features, evaluation of grammatical mistakes, and the identification of social engineering techniques commonly used in fraudulent content. By examining stylistic inconsistencies and manipulative language patterns, we enhance the accuracy of distinguishing between real and deepfake materials. To ensure interpretability, we employed classical machine learning models, allowing us to provide explainable insights into decision-making processes. Additionally, zero-shot evaluations were conducted using three large language model based solutions to assess their performance in detecting deepfake content. The experimental results show that these factors yield a 90% accuracy in distinguishing between deepfake-based fraudulent advertisements and real ones. This demonstrates the effectiveness of incorporating content-based analysis into deepfake detection, offering a complementary layer to existing audio-visual techniques.
Anthology ID:
2025.coling-main.564
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8432–8448
Language:
URL:
https://aclanthology.org/2025.coling-main.564/
DOI:
Bibkey:
Cite (ACL):
Alicja Martinek and Ewelina Bartuzi-Trokielewicz. 2025. Detecting deepfakes and false ads through analysis of text and social engineering techniques. In Proceedings of the 31st International Conference on Computational Linguistics, pages 8432–8448, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Detecting deepfakes and false ads through analysis of text and social engineering techniques (Martinek & Bartuzi-Trokielewicz, COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.564.pdf