Asif Hanif
2024
PALM: Few-Shot Prompt Learning for Audio Language Models
Asif Hanif
|
Maha Tufail Agro
|
Mohammad Areeb Qazi
|
Hanan Aldarmaki
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Audio-Language Models (ALMs) have recently achieved remarkable success in zero-shot audio recognition tasks, which match features of audio waveforms with class-specific text prompt features, inspired by advancements in Vision-Language Models (VLMs). Given the sensitivity of zero-shot performance to the choice of hand-crafted text prompts, many prompt learning techniques have been developed for VLMs. We explore the efficacy of these approaches in ALMs and propose a novel method, Prompt Learning in Audio Language Models (PALM), which optimizes the feature space of the text encoder branch. Unlike existing methods that work in the input space, our approach results in greater training efficiency. We demonstrate the effectiveness of our approach on 11 audio recognition datasets, encompassing a variety of speech-processing tasks, and compare the results with three baselines in a few-shot learning setup. Our method is either on par with or outperforms other approaches while being computationally less demanding. Our code is publicly available at https://asif-hanif.github.io/palm/.
2023
Detecting Propaganda Techniques in Code-Switched Social Media Text
Muhammad Salman
|
Asif Hanif
|
Shady Shehata
|
Preslav Nakov
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Propaganda is a form of communication intended to influence the opinions and the mindset of the public to promote a particular agenda. With the rise of social media, propaganda has spread rapidly, leading to the need for automatic propaganda detection systems. Most work on propaganda detection has focused on high-resource languages, such as English, and little effort has been made to detect propaganda for low-resource languages. Yet, it is common to find a mix of multiple languages in social media communication, a phenomenon known as code-switching. Code-switching combines different languages within the same text, which poses a challenge for automatic systems. Considering this premise, we propose a novel task of detecting propaganda techniques in code-switched text. To support this task, we create a corpus of 1,030 texts code-switching between English and Roman Urdu, annotated with 20 propaganda techniques at fragment-level. We perform a number of experiments contrasting different experimental setups, and we find that it is important to model the multilinguality directly rather than using translation as well as to use the right fine-tuning strategy. We plan to publicly release our code and dataset.
Search
Co-authors
- Maha Tufail Agro 1
- Mohammad Areeb Qazi 1
- Hanan Aldarmaki 1
- Muhammad Salman 1
- Shady Shehata 1
- show all...