Effect of Pivot Language and Segment-Based Few-Shot Prompting for Cross-Domain Multi-Intent Identification in Low Resource Languages

Mitra Kathakali, Ashish Aditha Venkata Santosh, Teotia Soumya, Malapati Aruna


Abstract
NLU (Natural Language Understanding) has considerable difficulties in identifying multiple intentions across different domains in languages with limited resources. Our contributions involve utilizing pivot languages with similar semantics for NLU tasks, creating a vector database for efficient retrieval and indexing of language embeddings in high-resource languages for Retrieval Augmented Generation (RAG) in low-resource languages, and thoroughly investigating the effect of segmentbased strategies on complex user utterances across multiple domains and intents in the development of a Chain of Thought Prompting (COT) combined with Retrieval Augmented Generation. The study investigated recursive approaches to identify the most effective zeroshot instances for segment-based prompting. A comparison analysis was conducted to compare the effectiveness of sentence-based prompting vs segment-based prompting across different domains and multiple intents. This research offers a promising avenue to address the formidable challenges of NLU in low-resource languages, with potential applications in conversational agents and dialogue systems and a broader impact on linguistic understanding and inclusivity.
Anthology ID:
2023.icon-1.27
Volume:
Proceedings of the 20th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2023
Address:
Goa University, Goa, India
Editors:
D. Pawar Jyoti, Lalitha Devi Sobha
Venue:
ICON
SIG:
SIGLEX
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
349–356
Language:
URL:
https://aclanthology.org/2023.icon-1.27
DOI:
Bibkey:
Cite (ACL):
Mitra Kathakali, Ashish Aditha Venkata Santosh, Teotia Soumya, and Malapati Aruna. 2023. Effect of Pivot Language and Segment-Based Few-Shot Prompting for Cross-Domain Multi-Intent Identification in Low Resource Languages. In Proceedings of the 20th International Conference on Natural Language Processing (ICON), pages 349–356, Goa University, Goa, India. NLP Association of India (NLPAI).
Cite (Informal):
Effect of Pivot Language and Segment-Based Few-Shot Prompting for Cross-Domain Multi-Intent Identification in Low Resource Languages (Kathakali et al., ICON 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.icon-1.27.pdf