Prakhar Joshi
Author directoryAlso published as: Prakhar joshi
2026
AI-Monitors at SemEval-2026 Task 4: A Hybrid Embedding and LLM Ensemble for Narrative Similarity
Vishnu Tripathi | Prakhar Joshi | Azad Singh | Pragyanand Saho | Gaurav Kumar | Neel Mani | Piyush Arora
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Vishnu Tripathi | Prakhar Joshi | Azad Singh | Pragyanand Saho | Gaurav Kumar | Neel Mani | Piyush Arora
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Narrative similarity requires reasoning over the deeper structural properties of stories - shared themes, causal progression, and outcomes - rather than surface-level lexical overlap. We describe AI-Monitors, our system for SemEval-2026 Task 4 (Track A), which determines which of two candidate stories is more narratively similar to a given anchor. We explore a progression of approaches - from embedding-based similarity to structured LLM prompting and ensemble construction - guided by four hypotheses about where narrative reasoning gains can be found. The final system achieves 75% test accuracy on 400 instances, ranking 3rd out of 47 systems and approaching the individual human annotator ceiling of 78%.Our key findings are: i) structured few-shot prompting substantially outperforms dense embedding similarity; ii) selecting ensemble components by how differently they make errors - rather than by accuracy alone - produces stronger predictions; and iii) how you describe an example to the model affects its predictions.
AI-Monitors at ChildSafeAds 2026: A Routed Hybrid for Commercial Content in Child-Facing YouTube Videos
Pragyananda sahoo | Vishnu Tripathi | Prakhar joshi | Gaurav Kumar | Neel Mani
Proceedings of the Natural Legal Language Processing Workshop 2026
Pragyananda sahoo | Vishnu Tripathi | Prakhar joshi | Gaurav Kumar | Neel Mani
Proceedings of the Natural Legal Language Processing Workshop 2026
We describe AI-Monitors, our system for the ChildSafeAds shared task at NLLP@EMNLP 2026. The task labels sponsored segments in YouTube videos aimed at teenagers with their commercial type, product category and compliance-risk flags, and provides the input at four levels of increasing collection cost, from the free transcript to a crawled product page. Our system gives each sub-task its own input level and model: a fine-tuned ModernBERT-large encoder reading all four levels predicts commercial type and product category, the latter averaged with a TF-IDF classifier; a second encoder reading only the transcript predicts the compliance flags, averaged on the two disclosure flags with a QLoRA-tuned Qwen2.5-7B-Instruct that also reads the video metadata, before rules from the task’s taxonomy are applied. The system scored 0.6223 mean macro-F1 on the test set, 11th of 21 teams, and labels the 503 test instances in 25.5 GPU-minutes. We report the experiments behind each design choice: in our runs the crawled page helped product categorisation but not compliance flagging, the taxonomy’s definitions helped a prompted model while the legal provisions added little, and in two cases our validation procedure was misleading.
2025
AI-Monitors at GenAI Detection Task 1: Fast and Scalable Machine Generated Text Detection
Azad Singh | Vishnu Tripathi | Ravindra Kumar Pandey | Pragyanand Saho | Prakhar Joshi | Neel Mani | Richa Alagh | Pallaw Mishra | Piyush Arora
Proceedings of the 1stWorkshop on GenAI Content Detection (GenAIDetect)
Azad Singh | Vishnu Tripathi | Ravindra Kumar Pandey | Pragyanand Saho | Prakhar Joshi | Neel Mani | Richa Alagh | Pallaw Mishra | Piyush Arora
Proceedings of the 1stWorkshop on GenAI Content Detection (GenAIDetect)
We describe the work carried out by our team, AI-Monitors, on the Binary Multilingual Machine-Generated Text Detection (Human vs. Machine) task at COLING 2025. This task aims to determine whether a given text is generated by a machine or authored by a human. We propose a lightweight, simple, and scalable approach using encoder models such as RoBERTa and XLM-R We provide an in-depth analysis based on our experiments. Our study found that carefully exploring fine-tuned parameters such as i) no. of training epochs, ii) maximum input size, iii) handling class imbalance etc., plays an important role in building an effective system to achieve good results and can significantly impact the underlying tasks. We found the optimum setting of these parameters can lead to a difference of about 5-6% in absolute terms for measure such as accuracy and F1 measure. The paper presents crucial insights into optimal parameter selection for fine-tuning RoBERTa and XLM-R based models to detect whether a given text is generated by a machine or a human.