Ratnesh Kumar Joshi
Author directory2026
EcoStatKG: A Domain-Specific Statistical Knowledge Graph and Benchmark for Evaluating Numerical Hallucination in LLMs
Ratnesh Kumar Joshi | Sagnik Sengupta | Asif Ekbal
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Ratnesh Kumar Joshi | Sagnik Sengupta | Asif Ekbal
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models routinely produce numerical hallucinations—plausible but incorrect quantities, percentages, and statistics—yet existing benchmarks focus almost exclusively on entity-level factuality. We introduce EcoStatKG, a knowledge graph (KG) of 50,746 statistical triples and 306,231 structural triples from 6,871 Wikipedia articles on environmental sustainability, and NumHallu, a 500-question numerical benchmark grounded in held-out KG topics. We use these resources to diagnose how knowledge-base coverage affects eight retrieval strategies across six LLMs. In the full-index, oracle-coverage condition, simple cosine retrieval reaches 0.989 Numerical Exact Match (NEM), statistically indistinguishable from Graph RAG (0.992; paired-bootstrap p=0.14). In the deliberately constructed held-out condition, which removes answer-bearing triples, retrieval methods fall below the zero-shot baseline (0.506 NEM), exposing the risk that topically related numerical distractors can override parametric knowledge. Similarity-threshold filtering restores KG Cosine to near-baseline performance (0.511), rather than establishing a new state-of-the-art. A bounded clinical-domain proof of concept reproduces the coverage and distractor patterns. The contribution is a diagnostic study and resource: its results clarify when numerical retrieval helps, when missing coverage can make it harmful, and why confidence gating is best viewed as damage control.
2024
TRIP NEGOTIATOR: A Travel Persona-aware Reinforced Dialogue Generation Model for Personalized Integrative Negotiation in Tourism
Priyanshu Priya | Desai Vishesh Yasheshbhai | Ratnesh Kumar Joshi | Roshni Ramnani | Anutosh Maitra | Shubhashis Sengupta | Asif Ekbal
Findings of the Association for Computational Linguistics: EMNLP 2024
Priyanshu Priya | Desai Vishesh Yasheshbhai | Ratnesh Kumar Joshi | Roshni Ramnani | Anutosh Maitra | Shubhashis Sengupta | Asif Ekbal
Findings of the Association for Computational Linguistics: EMNLP 2024
A sophisticated negotiation dialogue system for tourism should engage in negotiations beyond mere price considerations, encompassing various other aspects and amenities inherent in the tourism package. To ensure such tailored interaction, it is imperative to understand the intricacies of traveler preferences, constraints, and expectations. Incorporating these personality facets allows for customizing negotiation strategies, resulting in a more personalized and integrative experience. With this aim, we take a pivotal step in advancing automated dialogue systems for personalized integrative negotiation tasks. We develop DEAL, a pioneering Dialogue datasEt for personALized integrative negotiation task in the tourism domain. Further, we propose TRIP NEGOTIATOR, a novel Travel persona-aware Reinforced dIalogue generation model for Personalized iNtegrative nEGOTIATion within the tOuRism domain. TRIP NEGOTIATOR is built to discern the traveler’s persona and intent, systematically adjusts negotiation strategies, and directs the negotiation toward a pertinent phase to ensure effective negotiation. Through reinforcement learning with Proximal Policy Optimization (PPO), we guide TRIP NEGOTIATOR to generate coherent and diverse responses consistent with the traveler’s personality. Extensive qualitative and quantitative analyses demonstrate the effectiveness of TRIP NEGOTIATOR in generating personalized responses during negotiation.