Tatiana Muniz Rodriguez

Author directory

2026

The rapid proliferation of LLMs has further heightened the necessity to develop dependable AI-generated text detection, especially beyond English. Nevertheless, current benchmarks pay little attention to Indic languages and test detectors in idealized settings that do not represent the real world. We present a generalized benchmark for AI-generated text detection in Hindi, Telugu, and Tamil, which we name IndicDetect is a benchmark designed to assess the robustness of detectors under realistic distribution shifts. IndicDetect comprises highly curated human-written texts matched with LLM-generated counterparts across various domains and generators, and systematically evaluates detectors in the presence of domain shift, generator shift, and adversarial perturbation. Using a single and repeatable evaluation scheme, we evaluate a wide range of statistical and neural detectors. We find substantial robustness failures: supervised neural detectors perform well in-distribution, but most training-free methods fail catastrophically on unseen generators and adversarial attacks, with larger failures observed for Telugu and Tamil than for Hindi. These results highlight that the primary weakness of existing detectors in Indic settings lies in their robustness, not peak accuracy. IndicDetect provides standard data splits, an evaluation protocol, and baselines to establish a robust, language-aware foundation for AI-generated text detection in Indic scripts.