Vijayasri Iyer
Author directory2026
RefactorPlatform: An Open-Source Harness for Controlled Evaluation of Repository-Scale Refactoring Agents
Aziz Ben Amor | Drish Mali | Mann Acharya | Vijayasri Iyer | Sébastien Bratières
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Aziz Ben Amor | Drish Mali | Mann Acharya | Vijayasri Iyer | Sébastien Bratières
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Repository-scale refactoring requires coding agents to propagate a single change across many interdependent files without altering pro- gram behavior, yet to our knowledge no existing harness isolates the design choices that determine agent success on this task. We present RefactorPlatform, an open-source evaluation harness that holds the environment fixed and varies each design axis explicitly: model backbone (via OpenRouter and GitHub Copilot CLI), execution regime (baseline, retrieval-augmented, and multi-agent), and prompt specificity. Each run executes in an isolated workspace with live terminal streaming, per-task logging of tokens, diffs, and transcripts, AST-based verification, and exportable telemetry for audit and reproduction. Demonstrating the platform on 100 multi-file RefactorBench tasks across four model families, we illustrate the analyses it supports: AST-aware chunking outperforms naive token-window chunking by 25-30 percentage points (pp) across prompt modes, whereas naive retrieval falls below the retrieval-free baseline; a lean retrieval-augmented single agent (86%) beats the sub-agent configuration we evaluated (66%) on matched tasks with no task passing under delegation that fails under retrieval; and retrieval’s accuracy gains absorb its token overhead, leaving cost per successful refactoring unchanged. RefactorPlatform is open-sourced to make refactoring-agent evaluation reproducible and auditable.
EVE: A Domain-Specific LLM Framework for Earth Intelligence
Àlex R. Atrio | Antonio Lopez | Jino Rohit | Yassine El Ouahidi | Marcello Politi | Vijayasri Iyer | Umar Jamil | Sébastien Bratières | Nicolas Longépé
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
Àlex R. Atrio | Antonio Lopez | Jino Rohit | Yassine El Ouahidi | Marcello Politi | Vijayasri Iyer | Umar Jamil | Sébastien Bratières | Nicolas Longépé
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 6: Industry Track)
We introduce Earth Virtual Expert (EVE), the first open-source, end-to-end initiative for developing and deploying domain-specialized LLMs for Earth Intelligence. At its core is EVE-Instruct, a domain-adapted 24B model built on Mistral Small 3.2 and optimized for reasoning and question answering. On newly constructed Earth Observation and Earth Sciences benchmarks, it outperforms comparable models while preserving general capabilities.We release curated training corpora and the first systematic domain-specific evaluation benchmarks, covering MCQA, open-ended QA, and factuality. EVE further integrates RAG and a hallucination-detection pipeline into a production system deployed via API and GUI, supporting 350 pilot users. All models, datasets, and code are publicly available.