Zhen Qi
Author directory2026
ChainSWE: Benchmarking Coding Agents on Multi-Bug Software Maintenance
Qirui Jin | Lingching Tung | Kenan Li | Qiyang Shi | Yushi She | Huanzhong Jia | Harrison Zhao | Kejing Xia | Zhenbang Du | Jiaxin Pei | Zhenyu Zhang | Zhen Qi | Yuyan Duan | Wenke Lee | Zijian Jin
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Qirui Jin | Lingching Tung | Kenan Li | Qiyang Shi | Yushi She | Huanzhong Jia | Harrison Zhao | Kejing Xia | Zhenbang Du | Jiaxin Pei | Zhenyu Zhang | Zhen Qi | Yuyan Duan | Wenke Lee | Zijian Jin
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Language model (LM) agents are increasingly deployed to maintain codebases over extended periods, fixing streams of related defects while carrying context from one fix to the next. Yet existing software engineering (SWE) benchmarks evaluate models one bug at a time: the repository is reset, the codebase is re-read, and a single self-contained issue is graded in isolation. This setting collapses a continuous maintenance workflow into a series of independent sessions, ignoring the cumulative dependencies that make real-world bug fixing challenging. To bridge this gap, we introduce ChainSWE, the first benchmark for evaluating agents on sequential, dependent bug fixes within a shared codebase. We collect chronological chains of 304 issues across 54 Python projects, mined from six SWE-bench-family datasets. Our evaluation across a range of agents and models reveals a consistent performance drop by **up to 70%** as the chain length increases. Our data and code is available at [C-lister/ChainSWE](https://huggingface.co/datasets/C-lister/ChainSWE).