DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories Jia Li author Ge Li author Yunfei Zhao author Yongmin Li author Huanyu Liu author Hao Zhu author Lecheng Wang author Kaibo Liu author Zheng Fang author Lanshen Wang author Jiazheng Ding author Xuanming Zhang author Yuqi Zhu author Yihong Dong author Zhi Jin author Binhua Li author Fei Huang author Yongbin Li author Bin Gu author Mengfei Yang author 2024-08 text Findings of the Association for Computational Linguistics: ACL 2024 Lun-Wei Ku editor Andre Martins editor Vivek Srikumar editor Association for Computational Linguistics Bangkok, Thailand conference publication li-etal-2024-deveval 10.18653/v1/2024.findings-acl.214 https://aclanthology.org/2024.findings-acl.214/ 2024-08 3603 3614