Fix-Filter-Fix: Intuitively Connect Any Models for Effective Bug Fixing

Haiwen Hong, Jingfeng Zhang, Yin Zhang, Yao Wan, Yulei Sui


Abstract
Locating and fixing bugs is a time-consuming task. Most neural machine translation (NMT) based approaches for automatically bug fixing lack generality and do not make full use of the rich information in the source code. In NMT-based bug fixing, we find some predicted code identical to the input buggy code (called unchanged fix) in NMT-based approaches due to high similarity between buggy and fixed code (e.g., the difference may only appear in one particular line). Obviously, unchanged fix is not the correct fix because it is the same as the buggy code that needs to be fixed. Based on these, we propose an intuitive yet effective general framework (called Fix-Filter-Fix or Fˆ3) for bug fixing. Fˆ3 connects models with our filter mechanism to filter out the last model’s unchanged fix to the next. We propose an Fˆ3 theory that can quantitatively and accurately calculate the Fˆ3 lifting effect. To evaluate, we implement the Seq2Seq Transformer (ST) and the AST2Seq Transformer (AT) to form some basic Fˆ3 instances, called Fˆ3_ST+AT and Fˆ3_AT+ST. Comparing them with single model approaches and many model connection baselines across four datasets validates the effectiveness and generality of Fˆ3 and corroborates our findings and methodology.
Anthology ID:
2021.emnlp-main.282
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3495–3504
Language:
URL:
https://aclanthology.org/2021.emnlp-main.282
DOI:
10.18653/v1/2021.emnlp-main.282
Bibkey:
Cite (ACL):
Haiwen Hong, Jingfeng Zhang, Yin Zhang, Yao Wan, and Yulei Sui. 2021. Fix-Filter-Fix: Intuitively Connect Any Models for Effective Bug Fixing. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3495–3504, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Fix-Filter-Fix: Intuitively Connect Any Models for Effective Bug Fixing (Hong et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.282.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.282.mp4