In-Place Feedback: Reliable Refinement for Multi-Turn Expert-LLM Collaboration

Youngbin Choi, Minjong Lee, Saemi Moon, Seunghyuk Cho, Chaehyeon Chung, MoonJeong Park, Dongwoo Kim


Abstract
LLM-generated drafts often contain subtle factual or logical errors, yet prior work shows that models struggle to reliably integrate multi-turn feedback aimed at fixing them. We propose *in-place feedback*, an interaction paradigm in which the user directly edits the model’s previous response and the model continues generation from the edited context. In-place feedback consistently outperforms standard multi-turn feedback across five reasoning-intensive benchmarks while requiring fewer tokens, and our fine-grained analysis shows that it applies corrections more reliably and propagates them to subsequent reasoning. A user study with domain experts refining LLM-generated summaries corroborates these findings: participants report higher final-output satisfaction and substantially lower fatigue with in-place feedback, and a mixed strategy combining in-place and multi-turn feedback improves every dimension we measure. These results suggest that editing errors in place is a more reliable way to incorporate expert corrections than multi-turn feedback, while combining the two acts complementarily to form a more effective collaboration than either mechanism alone.
Anthology ID:
2026.emnlp-main.1338
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
30503–30545
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1338/
DOI:
Bibkey:
Cite (ACL):
Youngbin Choi, Minjong Lee, Saemi Moon, Seunghyuk Cho, Chaehyeon Chung, MoonJeong Park, and Dongwoo Kim. 2026. In-Place Feedback: Reliable Refinement for Multi-Turn Expert-LLM Collaboration. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 30503–30545, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
In-Place Feedback: Reliable Refinement for Multi-Turn Expert-LLM Collaboration (Choi et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1338.pdf