FailAlign: Failure-Aligned Bootstrapping for Long-Horizon HTML Based Code Generation Agents

Fanglin Xu, Wei Zhang, Jian Yang, Guo Chen, Liqun Yang, Zhoujun Li


Abstract
LLM-based web agents automate browser interactions by generating structured action sequences, yet their deployment in long-horizon tasks is hindered by fragile error propagation in noisy DOM trees. Critically, existing training paradigms rely exclusively on positive supervision from gold demonstrations, teaching models **what** is correct but never **why** plausible alternatives fail, leaving agents unable to distinguish between subtly different yet critically divergent choices. We propose **FailAlign**, a failure-aligned learning framework that systematically integrates error signals as first-class training supervision. We mine a Failure Index from model rollouts by pinpointing first-error steps, then leverage these instances across a three-stage pipeline: (i) action-grounded context compression distills verbose HTML into compact DOM snippets; (ii) hard-negative DPO pairs gold actions with semantically similar incorrect alternatives to sharpen decision boundaries; (iii) trajectory-level GRPO mitigates error cascades by re-simulating corrected trajectories. On Mind2Web with Qwen3-32B, FailAlign achieves **49.7% SSR** and **5.6% SR**, surpassing models 15× larger (Qwen3-Coder-480B: 37.0% SSR) and commercial systems (Claude Opus-4.5: 39.4% SSR), validating the efficacy of learning from failures.
Anthology ID:
2026.findings-emnlp.724
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
15223–15236
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.724/
DOI:
Bibkey:
Cite (ACL):
Fanglin Xu, Wei Zhang, Jian Yang, Guo Chen, Liqun Yang, and Zhoujun Li. 2026. FailAlign: Failure-Aligned Bootstrapping for Long-Horizon HTML Based Code Generation Agents. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 15223–15236, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
FailAlign: Failure-Aligned Bootstrapping for Long-Horizon HTML Based Code Generation Agents (Xu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.724.pdf