SafeBranch: Branch-Pair Safety Alignment for Embodied Agents

Hyunse Lee, Jiwoo Jung, Haneul Lee, Kyochul Jang, Youngjae Yu, Woojin Lee


Abstract
Vision-language-model-based embodied agents can complete instructed tasks but often violate safety constraints in the process, a problem recently framed as interactive safety. Training such agents to act safely is difficult, since safety and task success are distinct objectives, and safety arises only at a small number of safety-critical steps within a trajectory. Standard supervision is insufficient: imitating safe trajectories teaches behavior without explaining why it is safe, and contrasting arbitrary safe and unsafe trajectories mixes the safety signal with unrelated differences. We propose SafeBranch, a framework that aligns an embodied actor on safety through branch pairs constructed from the actor’s own unsafe rollouts via environment rollback. SafeBranch rolls each unsafe rollout back to the safety-critical step that caused the violation, queries the actor for a safe alternative, and pairs the original action with the alternative so that the two branches differ only at that step. The trained actor acts safely at deployment with no critic in the loop. On IS-Bench, SafetyALFRED, and out-of-distribution variants with unseen tasks and objects, it improves safe task completion, achieving roughly ten times more safe successes than the untrained baseline on the unseen-object variant. Project page: https://github.com/98hyunse/SafeBranch.
Anthology ID:
2026.findings-emnlp.1730
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
36985–37010
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1730/
DOI:
Bibkey:
Cite (ACL):
Hyunse Lee, Jiwoo Jung, Haneul Lee, Kyochul Jang, Youngjae Yu, and Woojin Lee. 2026. SafeBranch: Branch-Pair Safety Alignment for Embodied Agents. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 36985–37010, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SafeBranch: Branch-Pair Safety Alignment for Embodied Agents (Lee et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1730.pdf