A Case Study of On-Premise ReAct for Collaborative Robot Programming

Yu-Seung Ma, Sangyeop Yeo


Abstract
LLM-based coding agents are increasingly used in software development, but their use in industrial robot programming remains constrained by vendor-specific APIs, organization-specific code assets, and on-premise deployment requirements. We study a bounded ReAct agent that uses local retrieval over API documentation and code examples to generate collaborative-robot programs from natural-language requirements.

This work is a case study of a structured programming domain in which domain knowledge must remain within the organizational boundary and local models may be sufficient. We evaluate seven open-weight models from 7B to 32B parameters, with five independent runs per model, and include one commercial model as a reference. We also apply the same framework to a smaller public Universal Robots set.

Under our agent and evaluation setup, the strongest local 27B model achieves a mean task success rate of 89.6%. Smaller models often use more steps and tokens because they repeat retrieval or fail to convert retrieved evidence into code. These results suggest that model selection should consider task success, interaction efficiency, and run-to-run consistency.
Anthology ID:
2026.realm-1.69
Volume:
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ehsan Kamalloo, Nicolas Gontier, Nikolai Rozanov, Maryam Hashemzadeh, Akhil Arora
Venues:
REALM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1003–1010
Language:
URL:
https://aclanthology.org/2026.realm-1.69/
DOI:
Bibkey:
Cite (ACL):
Yu-Seung Ma and Sangyeop Yeo. 2026. A Case Study of On-Premise ReAct for Collaborative Robot Programming. In Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026), pages 1003–1010, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Case Study of On-Premise ReAct for Collaborative Robot Programming (Ma & Yeo, REALM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.realm-1.69.pdf