VISTA: A Controllable Platform for Generating and Auditing Egocentric Assistance Scenarios

Yu-Hsiang Liu, Yu-Chien Tang, An-Zi Yen


Abstract
First-person assistance situations are difficult to collect with controlled timing and evidence: rare hazards should not be staged, while ordinary needs often depend on subtle visual and conversational context. We present VISTA, an interactive platform that treats scenario creation as an inspectable authoring workflow rather than a one-shot video prompt. A six-stage compiler turns a seed into typed intent, scene, event, interaction, rendering, and media artifacts; human reviewers can inspect revisions and provider requests before approving execution. We evaluate the rendered outputs, not the authoring interface. In a blinded study of 60 scenarios, 11 evaluators supplied 165 judgments. They selected the human-reviewed VISTA output as the best match to the seed in 52.1% of judgments, versus 22.4% for a one-pass seed-plus-assets baseline and 25.5% for seed-only generation. Case-balanced seed-match scores were 3.65, 3.27, and 3.22, respectively. These results support the complete workflow under the tested renderers; they do not establish interface usability, authoring efficiency, or a novel planning algorithm. The public artifact is a credential-free prepared replay with a narrated screencast.
Anthology ID:
2026.emnlp-demos.81
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sweta Agrawal, Alberto Abad
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
859–867
Language:
URL:
https://aclanthology.org/2026.emnlp-demos.81/
DOI:
Bibkey:
Cite (ACL):
Yu-Hsiang Liu, Yu-Chien Tang, and An-Zi Yen. 2026. VISTA: A Controllable Platform for Generating and Auditing Egocentric Assistance Scenarios. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 859–867, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
VISTA: A Controllable Platform for Generating and Auditing Egocentric Assistance Scenarios (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-demos.81.pdf