G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition

Jing Peng, Ziyi Chen, Haoyu Li, Yucheng Wang, Mengtian Li, Duo MA, Yu Xi, Yunfan Du, Kai Yu, Shuai Wang


Abstract
We study timestamped speaker-attributed automatic speech recognition (SA-ASR) for long-form, multi-party speech with overlap. In this setting, chunk-wise inference must preserve meeting-level speaker identity consistency while producing time-stamped, speaker-labeled transcripts. Prior Speech-LLM systems tend to prioritize either local diarization or global labeling, lacking the ability to jointly model fine-grained temporal boundaries and robust cross-chunk identity linking. We propose G-STAR, an end-to-end framework that couples a cache-conditioned speaker-tracking module with a Speech-LLM transcription backbone. The tracker provides structured speaker cues with temporal grounding, and the LLM generates attributed text conditioned on these cues. G-STAR supports component-wise optimization and joint end-to-end training, enabling flexible learning under heterogeneous supervision and domain shift. Under chunk-wise decoding protocols, experiments on both oracle-segmented local evaluation and full-meeting global evaluation show strong speaker-attributed transcription performance.
Anthology ID:
2026.findings-emnlp.1697
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
36267–36276
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1697/
DOI:
Bibkey:
Cite (ACL):
Jing Peng, Ziyi Chen, Haoyu Li, Yucheng Wang, Mengtian Li, Duo MA, Yu Xi, Yunfan Du, Kai Yu, and Shuai Wang. 2026. G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 36267–36276, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition (Peng et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1697.pdf