ACRE: An Acoustic-Cue and Contextual-Knowledge Reasoning Enhancement Framework for Speech Relation Extraction

Wenxuan Mu, Jinzhong Ning, Di Zhao, Yijia Zhang


Abstract
Speech relation extraction (SpeechRE) aims to extract structured relational triples directly from speech. However, existing studies still face three major challenges: **the lack of Chinese SpeechRE benchmarks**, **insufficient modeling of speech-specific cues**, and **evaluation bias introduced by character-level exact matching** in Chinese scenarios. To address these challenges, we first construct **CSRTE**, a real-world Chinese SpeechRE benchmark built from human speech, providing unified data and evaluation settings. We then propose **ACRE**, a reasoning enhancement framework for SpeechRE, which integrates acoustic-cue and contextual-knowledge into a structured acoustic-semantic reasoning chain, enabling the model to go beyond literal semantic content **(what-to-say)** and capture speech-specific features **(how-to-say)** for relation reasoning. We further combine supervised fine-tuning with reinforcement learning and design composite rewards to improve the quality of the model’s reasoning process. In addition, we propose pronunciation-aware evaluation **(PAE)**, which considers pronunciation and tone consistency during entity matching to reduce the evaluation bias. Experiments on both Chinese and English SpeechRE benchmarks demonstrate the effectiveness of ACRE and the usefulness of PAE. Our source code and datasets are available at https://github.com/MWXGOD/CSRTE.
Anthology ID:
2026.findings-emnlp.1244
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
26343–26352
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1244/
DOI:
Bibkey:
Cite (ACL):
Wenxuan Mu, Jinzhong Ning, Di Zhao, and Yijia Zhang. 2026. ACRE: An Acoustic-Cue and Contextual-Knowledge Reasoning Enhancement Framework for Speech Relation Extraction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 26343–26352, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ACRE: An Acoustic-Cue and Contextual-Knowledge Reasoning Enhancement Framework for Speech Relation Extraction (Mu et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1244.pdf