Impact of Microphone position Measurement Error on Multi Channel Distant Speech Recognition & Intelligibility

Karan Nathwani, Sunil Kumar Kopparapu


Abstract
It was shown in (Raikar et al., 2020) that the measurement error in the microphone position affected the room impulse response (RIR) which in turn affected the single channel speech recognition. In this paper, we ex-tend this to study the more complex and realistic scenario of multi channel distant speech recognition. Specifically we simulate m speakers in a given room with n microphones speaking without overlap. Then channel audio is beamformed and passed through a speech to text (s2t) engine. We compare the s2t accuracy when the microphone locations are known exactly (ground truth) with the s2t accuracy when there is a measurement error in the location of the microphone. We report the performance of an end-to-end s2t on beamformed input in terms of character error rate (CER) and and also speech intelligibility and quality in terms of STOI and PESQ respectively.
Anthology ID:
2021.icon-main.23
Volume:
Proceedings of the 18th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2021
Address:
National Institute of Technology Silchar, Silchar, India
Editors:
Sivaji Bandyopadhyay, Sobha Lalitha Devi, Pushpak Bhattacharyya
Venue:
ICON
SIG:
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
186–194
Language:
URL:
https://aclanthology.org/2021.icon-main.23
DOI:
Bibkey:
Cite (ACL):
Karan Nathwani and Sunil Kumar Kopparapu. 2021. Impact of Microphone position Measurement Error on Multi Channel Distant Speech Recognition & Intelligibility. In Proceedings of the 18th International Conference on Natural Language Processing (ICON), pages 186–194, National Institute of Technology Silchar, Silchar, India. NLP Association of India (NLPAI).
Cite (Informal):
Impact of Microphone position Measurement Error on Multi Channel Distant Speech Recognition & Intelligibility (Nathwani & Kopparapu, ICON 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.icon-main.23.pdf