ColorCode: A Bayesian Approach to Augmentative and Alternative Communication with Two Buttons

Matthew Daly


Abstract
Many people with severely limited muscle control can only communicate through augmentative and alternative communication (AAC) systems with a small number of buttons. In this paper, we present the design for ColorCode, which is an AAC system with two buttons that uses Bayesian inference to determine what the user wishes to communicate. Our information-theoretic analysis of ColorCode simulations shows that it is efficient in extracting information from the user, even in the presence of errors, achieving nearly optimal error correction. ColorCode is provided as open source software.
Anthology ID:
2022.slpat-1.2
Volume:
Ninth Workshop on Speech and Language Processing for Assistive Technologies (SLPAT-2022)
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Sarah Ebling, Emily Prud’hommeaux, Preethi Vaidyanathan
Venue:
SLPAT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17–23
Language:
URL:
https://aclanthology.org/2022.slpat-1.2
DOI:
10.18653/v1/2022.slpat-1.2
Bibkey:
Cite (ACL):
Matthew Daly. 2022. ColorCode: A Bayesian Approach to Augmentative and Alternative Communication with Two Buttons. In Ninth Workshop on Speech and Language Processing for Assistive Technologies (SLPAT-2022), pages 17–23, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
ColorCode: A Bayesian Approach to Augmentative and Alternative Communication with Two Buttons (Daly, SLPAT 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.slpat-1.2.pdf
Video:
 https://aclanthology.org/2022.slpat-1.2.mp4
Code
 mrdaly/colorcode