TouchThinker: Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representation

Kailin Lyu, Di Wu, Pengwei Zhang, Yuhang Zheng, Yingxin Lai, Long Xiao, Kangyi Wu, Pengna Li, Chen Gao, Lianyu Hu, Xiaobin Hu, Jie Hao, Ce Hao, Weihao Yuan, Shuicheng Yan


Abstract
Touch is a key modality for embodied agents to understand the physical world. Although recent work has incorporated tactile signals into lan- guage systems for tactile Commonsense Rea- soning, scaling such systems to realistic open- world settings remains challenging due to two key bottlenecks: (1) current tactile reasoning datasets remain limited in format and scale, pro- viding insufficient supervision for reasoning from tactile observations to physical common- sense and hindering the learning of transferable tactile commonsense; (2) Tactile signals are inherently redundant and action-specific, yet existing methods often overlook these proper- ties, resulting in inefficient representations with limited semantic expressiveness. To address these limitations, we propose TouchThinker, a tactile-language framework that scales tac- tile commonsense reasoning to the open world from both data and representation perspec- tives. First, we construct TouchThinker-1M, a million-scale, multi-source tactile reasoning dataset covering 410 objects, 8 scenarios, and 7 sensor types, providing a solid data founda- tion for open-world generalization. We fur- ther introduce TouchThinker-Bench, an open- world benchmark with more realistic and di- verse tasks. Then, we further introduce action- aware tactile modeling and a two-stage training paradigm to improve tactile representation effi- ciency and enable efficient reasoning. Experi- mental results demonstrate that TouchThinker achieves competitive performance against state- of-the-art models across multiple datasets. Our code and dataset will be released.
Anthology ID:
2026.emnlp-main.1925
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
43841–43858
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1925/
DOI:
Bibkey:
Cite (ACL):
Kailin Lyu, Di Wu, Pengwei Zhang, Yuhang Zheng, Yingxin Lai, Long Xiao, Kangyi Wu, Pengna Li, Chen Gao, Lianyu Hu, Xiaobin Hu, Jie Hao, Ce Hao, Weihao Yuan, and Shuicheng Yan. 2026. TouchThinker: Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 43841–43858, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TouchThinker: Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representation (Lyu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1925.pdf