Language Models as Windows into Human Language Processing: Neural Encoding, Decoding, and Brain Alignment with NLP

Jingyuan Sun, Yunhao Zhang, Yifan Wang, Yang Cui


Abstract
Modern language models are not only tools for processing text; they are also becoming computational instruments for studying how humans understand, predict, and generate language. This tutorial introduces neural encoding and neural decoding to the NLP community through this broader perspective: how can NLP help us understand language processing in the human brain, and how can brain data help us evaluate and improve language models? We will present neural encoding as a way to test whether representations from language models—such as contextual embeddings, surprisal, attention patterns, and layer-wise features—can explain brain responses during reading or listening. We will then introduce neural decoding as the reverse problem: reconstructing linguistic or multimodal content from brain activity using retrieval, representation learning, and foundation-model-guided generation. Rather than framing decoding mainly as brain–computer interface technology, we will connect it to core NLP questions about meaning representation, generation under uncertainty, multimodal grounding, and semantic evaluation. The tutorial assumes no neuroscience background. It combines intuitive foundations, representative papers, practical modeling recipes, notebook-style demos, and discussion of mental privacy, consent, and responsible brain–language technologies.
Anthology ID:
2026.emnlp-tutorials.2
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Ana Marasović, Goran Glavaš
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2–3
Language:
URL:
https://aclanthology.org/2026.emnlp-tutorials.2/
DOI:
Bibkey:
Cite (ACL):
Jingyuan Sun, Yunhao Zhang, Yifan Wang, and Yang Cui. 2026. Language Models as Windows into Human Language Processing: Neural Encoding, Decoding, and Brain Alignment with NLP. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts, pages 2–3, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Language Models as Windows into Human Language Processing: Neural Encoding, Decoding, and Brain Alignment with NLP (Sun et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-tutorials.2.pdf