AttentionApp: An Interactive Tool for Analyzing Transformer Attention Patterns in Portuguese

Ricardo G. Oliveira, Daniela Barreiro Claro


Abstract
This paper presents AttentionApp, an interactive demonstration system designed to support the inspection and linguistic analysis of attention mechanisms in Transformer-based language models for Portuguese. The tool allows users to input sentences in Portuguese and visualize attention distributions across layers and heads, enabling fine-grained qualitative analysis of syntactic and semantic patterns captured by the model. AttentionApp is intended as a research-oriented tool, facilitating exploratory analysis, hypothesis generation, and interpretability studies for Portuguese Natural Language Processing.
Anthology ID:
2026.propor-2.6
Volume:
Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2
Month:
April
Year:
2026
Address:
Salvador, Brazil
Editors:
Marlo Souza, Iria de-Dios-Flores, Diana Santos, Larissa Freitas, Jackson Wilke da Cruz Souza, Eugénio Ribeiro
Venue:
PROPOR
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
18–20
Language:
URL:
https://aclanthology.org/2026.propor-2.6/
DOI:
Bibkey:
Cite (ACL):
Ricardo G. Oliveira and Daniela Barreiro Claro. 2026. AttentionApp: An Interactive Tool for Analyzing Transformer Attention Patterns in Portuguese. In Proceedings of the 17th International Conference on Computational Processing of Portuguese (PROPOR 2026) - Vol. 2, pages 18–20, Salvador, Brazil. Association for Computational Linguistics.
Cite (Informal):
AttentionApp: An Interactive Tool for Analyzing Transformer Attention Patterns in Portuguese (Oliveira & Claro, PROPOR 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.propor-2.6.pdf