Whitening and Fine-Tuning Are Substitutes: One-Shot Indian Sign Language Recognition

Galiveeti Poornima, Sandeep Mathias


Abstract
We describe our submission to the WSLP 2026 shared task on Isolated Sign Language Recognition. The task is one-shot retrieval over 4,361 Indian Sign Language word classes with roughly one training clip per class. Our final system placed 3rd on top-1 accuracy at 0.6825 and 2nd on top-10 at 0.7357. The system is deliberately simple. It combines MediaPipe keypoints, a graph attention backbone pretrained on a different ISL corpus, PCA whitening, and nearest-exemplar cosine retrieval against an enriched gallery. Our main finding concerns how two very differently priced interventions relate. PCA whitening of the frozen cross-corpus encoder is worth +18.85 points on a leave-one-out gallery evaluation. Fine-tuning that encoder end-to-end is worth a comparable amount. The two do not compose. Once the encoder has been fine-tuned, whitening adds +0.38 points, an interaction of −18.5. Whitening and fine-tuning act as substitutes because both correct the same embedding anisotropy, and a transform that is fitted in seconds captures most of what a day of GPU training buys. We also report fifteen interventions that produced no usable gain: twelve indistinguishable from zero and three actively harmful. These were evaluated with McNemar tests on a 2,030-query held-out split with a minimum detectable effect of 1.23 points. We argue that the 526-clip official test set is too small to support the comparisons participants routinely make with it.
Anthology ID:
2026.wslp-1.4
Volume:
Proceedings of the Second Workshop on Sign Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Sanjeet Singh, Abhinav Joshi, Pokala Dattatreya, Keren Artiaga, Khushi Jaydeep Pujara, Tomáš Železný, Ivan Gruber, Jakub Honzík, Sabyasachi Kamila, Facundo Manuel Quiroga, Marek Hrúz, Mohammed Hasanuzzaman, Ashutosh Modi
Venues:
WSLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
32–42
Language:
URL:
https://aclanthology.org/2026.wslp-1.4/
DOI:
Bibkey:
Cite (ACL):
Galiveeti Poornima and Sandeep Mathias. 2026. Whitening and Fine-Tuning Are Substitutes: One-Shot Indian Sign Language Recognition. In Proceedings of the Second Workshop on Sign Language Processing, pages 32–42, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Whitening and Fine-Tuning Are Substitutes: One-Shot Indian Sign Language Recognition (Poornima & Mathias, WSLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wslp-1.4.pdf