Learning the Bitter Lesson: Empirical Evidence from 20 Years of CVPR Proceedings

Mojtaba Yousefi, Jack Collins


Abstract
This study examines the alignment of Conference on Computer Vision and Pattern Recognition (CVPR) research with the principles of the “bitter lesson” proposed by Rich Sutton. We analyze two decades of CVPR abstracts and titles using large language models (LLMs) to assess the field’s embracement of these principles. Our methodology leverages state-of-the-art natural language processing techniques to systematically evaluate the evolution of research approaches in computer vision. The results reveal significant trends in the adoption of general-purpose learning algorithms and the utilization of increased computational resources. We discuss the implications of these findings for the future direction of computer vision research and its potential impact on broader artificial intelligence development. This work contributes to the ongoing dialogue about the most effective strategies for advancing machine learning and computer vision, offering insights that may guide future research priorities and methodologies in the field.
Anthology ID:
2024.nlp4science-1.15
Volume:
Proceedings of the 1st Workshop on NLP for Science (NLP4Science)
Month:
November
Year:
2024
Address:
Miami, FL, USA
Editors:
Lotem Peled-Cohen, Nitay Calderon, Shir Lissak, Roi Reichart
Venue:
NLP4Science
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
175–187
Language:
URL:
https://aclanthology.org/2024.nlp4science-1.15
DOI:
Bibkey:
Cite (ACL):
Mojtaba Yousefi and Jack Collins. 2024. Learning the Bitter Lesson: Empirical Evidence from 20 Years of CVPR Proceedings. In Proceedings of the 1st Workshop on NLP for Science (NLP4Science), pages 175–187, Miami, FL, USA. Association for Computational Linguistics.
Cite (Informal):
Learning the Bitter Lesson: Empirical Evidence from 20 Years of CVPR Proceedings (Yousefi & Collins, NLP4Science 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.nlp4science-1.15.pdf