Exploring Language in Different Daily Time Segments Through Text Prediction and Language Modeling

Kennedy Roland, Milton King


Abstract
Temporal-aware language models have proved to be effective over longer time periods as language and its use changes, but little research has looked at how language use can change at different times of the day. We hypothesize that a person’s usage of language varies at different times of day. We explore this concept by evaluating if models for language modeling and next word prediction improve their performance when considering the time of day. Specifically, we explore personalized temporal-aware models for next-word prediction and language modeling and compare them against baseline models, including non-temporal-aware personalized models. Specifically, our proposed model considers which of the 8, 3-hr daily time segments that a text snippet was written during for a given author. We found that our temporal-aware models tend to outperform temporal-agnostic models with respect to accuracy and perplexity.
Anthology ID:
2025.lm4dh-1.11
Volume:
Proceedings of the First on Natural Language Processing and Language Models for Digital Humanities
Month:
September
Year:
2025
Address:
Varna, Bulgaria
Editors:
Isuri Nanomi Arachchige, Francesca Frontini, Ruslan Mitkov, Paul Rayson
Venues:
LM4DH | WS
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
120–125
Language:
URL:
https://aclanthology.org/2025.lm4dh-1.11/
DOI:
Bibkey:
Cite (ACL):
Kennedy Roland and Milton King. 2025. Exploring Language in Different Daily Time Segments Through Text Prediction and Language Modeling. In Proceedings of the First on Natural Language Processing and Language Models for Digital Humanities, pages 120–125, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Exploring Language in Different Daily Time Segments Through Text Prediction and Language Modeling (Roland & King, LM4DH 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.lm4dh-1.11.pdf