Julien Romero
Author directory2026
TEMPS: Temporal Sentence Embeddings for Temporal Information Retrieval
Mourad Hassani | Julien Romero | Amel Bouzeghoub | Jacquelinet
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Mourad Hassani | Julien Romero | Amel Bouzeghoub | Jacquelinet
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Modern information retrieval (IR) systems rarely represent time, yet many information needs depend on it: in clinical, journalistic, and legal search, when an event occurred can decide whether a document is relevant. Dense retrievers and Retrieval-Augmented Generation (RAG) pipelines match queries to documents well on topic but poorly on time, so they surface content that is on-topic yet temporally wrong. We introduce Temporal Textual Similarity (TTS), a task that measures how well two anchored texts align in time, independent of their topical similarity. We then present TEMPS (Temporal Embedding Model for Precise Search), a modular temporal branch that attaches to a frozen semantic retriever and trains on that signal. It resolves anchored temporal expressions to intervals and moment-matches each one to a Gaussian; the resulting ordering supervises an anchor-date-conditioned encoder, whose score we fuse with the semantic score at inference. Grounding supplies the supervision, so training uses no hand-labeled temporal data. The temporal score itself is the Gaussian-KL inclusion measure from distributional embeddings; what TEMPS adds is the grounding and the moment-matched supervision. On three temporal benchmarks, TEMPS improves MRR for every semantic backbone tested and, on TS-Retriever, lifts R@1 from 19.92 to 25.39 over the prior temporal state of the art.
2022
Do Children Texts Hold The Key To Commonsense Knowledge?
Julien Romero | Simon Razniewski
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Julien Romero | Simon Razniewski
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Compiling comprehensive repositories of commonsense knowledge is a long-standing problem in AI. Many concerns revolve around the issue of reporting bias, i.e., that frequency in text sources is not a good proxy for relevance or truth. This paper explores whether children’s texts hold the key to commonsense knowledge compilation, based on the hypothesis that such content makes fewer assumptions on the reader’s knowledge, and therefore spells out commonsense more explicitly. An analysis with several corpora shows that children’s texts indeed contain much more, and more typical commonsense assertions. Moreover, experiments show that this advantage can be leveraged in popular language-model-based commonsense knowledge extraction settings, where task-unspecific fine-tuning on small amounts of children texts (childBERT) already yields significant improvements. This provides a refreshing perspective different from the common trend of deriving progress from ever larger models and corpora.