Mozila: Continual Event Detection Through the Lens of Multi-Objective Optimization and Language Model Head Preservation**

Nam Le Hai, Linh Ngo Van, Sang Dinh


Abstract
Continual Event Detection (CED) aims to identify and classify event triggers in evolving ontologies, where novel event types emerge incrementally. Unlike standard continual learning, CED faces highly imbalanced, long-tail distributions, semantic overlaps between event types, and a prevalence of negative spans, all of which exacerbate catastrophic forgetting. To address these challenges, we propose Mozila, a novel framework that integrates Sharpness-Aware Multi-Objective Optimization (SaMOO) and Language Model Head Preservation (LMHP). SaMOO adapts gradient-based multi-objective optimization with sharpness-aware minimization to balance competing objectives, navigate the Pareto front, and locate flatter minima, enhancing robustness across sequential tasks. Meanwhile, LMHP strengthens representation learning by preserving essential linguistic knowledge from the pretrained language model head through distribution alignment, explored with three alternative strategies. To further address data imbalance, we leverage a generative model to synthesize event trigger representations, mitigating replay buffer limitations. Comprehensive experiments on standard CED benchmarks demonstrate that Mozila consistently improves performance, achieving significant improvements over baseline methods. Ablation studies and error analyses highlight the individual contributions of each component and reveal key challenges in CED, including class imbalance and distinguishing similar event types across tasks. Our framework provides a robust and generalizable solution for continual event detection in dynamic, real-world environments. All resources are publicly available at: Mozila.
Anthology ID:
2026.cl-3.2
Volume:
Computational Linguistics, Volume 52, Issue 3 - September 2026
Month:
September
Year:
2026
Address:
Cambridge, MA
Venue:
CL
SIG:
Publisher:
MIT Press
Note:
Pages:
897–942
Language:
URL:
https://aclanthology.org/2026.cl-3.2/
DOI:
10.1162/coli.a.617
Bibkey:
Cite (ACL):
Nam Le Hai, Linh Ngo Van, and Sang Dinh. 2026. Mozila: Continual Event Detection Through the Lens of Multi-Objective Optimization and Language Model Head Preservation**. Computational Linguistics, 52(3):897–942.
Cite (Informal):
Mozila: Continual Event Detection Through the Lens of Multi-Objective Optimization and Language Model Head Preservation** (Hai et al., CL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.cl-3.2.pdf