Hippolyte Gisserot-Boukhlef
Author directory2026
Scale or Reason? A Compute-Equivalent Analysis of Reasoning Distillation
Nicolas Boizard | Hippolyte Gisserot-Boukhlef | Kevin El Haddad | Celine Hudelot | Pierre Colombo
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Nicolas Boizard | Hippolyte Gisserot-Boukhlef | Kevin El Haddad | Celine Hudelot | Pierre Colombo
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Distilling reasoning traces from strong teacher models has become the standard recipe for building capable small language models. Yet reasoning traces are 5-20× longer than standard instruction fine-tuning (IFT) outputs, meaning every practitioner who chooses reasoning distillation implicitly forgoes training a larger IFT model on the same compute budget. Whether this trade-off is worthwhile remains unaddressed. We study it with a controlled experiment: a single teacher generates paired IFT and reasoning outputs for identical prompts by toggling only its reasoning mode, isolating supervision format as the sole variable. Training students at five scales (0.5B to 14B) and evaluating on 18 benchmarks, we find that at matched FLOPs, IFT lies on or near the Pareto frontier across the majority of configurations. Reasoning reaches the Pareto frontier only on open-ended tasks at 7B and above. Even there, a sequential curriculum mixing just 25-50% reasoning data with IFT captures most of the accuracy benefit at far lower compute cost.
2024
Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis
Hippolyte Gisserot-Boukhlef | Ricardo Rei | Emmanuel Malherbe | Céline Hudelot | Pierre Colombo | Nuno M. Guerreiro
Proceedings of the Ninth Conference on Machine Translation
Hippolyte Gisserot-Boukhlef | Ricardo Rei | Emmanuel Malherbe | Céline Hudelot | Pierre Colombo | Nuno M. Guerreiro
Proceedings of the Ninth Conference on Machine Translation
Neural metrics for machine translation (MT) evaluation have become increasingly prominent due to their superior correlation with human judgments compared to traditional lexical metrics. Researchers have therefore utilized neural metrics through quality-informed decoding strategies, achieving better results than likelihood-based methods. With the rise of Large Language Models (LLMs), preference-based alignment techniques have gained attention for their potential to enhance translation quality by optimizing model weights directly on preferences induced by quality estimators. This study focuses on Contrastive Preference Optimization (CPO) and conducts extensive experiments to evaluate the impact of preference-based alignment on translation quality. Our findings indicate that while CPO consistently outperforms Supervised Fine-Tuning (SFT) on high-quality data with regard to the alignment metric, it may lead to instability across downstream evaluation metrics, particularly between neural and lexical ones. Additionally, we demonstrate that relying solely on the base model for generating candidate translations achieves performance comparable to using multiple external systems, while ensuring better consistency across downstream metrics.