Víctor Martínez
Author directoryAlso published as: Victor Martinez
2026
SynthAVE: Scalable Synthetic Labeling for E-Commerce with LLM-Arena Validation
Andrea Scarinci | Virginia Negri | Brayan Impata | Suleiman A. Khan | Víctor Martínez | Marcello Federico
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Andrea Scarinci | Virginia Negri | Brayan Impata | Suleiman A. Khan | Víctor Martínez | Marcello Federico
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Fine-tuning large language models (LLMs) for e-commerce attribute extraction requires labeled data representative across thousands of product types, attributes, and multiple languages. This combinatorial scale translates to millions of annotations, rendering human labeling prohibitively costly. While recent work has demonstrated synthetic label generation using LLMs, deploying such approaches at industrial scale requires integrated quality control mechanisms. We present SynthAVE, a large-scale benchmark for attribute-value verification spanning 12,726 products across 229 product types, 792 attributes, and 4 languages (Spanish, French, Italian, German). To validate synthetic labels at scale, we introduce a multi-LLM arena framework where each sample is evaluated by 21 judge configurations (7 model families × 3 prompts), with final labels determined via majority voting; disagreements with the synthetic label are expert-adjudicated and agreement cases are audited on a stratified sample. The majority vote ensemble agrees with expert labels at Cohen’s 𝜅 = 0.92 (95.0% agreement), while individual judges agree with one another only moderately (Fleiss’ 𝜅 = 0.76)—by design, since we select for diversity. This demonstrates that diverse models with varying individual judgments aggregate into highly reliable predictions, enabling cost-effective validation at scale while concentrating expert effort on the cases where it changes the label. We estimate the resulting label quality at 97.9%.
2020
Joint Estimation and Analysis of Risk Behavior Ratings in Movie Scripts
Victor Martinez | Krishna Somandepalli | Yalda Tehranian-Uhls | Shrikanth Narayanan
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Victor Martinez | Krishna Somandepalli | Yalda Tehranian-Uhls | Shrikanth Narayanan
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Exposure to violent, sexual, or substance-abuse content in media increases the willingness of children and adolescents to imitate similar behaviors. Computational methods that identify portrayals of risk behaviors from audio-visual cues are limited in their applicability to films in post-production, where modifications might be prohibitively expensive. To address this limitation, we propose a model that estimates content ratings based on the language use in movie scripts, making our solution available at the earlier stages of creative production. Our model significantly improves the state-of-the-art by adapting novel techniques to learn better movie representations from the semantic and sentiment aspects of a character’s language use, and by leveraging the co-occurrence of risk behaviors, following a multi-task approach. Additionally, we show how this approach can be useful to learn novel insights on the joint portrayal of these behaviors, and on the subtleties that filmmakers may otherwise not pick up on.