Vinny DeGenova
Author directory2026
The Differential Reasoning Router: Operationalizing Cost-Aware LLM Annotation in E-commerce
Cheng Lyu | Jingyue Zhang | Vinny DeGenova | Mengwei Li | Yuanli Pei
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Cheng Lyu | Jingyue Zhang | Vinny DeGenova | Mengwei Li | Yuanli Pei
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Large Language Models (LLMs) are increasingly used to annotate structured product data in e-commerce, but early deployment often begins as a cold-start problem: only limited pre-launch labels are available, the value of expensive reasoning is unknown, and human review is needed before the system can be trusted at scale. This challenge is especially common in rule-based annotation workflows, where each item must satisfy multiple business rules and both model errors and ambiguous rule boundaries affect final decisions. We introduce the Differential Reasoning Router (DRR), a cost-aware framework for cold-start LLM annotation that jointly optimizes model selection and human escalation. Rather than treating a reasoning model as a default fallback, DRR estimates separate success probabilities for a direct model and a reasoning model at both the sample and business-rule levels, enabling adaptive routing: easy cases are handled directly, reasoning is reserved for cases where it is expected to improve the decision, and likely double-failure or rule-disagreement cases are escalated to human annotators. The resulting labels provide targeted ground truth for prompt engineering, supervised fine-tuning, calibration, and rule refinement, enabling a gradual shift from human-heavy cold-start annotation toward high-confidence automated routing. In a production e-commerce workflow, DRR reaches accuracy parity with the strongest confidence-based router while achieving more than 60% reasoning-token cost savings.
2025
End-to-End Aspect-Guided Review Summarization at Scale
Ilya Boytsov | Vinny DeGenova | Mikhail Balyasin | Joseph Walt | Caitlin Eusden | Marie-Claire Rochat | Margaret Pierson
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track
Ilya Boytsov | Vinny DeGenova | Mikhail Balyasin | Joseph Walt | Caitlin Eusden | Marie-Claire Rochat | Margaret Pierson
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track
We present a scalable large language model (LLM)-based system that combines aspect-based sentiment analysis (ABSA) with guided summarization to generate concise and interpretable product review summaries. Our approach first extracts and consolidates aspect–sentiment pairs from individual reviews, selects the most frequent aspects for each product, and samples representative reviews accordingly. These are used to construct structured prompts that guide the LLM to produce summaries grounded in actual customer feedback. We demonstrate the real-world effectiveness of our system through a large-scale online A/B test. Furthermore, we describe our real-time deployment strategy and release a dataset of 11,8 million anonymized customer reviews covering 92,000 products, including extracted aspects and generated summaries, to support future research in aspect-guided review summarization.