Sina Khoshfetrat Pakazad
Author directory2026
Data Intelligence Agents: Interpreting, Modeling, and Querying Enterprise Data via Autonomous Coding Agents
Anoushka Vyas | Aarushi Dhanuka | Sina Khoshfetrat Pakazad | Henrik Ohlsson
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Anoushka Vyas | Aarushi Dhanuka | Sina Khoshfetrat Pakazad | Henrik Ohlsson
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Production data integration is bottlenecked by repeated, lossy handoffs between data owners, engineers, and analysts who must collaboratively discover, structure, and query enterprise data. We present **D**ata **I**ntelligence **A**gents (DIA), a system of three agents (*Data Interpreter*, *Schema Creator*, and *Query Generator*) that compresses this workflow by treating autonomous coding agents (ACAs) as a first-class abstraction: rather than emitting text, the agents generate, execute, validate, and repair concrete artifacts, draw on a shared memory for experience reuse, and surface each for review by domain experts. DIA is deployed in production for enterprise customers. We study the *Query Generator* in depth and evaluate it in fully autonomous mode across seven SQL benchmarks spanning four task categories and four dialects. It matches or surpasses the best published results on all seven, demonstrating that an architecture grounded in execution, built on ACAs and a shared memory, generalizes across the data intelligence workload with adaptation confined to natural-language instructions.
2024
Synthetic Multimodal Question Generation
Ian Wu | Sravan Jayanthi | Vijay Viswanathan | Simon Rosenberg | Sina Khoshfetrat Pakazad | Tongshuang Wu | Graham Neubig
Findings of the Association for Computational Linguistics: EMNLP 2024
Ian Wu | Sravan Jayanthi | Vijay Viswanathan | Simon Rosenberg | Sina Khoshfetrat Pakazad | Tongshuang Wu | Graham Neubig
Findings of the Association for Computational Linguistics: EMNLP 2024
Multimodal Retrieval Augmented Generation (MMRAG) is a powerful approach to question-answering over multimodal documents. A key challenge with evaluating MMRAG is the paucity of high-quality datasets matching the question styles and modalities of interest. In light of this, we propose SMMQG, a synthetic data generation framework. SMMQG leverages interplay between a retriever, large language model (LLM) and large multimodal model (LMM) to generate question and answer pairs directly from multimodal documents, with the questions conforming to specified styles and modalities. We use SMMQG to generate an MMRAG dataset of 1024 questions over Wikipedia documents and evaluate state-of-the-art models using it, revealing insights into model performance that are attainable only through style- and modality-specific evaluation data. Next, we measure the quality of data produced by SMMQG via a human study. We find that the quality of SMMQG-generated synthetic data is on par with the quality of the crowdsourced benchmark MMQA and that downstream evaluation results using both datasets strongly concur.