<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="khondaker-etal-2026-drflow">
    <titleInfo>
        <title>DRFLOW: A Deep Research Benchmark for Personalized Workflow Prediction</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Md</namePart>
        <namePart type="given">Tawkat</namePart>
        <namePart type="given">Islam</namePart>
        <namePart type="family">Khondaker</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Raymond</namePart>
        <namePart type="family">Li</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Muhammad</namePart>
        <namePart type="family">Abdul-Mageed</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Laks</namePart>
        <namePart type="given">V</namePart>
        <namePart type="given">S</namePart>
        <namePart type="family">Lakshmanan</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Issam</namePart>
        <namePart type="given">H</namePart>
        <namePart type="family">Laradji</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-10</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: EMNLP 2026</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Hung-Yi</namePart>
            <namePart type="family">Lee</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Sunipa</namePart>
            <namePart type="family">Dev</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jessy</namePart>
            <namePart type="family">Li</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Desmond</namePart>
            <namePart type="family">Elliott</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Budapest, Hungary</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-462-0</identifier>
    </relatedItem>
    <abstract>Deep research (DR) systems are increasingly used for complex information-seeking tasks, but existing works mainly focus on generating reports and summaries. In contrast, many enterprise tasks instead require an agent to identify concrete workflows which is a sequence of action-steps. For example, rather than summarizing budgeting policies, an agent should be able to determine the steps needed to answer a question such as: “How do I request new headcount given a fixed budget?”. Therefore, we introduce DRFLOW, a benchmark for evaluating personalized workflows predicted by agents from heterogeneous sources. Each task requires the agent to identify relevant evidence from scattered sources, then use that evidence to predict the correct action-step sequence for the user’s task. DRFLOW contains 100 tasks across five domains, with 1, 246 reference workflow steps grounded in more than 3, 900 sources. We define seven diagnostic metrics covering factual grounding, step recovery, structural ordering, condition resolution, and personalization. We further present DRFLOW-Agent (DRFA), a workflow-oriented reference agent to predict personalized workflow. We show that although DRFA improves over strong baseline agents (upto 10.02% average F1 score), there is substantial room for improvement remains across these workflow metrics, indicating that predicting complete and correct personalized workflows remains a challenging frontier for deep research.</abstract>
    <identifier type="citekey">khondaker-etal-2026-drflow</identifier>
    <location>
        <url>https://aclanthology.org/2026.findings-emnlp.1344/</url>
    </location>
    <part>
        <date>2026-10</date>
        <extent unit="page">
            <start>28492</start>
            <end>28558</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T DRFLOW: A Deep Research Benchmark for Personalized Workflow Prediction
%A Khondaker, Md Tawkat Islam
%A Li, Raymond
%A Abdul-Mageed, Muhammad
%A Lakshmanan, Laks V. S.
%A Laradji, Issam H.
%Y Lee, Hung-Yi
%Y Dev, Sunipa
%Y Li, Jessy
%Y Elliott, Desmond
%S Findings of the Association for Computational Linguistics: EMNLP 2026
%D 2026
%8 October
%I Association for Computational Linguistics
%C Budapest, Hungary
%@ 979-8-89176-462-0
%F khondaker-etal-2026-drflow
%X Deep research (DR) systems are increasingly used for complex information-seeking tasks, but existing works mainly focus on generating reports and summaries. In contrast, many enterprise tasks instead require an agent to identify concrete workflows which is a sequence of action-steps. For example, rather than summarizing budgeting policies, an agent should be able to determine the steps needed to answer a question such as: “How do I request new headcount given a fixed budget?”. Therefore, we introduce DRFLOW, a benchmark for evaluating personalized workflows predicted by agents from heterogeneous sources. Each task requires the agent to identify relevant evidence from scattered sources, then use that evidence to predict the correct action-step sequence for the user’s task. DRFLOW contains 100 tasks across five domains, with 1, 246 reference workflow steps grounded in more than 3, 900 sources. We define seven diagnostic metrics covering factual grounding, step recovery, structural ordering, condition resolution, and personalization. We further present DRFLOW-Agent (DRFA), a workflow-oriented reference agent to predict personalized workflow. We show that although DRFA improves over strong baseline agents (upto 10.02% average F1 score), there is substantial room for improvement remains across these workflow metrics, indicating that predicting complete and correct personalized workflows remains a challenging frontier for deep research.
%U https://aclanthology.org/2026.findings-emnlp.1344/
%P 28492-28558

Markdown (Informal)

[DRFLOW: A Deep Research Benchmark for Personalized Workflow Prediction](https://aclanthology.org/2026.findings-emnlp.1344/) (Khondaker et al., Findings 2026)

• DRFLOW: A Deep Research Benchmark for Personalized Workflow Prediction (Khondaker et al., Findings 2026)

ACL

• Md Tawkat Islam Khondaker, Raymond Li, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, and Issam H. Laradji. 2026. DRFLOW: A Deep Research Benchmark for Personalized Workflow Prediction. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 28492–28558, Budapest, Hungary. Association for Computational Linguistics.