Anirban Das
Author directory2026
T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domains
Genta Indra Winata | Amartya Chakraborty | Yuzhen Lin | Swasthi P Rao | Shikhhar Siingh | Houhan Lu | Nadia Bathaee | Sriharsha Hatwar | Paresh Dashore | Anmol Jain | Kshitij Tayal | Xiuzhu Lin | Anirban Das | Sambit Sahu | Shi-Xiong Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Genta Indra Winata | Amartya Chakraborty | Yuzhen Lin | Swasthi P Rao | Shikhhar Siingh | Houhan Lu | Nadia Bathaee | Sriharsha Hatwar | Paresh Dashore | Anmol Jain | Kshitij Tayal | Xiuzhu Lin | Anirban Das | Sambit Sahu | Shi-Xiong Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Recent advances in reasoning and tool-calling capabilities of large language models (LLMs) have enabled increasingly capable agentic systems. However, existing benchmarks remain limited in task complexity, realism, and domain diversity, and often fail to capture interactions that span multiple domains, limiting their ability to evaluate agents in realistic multi-step settings that require sustained reasoning and coordination. To address these limitations, we introduce T1-Bench, a high-fidelity, comprehensive benchmark for evaluating agentic systems in realistic customer-facing, multi-domain environments, featuring interleaved scenarios that require structured reasoning across multi-turn user-assistant interactions and substantially increasing both compositional complexity and evaluative rigor across 25 domains of varying difficulty. We evaluate T1-Bench using 12 proprietary and open-weight models, providing a reproducible and standardized framework for assessing agent behavior, tool utilization, and conversational quality in complex, multi-step environments. We further complement automatic evaluation with human judgments to strengthen the assessment of qualitative performance. Overall, T1-Bench substantially advances prior benchmarks by increasing task complexity, interaction depth, and domain coverage in simulated multi-domain environments. To facilitate future research on agentic systems, we will publicly release data and evaluation code as open source.
2025
WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines
Genta Indra Winata | Frederikus Hudi | Patrick Amadeus Irawan | David Anugraha | Rifki Afina Putri | Wang Yutong | Adam Nohejl | Ubaidillah Ariq Prathama | Nedjma Ousidhoum | Afifa Amriani | Anar Rzayev | Anirban Das | Ashmari Pramodya | Aulia Adila | Bryan Wilie | Candy Olivia Mawalim | Cheng Ching Lam | Daud Abolade | Emmanuele Chersoni | Enrico Santus | Fariz Ikhwantri | Garry Kuwanto | Hanyang Zhao | Haryo Akbarianto Wibowo | Holy Lovenia | Jan Christian Blaise Cruz | Jan Wira Gotama Putra | Junho Myung | Lucky Susanto | Maria Angelica Riera Machin | Marina Zhukova | Michael Anugraha | Muhammad Farid Adilazuarda | Natasha Christabelle Santosa | Peerat Limkonchotiwat | Raj Dabre | Rio Alexander Audino | Samuel Cahyawijaya | Shi-Xiong Zhang | Stephanie Yulia Salim | Yi Zhou | Yinxuan Gui | David Ifeoluwa Adelani | En-Shiun Annie Lee | Shogo Okada | Ayu Purwarianti | Alham Fikri Aji | Taro Watanabe | Derry Tanti Wijaya | Alice Oh | Chong-Wah Ngo
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Genta Indra Winata | Frederikus Hudi | Patrick Amadeus Irawan | David Anugraha | Rifki Afina Putri | Wang Yutong | Adam Nohejl | Ubaidillah Ariq Prathama | Nedjma Ousidhoum | Afifa Amriani | Anar Rzayev | Anirban Das | Ashmari Pramodya | Aulia Adila | Bryan Wilie | Candy Olivia Mawalim | Cheng Ching Lam | Daud Abolade | Emmanuele Chersoni | Enrico Santus | Fariz Ikhwantri | Garry Kuwanto | Hanyang Zhao | Haryo Akbarianto Wibowo | Holy Lovenia | Jan Christian Blaise Cruz | Jan Wira Gotama Putra | Junho Myung | Lucky Susanto | Maria Angelica Riera Machin | Marina Zhukova | Michael Anugraha | Muhammad Farid Adilazuarda | Natasha Christabelle Santosa | Peerat Limkonchotiwat | Raj Dabre | Rio Alexander Audino | Samuel Cahyawijaya | Shi-Xiong Zhang | Stephanie Yulia Salim | Yi Zhou | Yinxuan Gui | David Ifeoluwa Adelani | En-Shiun Annie Lee | Shogo Okada | Ayu Purwarianti | Alham Fikri Aji | Taro Watanabe | Derry Tanti Wijaya | Alice Oh | Chong-Wah Ngo
Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Vision Language Models (VLMs) often struggle with culture-specific knowledge, particularly in languages other than English and in underrepresented cultural contexts. To evaluate their understanding of such knowledge, we introduce WorldCuisines, a massive-scale benchmark for multilingual and multicultural, visually grounded language understanding. This benchmark includes a visual question answering (VQA) dataset with text-image pairs across 30 languages and dialects, spanning 9 language families and featuring over 1 million data points, making it the largest multicultural VQA benchmark to date. It includes tasks for identifying dish names and their origins. We provide evaluation datasets in two sizes (12k and 60k instances) alongside a training dataset (1 million instances). Our findings show that while VLMs perform better with correct location context, they struggle with adversarial contexts and predicting specific regional cuisines and languages. To support future research, we release a knowledge base with annotated food entries and images along with the VQA data.
Search
Fix author
Co-authors
- Genta Indra Winata 3
- Shi-Xiong Zhang 2
- Daud Abolade 1
- David Ifeoluwa Adelani 1
- Aulia Adila 1
- Muhammad Farid Adilazuarda 1
- Alham Fikri Aji 1
- Afifa Amriani 1
- David Anugraha 1
- Michael Anugraha 1
- Rio Alexander Audino 1
- Nadia Bathaee 1
- Samuel Cahyawijaya 1
- Amartya Chakraborty 1
- Chung-Chi Chen 1
- Hsin-Hsi Chen 1
- Emmanuele Chersoni 1
- Jan Christian Blaise Cruz 1
- Raj Dabre 1
- Paresh Dashore 1
- Yinxuan Gui 1
- Sriharsha Hatwar 1
- Frederikus Hudi 1
- Fariz Ikhwantri 1
- Patrick Amadeus Irawan 1
- Anmol Jain 1
- Garry Kuwanto 1
- Cheng Ching Lam 1
- En-Shiun Annie Lee 1
- Peerat Limkonchotiwat 1
- Xiuzhu Lin 1
- Yuzhen Lin 1
- Holy Lovenia 1
- Houhan Lu 1
- Candy Olivia Mawalim 1
- Junho Myung 1
- Chong-Wah Ngo 1
- Adam Nohejl 1
- Alice Oh 1
- Shogo Okada 1
- Nedjma Ousidhoum 1
- Ashmari Pramodya 1
- Ubaidillah Ariq Prathama 1
- Ayu Purwarianti 1
- Jan Wira Gotama Putra 1
- Rifki Afina Putri 1
- Swasthi P Rao 1
- Stephen Rawls 1
- Maria Angelica Riera Machin 1
- Anar Rzayev 1
- Sambit Sahu 1
- Stephanie Yulia Salim 1
- Natasha Christabelle Santosa 1
- Enrico Santus 1
- Shikhhar Siingh 1
- Lucky Susanto 1
- Hiroya Takamura 1
- Kshitij Tayal 1
- Taro Watanabe 1
- Haryo Akbarianto Wibowo 1
- Derry Tanti Wijaya 1
- Bryan Wilie 1
- Wang Yutong 1
- Hanyang Zhao 1
- Yi Zhou 1
- Marina Zhukova 1