Dmitrii Khizbullin
Author directory2026
OASIS: Online Anchor-calibrated Self-Improvement System
Wenyi Wang | Firas Laakom | Li Nanbo | Yanning Dai | Yuhui Wang | Yifan Xu | Dmitrii Khizbullin | Piotr Piękos | Yilan Zhang | Yimeng Chen | Alfonso Amayuelas | Mingchen Zhuge | Jürgen Schmidhuber
Findings of the Association for Computational Linguistics: EMNLP 2026
Wenyi Wang | Firas Laakom | Li Nanbo | Yanning Dai | Yuhui Wang | Yifan Xu | Dmitrii Khizbullin | Piotr Piękos | Yilan Zhang | Yimeng Chen | Alfonso Amayuelas | Mingchen Zhuge | Jürgen Schmidhuber
Findings of the Association for Computational Linguistics: EMNLP 2026
Many recursively self-improving systems improve by editing their codebases based on observed rollout behavior. However, recent methods largely treat self-improvement as offline search: variants are optimized and evaluated on fixed benchmarks. This misaligns with real-world deployment, where tasks arrive sequentially and may have different distributions. We study recursive self-improvement as online learning over non-stationary task streams. In this setting, reliable execution and fallback are particularly difficult with limited evidence: different branches of self-improvement see different tasks, so raw rewards conflate capability with task difficulty, leading to overly conservative or optimistic reversion. We propose Online Anchor-calibrated Self-Improvement System (OASIS) that runs an adaptive reference agent on incoming tasks, converts raw rewards into paired comparisons, and uses confidence-calibrated rules for branch continuation and fallback without evaluating every agent on all tasks. Across SWE-Bench Pro and DeepResearch Bench, OASIS consistently improves over both the initial agent and prior RSI baseline SSA, raising the SWE-Bench Pro solve rate from 51.6% to 56.9% using Qwen3.6-35B-A3B and DeepResearch Bench from 35.18 to 39.31 using Gemini 3 Flash. This enables OASIS to outperform larger open weights and proprietary systems, including Qwen3.5-397B-A17B, Minimax 2.7, Qwen3.6-Plus, and GPT-5.3-Codex, with sustained deep self-improvements rather than shallow cycles.
Telco-GAIA: Bilingual Benchmark for Agents in Telecom Domain
Dmitrii Khizbullin | Zaid Alyafeai | Abdelrahman Eldesokey | Nourah AlSultan | Raghad Alshalan | Bernard Ghanem | David R. Pugh
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Dmitrii Khizbullin | Zaid Alyafeai | Abdelrahman Eldesokey | Nourah AlSultan | Raghad Alshalan | Bernard Ghanem | David R. Pugh
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
We introduce Telco-GAIA, a bilingual, multi-modal benchmark for evaluating tool-using agents on the data of a real-world telecommunications operator. Telco-GAIA comprises 100 human-verified question-answering tasks, in English and Arabic, that each demand multi-hop reasoning (4.2 hops on average) over three heterogeneous sources: a static website snapshot (HTML, images, and linked PDFs), a synthetic relational SQL database, and external web archives, spanning text, image, and tabular modalities. The benchmark is delivered as a sandboxed Docker environment and scored by normalized exact string matching, making evaluation objective, deterministic, and reproducible over time without any LLM-as-a-Judge. Evaluating a purpose-built reference agent across twelve commercial and open LLMs, we find Telco-GAIA challenging: even the strongest model solves only 71% of tasks; under a moderate cost budget, this falls to about 40%, and the visually grounded categories remain the weakest, where the average backend scores below 30%, leaving substantial headroom in document and image understanding. Telco-GAIA offers a rigorous, reproducible testbed for enterprise agents and a template for constructing closed-domain benchmarks.
2025
Beyond Outlining: Heterogeneous Recursive Planning for Adaptive Long-form Writing with Language Models
Ruibin Xiong | Yimeng Chen | Dmitrii Khizbullin | Mingchen Zhuge | Jürgen Schmidhuber
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Ruibin Xiong | Yimeng Chen | Dmitrii Khizbullin | Mingchen Zhuge | Jürgen Schmidhuber
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Long-form writing agents require flexible integration and interaction across information retrieval, reasoning, and composition. Current approaches rely on predefined workflows and rigid thinking patterns to generate outlines before writing, resulting in constrained adaptability during writing. In this paper we propose WriteHERE, a general agent framework that achieves human-like adaptive writing through recursive task decomposition and dynamic integration of three fundamental task types: retrieval, reasoning, and composition. Our methodology features: 1) a planning mechanism that interleaves recursive task decomposition and execution, eliminating artificial restrictions on writing workflow; and 2) integration of task types that facilitates heterogeneous task decomposition. Evaluations on both fiction writing and technical report generation show that our method consistently outperforms state-of-the-art approaches across all automatic evaluation metrics, demonstrating the effectiveness and broad applicability of our proposed framework. We have publicly released our code and prompts to facilitate further research.