Zixuan Dong
Author directoryOther people with similar names: Zixuan Dong
Unverified author pages with similar names: Zixuan Dong
2026
OmniHalluc-L: Counterfactual Benchmarking and Modality-Perturbation Calibration for Long-Form Omni Hallucination
Zixuan Dong | Jiafu Tang | Zhide Lei | Zhe Cao | Zijie Zhang | Yanghai Wang | Shihao Li | Xiaodong Wang | Baoyun Peng | Jiaheng Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zixuan Dong | Jiafu Tang | Zhide Lei | Zhe Cao | Zijie Zhang | Yanghai Wang | Shihao Li | Xiaodong Wang | Baoyun Peng | Jiaheng Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Long-video Omni assistants often fail not by inventing content, but by misbinding real evidence: they hear the right utterance and see the right event, yet attach it to the wrong speaker, moment, or modality. These almost-true errors evade standard video QA because local evidence remains valid, so item-level scoring can reward both a supported claim and its near-counterfactual. We introduce a counterfactual event-binding protocol that constructs paired supported/counterfactual claims from the same audio-visual event evidence and evaluates them by strict-pair accuracy. We instantiate it as OmniHalluc-L, to our knowledge the first benchmark for long-video Omni hallucination, with 3600 single-claim QA items from 638 long-form videos averaging 24.16 minutes and covering 256.87 hours. Under this protocol, open-weight Omni models remain weak at pair-level binding: Qwen2.5-Omni-7B reaches 32.06% and Qwen3-Omni-Instruct reaches 41.55%, versus 76.54% for a closed-source reference. To narrow this gap, we propose MPRC (Modality-Perturbation Reliability Calibration), a frozen-backbone calibrator that combines native confidence with response shifts from selected audio-negative probes. MPRC raises these two models to 36.22% and 51.09%, respectively, and improves target-adapted MCQ accuracy on OmniVideoBench and WorldSense. The code is available at https://github.com/ZexDong/omnihallucL-mprc.
AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioning
Yanghai Wang | Jiahao Wang | Jiafu Tang | Yuanxing Zhang | Zhe Cao | Hanyan Bian | Zijie Zhang | Weiliang Luo | Zhiyu Pan | Zixuan Dong | Jiaheng Liu | Zhaoxiang Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yanghai Wang | Jiahao Wang | Jiafu Tang | Yuanxing Zhang | Zhe Cao | Hanyan Bian | Zijie Zhang | Weiliang Luo | Zhiyu Pan | Zixuan Dong | Jiaheng Liu | Zhaoxiang Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Omni-modal video captioning is not merely combining visual captioning with audio transcription: a useful caption must describe how visual actions, speech, music, and sound effects co-evolve over time. Existing large multimodal models often fail at this relational step, treating audio and visual streams as loosely coupled observations, relying heavily on automatic speech recognition, and under-specifying non-speech sounds and their links to visual events. We present AVSCap, a framework for audio-visual captioning centered on explicit cross-modal event binding. First, we construct AVSCap-130K, a tri-modal training corpus generated by a decoupled-then-fused pipeline that anchors visual and acoustic evidence independently before composing temporally grounded omni-modal captions. Second, we train AVSCap-7B, a 7B captioner with a two-stage strategy: supervised fine-tuning establishes baseline captioning ability, while a sample-efficient reinforcement learning stage uses hybrid rewards to optimize acoustic completeness and audio-visual synergy. Our scaling analysis shows that reinforcement learning brings larger gains than simply increasing SFT data. Third, we introduce AVSCapBench, a human-curated benchmark that decomposes captions into visual, audio, and synergy events and evaluates them with fine-grained event recall. Experiments on AVSCapBench and external benchmarks show that AVSCap-7B improves non-speech audio coverage and cross-modal binding, delivering the best overall performance among evaluated open-source models.
Reasoning with Ontology Graph: Toward Type-Constrained Knowledge Graph Question Answering
Yongxue Shan | Jie Peng | Zixuan Dong | Fei Hu | Xiaodong Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yongxue Shan | Jie Peng | Zixuan Dong | Fei Hu | Xiaodong Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models (LLMs) have recently advanced knowledge graph question answering (KGQA), but current methods tend to rely on LLM-induced type systems with inconsistent granularity, or perform multi-hop reasoning without explicit target-type constraints. We introduce OntGQA, a type-constrained KGQA framework that reasons over a relation-centric ontology graph, where each relation is labeled with its head and tail entity types to provide a stable schema backbone. Built on this graph, OntGQA adopts a planner–judge architecture with generative backoff: a type planner proposes plausible head–tail type pairs, a judge verifies retrieved candidates and their paths, and a generator is invoked only when all candidates are rejected. By constraining both endpoints of reasoning in type space, OntGQA achieves state-of-the-art performance and produces ontology-grounded reasoning chains, with substantial Hit@1 gains (87.7%→91.5% on WebQSP and 67.6%→74.6% on CWQ).