Fei Hu
Author directory2026
An LLM-Driven Pipeline for Extremely Low-Resource English-to-Indic Translation — From Vocabulary Injection to Post-Training and Decoding
Lu Ruan | Shaoying Jia | Fan Ning | Wei Wang | Zhengzhen Cai | Fei Hu | Heng Hu | Chenzi Wang
Proceedings of the Eleventh Conference on Machine Translation
Lu Ruan | Shaoying Jia | Fan Ning | Wei Wang | Zhengzhen Cai | Fei Hu | Heng Hu | Chenzi Wang
Proceedings of the Eleventh Conference on Machine Translation
This submission addresses WMT26 Category 2 for five extremely low-resource English-to-X translation directions: Bodo, Karbi, Kokborok, Nagamese, and Tagin. We develop an LLM-driven pipeline in which large language models are used both to construct bilingual lexical resources and as translation models. First, an English seed dictionary and qwen3-max are used to build word-level bilingual vocabularies, whose top candidates are injected into translation prompts as a "Helpful Vocabulary" block. On an 80/20 train-held-out split of the Tagin data, vocabulary injection is associated with a 7.09-point BLEU improvement and a 49.35-point TER reduction. Second, we compare LoRA adaptation of Qwen2.5-32B-Instruct with full-parameter fine-tuning of Hunyuan-MT-7B, with optional DPO. Hunyuan performs better in the reported Bodo and Kokborok comparisons, including an 11.87-point ChrF advantage on Bodo. Third, post-hoc repeated-ngram and length truncation, combined with per-sentence selection of the shorter of two decoding outputs, mitigates generation degeneration and improves Bodo BLEU from 19.27 to 27.18 without retraining. We submit two contrastive systems per direction: a take-shorter system with output truncation for Bodo, and augmented and baseline SFT systems for the other directions. Code and configurations are publicly available.
An LLM-Driven Pipeline for Extremely Low-Resource English-to-Indic Translation — From Vocabulary Injection to Post-Training and Decoding
Lu Ruan | Shaoying Jia | Fan Ning | Wei Wang | Zhengzhen Cai | Fei Hu | Heng Hu | Chenzi Wang
Proceedings of the Eleventh Conference on Machine Translation
Lu Ruan | Shaoying Jia | Fan Ning | Wei Wang | Zhengzhen Cai | Fei Hu | Heng Hu | Chenzi Wang
Proceedings of the Eleventh Conference on Machine Translation
This submission addresses WMT26 Category 2 for five extremely low-resource English-to-X translation directions: Bodo, Karbi, Kokborok, Nagamese, and Tagin. We develop an LLM-driven pipeline in which large language models are used both to construct bilingual lexical resources and as translation models. First, an English seed dictionary and qwen3-max are used to build word-level bilingual vocabularies, whose top candidates are injected into translation prompts as a "Helpful Vocabulary" block. On an 80/20 train-held-out split of the Tagin data, vocabulary injection is associated with a 7.09-point BLEU improvement and a 49.35-point TER reduction. Second, we compare LoRA adaptation of Qwen2.5-32B-Instruct with full-parameter fine-tuning of Hunyuan-MT-7B, with optional DPO. Hunyuan performs better in the reported Bodo and Kokborok comparisons, including an 11.87-point ChrF advantage on Bodo. Third, post-hoc repeated-ngram and length truncation, combined with per-sentence selection of the shorter of two decoding outputs, mitigates generation degeneration and improves Bodo BLEU from 19.27 to 27.18 without retraining. We submit two contrastive systems per direction: a take-shorter system with output truncation for Bodo, and augmented and baseline SFT systems for the other directions. Code and configurations are publicly available.
Reasoning with Ontology Graph: Toward Type-Constrained Knowledge Graph Question Answering
Yongxue Shan | Jie Peng | Zixuan Dong | Fei Hu | Xiaodong Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yongxue Shan | Jie Peng | Zixuan Dong | Fei Hu | Xiaodong Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models (LLMs) have recently advanced knowledge graph question answering (KGQA), but current methods tend to rely on LLM-induced type systems with inconsistent granularity, or perform multi-hop reasoning without explicit target-type constraints. We introduce OntGQA, a type-constrained KGQA framework that reasons over a relation-centric ontology graph, where each relation is labeled with its head and tail entity types to provide a stable schema backbone. Built on this graph, OntGQA adopts a planner–judge architecture with generative backoff: a type planner proposes plausible head–tail type pairs, a judge verifies retrieved candidates and their paths, and a generator is invoked only when all candidates are rejected. By constraining both endpoints of reasoning in type space, OntGQA achieves state-of-the-art performance and produces ontology-grounded reasoning chains, with substantial Hit@1 gains (87.7%→91.5% on WebQSP and 67.6%→74.6% on CWQ).
2021
FastSeq: Make Sequence Generation Faster
Yu Yan | Fei Hu | Jiusheng Chen | Nikhil Bhendawade | Ting Ye | Yeyun Gong | Nan Duan | Desheng Cui | Bingyu Chi | Ruofei Zhang
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations
Yu Yan | Fei Hu | Jiusheng Chen | Nikhil Bhendawade | Ting Ye | Yeyun Gong | Nan Duan | Desheng Cui | Bingyu Chi | Ruofei Zhang
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations
Transformer-based models have made tremendous impacts in natural language generation. However the inference speed is a bottleneck due to large model size and intensive computing involved in auto-regressive decoding process. We develop FastSeq framework to accelerate sequence generation without accuracy loss. The proposed optimization techniques include an attention cache optimization, an efficient algorithm for detecting repeated n-grams, and an asynchronous generation pipeline with parallel I/O. These optimizations are general enough to be applicable to Transformer-based models (e.g., T5, GPT2, and UniLM). Our benchmark results on a set of widely used and diverse models demonstrate 4-9x inference speed gain. Additionally, FastSeq is easy to use with a simple one-line code change. The source code is available at https://github.com/microsoft/fastseq.