Yue Yang
Author directoryOther people with similar names: Yue Yang, Yue Yang, Yue Yang
Unverified author pages with similar names: Yue Yang
2026
CHUNDER: Enabling Million-Token Qwen3 Serving on AMD ROCm
David Lemphers | Maxwell Twelftree | An-Chi He | Yue Yang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
David Lemphers | Maxwell Twelftree | An-Chi He | Yue Yang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Million-token context serving is becoming a critical requirement for industry LLM systems for real deployments. However, practical 1M-context serving for open-source models has remained heavily CUDA-centric, largely because the required long-context runtime features are not fully available on AMD ROCm. With AMD GPUs now reported at around 19% market share, this gap matters. We address it by enabling 1M-token Qwen3 serving on AMD GPUs with ROCm. We present , a runtime stack that enables million-token serving for the widely used open-source Qwen3 family on AMD ROCm. achieves this by intercepting vLLM’s attention routing at runtime and redirecting queries, keys, and values to JIT-compiled Triton Dual Chunk Attention (DCA) kernels, without forking the serving engine. We then harden the surrounding runtime to make full 1M-token execution practical: DCA-aware paged metadata, tiled single-request chunked prefill, MoE token chunking that reduces per-rank transient memory from approximately 91.6 GiB to 10.6 GiB, and FP8 GEMMs with hardened hipBLASLt kernel selection. We evaluate across multiple million-token context tasks and show consistent serving performance and exact retrieval correctness. To our knowledge, this is the first reported end-to-end Qwen3 million-token serving path on AMD ROCm integrated with vLLM.
OpenDC-Infer-LC: Benchmarking Production-Valid Long-Context and RAG LLM Serving
Yue Yang | Maxwell Twelftree | Jared Collette | An-Chi He | Luke Borgnolo | David Lemphers
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Yue Yang | Maxwell Twelftree | Jared Collette | An-Chi He | Luke Borgnolo | David Lemphers
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Long-context and RAG workloads expose production bottlenecks that raw tokens/s and offline accuracy do not capture, including prefill cost, KV-cache pressure, prefix reuse, routing, and latency SLOs. We introduce OpenDC-Infer-LC, a hardware- and backend-neutral benchmark for evaluating complete data-center LLM serving stacks under long-context and retrieved-context workloads. The benchmark ranks systems by SLO-qualified, quality-preserving goodput: valid output-token throughput at the highest load satisfying p95 TTFT, p95 TPOT, p95 end-to-end latency, and success-rate targets. Because RAG and LongBench quality depends on model ability, retrieval difficulty, and task difficulty, OpenDC-Infer-LC uses a relative quality guardrail against a low-load reference run for the same model and workload, while reporting absolute quality separately. Pilot results on AMD MI355X and NVIDIA B200 show that deployable capacity depends strongly on backend scheduling, cache reuse, context length, routing, quantization, and runtime maturity.
Voice of Australian-AI: Learning Australian Assistant Voice Without Caricature
Yue Yang | Maxwell Twelftree | Luke Borgnolo | David Lemphers | Amanda Baughan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Yue Yang | Maxwell Twelftree | Luke Borgnolo | David Lemphers | Amanda Baughan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
LLM assistants deployed outside the United States often inherit US-centred interactional defaults. We introduce an Australian-facing assistant, and test whether local voice is better learned during fine-tuning or imposed with an inference-time prompt. We define Australian Voice as pragmatic alignment, directness, modesty, warmth, register control, and task fidelity, rather than slang or spelling substitution. We build a governed dataset from user research, human rewrites, contrastive negatives, reviewed synthetic examples, and replay data. In a blind evaluation by Australian English users (356 question-level ratings over 89 prompts), the raw 50% voice/replay mix scores best on all five dimensions (4.24/5; 102 best-pick wins). Prompted variants underperform every matched fine-tuned model.
Explain the Synth: Interpretable Evaluation of LLM Data Synthesis
Yue Yang | Fan Yang | Yu Bai | Hao Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yue Yang | Fan Yang | Yu Bai | Hao Wang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models (LLMs) are increasingly used to generate synthetic data, in which tabular data constitute a fundamental data modality across a wide range of domains. Yet, current evaluation practices often provide limited insights into whether the synthetic data preserve real data-generating relationships or introduce plausible-looking artifacts. We present a conceptually simple, interpretable auditing framework that compares the explanatory structure induced by real versus synthetic data. The key idea is to use a transparent rule-based model as a shared explanatory language: we extract rules from real data to summarize how features relate to labels, then examine how this rule structure changes when explained using LLM-generated data. Importantly, these rules are derived by an independent rule auditor rather than by the generator itself. The resulting “explanation shift” reveals which relationships are preserved, weakened, removed, or newly introduced by the generator, offering actionable diagnostics beyond aggregate fidelity scores. We further provide a theoretical perspective that links explanation shift and cross-domain predictive gaps to distribution mismatch within an interpretable hypothesis class. Overall, our approach turns synthetic data evaluation into a human-auditable comparison of explanations, improving transparency for LLM-based tabular synthesis.
2025
InterIDEAS: Philosophical Intertextuality via LLMs
Yue Yang | Yinzhi Xu | Chenghao Huang | JohnMichael Jurgensen | Han Hu | Hao Wang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Yue Yang | Yinzhi Xu | Chenghao Huang | JohnMichael Jurgensen | Han Hu | Hao Wang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
The formation and circulation of ideas in philosophy have profound implications for understanding philosophical dynamism–enabling us to identify seminal texts, delineate intellectual traditions, and track changing conventions in the act of philosophizing. However, traditional analyses of these issues often depend on manual reading and subjective interpretation, constrained by human cognitive limits. We introduce InterIDEAS, a pioneering dataset designed to bridge philosophy, literary studies, and natural language processing (NLP). By merging theories of intertextuality from literary studies with bibliometric techniques and recent LLMs, InterIDEAS enables both quantitative and qualitative analysis of the intellectual, social, and historical relations embedded within authentic philosophical texts. This dataset not only assists the study of philosophy but also contributes to the development of language models by providing a training corpus that challenges and enhances their interpretative capacity.