Luke Borgnolo
Author directory2026
OpenDC-Infer-LC: Benchmarking Production-Valid Long-Context and RAG LLM Serving
Yue Yang | Maxwell Twelftree | Jared Collette | An-Chi He | Luke Borgnolo | David Lemphers
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Yue Yang | Maxwell Twelftree | Jared Collette | An-Chi He | Luke Borgnolo | David Lemphers
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Long-context and RAG workloads expose production bottlenecks that raw tokens/s and offline accuracy do not capture, including prefill cost, KV-cache pressure, prefix reuse, routing, and latency SLOs. We introduce OpenDC-Infer-LC, a hardware- and backend-neutral benchmark for evaluating complete data-center LLM serving stacks under long-context and retrieved-context workloads. The benchmark ranks systems by SLO-qualified, quality-preserving goodput: valid output-token throughput at the highest load satisfying p95 TTFT, p95 TPOT, p95 end-to-end latency, and success-rate targets. Because RAG and LongBench quality depends on model ability, retrieval difficulty, and task difficulty, OpenDC-Infer-LC uses a relative quality guardrail against a low-load reference run for the same model and workload, while reporting absolute quality separately. Pilot results on AMD MI355X and NVIDIA B200 show that deployable capacity depends strongly on backend scheduling, cache reuse, context length, routing, quantization, and runtime maturity.
Voice of Australian-AI: Learning Australian Assistant Voice Without Caricature
Yue Yang | Maxwell Twelftree | Luke Borgnolo | David Lemphers | Amanda Baughan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Yue Yang | Maxwell Twelftree | Luke Borgnolo | David Lemphers | Amanda Baughan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
LLM assistants deployed outside the United States often inherit US-centred interactional defaults. We introduce an Australian-facing assistant, and test whether local voice is better learned during fine-tuning or imposed with an inference-time prompt. We define Australian Voice as pragmatic alignment, directness, modesty, warmth, register control, and task fidelity, rather than slang or spelling substitution. We build a governed dataset from user research, human rewrites, contrastive negatives, reviewed synthetic examples, and replay data. In a blind evaluation by Australian English users (356 question-level ratings over 89 prompts), the raw 50% voice/replay mix scores best on all five dimensions (4.24/5; 102 best-pick wins). Prompted variants underperform every matched fine-tuned model.