Haozhe Zhang
Author directoryOther people with similar names: Haozhe Zhang
Unverified author pages with similar names: Haozhe Zhang
2026
TeleTables: A Benchmark for Evaluating LLM Understanding of Tables in Technical Standards
Anas Ezzakri | Nicola Piovesan | Mohamed Sana | Antonio De Domenico | Fadhel Ayed | Haozhe Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Anas Ezzakri | Nicola Piovesan | Mohamed Sana | Antonio De Domenico | Fadhel Ayed | Haozhe Zhang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing: Industry Track
Large Language Models (LLMs) are increasingly applied to telecom engineering tasks, yet perform poorly on 3GPP specifications. These standards encode much of their technical information in complex tables, but LLM knowledge and interpretation of such tables remain largely unexplored. We introduce TeleTables, a benchmark comprising 2,220 tables from 13 3GPP specifications in four formats and 500 human-verified MCQs spanning direct retrieval to multi-step reasoning. Evaluating 20 open-weight LLMs across non-reasoning, multimodal, reasoning, and table-specialized architectures reveals two distinct performance bottlenecks. In the closed-book setting, domain knowledge is the primary constraint, with no general-purpose model exceeding 41% accuracy. When the table is provided as context, the best models exceed 90%, but performance degrades systematically with reasoning depth, evidence scope, and structural complexity, with a 32.2 pp spread across reasoning skills. Table specialization on non-telecom data provides no consistent benefit, while strong reasoning capabilities remain essential for reliable interpretation of complex technical tables.
2024
Embedding and Gradient Say Wrong: A White-Box Method for Hallucination Detection
Xiaomeng Hu | Yiming Zhang | Ru Peng | Haozhe Zhang | Chenwei Wu | Gang Chen | Junbo Zhao
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Xiaomeng Hu | Yiming Zhang | Ru Peng | Haozhe Zhang | Chenwei Wu | Gang Chen | Junbo Zhao
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
In recent years, large language models (LLMs) have achieved remarkable success in the field of natural language generation. Compared to previous small-scale models, they are capable of generating fluent output based on the provided prefix or prompt. However, one critical challenge — the hallucination problem — remains to be resolved. Generally, the community refers to the undetected hallucination scenario where the LLMs generate text unrelated to the input text or facts. In this study, we intend to model the distributional distance between the regular conditional output and the unconditional output, which is generated without a given input text. Based upon Taylor Expansion for this distance at the output probability space, our approach manages to leverage the embedding and first-order gradient information. The resulting approach is plug-and-play that can be easily adapted to any autoregressive LLM. On the hallucination benchmarks HADES and other datasets, our approach achieves state-of-the-art performance.