Lujing Xie
2024
OpenT2T: An Open-Source Toolkit for Table-to-Text Generation
Haowei Zhang
|
Shengyun Si
|
Yilun Zhao
|
Lujing Xie
|
Zhijian Xu
|
Lyuhao Chen
|
Linyong Nan
|
Pengcheng Wang
|
Xiangru Tang
|
Arman Cohan
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Table data is pervasive in various industries, and its comprehension and manipulation demand significant time and effort for users seeking to extract relevant information. Consequently, an increasing number of studies have been directed towards table-to-text generation tasks. However, most existing methods are benchmarked solely on a limited number of datasets with varying configurations, leading to a lack of unified, standardized, fair, and comprehensive comparison between methods. This paper presents OpenT2T, the first open-source toolkit for table-to-text generation, designed to reproduce existing large language models (LLMs) for performance comparison and expedite the development of new models.We have implemented and compared a wide range of LLMs under zero- and few-shot settings on 9 table-to-text generation datasets, covering data insight generation, table summarization, and free-form table question answering. Additionally, we maintain a public leaderboard to provide insights for future work into how to choose appropriate table-to-text generation systems for real-world scenarios.
Search
Co-authors
- Haowei Zhang 1
- Shengyun Si 1
- Yilun Zhao 1
- Zhijian Xu 1
- Lyuhao Chen 1
- show all...