%0 Conference Proceedings %T Analysing The Impact of Sequence Composition on Language Model Pre-Training %A Zhao, Yu %A Qu, Yuanbin %A Staniszewski, Konrad %A Tworkowski, Szymon %A Liu, Wei %A Miłoś, Piotr %A Wu, Yuxiang %A Minervini, Pasquale %Y Ku, Lun-Wei %Y Martins, Andre %Y Srikumar, Vivek %S Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) %D 2024 %8 August %I Association for Computational Linguistics %C Bangkok, Thailand %F zhao-etal-2024-analysing %R 10.18653/v1/2024.acl-long.427 %U https://aclanthology.org/2024.acl-long.427/ %U https://doi.org/10.18653/v1/2024.acl-long.427 %P 7897-7912