Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks

Tokenization Consistency Matters for Generative Models on Extractive NLP Tasks Kaiser Sun author Peng Qi author Yuhao Zhang author Lan Liu author William Wang author Zhiheng Huang author 2023-12 text Findings of the Association for Computational Linguistics: EMNLP 2023 Houda Bouamor editor Juan Pino editor Kalika Bali editor Association for Computational Linguistics Singapore conference publication sun-etal-2023-tokenization 10.18653/v1/2023.findings-emnlp.887 https://aclanthology.org/2023.findings-emnlp.887/ 2023-12 13300 13310