Jinsoo Kim
Author directory2026
StreamAlign: Streaming Text-Aligned Speech Tokenization
Kang-wook Kim | Jinyoung Park | Jinsoo Kim | Sehun Lee | Tony Woo | Gunhee Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Kang-wook Kim | Jinyoung Park | Jinsoo Kim | Sehun Lee | Tony Woo | Gunhee Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Text-aligned speech tokenization methods have emerged to better align speech tokens with LLM token spaces, enabling more effective utilization of pretrained LLMs. However, they rely on offline automatic speech recognition (ASR), leading to two key limitations: (i) the need for complete utterances before tokenization, precluding real-time streaming, and (ii) vocabulary mismatch between ASR and LLMs, which reduces acoustic granularity from the subword to the word level. We introduce StreamAlign, a text-aligned speech tokenization framework that enables streaming tokenization for real-time speech–text joint modeling. StreamAlign performs online speech–text alignment by combining character-level RNN-Transducer alignment with word-level ASR guidance, mitigating ASR–LLM vocabulary mismatch while preserving recognition accuracy. A proactive word boundary classifier anticipates word completion at chunk boundaries, reducing tokenization latency from 560ms to 270 ms. On LibriSpeech, StreamAlign achieves the lowest WER and highest UTMOS among evaluated tokenizers. Furthermore, StreamAlign-SLM, a spoken language model trained on StreamAlign units, demonstrates the strongest overall performance in terms of both acoustic and semantic consistency on the SALMon and spoken StoryCloze benchmarks.
2025
The RAG Paradox: A Black-Box Attack Exploiting Unintentional Vulnerabilities in Retrieval-Augmented Generation Systems
Chanwoo Choi | Jinsoo Kim | Sukmin Cho | Soyeong Jeong | Buru Chang
Findings of the Association for Computational Linguistics: EMNLP 2025
Chanwoo Choi | Jinsoo Kim | Sukmin Cho | Soyeong Jeong | Buru Chang
Findings of the Association for Computational Linguistics: EMNLP 2025
With the growing adoption of retrieval-augmented generation (RAG) systems, various attack methods have been proposed to degrade their performance. However, most existing approaches rely on unrealistic assumptions in which external attackers have access to internal components such as the retriever. To address this issue, we introduce a realistic black-box attack based on the RAG paradox, a structural vulnerability that emerges from the system’s effort to enhance trust by revealing both the retrieved documents and their sources to users. This transparency enables attackers to observe which sources are used and how information is phrased, allowing them to craft poisoned documents that are more likely to be retrieved and upload them to the identified sources. Moreover, as RAG systems directly provide retrieved content to users, these documents must not only be retrievable but also appear natural and credible to prevent users from questioning the search results. Unlike prior work that focuses solely on improving document retrievability, our attack method explicitly considers both retrievability and user trust in the retrieved content. Through extensive offline and online experiments, we demonstrate that our method significantly degrades system performance without internal access, while generating natural-looking poisoned documents.