Young-Kyoon Suh
Author directory2026
Layer-wise Target Propagation: Efficient Component Attribution through Target Centric Propagation
Lasse M. Jantsch | Dong-Jae Koh | Seonghyeon Lee | Young-Kyoon Suh
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Lasse M. Jantsch | Dong-Jae Koh | Seonghyeon Lee | Young-Kyoon Suh
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Understanding the internal mechanisms of transformer-based large language models (LLMs) is crucial for their reliable deployment and effective operation. While recent efforts have yielded a plethora of attribution methods attempting to balance faithfulness and computational efficiency, dense component attribution remains prohibitively expensive. In this work, we introduce *Layer-wise Target Propagation* (LTP), a novel framework that faithfully traces information flow on the frozen transformer in one forward and one backward pass without requiring counterfactual examples. LTP analytically decomposes and linearizes the computational structure of the Transformers into distinct pathways along which it propagates a targeted unembedding vector to receive the effective representation at each residual position. This target-centric propagation achieves O(1) time complexity with respect to the number of model components, scaling to long input sequences and dense component attribution. Extensive experiments on standard interpretability benchmarks demonstrate that LTP achieves state-of-the-art faithfulness and unprecedented efficiency compared to existing baselines. O(1) time complexity with respect to the number of model components, scaling to long input sequences and dense component attribution. Extensive experiments on standard interpretability benchmarks demonstrate that LTP achieves state-of-the-art faithfulness and unprecedented efficiency compared to existing baselines.
2025
FineCite: A Novel Approach For Fine-Grained Citation Context Analysis
Lasse Jantsch | Dong-Jae Koh | Seonghwan Yoon | Jisu Lee | Anne Lauscher | Young-Kyoon Suh
Findings of the Association for Computational Linguistics: ACL 2025
Lasse Jantsch | Dong-Jae Koh | Seonghwan Yoon | Jisu Lee | Anne Lauscher | Young-Kyoon Suh
Findings of the Association for Computational Linguistics: ACL 2025
Citation context analysis (CCA) is a field of research studying the role and purpose of citation in scientific discourse. While most of the efforts in CCA have been focused on elaborate characterization schemata to assign function or intent labels to individual citations, the citation context as the basis for such a classification has received rather limited attention. This relative neglect, however, has led to the prevalence of vague definitions and restrictive assumptions, limiting the citation context in its expressiveness. It is a common practice, for example, to restrict the context to the citing sentence. While this simple context conceptualization might be sufficient to assign intent or function classes, it fails to cover the rich information of scientific discourse. To address this concern, we analyze the context conceptualizations of previous works and, to our knowledge, construct the first comprehensive context definition based on the semantic properties of the citing text. To evaluate this definition, we construct and publish the FineCite corpus containing 1,056 manually annotated citation contexts. Our experiments on established CCA benchmarks demonstrate the effectiveness of our fine-grained context definition, showing improvements of up to 25% compared to state-of-the-art approaches. We make our code and data publicly available at https://github.com/lab-paper-code/FineCite.