Sungwoong Kim
Author directoryOther people with similar names: Sungwoong Kim
Unverified author pages with similar names: Sungwoong Kim
2026
RetroReasoner: A Reasoning LLM for Strategic Retrosynthesis Prediction
Hanbum Ko | Chanhui Lee | Ye Rin Kim | Rodrigo Hormazabal | Sehui Han | Sungbin Lim | Sungwoong Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Hanbum Ko | Chanhui Lee | Ye Rin Kim | Rodrigo Hormazabal | Sehui Han | Sungbin Lim | Sungwoong Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Retrosynthesis prediction aims to identify reactants that can synthesize a given product molecule. Although molecular large language models (LLMs) have recently shown promising results, most existing methods either generate reactants directly or provide only generic product-level analysis, without explicitly reasoning about bond-disconnection strategies that justify specific reactant choices. This paper proposes RetroReasoner, a retrosynthetic reasoning model that captures chemists’ strategic disconnection-based thinking. RetroReasoner is trained with supervised fine-tuning and reinforcement learning. For supervised fine-tuning, SyntheticRetro generates structured disconnection rationales paired with reactant predictions. For reinforcement learning, a round-trip reward evaluates predicted reactants by passing them through a forward synthesis model and rewarding predictions that reconstruct the original product. RetroReasoner can also be applied to multi-step retrosynthetic planning by incorporating it into a parallelized Monte Carlo tree search framework, reducing search time while increasing the number and diversity of valid synthetic pathways. Experimental results show that RetroReasoner outperforms prior baselines, including not only molecular LLMs but also retrosynthesis-specific expert models, and generates a broader range of feasible reactant proposals, especially for challenging reaction instances. The code is available at https://github.com/KU-AGI/RetroReasoner.
Plan-and-Verify Video Reward Reasoning with Spatio-Temporal Scene Graph Grounding
Hyomin Kim | Junghye Kim | Joanie Hayoun Chung | Yoonjin Oh | Kyungjae Lee | Sungbin Lim | Sungwoong Kim
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hyomin Kim | Junghye Kim | Joanie Hayoun Chung | Yoonjin Oh | Kyungjae Lee | Sungbin Lim | Sungwoong Kim
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Reward models for text-to-video (T2V) generation guide post-training but often fail at fine-grained semantic alignment. We trace this to two structural weaknesses in existing reasoning-based reward models: they do not systematically verify every condition described in the prompt, and the visual evidence supporting each judgment remains implicit in their free-form reasoning. We propose **SG-PVR**, a video reward model that addresses these limitations through plan-and-verify reasoning grounded in spatio-temporal scene graphs. The verification plan decomposes the prompt into atomic claims, making the set of requirements to be checked explicit. The spatio-temporal scene graph, encoding entities, attributes, and temporally grounded relations, is extracted from the video and maintained as a persistent structured visual reference throughout reasoning. Each claim is verified against both the video and the scene graph, anchoring judgments in explicit visual evidence. SG-PVR achieves strong performance on semantic alignment, including fine-grained temporal semantics. As a test-time reranker, it further enhances compositional alignment in T2V generation.
2024
Query-based Cross-Modal Projector Bolstering Mamba Multimodal LLM
SooHwan Eom | Jay Shim | Gwanhyeong Koo | Haebin Na | Mark A. Hasegawa-Johnson | Sungwoong Kim | Chang D. Yoo
Findings of the Association for Computational Linguistics: EMNLP 2024
SooHwan Eom | Jay Shim | Gwanhyeong Koo | Haebin Na | Mark A. Hasegawa-Johnson | Sungwoong Kim | Chang D. Yoo
Findings of the Association for Computational Linguistics: EMNLP 2024
The Transformer’s quadratic complexity with input length imposes an unsustainable computational load on large language models (LLMs). In contrast, the Selective Scan Structured State-Space Model, or Mamba, addresses this computational challenge effectively. This paper explores a query-based cross-modal projector designed to bolster Mamba’s efficiency for vision-language modeling by compressing visual tokens based on input through the cross-attention mechanism. This innovative projector also removes the need for manually designing the 2D scan order of original image features when converting them into an input sequence for Mamba LLM. Experimental results across various vision-language understanding benchmarks show that the proposed cross-modal projector enhances Mamba-based multimodal LLMs, boosting both performance and throughput.