Hayeong Ryu
Author directory2026
Look Before You Leap: Factual Decoding with Internal Attribution Signals
Hayeong Ryu | JungMin Yun | Byeonggeuk Lim | Sunhee Jo | YoungBin Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Hayeong Ryu | JungMin Yun | Byeonggeuk Lim | Sunhee Jo | YoungBin Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Hallucination remains a critical challenge in large language models (LLMs), where early factual errors compound through autoregressive generation in a snowballing effect that neither post-hoc correction nor weight-level intervention can effectively preempt. We propose DescaPE (DEcoding Signal Control Against Path Error-snowballing), a decoding framework that leverages internal model signals to suppress hallucination-prone trajectories at inference time. Through sliding-window MLP ablation, we identify a factual-salient layer span within LLMs whose derived signal is selectively elevated for factual tokens and exhibits anomalous spikes at hallucination-prone steps. We train a lightweight probe to approximate this signal from a single forward pass and integrate it into candidate scoring to penalize high-risk continuations while rewarding factually grounded ones. Experiments across five factuality benchmarks on three LLMs demonstrate that DescaPE achieves factuality improvements over decoding-time baselines in multiple settings, while incurring only 1.10x latency overhead in our efficiency evaluation. Our code is available at https://github.com/hayeonggg/DESCAPE.
Don’t Count the Edits, Judge by the Outcome Alone: Reward-Based Evaluation for Grammatical Error Correction
Hayeong Ryu | Sunhee Jo | Seunguk Yu | YoungBin Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Hayeong Ryu | Sunhee Jo | Seunguk Yu | YoungBin Kim
Findings of the Association for Computational Linguistics: EMNLP 2026
Grammatical error correction (GEC) evaluation has traditionally relied on reference or edit overlap, which can penalize valid rewrites that differ from gold corrections. Reference-free metrics reduce this dependence, but evaluating whether a fluent output is a valid correction of the source remains challenging. We propose SURE, a source-conditioned reward evaluator trained on within-source preferences spanning minimal-edit and rewrite-oriented corrections. SURE jointly learns an overall reward with criteria-level supervision for grammaticality, faithfulness, and fluency, together with span-level grounding for source-side error resolution. Experiments on SEEDA show that SURE performs competitively against strong baselines, with particular gains on rewrite-style corrections and more disentangled criteria-level diagnostics. Our code is available at https://github.com/hayeonggg/SURE.
Beyond Safe Answers: Segment-Aware Listwise Alignment for Reasoning Safety in Large Reasoning Models
JungMin Yun | Junehyoung Kwon | Hayeong Ryu | Byeonggeuk Lim | Hoejoon Kwon | YoungBin Kim
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
JungMin Yun | Junehyoung Kwon | Hayeong Ryu | Byeonggeuk Lim | Hoejoon Kwon | YoungBin Kim
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Reasoning Models (LRMs) pose a dual-surface safety challenge: both intermediate reasoning traces and final answers can contain harmful content. Existing alignment methods often operate at the whole-response level, allowing unsafe reasoning to be masked by a safe-looking final answer. We propose Segment-aware Listwise Target DPO (SaLT-DPO), which addresses this gap through three mechanisms: (1) segment-aware listwise alignment that decomposes responses into reasoning and answer segments, independently scores each segment’s safety, and aligns length-normalized segment rewards with soft target distributions over multiple candidates; (2) joint safety coherence regularization that applies a weakest-link principle to promote safety consistency across both segments; and (3) utility anchoring on benign prompts to mitigate over-refusal and reasoning degradation. Experiments on three LRMs show that SaLT-DPO consistently reduces unsafe rates for both reasoning and answer segments while mitigating degradation in benign compliance and preserving general reasoning performance. Ablation studies demonstrate the complementary contributions of its components.