Jiayu Liang

Author directory

2026

Reasoning language models generate lengthy chain-of-thought (CoT) sequences whose key-value (KV) cache grows linearly and becomes a memory bottleneck during decoding. Existing compaction methods treat reasoning trajectories as flat token sequences and apply uniform compression, ignoring the hierarchical structure of CoT reasoning where different steps vary drastically in importance. We propose Thought-Aware Attention Matching (TAM), which exploits this structure through three mechanisms: (i)thought segmentation that decomposes the trajectory into reasoning blocks, (ii)adaptive budget allocation that assigns compression budget based on each segment’s importance and size, and (iii)pivotal token protection that preserves high-attention reasoning anchors. We prove that the allocation rule is optimal under a convex error model and that cumulative error under sequential compaction remains bounded. Experiments on AIME 2024 and MATH-500 with Qwen3-4B show that TAM improves accuracy over uniform compaction at the same memory footprint, with periodic compaction bounding peak memory to 3.1–3.2,GB (a 65% reduction) while maintaining competitive accuracy.
The democratization of LLMs has accelerated the generation and circulation of highly fluent disinformation, making traditional syntax-semantic verification increasingly insufficient. Such deception often combines persuasive rhetoric, emotional manipulation, and narrative role construction to shape readers’ interpretations. However, existing detectors typically emphasize isolated signals—such as syntax, external knowledge, persuasion, or affective cues—and thus struggle to capture multi-faceted manipulation or provide structured, taxonomy-grounded evidence. To address this gap, we present ExTax, a taxonomy-aligned framework for interpretable disinformation detection. ExTax unifies persuasive rhetoric, emotional manipulation, and narrative roles into a 17-dimensional taxonomic space comprising 6 persuasive-rhetoric strategies, 5 emotional-manipulation methods, and 6 narrative-role categories. It elicits attributes from multiple frontier LLMs, reconciles their disagreements through Entropy-driven Dynamic Label Smoothing, and fuses the resulting taxonomic representations with contextual encodings via Heterogeneous Multi-Head Attention. Across five cross-domain and cross-genre benchmarks, ExTax achieves an overall Macro F1 of 0.8456, outperforming strong deep learning and LLM-based baselines. It also remains robust under severe genre imbalance, where the strongest deep baseline drops from 0.9454 to 0.6194 across genres. Our code is available at https://github.com/owlsan49/ExTax.