Chain-of-thought (CoT) reasoning has become a default paradigm across reasoning-intensive tasks and is widely assumed to be, at worst, harmless. Recent efficient-reasoning work treats unnecessary CoT purely as a cost to be reduced. We show that in boundary-dense classification tasks such as content moderation and toxicity detection, CoT is instead actively harmful. We identify the overthinking effect: extended reasoning amplifies weak surface signals into false evidence of violation, inflating false positive rates on ambiguous non-violating samples while its gains on ambiguous violating samples mask the harm in aggregate metrics. To address this, we propose Oreki, an adaptive CoT framework that uses K-fold cross-probing to label per-sample reasoning necessity and fine-tunes on a mixture of full-reasoning and reasoning-skipped formats. Across four base models on video moderation and multi-label toxicity detection, Oreki preserves CoT’s recall gains while suppressing its false positive inflation, outperforming both Always-CoT and Never-CoT. On toxicity detection, it cuts low-agreement false positive rate from 0.467 to 0.257 while raising overall F1 from 0.792 to 0.851.

Online video content moderation is critical for protecting minors. Violations are increasingly implicit and context-dependent: a swimwear is innocuous in a vlog but high-risk with suggestive posing. Yet, traditional binary systems fundamentally fail to capture this continuous severity spectrum, directly leading to both excessive false positives for context-heavy samples and missing deeply implicit violations. We introduce KUROKO, a content moderation system that acts as a behind-the-scenes assistant, driving a paradigm shift in content moderation from binary classification to severity-aware ranking. Our contributions are threefold: (1) Human-Centric Severity Ranking: KUROKO shifts from rigid binary divides to a continuous risk spectrum, producing nuanced, expert-level rationales closely aligning with human judgment. (2) Verifiable Alignment and Interpretability: By integrating a severity-aware data engine and a verifiable reinforcement learning approach, we replace black-box decisions with transparent, actionable diagnostics. (3) Cost-Efficient Deployment: We engineer a coarse-to-fine inference architecture equipped with a lightweight recall classifier, enabling compact models to rival proprietary VLMs at a fraction of the computational cost. Extensive offline and online A/B tests demonstrate KUROKO’s advantages over traditional binary baselines and its competitiveness with leading commercial APIs at a fraction of their scale. Online, KUROKO yields more human-confirmed enforcement actions under an equal human-review budget, while lowering violative exposure and user negative feedback.

As large language models (LLMs) are gradually integrated into human daily life, assessing their underlying values becomes essential for understanding their risks and alignment with specific preferences. Despite growing efforts, current value evaluation methods face two key challenges. C1. Evaluation Validity: Static benchmarks fail to reflect intended values or yield informative results due to data contamination or a ceiling effect. C2. Result Interpretation: They typically reduce the pluralistic and often incommensurable values to one-dimensional scores, which hinders users from gaining meaningful insights and guidance. To address these challenges, we present Value Compass Benchmarks, the first dynamic, online and interactive platform specially devised for comprehensive value diagnosis of LLMs. It (1) grounds evaluations in multiple basic value systems from social science; (2) develops a generative evolving evaluation paradigm that automatically creates real-world test items co-evolving with ever-advancing LLMs; (3) offers multi-faceted result interpretation, including (i) fine-grained scores and case studies across 27 value dimensions for 33 leading LLMs, (ii) customized comparisons, and (iii) visualized analysis of LLMs’ alignment with cultural values. We hope Value Compass Benchmarks serves as a navigator for further enhancing LLMs’ safety and alignment, benefiting their responsible and adaptive development.