Emotion understanding in discourse requires reasoning beyond surface sentiment, since speakers often convey affect through indirect, implicit, polite, ironic, or deliberately mismatched expressions. Existing emotion benchmarks mainly annotate surface polarity or final emotion categories, while lacking a structured account of how explicit expression, implicit affect, pragmatic intent, and fine-grained emotion interact. This limitation makes current evaluations insensitive to cases where affective meaning is concealed, weakened, inverted, or pragmatically reshaped, thereby obscuring models’ failures in deeper emotion understanding. To address this gap, we introduce **CUE-Bench**, a **C**hinese **U**nsaid **E**motion benchmark that centers on **Affective Stance** and covers diverse communicative scenarios. CUE-Bench constructs nine human-interpretable affective stances from Explicit-Implicit polarity interaction and further provides intent and fine-grained emotion annotations for structured affective inference. Experiments show that incorporating Affective Stance improves fine-grained emotion recognition by **3.1** percentage points and pragmatic intent detection by **8.1** percentage points over strong baselines. Project page, data, and code are available at [https://ai4ss.github.io/CUE-Bench/](https://ai4ss.github.io/CUE-Bench/).