Jiacheng Shi
Author directoryOther people with similar names: Jiacheng Shi
Unverified author pages with similar names: Jiacheng Shi
2026
AffectCodec: Emotion-Preserving Neural Speech Codec for Expressive Speech Modeling
Jiacheng Shi | Hongfei Du | Xinyuan Song | Y. Alicia Hong | Yanfu Zhang | Ashley Gao
Findings of the Association for Computational Linguistics: ACL 2026
Jiacheng Shi | Hongfei Du | Xinyuan Song | Y. Alicia Hong | Yanfu Zhang | Ashley Gao
Findings of the Association for Computational Linguistics: ACL 2026
Neural speech codecs provide discrete representations for speech language models, but emotional cues are often degraded during quantization. Existing codecs mainly optimize acoustic reconstruction, leaving emotion expressiveness insufficiently modeled at the representation level. We propose an emotion-guided neural speech codec that explicitly preserves emotional information while maintaining semantic fidelity and prosodic naturalness. Our framework combines emotion–semantic guided latent modulation, relation-preserving emotional–semantic distillation, and emotion-weighted semantic alignment to retain emotionally salient cues under compression. Extensive evaluations across speech reconstruction, emotion recognition, and downstream text to speech generation demonstrate improved emotion consistency and perceptual quality without sacrificing content accuracy.
Tracing a Sparse Emotion-Control Circuit in LLM-Based Text-to-Speech
Hongfei Du | Jiacheng Shi | Yanfu Zhang | Ashley Gao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hongfei Du | Jiacheng Shi | Yanfu Zhang | Ashley Gao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
LLM-based text-to-speech (TTS) models can generate emotionally expressive speech, but how reference emotion is routed through the model and realized in decoded speech remains unclear. We introduce two emotion-sensitive metrics for matched neutral and emotional syntheses—a codec trajectory score and a late residual direction score—and use them to score activation-patching interventions. Under controlled matched-reference conditions, this analysis identifies a sparse source-to-readout component-level circuit: 23–27 attention heads and MLPs per emotion, roughly 5% of the components considered, recover or suppress 74–88% of the late emotion-readout shift on held-out cases. The circuit combines a shared component backbone with emotion-specific components; cross-emotion activation swaps reduce the target readout in 47 of 48 cases. In decoded speech, the same intervention produces consistent changes in pitch, energy, and spectral brightness over 24 matched pairs per emotion. A readout-matched residual-direction baseline produces only 17–27% of the intervention’s pitch effect, showing that internal readout movement alone does not explain the decoded acoustic changes. These results trace a compact causal route from reference-derived prefix information to emotion-relevant properties of generated speech.
Usage-Modulated Sentiment Representations in Large Language Models
Hongfei Du | Jiacheng Shi | Yanfu Zhang | Gang Zhou | Ashley Gao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Hongfei Du | Jiacheng Shi | Yanfu Zhang | Gang Zhou | Ashley Gao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Prior work suggests that sentiment can often be captured by approximately linear directions in LLM activation spaces, but a single direction may not fully capture sentiment representations. In natural communication, sentiment is shaped not only by polarity but also by usage factors, such as tone and audience adaptation. We test whether these factors systematically modulate sentiment representations beyond a shared sentiment direction. We construct a controlled paired dataset that holds event content fixed while varying sentiment polarity and usage factors, and analyze Llama, Mistral, and Gemma. We identify a shared sentiment direction, remove it, and test the residual structure through erasure and generation-time tone steering. Across models, the shared direction is robust (median cosine 0.953–0.975), yet removing it leaves 0.833–0.909 of the original positive–negative representation-difference norm. The residuals contain compact, reproducible usage-conditioned structure. Targeted erasure weakens held-out usage metrics more than random and label-shuffled controls. On Llama, outputs steered along residualized tone components are preferred in 92.8% of blind target-tone comparisons while preserving the requested sentiment polarity in 98.7% of evaluated outputs.
2025
Role-Guided Annotation and Prototype-Aligned Representation Learning for Historical Literature Sentiment Classification
Hongfei Du | Jiacheng Shi | Jacobo Myerston | Sidi Lu | Gang Zhou | Ashley Gao
Findings of the Association for Computational Linguistics: EMNLP 2025
Hongfei Du | Jiacheng Shi | Jacobo Myerston | Sidi Lu | Gang Zhou | Ashley Gao
Findings of the Association for Computational Linguistics: EMNLP 2025
Sentiment analysis of historical literature provides valuable insights for humanities research, yet remains challenging due to scarce annotations and limited generalization of models trained on modern texts. Prior work has primarily focused on two directions: using sentiment lexicons or leveraging large language models (LLMs) for annotation. However, lexicons are often unavailable for historical texts due to limited linguistic resources, and LLM-generated labels often reflect modern sentiment norms and fail to capture the implicit, ironic, or morally nuanced expressions typical of historical literature, resulting in noisy supervision. To address these issues, we introduce a role-guided annotation strategy that prompts LLMs to simulate historically situated perspectives when labeling sentiment. Furthermore, we design a prototype-aligned framework that learns sentiment prototypes from high-resource data and aligns them with low-resource representations via symmetric contrastive loss, improving robustness to noisy labels. Experiments across multiple historical literature datasets show that our method outperforms state-of-the-art baselines, demonstrating its effectiveness.