Zhenyuan Dong
2025
Mitigating Sequential Dependencies: A Survey of Algorithms and Systems for Generation-Refinement Frameworks in Autoregressive Models
Yunhai Hu
|
Zining Liu
|
Zhenyuan Dong
|
Tianfan Peng
|
Bradley McDanel
|
Sai Qian Zhang
Findings of the Association for Computational Linguistics: EMNLP 2025
Sequential dependencies present a fundamental bottleneck in deploying large-scale autoregressive models, particularly for real-time applications. While traditional optimization approaches like pruning and quantization often compromise model quality, recent advances in generation-refinement frameworks demonstrate that this trade-off can be significantly mitigated.This survey presents a comprehensive taxonomy of generation-refinement frameworks, analyzing methods across autoregressive sequence tasks. We categorize methods based on their generation strategies (from simple n-gram prediction to sophisticated draft models) and refinement mechanisms (including single-pass verification and iterative approaches). Through systematic analysis of both algorithmic innovations and system-level implementations, we examine deployment strategies across computing environments and explore applications spanning text, images, and speech generation. This systematic examination of both theoretical frameworks and practical implementations provides a foundation for future research in efficient autoregressive decoding. In the appendix A, we additionally provide experimental comparisons of various baseline methods.
2018
ISCLAB at SemEval-2018 Task 1: UIR-Miner for Affect in Tweets
Meng Li
|
Zhenyuan Dong
|
Zhihao Fan
|
Kongming Meng
|
Jinghua Cao
|
Guanqi Ding
|
Yuhan Liu
|
Jiawei Shan
|
Binyang Li
Proceedings of the 12th International Workshop on Semantic Evaluation
This paper presents a UIR-Miner system for emotion and sentiment analysis evaluation in Twitter in SemEval 2018. Our system consists of three main modules: preprocessing module, stacking module to solve the intensity prediction of emotion and sentiment, LSTM network module to solve multi-label classification, and the hierarchical attention network module for solving emotion and sentiment classification problem. According to the metrics of SemEval 2018, our system gets the final scores of 0.636, 0.531, 0.731, 0.708, and 0.408 on 5 subtasks, respectively.
Search
Fix author
Co-authors
- Jinghua Cao 1
- Guanqi Ding 1
- Zhihao Fan 1
- Yunhai Hu 1
- Meng Li (李梦) 1
- show all...