Yiran Ding
2026
Mitigating Position Bias in Transformers via Layer-Specific Positional Embedding Scaling
Zhenghua Wang | Yiran Ding | Changze Lv | Yixin Wu | Tianlong Li | Zhibo Xu | Muling Wu | Tianyuan Shi | Shizheng Li | Qi Qian | Xuanjing Huang | Xiaoqing Zheng
Findings of the Association for Computational Linguistics: ACL 2026
Zhenghua Wang | Yiran Ding | Changze Lv | Yixin Wu | Tianlong Li | Zhibo Xu | Muling Wu | Tianyuan Shi | Shizheng Li | Qi Qian | Xuanjing Huang | Xiaoqing Zheng
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Models (LLMs) still struggle with the "lost-in-the-middle" problem, where critical information located in the middle of long-context inputs is often underrepresented or lost. While existing methods attempt to address this by combining multi-scale rotary position embeddings (RoPE), they typically suffer from high latency or rely on suboptimal hand-crafted scaling strategies. To overcome these limitations, we introduce a layer-specific positional embedding scaling (LPES) method that assigns distinct scaling factors to each layer. LPES achieves a more balanced attention distribution without fine-tuning model parameters or increasing inference delay. A specially designed genetic algorithm is employed to efficiently select the optimal scaling factors for each layer by incorporating B’ezier curves to significantly reduce the search space. Extensive experiments demonstrate that LPES effectively mitigates positional attention bias and delivers consistent improvements across multiple long-context benchmarks, yielding up to an 11.2% accuracy gain on the key-value retrieval dataset.
AutoFigure-Edit: Generating Editable Scientific Illustrations via Reference-Guided Styling
Zhen Lin | Qiujie Xie | Minjun Zhu | Shichen Li | QiYao Sun | Enhao Gu | Yiran Ding | Ke Sun | Fang Guo | Panzhong Lu | Zhiyuan Ning | Yixuan Weng | Yue Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
Zhen Lin | Qiujie Xie | Minjun Zhu | Shichen Li | QiYao Sun | Enhao Gu | Yiran Ding | Ke Sun | Fang Guo | Panzhong Lu | Zhiyuan Ning | Yixuan Weng | Yue Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
High-quality scientific illustrations are essential for communicating complex scientific and technical concepts, yet existing automated systems remain limited in editability, stylistic controllability, and efficiency. We present AutoFigure-Edit, an end-to-end system that generates fully editable scientific illustrations from long-form scientific text while enabling flexible style adaptation through user-provided reference images. By combining long-context understanding, reference-guided styling, and native SVG editing, it enables efficient creation and refinement of high-quality scientific illustrations. To facilitate further progress in this field, we release the video at https://youtu.be/10IH8SyJjAQ, the full codebase at https://github.com/ResearAI/AutoFigure-Edit and provide a live demo for easy access and interactive use at https://autofigure.cc/.