Hongyu Chang
Author directory2026
CircuitPile: A Data Synthesis Framework for Enhancing Multimodal LLMs’ Perception on Circuit Schematics
Hongyu Chang | Xinyue Li | Huanyong Liu | Feng Zhang | Yuhui Yin
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Hongyu Chang | Xinyue Li | Huanyong Liu | Feng Zhang | Yuhui Yin
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
In recent years, multimodal large language models have achieved substantial progress, yet their performance remains limited in specialized domains such as circuit diagram understanding. A key bottleneck lies in the lack of diverse and large-scale training data tailored to the structural characteristics of circuit diagrams, together with the high cost of expert annotation. To address this challenge, we propose CircuitPile, a systematic data synthesis framework for circuit visual-language modeling. CircuitPile integrates heterogeneous circuit resources from multiple sources and constructs standardized label spaces and multi-granularity visual representations. Based on this framework, we build 738K domain-specific pre-training samples and 100K task-oriented instruction-tuning samples for the pre-training and supervised fine-tuning stages, respectively. Furthermore, to systematically evaluate fundamental visually grounded circuit perception, we introduce CircuitPerception-Bench, a diagnostic benchmark comprising 2,700 multiple-choice samples across three dimensions: component recognition, spatial understanding, and quantitative reasoning. CircuitPerception-Bench focuses on fundamental visually grounded perception and complements external benchmarks such as AMS Benchmark. Experimental results show that multimodal models trained with CircuitPile achieve significant performance gains on the internal benchmark and demonstrate favorable transferability on the external public AMS Benchmark. For example, applying CircuitPile-based SFT to Qwen3-VL-8B improves the scores on CircuitPerception-Bench and AMS Benchmark from 0.5759 and 0.5067 to 0.7703 and 0.5988, respectively.