Wenjun Sun
Author directory2026
Reasoning for Hierarchical Text Classification: The Case of Patents
Lekang Jiang | Wenjun Sun | Stefan Goetz
Findings of the Association for Computational Linguistics: ACL 2026
Lekang Jiang | Wenjun Sun | Stefan Goetz
Findings of the Association for Computational Linguistics: ACL 2026
Hierarchical text classification (HTC) assigns documents to multiple levels of a pre-defined taxonomy. Automated patent subject classification represents one of the hardest HTC scenarios because of professional difficulties and extensive labels. Prior approaches only output a flat label set, which offers little insight into the reason behind predictions. Therefore, we propose Reasoning for Hierarchical Classification (RHC), a novel framework that reformulates HTC as a step-by-step reasoning task to sequentially deduce hierarchical labels. RHC trains large language models (LLMs) in two stages: a cold-start stage that aligns outputs with chain-of-thought (CoT) reasoning format and a reinforcement learning (RL) stage to enhance multi-step reasoning ability. RHC demonstrates four advantages in our experiments. (1) Effectiveness: RHC surpasses previous baselines and outperforms the supervised fine-tuning counterparts by approximately 3% in accuracy and macro F1. (2) Explainability: RHC produces natural-language justifications before prediction to facilitate human inspection. (3) Scalability: RHC scales favorably with model size with larger gains compared to standard fine-tuning. (4) Applicability: Beyond patents, we further demonstrate that RHC achieves state-of-the-art performance on other widely used HTC benchmarks, which highlights its broad applicability.
Thinking Silently for Patent Claim Generation
Lekang Jiang | Wenjun Sun | Stefan Goetz
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Lekang Jiang | Wenjun Sun | Stefan Goetz
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
This work investigates whether Chain-of-Thought (CoT) prompting benefits patent claim generation. We demonstrate a counter-intuitive but important empirical finding: implicit CoT, where reasoning is kept internal rather than explicitly verbalized, consistently outperforms explicit CoT. Through systematic analysis, we show that explicit CoT can introduce an unnecessary information bottleneck for claim generation. Verbalized reasoning may compromise the quality of final outputs through three specific mechanisms: abstraction of critical details, disruption of internalized generation patterns, and cascading error propagation. Our findings provide new insights into structured text generation and CoT applications.
Benchmarking Patent Drafting from Inventor-Style Disclosures
Lekang Jiang | Wenjun Sun | Stefan Goetz
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Lekang Jiang | Wenjun Sun | Stefan Goetz
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
While recent large language models (LLMs) have achieved promising results on individual patent drafting tasks, they fundamentally fail to investigate the core challenge of real-world patent drafting: generating a complete and legally coherent patent application directly from early-stage invention materials. Prior work predominantly assumes later-stage, highly structured, or already legalistic inputs. However, real patenting workflows begin with informal, de-legalized disclosures authored by inventors. To bridge the gap, we introduce Dis2Pat, a disclosure-to-patent dataset that reflects realistic patenting workflows by requiring the generation of complete patent applications directly from inventor-style, de-legalized disclosures. Given the inherent difficulty of long-form, legally constrained patent drafting and the strong privacy requirements, we further propose a strong baseline named Patent-MAF. It is a multi-agent framework for locally deployable patent drafting. Benchmark results reveal that current LLMs exhibit limitations in patent drafting, while Patent-MAF provides a strong baseline that consistently outperforms evaluated open-source models and remains competitive with large closed-source models.