Yagna Manasa Boyapati
Author directory2026
Privacy-Preserving Heterogeneous Multi-LLM Federated Inference for Cognitive Diagnosis
Yagna Manasa Boyapati | Chong Yu | Tianyu Jiang | Justin Zhan
Findings of the Association for Computational Linguistics: EMNLP 2026
Yagna Manasa Boyapati | Chong Yu | Tianyu Jiang | Justin Zhan
Findings of the Association for Computational Linguistics: EMNLP 2026
Significant challenges remain in AI-driven educational systems in balancing privacy preservation with accurate cognitive diagnosis. In order to overcome this, we propose a federated inference framework in which several commercial LLM APIs collaborate without requiring access to raw student data or proprietary model internals. Using multiple federated entities, such as LLaMA-3.3-70B, GPT-4o-mini, and Claude-3-Haiku, our framework builds upon the heterogeneous multi-LLM architecture. The predictions generated by these entities are combined with ε-local differential privacy by adding Laplace noise locally to each entity’s prediction output before aggregation, while residual-based aggregation mitigates model heterogeneity. Our approach is predicated on an honest-but-curious trust paradigm in which API providers are presumed not to abuse submitted queries, and our differential privacy mechanism shields the published diagnostic results from external inference. We conduct rigorous privacy–utility analysis showing strong privacy guarantees with minimal accuracy loss, and extensive real-world evaluations across three educational benchmarks confirm the framework’s practical usability and cross-domain generalizability.