A Secure and Efficient Federated Learning Framework for NLP

Chenghong Wang, Jieren Deng, Xianrui Meng, Yijue Wang, Ji Li, Sheng Lin, Shuo Han, Fei Miao, Sanguthevar Rajasekaran, Caiwen Ding


Abstract
In this work, we consider the problem of designing secure and efficient federated learning (FL) frameworks for NLP. Existing solutions under this literature either consider a trusted aggregator or require heavy-weight cryptographic primitives, which makes the performance significantly degraded. Moreover, many existing secure FL designs work only under the restrictive assumption that none of the clients can be dropped out from the training protocol. To tackle these problems, we propose SEFL, a secure and efficient federated learning framework that (1) eliminates the need for the trusted entities; (2) achieves similar and even better model accuracy compared with existing FL designs; (3) is resilient to client dropouts.
Anthology ID:
2021.emnlp-main.606
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7676–7682
Language:
URL:
https://aclanthology.org/2021.emnlp-main.606
DOI:
10.18653/v1/2021.emnlp-main.606
Bibkey:
Cite (ACL):
Chenghong Wang, Jieren Deng, Xianrui Meng, Yijue Wang, Ji Li, Sheng Lin, Shuo Han, Fei Miao, Sanguthevar Rajasekaran, and Caiwen Ding. 2021. A Secure and Efficient Federated Learning Framework for NLP. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 7676–7682, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
A Secure and Efficient Federated Learning Framework for NLP (Wang et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.606.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.606.mp4