Fast-adapting and privacy-preserving federated recommender system
KAUST DepartmentComputer Science Program
Computer, Electrical and Mathematical Science and Engineering (CEMSE) Division
Preprint Posting Date2021-04-02
Online Publication Date2021-10-03
Print Publication Date2022-09
Embargo End Date2022-10-03
Permanent link to this recordhttp://hdl.handle.net/10754/668578
MetadataShow full item record
AbstractIn the mobile Internet era, recommender systems have become an irreplaceable tool to help users discover useful items, thus alleviating the information overload problem. Recent research on deep neural network (DNN)-based recommender systems have made significant progress in improving prediction accuracy, largely attributed to the widely accessible large-scale user data. Such data is commonly collected from users’ personal devices and then centrally stored in the cloud server to facilitate model training. However, with the rising public concerns on user privacy leakage in online platforms, online users are becoming increasingly anxious over abuses of user privacy. Therefore, it is urgent and beneficial to develop a recommender system that can achieve both high prediction accuracy and strong privacy protection. To this end, we propose a DNN-based recommendation model called PrivRec running on the decentralized federated learning (FL) environment, which ensures that a user’s data is fully retained on her/his personal device while contributing to training an accurate model. On the other hand, to better embrace the data heterogeneity (e.g., users’ data vary in scale and quality significantly) in FL, we innovatively introduce a first-order meta-learning method that enables fast on-device personalization with only a few data points. Furthermore, to defend against potential malicious participants that pose serious security threat to other users, we further develop a user-level differentially private model, namely DP-PrivRec, so attackers are unable to identify any arbitrary user from the trained model. To compensate for the loss by adding noise during model updates, we introduce a two-stage training approach. Finally, we conduct extensive experiments on two large-scale datasets in a simulated FL environment, and the results validate the superiority of both PrivRec and DP-PrivRec.
CitationWang, Q., Yin, H., Chen, T., Yu, J., Zhou, A., & Zhang, X. (2021). Fast-adapting and privacy-preserving federated recommender system. The VLDB Journal. doi:10.1007/s00778-021-00700-6
SponsorsThis work was supported by ARC Discovery Project (Grant No. DP190101985) and ARC Future Fellowship (FT210100624).
PublisherSpringer Science and Business Media LLC
JournalThe VLDB Journal