Download pdf
A review of federated learning algorithms in image classification
- 1 Jinan-Birmingham Joint Institute, Jinan University, Guangzhou, China
* Author to whom correspondence should be addressed.
Abstract
Image classification is one of the most popular applications of machine learning. It has shown its potential in fields like healthcare, auto-driving and face recognition. Federated learning (FL) emerged in 2017, creating a major innovation to the field. The new structure brings new possibilities, but create new challenges such as data heterogeneity, privacy leakage and communication burdens in parameter updating. The paper solves the problem that there are relatively few papers providing a complete analysis relating to the application of FL in image classification. The paper contributes to describe the new challenges of FL in image classification and show the related reasons behind respectively, then analyze the current state-of-the-art algorithms designed for solving the challenges and improving image model performance by discussing the basic ideas and steps of algorithms and showing their pros and cons. The paper further more contributes to compare the performance of each model in accuracy and communication speed, and outline several possible directions for future advancement.
Keywords
federated learning, image classification, application, directions
[1]. Wu M., Zhou J., Peng Y., Wang S., Zhang Y. Deep Learning for Image Classification: A Review. In: Su R., Zhang YD., Frangi AF. (Eds.), Proc. Int. Conf. Med. Imag. Comput.-Aid. Diagn. (MICAD). MICAD 2023, Lect. Notes Electr. Eng., Vol. 1166. Springer, Singapore.
[2]. Konecný J., McMahan B., Ramage D., Richtárik P. Federated Optimization: Distributed Machine Learning for On-Device Intelligence. arXiv preprint arXiv:1610.02527 2023.
[3]. Nampalle K., Singh P., Narayan U., Raman B. Vision Through the Veil: Differential Privacy in Federated Learning for Medical Image Classification. arXiv preprint arXiv:2306.17794, 2022.
[4]. Mahlool D., Abed M. A Comprehensive Survey on Federated Learning: Concept and Applications. arXiv preprint arXiv:2201.09384 2022.
[5]. Li T., Sahu A., Talwalkar A., Smith V. Federated Learning: Challenges, Methods, and Future Directions. IEEE Signal Process. Mag., 2020, 37(3), pp. 50-60.
[6]. Dinh C., Tran N., Nguyen J. Personalized Federated Learning with Moreau Envelopes. In Adv. Neural Inf. Process. Syst. 2020, pp. 21394-21405.
[7]. Li Q., He B., Song D. Model-Contrastive Federated Learning. In 2021 IEEE/CVF Conf. Comput. Vis. Pattern Recognit. 2021, pp. 10708-10717.
[8]. McMahan B., Moore E., Ramage D., Hampson S., Aguera y Arcas BA. Communication-Efficient Learning of Deep Networks from Decentralized Data. In Int. Conf. Artif. Intell. Stat, 2021.
[9]. Chen T., Kornblith S., Norouzi M., Hinton G. A Simple Framework for Contrastive Learning of Visual Representations. arXiv preprint arXiv:2002.05709, 2020.
[10]. Jiang S., Lu M., Hu K., et al. Personalized Federated Learning Based on Multi-Head Attention Algorithm. Int. J. Mach. Learn. Cybern., 2023, 14, pp. 3783-3798.
[11]. Liu B., Lv N., Guo YC., Li YW. Recent Advances on Federated Learning: A Systematic Survey. Neurocomputing, 2024, 597, pp. 128019.
[12]. Gu H., Luo J., Kang Y., Fan L., Yang Q. FedPass: Privacy-Preserving Vertical Federated Deep Learning with Adaptive Obfuscation. In Int. Joint Conf. Artif. Intell 2023.
[13]. Wei K., Li J., Ding M., Ma C., Yang H., Farokhi F., Jin S., Quek T., Poor HV. Federated Learning With Differential Privacy: Algorithms and Performance Analysis. IEEE Trans. Inf. Forens. Secur., 2020, 15, pp. 3454-3469.
[14]. Ghazi B., Pagh R., Velingker A. Scalable and Differentially Private Distributed Aggregation in the Shuffled Model. arXiv preprint arXiv:1906.08320, 2019.
[15]. Hossain M., Imteaj A. FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures Optimizer. arXiv preprint arXiv:2305.01154, 2023.
[16]. Kuo T. Lin C. Improving Federated Learning Communication Efficiency with Global Momentum Fusion for Gradient Compression Schemes. arXiv preprint arXiv:2211.09320, 2022.
Cite this article
Qu,X. (2024). A review of federated learning algorithms in image classification. Applied and Computational Engineering,86,135-144.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of the 6th International Conference on Computing and Data Science
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).