TY  - JOUR
T1  - A Study on Distributed Learning Algorithm for Heterogeneous Client Settings in Computing Capabilities
AU  - Ryu, Ji-Hyun 
AU  - Yang, Heecheol 
JO  - The Journal of Korean Institute of Communications and Information Sciences
PY  - 2025
DA  - 2025/1/1
DO  - 10.7840/kics.2025.50.2.195
KW  - Distributed learning
KW  - Federated learning
KW  - Split learning
AB  - In this paper, we address a distributed learning system with a server and clients with heterogeneous computational capabilities. We propose a new distributed learning algorithm that combines split learning with ordered dropout, enabling clients with limited and heterogeneous computing capabilities to participate in training. This approach allows all clients, even with different client-model sizes, to contribute to the improvement of the global model’s performance. We conduct experiments on image classification using ResNet50 on the CIFAR-10 dataset, examining classification performance given the number of clients and the distribution of the dataset. With heterogeneous client settings in computational capacities, simulation results demonstrate that all clients with various client-side model sizes effectively contribute to global model training.