Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
Takayuki NishioRyo Yonetani
Proposes FedCS, a resource-aware client selection protocol for federated learning in mobile edge networks that significantly accelerates training time by filtering participating devices according to their computational capacity and wireless channel conditions.
Training modern artificial intelligence models on mobile devices allows organizations to leverage rich, real-world data while preserving user privacy by keeping data stored locally. However, standard federated learning methods struggle in practical cellular networks because client devices possess highly uneven computing speeds, varying data volumes, and fluctuating wireless connectivity. When slower or poorly connected devices bottleneck the network, model training stalls, leading to wasted bandwidth and prolonged training timelines.
The article introduces and evaluates FedCS, a resource-aware federated learning protocol designed to accelerate model training across heterogeneous mobile devices. The primary objective is to demonstrate that actively managing client selection within strict time limits can maximize update throughput and significantly speed up overall training without compromising model accuracy.
The researchers assessed FedCS by simulating a mobile edge computing environment within an urban cellular cell serving 1,000 client devices. Using standard image recognition tasks based on the CIFAR-10 and Fashion-MNIST datasets, the team evaluated both uniform and non-uniform data distributions among devices. The protocol polls candidate devices for their resource status—including local processing speed and wireless channel conditions—and uses an efficient greedy selection algorithm to schedule as many successful model updates as possible within a designated round deadline.
The evaluation produced several critical findings. First, FedCS accelerated model training substantially compared to baseline federated methods under identical deadlines, reaching 75% accuracy on CIFAR-10 about 76.5 minutes faster (a roughly 37% time reduction) and 85% accuracy on Fashion-MNIST about 33.3 minutes faster (a roughly 50% reduction). Second, the protocol incorporated more than twice as many participating devices per round (averaging 7.7 clients versus 3.3 for the baseline under a three-minute deadline), which directly drove faster convergence. Third, FedCS maintained its performance advantage even when accounting for moderate fluctuations in computing load and wireless throughput. Finally, in challenging non-uniform data environments where the baseline failed to reach target thresholds, FedCS successfully trained functional models, reaching 54% accuracy on CIFAR-10 and 71% on Fashion-MNIST within the allotted timeframe.
These results indicate that managing edge computing resources proactively can drastically lower the operational time and communication costs required to train decentralized machine learning models. FedCS offers an effective framework for deploying artificial intelligence across smart devices and connected vehicles without exposing private user data to centralized servers. For optimal performance, organizations adopting this framework must carefully tune round deadlines, as setting deadlines too short limits participant diversity, while setting them too long reduces the frequency of model aggregations.
To build upon these findings, future development should explore dynamic deadline adjustments that automatically adapt to real-time network traffic, as well as integrating model compression techniques to handle larger network models and highly fragmented datasets. While the simulations demonstrate robust performance in realistic LTE cellular conditions, leaders should note that the evaluation relied on synthetic workload simulations with moderately sized neural networks. Validating the protocol on larger commercial models and live, moving mobile edge deployments will be essential before full-scale operational rollout.
- Paper: Federated Optimization: Distributed Machine Learning for On-Device Intelligence, Jakub Konečný et al. (2016). This seminal paper introduces federated optimization and decentralized client-server training under communication and non-IID constraints, establishing the foundational problem setting that FedCS aims to optimize.
- Paper: Federated Learning: Strategies for Improving Communication Efficiency, Jakub Konečný et al. (2016). It provides essential background on communication-efficiency challenges and uplink bandwidth bottlenecks in federated learning over mobile networks.
- Paper: Federated Multi-Task Learning, Virginia Smith et al. (2017). It formalizes the systems and statistical challenges of client heterogeneity in federated environments, directly motivating FedCS's resource-constrained selection protocol.
- Paper: Federated Learning with Non-IID Data, Yue Zhao et al. (2018). It analyzes the performance degradation of standard federated averaging under non-IID client data, providing necessary context for why managing heterogeneous client updates is critical.
- Paper: MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications, Andrew G. Howard et al. (2017). It details efficient lightweight neural network architectures tailored for mobile devices, which serve as common target models for on-device edge training.
- Paper: Towards Federated Learning at Scale: System Design, Keith Bonawitz et al. (2019). This paper presents the large-scale production system design and client orchestration protocol for deploying federated learning across millions of mobile devices, expanding upon resource-aware scheduling in practice.
- Paper: Federated Optimization in Heterogeneous Networks, Tian Li et al. (2018). It introduces the FedProx framework to tackle system and statistical heterogeneity by allowing variable local computation and adding a proximal term to handle stragglers.
- Paper: Advances and Open Problems in Federated Learning, P. Kairouz et al. (2019). This comprehensive survey provides an expansive overview of advances and open challenges across optimization, systems, and client heterogeneity in federated learning.
- Paper: Federated Learning: Challenges, Methods, and Future Directions, Tian Li et al. (2019). It synthesizes core systems and algorithmic challenges in federated settings, discussing straggler mitigation and heterogeneous client management as key future directions.
- Paper: Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization, Jianyu Wang et al. (2020). It extends heterogeneous federated optimization by addressing the objective inconsistency that arises when clients perform varying amounts of local work due to system heterogeneity.
- Paper: SCAFFOLD: Stochastic Controlled Averaging for Federated Learning, Sai Praneeth Karimireddy et al. (2019). It develops the SCAFFOLD algorithm to correct client drift under heterogeneous local updates, providing an algorithmic remedy for non-uniform client contributions.
- Paper: Adaptive Federated Optimization, Sashank Reddi et al. (2020). It introduces server-side adaptive optimization to improve convergence and stability across heterogeneous federated client populations.
- Paper: Edge Intelligence: Paving the Last Mile of Artificial Intelligence With Edge Computing, Zhi Zhou et al. (2019). This survey examines the broader landscape of edge intelligence and mobile edge computing architectures that enable decentralized AI training.
