Abstract
In the era of artificial intelligence (AI), deep neural networks (DNNs) become larger using a massive amount of data, and thus, they are trained via cooperative computing devices (e.g., GPUs or servers) based on federated learning. As computation and data generation move to the edge due to privacy, latency, or bandwidth issue, DNN with edge devices has been investigated. However, edge devices are wirelessly connected and mostly incur fragile connectivity. We propose VersatileFL, a novel volatility-resilient deep learning framework under hostile environments. We address short-term and long-term volatility: 1) versatile distributed learning against short-term fluctuation by substituting the missing intermediate values with the past or approximated values and 2) model rearrangement with runtime connectivity diagnosis against long-term variation by adaptively adjusting the partitioned model for the impaired. We have demonstrated that VersatileFL has achieved 62.0% and 31.9% higher performance than hostile learning without a maintenance scheme against the short-term and long-term volatility, respectively.
Original language | English |
---|---|
Title of host publication | 2023 20th Annual IEEE International Conference on Sensing, Communication, and Networking, SECON 2023 |
Publisher | IEEE Computer Society |
Pages | 294-302 |
Number of pages | 9 |
ISBN (Electronic) | 9798350300529 |
DOIs | |
State | Published - 2023 |
Event | 20th Annual IEEE International Conference on Sensing, Communication, and Networking, SECON 2023 - Madrid, Spain Duration: 11 Sep 2023 → 14 Sep 2023 |
Publication series
Name | Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks workshops |
---|---|
Volume | 2023-September |
ISSN (Print) | 2155-5486 |
ISSN (Electronic) | 2155-5494 |
Conference
Conference | 20th Annual IEEE International Conference on Sensing, Communication, and Networking, SECON 2023 |
---|---|
Country/Territory | Spain |
City | Madrid |
Period | 11/09/23 → 14/09/23 |
Bibliographical note
Publisher Copyright:© 2023 IEEE.
Keywords
- Distributed Learning
- Edge Intelligence
- Federated Learning
- Model Parallelism
- Network Volatility
- Split Learning
- Wireless Networks