Abstract
In recent years, container-based deep learning has emerged as a trending technology in edge environments. Containers offer several advantages over traditional virtual machines, including improved resource utilization and mobility. However, containers still hinder efficient use of system resources in deep learning workloads, so it is important to adopt effective resource management techniques to avoid resource conflicts. In this paper, we extract system call and event traces while executing deep learning workloads in a container and compare the results with those of running the same workloads on a host machine. By comparing system calls invoked between the two environments, we quantify the overhead of containers with respect to resource consumption and interference. We then explore the impact of running multiple containers concurrently and highlight the issues that arise in a multi-tenant environment. Our findings show that container-based deep learning can be a viable solution for deep learning workloads, but it is important to carefully consider the resource requirements and performance impact of containerization. We recommend that cloud or edge providers use a combination of resource management techniques, such as resource quotas and limits, to avoid resource wastes of containers and interference with each other.
Original language | English |
---|---|
Title of host publication | 2023 8th International Conference on Fog and Mobile Edge Computing, FMEC 2023 |
Editors | Muhannad Quwaider, Feras M. Awaysheh, Yaser Jararweh |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 87-92 |
Number of pages | 6 |
ISBN (Electronic) | 9798350316971 |
DOIs | |
State | Published - 2023 |
Event | 8th IEEE International Conference on Fog and Mobile Edge Computing, FMEC 2023 - Tartu, Estonia Duration: 18 Sep 2023 → 20 Sep 2023 |
Publication series
Name | 2023 8th International Conference on Fog and Mobile Edge Computing, FMEC 2023 |
---|
Conference
Conference | 8th IEEE International Conference on Fog and Mobile Edge Computing, FMEC 2023 |
---|---|
Country/Territory | Estonia |
City | Tartu |
Period | 18/09/23 → 20/09/23 |
Bibliographical note
Publisher Copyright:© 2023 IEEE.
Keywords
- container
- deep learning
- system call
- system resource
- virtual machine