Trace-based Performance Analysis for Deep Learning in Edge Container Environments

Soyeon Park, Hyokyung Bahn

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

In recent years, container-based deep learning has emerged as a trending technology in edge environments. Containers offer several advantages over traditional virtual machines, including improved resource utilization and mobility. However, containers still hinder efficient use of system resources in deep learning workloads, so it is important to adopt effective resource management techniques to avoid resource conflicts. In this paper, we extract system call and event traces while executing deep learning workloads in a container and compare the results with those of running the same workloads on a host machine. By comparing system calls invoked between the two environments, we quantify the overhead of containers with respect to resource consumption and interference. We then explore the impact of running multiple containers concurrently and highlight the issues that arise in a multi-tenant environment. Our findings show that container-based deep learning can be a viable solution for deep learning workloads, but it is important to carefully consider the resource requirements and performance impact of containerization. We recommend that cloud or edge providers use a combination of resource management techniques, such as resource quotas and limits, to avoid resource wastes of containers and interference with each other.

Original languageEnglish
Title of host publication2023 8th International Conference on Fog and Mobile Edge Computing, FMEC 2023
EditorsMuhannad Quwaider, Feras M. Awaysheh, Yaser Jararweh
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages87-92
Number of pages6
ISBN (Electronic)9798350316971
DOIs
StatePublished - 2023
Event8th IEEE International Conference on Fog and Mobile Edge Computing, FMEC 2023 - Tartu, Estonia
Duration: 18 Sep 202320 Sep 2023

Publication series

Name2023 8th International Conference on Fog and Mobile Edge Computing, FMEC 2023

Conference

Conference8th IEEE International Conference on Fog and Mobile Edge Computing, FMEC 2023
Country/TerritoryEstonia
CityTartu
Period18/09/2320/09/23

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

Keywords

  • container
  • deep learning
  • system call
  • system resource
  • virtual machine

Fingerprint

Dive into the research topics of 'Trace-based Performance Analysis for Deep Learning in Edge Container Environments'. Together they form a unique fingerprint.

Cite this