BenchPilot: Repeatable & Reproducible Benchmarking for Edge Micro-DCs

Joanna Georgiou, Moysis Symeonides, Michalis Kasioulis, Demetris Trihinas, George Pallis, Marios D. Dikaiakos

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Micro-Datacenters (DCs) are emerging as key en-ablers for Edge computing and 5G mobile networks by pro-viding processing power closer to IoT devices to extract timely analytic insights. However, the performance evaluation of data stream processing on micro-DCs is a daunting task due to difficulties raised by the time-consuming setup, configuration and heterogeneity of the underlying environment. To address these challenges, we introduce BenchPilot, a modular and highly customizable benchmarking framework for edge micro-DCs. BenchPilot provides a high-level declarative model for describing experiment testbeds and scenarios that automates the bench-marking process on Streaming Distributed Processing Engines (SDPEs). The latter enables users to focus on performance analysis instead of dealing with the complex and time-consuming setup. BenchPilot instantiates the underlying cluster, performs repeatable experimentation, and provides a unified monitoring stack in heterogeneous Micro-DCs. To highlight the usability of BenchPilot, we conduct experiments on two popular streaming engines, namely Apache Storm and Flink. Our experiments compare the engines based on performance, CPU utilization, energy consumption, temperature, and network I/O.

Original languageEnglish
Title of host publication2022 IEEE Symposium on Computers and Communications, ISCC 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665497923
DOIs
Publication statusPublished - 2022
Event27th IEEE Symposium on Computers and Communications, ISCC 2022 - Rhodes, Greece
Duration: 30 Jun 20223 Jul 2022

Publication series

NameProceedings - IEEE Symposium on Computers and Communications
Volume2022-June
ISSN (Print)1530-1346

Conference

Conference27th IEEE Symposium on Computers and Communications, ISCC 2022
Country/TerritoryGreece
CityRhodes
Period30/06/223/07/22

Keywords

  • Edge Computing
  • Internet of Things

Fingerprint

Dive into the research topics of 'BenchPilot: Repeatable & Reproducible Benchmarking for Edge Micro-DCs'. Together they form a unique fingerprint.

Cite this