TY - GEN
T1 - BenchPilot
T2 - 27th IEEE Symposium on Computers and Communications, ISCC 2022
AU - Georgiou, Joanna
AU - Symeonides, Moysis
AU - Kasioulis, Michalis
AU - Trihinas, Demetris
AU - Pallis, George
AU - Dikaiakos, Marios D.
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Micro-Datacenters (DCs) are emerging as key en-ablers for Edge computing and 5G mobile networks by pro-viding processing power closer to IoT devices to extract timely analytic insights. However, the performance evaluation of data stream processing on micro-DCs is a daunting task due to difficulties raised by the time-consuming setup, configuration and heterogeneity of the underlying environment. To address these challenges, we introduce BenchPilot, a modular and highly customizable benchmarking framework for edge micro-DCs. BenchPilot provides a high-level declarative model for describing experiment testbeds and scenarios that automates the bench-marking process on Streaming Distributed Processing Engines (SDPEs). The latter enables users to focus on performance analysis instead of dealing with the complex and time-consuming setup. BenchPilot instantiates the underlying cluster, performs repeatable experimentation, and provides a unified monitoring stack in heterogeneous Micro-DCs. To highlight the usability of BenchPilot, we conduct experiments on two popular streaming engines, namely Apache Storm and Flink. Our experiments compare the engines based on performance, CPU utilization, energy consumption, temperature, and network I/O.
AB - Micro-Datacenters (DCs) are emerging as key en-ablers for Edge computing and 5G mobile networks by pro-viding processing power closer to IoT devices to extract timely analytic insights. However, the performance evaluation of data stream processing on micro-DCs is a daunting task due to difficulties raised by the time-consuming setup, configuration and heterogeneity of the underlying environment. To address these challenges, we introduce BenchPilot, a modular and highly customizable benchmarking framework for edge micro-DCs. BenchPilot provides a high-level declarative model for describing experiment testbeds and scenarios that automates the bench-marking process on Streaming Distributed Processing Engines (SDPEs). The latter enables users to focus on performance analysis instead of dealing with the complex and time-consuming setup. BenchPilot instantiates the underlying cluster, performs repeatable experimentation, and provides a unified monitoring stack in heterogeneous Micro-DCs. To highlight the usability of BenchPilot, we conduct experiments on two popular streaming engines, namely Apache Storm and Flink. Our experiments compare the engines based on performance, CPU utilization, energy consumption, temperature, and network I/O.
KW - Edge Computing
KW - Internet of Things
UR - http://www.scopus.com/inward/record.url?scp=85141197104&partnerID=8YFLogxK
U2 - 10.1109/ISCC55528.2022.9912882
DO - 10.1109/ISCC55528.2022.9912882
M3 - Conference contribution
AN - SCOPUS:85141197104
T3 - Proceedings - IEEE Symposium on Computers and Communications
BT - 2022 IEEE Symposium on Computers and Communications, ISCC 2022
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 30 June 2022 through 3 July 2022
ER -