TY - GEN
T1 - A study on speculative task scheduling for apache spark in fog computing realms
AU - Symeonides, Moysis
AU - Trihinas, Demetris
N1 - Publisher Copyright:
© 2019 Association for Computing Machinery.
PY - 2019/11/28
Y1 - 2019/11/28
N2 - Speculative task scheduling is a technique used by most of today’s distributed data processing systems to cope with slow running tasks that delay subsequent computations and hamper the overall performance of analytics jobs. Fog computing is now becoming a prominent service paradigm to foster applications with low-latency analytics requirements by moving the analysis closer to the data sources. However, task scheduling in fog realms is not without challenges, as resource heterogeneity and highly volatile network connections have the potential to delay instead of improving the completion time of analytics jobs. In this paper, we present a comprehensive study showcasing the various obstacles that are presented in speculative task scheduling for analytics jobs deployed in fog realms and derive critical insights that must be taken into account when introducing new task scheduling algorithms.
AB - Speculative task scheduling is a technique used by most of today’s distributed data processing systems to cope with slow running tasks that delay subsequent computations and hamper the overall performance of analytics jobs. Fog computing is now becoming a prominent service paradigm to foster applications with low-latency analytics requirements by moving the analysis closer to the data sources. However, task scheduling in fog realms is not without challenges, as resource heterogeneity and highly volatile network connections have the potential to delay instead of improving the completion time of analytics jobs. In this paper, we present a comprehensive study showcasing the various obstacles that are presented in speculative task scheduling for analytics jobs deployed in fog realms and derive critical insights that must be taken into account when introducing new task scheduling algorithms.
UR - http://www.scopus.com/inward/record.url?scp=85123040983&partnerID=8YFLogxK
U2 - 10.1145/3368640.3368660
DO - 10.1145/3368640.3368660
M3 - Conference contribution
AN - SCOPUS:85123040983
T3 - ACM International Conference Proceeding Series
BT - Proceedings of the 23rd Pan-Hellenic Conference of Informatics, PCI 2019
PB - Association for Computing Machinery
T2 - 23rd Pan-Hellenic Conference of Informatics, PCI 2019
Y2 - 28 November 2019 through 29 November 2019
ER -