StreamSight: A query-driven framework for streaming analytics in edge computing

Zacharias Georgiou, Moysis Symeonides, Demetris Trihinas, George Pallis, Marios D. Dikaiakos

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Edge computing is the emerging architectural paradigm extending cloud technologies to the logical extremes of the network for on-demand and delay-sensitive services. However, once service placement on edge-enabling resources has been dealt with, a new challenge arises: how to process enormous volumes of streaming data to provide query-driven analytics while still satisfying the delay-critical servicing requirements. To overcome this challenge we introduce StreamSight, a framework for edge-enabled IoT services which provides a rich and declarative query model abstraction for expressing complex analytics on monitoring data streams and then dynamically compiling these queries into stream processing jobs for continuous execution on distributed processing engines. To overcome the resource restrictive barriers in edge computing deployments, StreamSight outputs the query execution plan so that intermediate results are reused and not continuously recomputed. In turn, StreamSight enables users to express various optimization strategies (e.g., approximate answers, query prioritization) and constraints (e.g., sample size, error-bounds) so that delay-sensitive requirements relevant to the deployment are not violated. We evaluate our framework on Apache Spark with real-world workloads and show that leveraging StreamSight can significantly increase performance by at least 4× while still satisfying all accuracy guarantees.

Original languageEnglish
Title of host publicationProceedings - 11th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2018
EditorsJosef Spillner, Alan Sill
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages143-152
Number of pages10
ISBN (Electronic)9781538655047
DOIs
Publication statusPublished - 4 Jan 2019
Event11th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2018 - Zurich, Switzerland
Duration: 17 Dec 201820 Dec 2018

Publication series

NameProceedings - 11th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2018

Conference

Conference11th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2018
Country/TerritorySwitzerland
CityZurich
Period17/12/1820/12/18

Keywords

  • Big Data
  • Cloud Computing
  • Edge Computing
  • Query Execution
  • Stream Processing

Fingerprint

Dive into the research topics of 'StreamSight: A query-driven framework for streaming analytics in edge computing'. Together they form a unique fingerprint.

Cite this