Distributed sequence pattern detection over multiple data streams

TY - GEN

T1 - Distributed sequence pattern detection over multiple data streams

AU - Leghari, Ahmed Khan

AU - Cao, Jianneng

AU - Zhou, Yongluan

N1 - Conference code: 19

PY - 2015

Y1 - 2015

N2 - Sequence pattern detection over streaming data has many real world applications. Most of the present work is aimed to process sequence queries over single data stream. Situations where streaming data arrive from multiple sources have not been explored much. In traditional approaches a single centralized machine handles and processes sequence queries over multiple data streams. While running sequence queries on a single server, even though many of the events in data streams do not lead to successful pattern detection they are still handled and processed by the server. This consumes precious network bandwidth, server’s computing resources and precious time. In this paper we focus on sequence pattern detection, where patterns are defined on chains of events that arrive from multiple distributed data streams. We propose a three layer distributed framework to avoid unnecessary event processing by the server, and to efficiently process sequence queries to detect sequence patterns relying upon chains of events. The bottom layer of data sources sends continuous data streams to the middle layer, which then performs pattern detection locally, and on the basis of the feedback received from the top layer of global server, sends events to the global server to detect complete patterns. Our present work is aimed to detect sequence patterns over multiple data streams, but, our proposed model can be extended to many other areas of distributed stream processing.

AB - Sequence pattern detection over streaming data has many real world applications. Most of the present work is aimed to process sequence queries over single data stream. Situations where streaming data arrive from multiple sources have not been explored much. In traditional approaches a single centralized machine handles and processes sequence queries over multiple data streams. While running sequence queries on a single server, even though many of the events in data streams do not lead to successful pattern detection they are still handled and processed by the server. This consumes precious network bandwidth, server’s computing resources and precious time. In this paper we focus on sequence pattern detection, where patterns are defined on chains of events that arrive from multiple distributed data streams. We propose a three layer distributed framework to avoid unnecessary event processing by the server, and to efficiently process sequence queries to detect sequence patterns relying upon chains of events. The bottom layer of data sources sends continuous data streams to the middle layer, which then performs pattern detection locally, and on the basis of the feedback received from the top layer of global server, sends events to the global server to detect complete patterns. Our present work is aimed to detect sequence patterns over multiple data streams, but, our proposed model can be extended to many other areas of distributed stream processing.

U2 - 10.1007/978-3-319-23135-8_26

DO - 10.1007/978-3-319-23135-8_26

M3 - Article in proceedings

SN - 978-3-319-23134-1

T3 - Lecture notes in computer science

SP - 380

EP - 394

BT - Advances in Databases and Information Systems

A2 - Tadeusz, Morzy

A2 - Valduriez, Patrick

A2 - Bellatreche, Ladjel

PB - Springer

T2 - 19th East European Conference on Advances in Databases and Information Systems

Y2 - 8 September 2015 through 11 September 2015

ER -