Efficient pattern detection over a distributed framework

Ahmed Khan Leghari; Martin Wolf; Yongluan Zhou

doi:10.1007/978-3-662-46839-5_9

Efficient pattern detection over a distributed framework

Ahmed Khan Leghari, Martin Wolf, Yongluan Zhou

3 Citations (Scopus)

Abstract

In recent past, work has been done to parallelize pattern detection queries over event stream, by partitioning the event stream on certain keys or attributes. In such partitioning schemes the degree of parallelization totally relies on the available partition keys. A limited number of partitioning keys, or unavailability of such partitioning attributes noticeably affect the distribution of data among multiple nodes, and is a reason of potential data skew and improper resource utilization. Moreover, majority of the past implementations of complex event detection are based on a single machine, hence, they are immune to potential data skew that could be seen in a real distributed environment. In this study, we propose an event stream partitioning scheme that without considering any key attributes partitions the stream over time-windows. This scheme efficiently distributes the event stream partitions across network, and detects pattern sequences in distributed fashion.

Original language	English
Title of host publication	Enabling Real-Time Business Intelligence : International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers
Editors	Malu Castellanos, Umeshwar Dayal, Torben Bach Pedersen, Nesime Tatbul
Number of pages	17
Publisher	Springer
Publication date	2015
Pages	133-149
ISBN (Print)	978-3-662-46838-8
ISBN (Electronic)	978-3-662-46839-5
DOIs	https://doi.org/10.1007/978-3-662-46839-5_9
Publication status	Published - 2015
Externally published	Yes
Event	2014 Workshop on Business Intelligence for the Real-Time Enterprise - Hangzhou, China Duration: 1 Sept 2014 → 1 Sept 2014

Workshop

Workshop	2014 Workshop on Business Intelligence for the Real-Time Enterprise
Country/Territory	China
City	Hangzhou
Period	01/09/2014 → 01/09/2014

Series	Lecture Notes in Business Information Processing
Volume	206
ISSN	1865-1348

Access to Document

10.1007/978-3-662-46839-5_9

Cite this

Leghari, A. K., Wolf, M., & Zhou, Y. (2015). Efficient pattern detection over a distributed framework. In M. Castellanos, U. Dayal, T. B. Pedersen, & N. Tatbul (Eds.), Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers (pp. 133-149). Springer. https://doi.org/10.1007/978-3-662-46839-5_9

Efficient pattern detection over a distributed framework. / Leghari, Ahmed Khan; Wolf, Martin; Zhou, Yongluan.
Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers. ed. / Malu Castellanos; Umeshwar Dayal; Torben Bach Pedersen; Nesime Tatbul. Springer, 2015. p. 133-149 (Lecture Notes in Business Information Processing, Vol. 206).

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Leghari, AK, Wolf, M & Zhou, Y 2015, Efficient pattern detection over a distributed framework. in M Castellanos, U Dayal, TB Pedersen & N Tatbul (eds), Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers. Springer, Lecture Notes in Business Information Processing, vol. 206, pp. 133-149, 2014 Workshop on Business Intelligence for the Real-Time Enterprise, Hangzhou, China, 01/09/2014. https://doi.org/10.1007/978-3-662-46839-5_9

Leghari AK, Wolf M, Zhou Y. Efficient pattern detection over a distributed framework. In Castellanos M, Dayal U, Pedersen TB, Tatbul N, editors, Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers. Springer. 2015. p. 133-149. (Lecture Notes in Business Information Processing, Vol. 206). doi: 10.1007/978-3-662-46839-5_9

Leghari, Ahmed Khan ; Wolf, Martin ; Zhou, Yongluan. / Efficient pattern detection over a distributed framework. Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers. editor / Malu Castellanos ; Umeshwar Dayal ; Torben Bach Pedersen ; Nesime Tatbul. Springer, 2015. pp. 133-149 (Lecture Notes in Business Information Processing, Vol. 206).

@inproceedings{f4e5e17431e74f14898201c47a3f9a2e,

title = "Efficient pattern detection over a distributed framework",

abstract = "In recent past, work has been done to parallelize pattern detection queries over event stream, by partitioning the event stream on certain keys or attributes. In such partitioning schemes the degree of parallelization totally relies on the available partition keys. A limited number of partitioning keys, or unavailability of such partitioning attributes noticeably affect the distribution of data among multiple nodes, and is a reason of potential data skew and improper resource utilization. Moreover, majority of the past implementations of complex event detection are based on a single machine, hence, they are immune to potential data skew that could be seen in a real distributed environment. In this study, we propose an event stream partitioning scheme that without considering any key attributes partitions the stream over time-windows. This scheme efficiently distributes the event stream partitions across network, and detects pattern sequences in distributed fashion.",

author = "Leghari, {Ahmed Khan} and Martin Wolf and Yongluan Zhou",

year = "2015",

doi = "10.1007/978-3-662-46839-5_9",

language = "English",

isbn = "978-3-662-46838-8",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer",

pages = "133--149",

editor = "Malu Castellanos and Umeshwar Dayal and Pedersen, {Torben Bach} and Nesime Tatbul",

booktitle = "Enabling Real-Time Business Intelligence",

note = "2014 Workshop on Business Intelligence for the Real-Time Enterprise ; Conference date: 01-09-2014 Through 01-09-2014",

}

TY - GEN

T1 - Efficient pattern detection over a distributed framework

AU - Leghari, Ahmed Khan

AU - Wolf, Martin

AU - Zhou, Yongluan

PY - 2015

Y1 - 2015

N2 - In recent past, work has been done to parallelize pattern detection queries over event stream, by partitioning the event stream on certain keys or attributes. In such partitioning schemes the degree of parallelization totally relies on the available partition keys. A limited number of partitioning keys, or unavailability of such partitioning attributes noticeably affect the distribution of data among multiple nodes, and is a reason of potential data skew and improper resource utilization. Moreover, majority of the past implementations of complex event detection are based on a single machine, hence, they are immune to potential data skew that could be seen in a real distributed environment. In this study, we propose an event stream partitioning scheme that without considering any key attributes partitions the stream over time-windows. This scheme efficiently distributes the event stream partitions across network, and detects pattern sequences in distributed fashion.

AB - In recent past, work has been done to parallelize pattern detection queries over event stream, by partitioning the event stream on certain keys or attributes. In such partitioning schemes the degree of parallelization totally relies on the available partition keys. A limited number of partitioning keys, or unavailability of such partitioning attributes noticeably affect the distribution of data among multiple nodes, and is a reason of potential data skew and improper resource utilization. Moreover, majority of the past implementations of complex event detection are based on a single machine, hence, they are immune to potential data skew that could be seen in a real distributed environment. In this study, we propose an event stream partitioning scheme that without considering any key attributes partitions the stream over time-windows. This scheme efficiently distributes the event stream partitions across network, and detects pattern sequences in distributed fashion.

U2 - 10.1007/978-3-662-46839-5_9

DO - 10.1007/978-3-662-46839-5_9

M3 - Article in proceedings

SN - 978-3-662-46838-8

T3 - Lecture Notes in Business Information Processing

SP - 133

EP - 149

BT - Enabling Real-Time Business Intelligence

A2 - Castellanos, Malu

A2 - Dayal, Umeshwar

A2 - Pedersen, Torben Bach

A2 - Tatbul, Nesime

PB - Springer

T2 - 2014 Workshop on Business Intelligence for the Real-Time Enterprise

Y2 - 1 September 2014 through 1 September 2014

ER -

Efficient pattern detection over a distributed framework

Abstract

Workshop

Access to Document

Fingerprint

Cite this