Efficient pattern detection over a distributed framework

Ahmed Khan Leghari; Martin Wolf; Yongluan Zhou

doi:10.1007/978-3-662-46839-5_9

Efficient pattern detection over a distributed framework

Ahmed Khan Leghari, Martin Wolf, Yongluan Zhou

3 Citationer (Scopus)

Abstract

In recent past, work has been done to parallelize pattern detection queries over event stream, by partitioning the event stream on certain keys or attributes. In such partitioning schemes the degree of parallelization totally relies on the available partition keys. A limited number of partitioning keys, or unavailability of such partitioning attributes noticeably affect the distribution of data among multiple nodes, and is a reason of potential data skew and improper resource utilization. Moreover, majority of the past implementations of complex event detection are based on a single machine, hence, they are immune to potential data skew that could be seen in a real distributed environment. In this study, we propose an event stream partitioning scheme that without considering any key attributes partitions the stream over time-windows. This scheme efficiently distributes the event stream partitions across network, and detects pattern sequences in distributed fashion.

Originalsprog	Engelsk
Titel	Enabling Real-Time Business Intelligence : International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers
Redaktører	Malu Castellanos, Umeshwar Dayal, Torben Bach Pedersen, Nesime Tatbul
Antal sider	17
Forlag	Springer
Publikationsdato	2015
Sider	133-149
ISBN (Trykt)	978-3-662-46838-8
ISBN (Elektronisk)	978-3-662-46839-5
DOI	https://doi.org/10.1007/978-3-662-46839-5_9
Status	Udgivet - 2015
Udgivet eksternt	Ja
Begivenhed	2014 Workshop on Business Intelligence for the Real-Time Enterprise - Hangzhou, Kina Varighed: 1 sep. 2014 → 1 sep. 2014

Workshop

Workshop	2014 Workshop on Business Intelligence for the Real-Time Enterprise
Land/Område	Kina
By	Hangzhou
Periode	01/09/2014 → 01/09/2014

Navn	Lecture Notes in Business Information Processing
Vol/bind	206
ISSN	1865-1348

Adgang til dokumentet

10.1007/978-3-662-46839-5_9

Citationsformater

Leghari, A. K., Wolf, M., & Zhou, Y. (2015). Efficient pattern detection over a distributed framework. I M. Castellanos, U. Dayal, T. B. Pedersen, & N. Tatbul (red.), Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers (s. 133-149). Springer. https://doi.org/10.1007/978-3-662-46839-5_9

Efficient pattern detection over a distributed framework. / Leghari, Ahmed Khan; Wolf, Martin; Zhou, Yongluan.
Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers. red. / Malu Castellanos; Umeshwar Dayal; Torben Bach Pedersen; Nesime Tatbul. Springer, 2015. s. 133-149 (Lecture Notes in Business Information Processing, Bind 206).

Publikation: Bidrag til bog/antologi/rapport › Konferencebidrag i proceedings › Forskning › peer review

Leghari, AK, Wolf, M & Zhou, Y 2015, Efficient pattern detection over a distributed framework. i M Castellanos, U Dayal, TB Pedersen & N Tatbul (red), Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers. Springer, Lecture Notes in Business Information Processing, bind 206, s. 133-149, 2014 Workshop on Business Intelligence for the Real-Time Enterprise, Hangzhou, Kina, 01/09/2014. https://doi.org/10.1007/978-3-662-46839-5_9

Leghari AK, Wolf M, Zhou Y. Efficient pattern detection over a distributed framework. I Castellanos M, Dayal U, Pedersen TB, Tatbul N, red., Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers. Springer. 2015. s. 133-149. (Lecture Notes in Business Information Processing, Bind 206). doi: 10.1007/978-3-662-46839-5_9

Leghari, Ahmed Khan ; Wolf, Martin ; Zhou, Yongluan. / Efficient pattern detection over a distributed framework. Enabling Real-Time Business Intelligence: International Workshops, BIRTE 2013, Riva del Garda, Italy, August 26, 2013, and BIRTE 2014, Hangzhou, China, September 1, 2014, Revised Selected Papers. red. / Malu Castellanos ; Umeshwar Dayal ; Torben Bach Pedersen ; Nesime Tatbul. Springer, 2015. s. 133-149 (Lecture Notes in Business Information Processing, Bind 206).

@inproceedings{f4e5e17431e74f14898201c47a3f9a2e,

title = "Efficient pattern detection over a distributed framework",

abstract = "In recent past, work has been done to parallelize pattern detection queries over event stream, by partitioning the event stream on certain keys or attributes. In such partitioning schemes the degree of parallelization totally relies on the available partition keys. A limited number of partitioning keys, or unavailability of such partitioning attributes noticeably affect the distribution of data among multiple nodes, and is a reason of potential data skew and improper resource utilization. Moreover, majority of the past implementations of complex event detection are based on a single machine, hence, they are immune to potential data skew that could be seen in a real distributed environment. In this study, we propose an event stream partitioning scheme that without considering any key attributes partitions the stream over time-windows. This scheme efficiently distributes the event stream partitions across network, and detects pattern sequences in distributed fashion.",

author = "Leghari, {Ahmed Khan} and Martin Wolf and Yongluan Zhou",

year = "2015",

doi = "10.1007/978-3-662-46839-5_9",

language = "English",

isbn = "978-3-662-46838-8",

series = "Lecture Notes in Business Information Processing",

publisher = "Springer",

pages = "133--149",

editor = "Malu Castellanos and Umeshwar Dayal and Pedersen, {Torben Bach} and Nesime Tatbul",

booktitle = "Enabling Real-Time Business Intelligence",

note = "2014 Workshop on Business Intelligence for the Real-Time Enterprise ; Conference date: 01-09-2014 Through 01-09-2014",

}

TY - GEN

T1 - Efficient pattern detection over a distributed framework

AU - Leghari, Ahmed Khan

AU - Wolf, Martin

AU - Zhou, Yongluan

PY - 2015

Y1 - 2015

N2 - In recent past, work has been done to parallelize pattern detection queries over event stream, by partitioning the event stream on certain keys or attributes. In such partitioning schemes the degree of parallelization totally relies on the available partition keys. A limited number of partitioning keys, or unavailability of such partitioning attributes noticeably affect the distribution of data among multiple nodes, and is a reason of potential data skew and improper resource utilization. Moreover, majority of the past implementations of complex event detection are based on a single machine, hence, they are immune to potential data skew that could be seen in a real distributed environment. In this study, we propose an event stream partitioning scheme that without considering any key attributes partitions the stream over time-windows. This scheme efficiently distributes the event stream partitions across network, and detects pattern sequences in distributed fashion.

AB - In recent past, work has been done to parallelize pattern detection queries over event stream, by partitioning the event stream on certain keys or attributes. In such partitioning schemes the degree of parallelization totally relies on the available partition keys. A limited number of partitioning keys, or unavailability of such partitioning attributes noticeably affect the distribution of data among multiple nodes, and is a reason of potential data skew and improper resource utilization. Moreover, majority of the past implementations of complex event detection are based on a single machine, hence, they are immune to potential data skew that could be seen in a real distributed environment. In this study, we propose an event stream partitioning scheme that without considering any key attributes partitions the stream over time-windows. This scheme efficiently distributes the event stream partitions across network, and detects pattern sequences in distributed fashion.

U2 - 10.1007/978-3-662-46839-5_9

DO - 10.1007/978-3-662-46839-5_9

M3 - Article in proceedings

SN - 978-3-662-46838-8

T3 - Lecture Notes in Business Information Processing

SP - 133

EP - 149

BT - Enabling Real-Time Business Intelligence

A2 - Castellanos, Malu

A2 - Dayal, Umeshwar

A2 - Pedersen, Torben Bach

A2 - Tatbul, Nesime

PB - Springer

T2 - 2014 Workshop on Business Intelligence for the Real-Time Enterprise

Y2 - 1 September 2014 through 1 September 2014

ER -

Efficient pattern detection over a distributed framework

Abstract

Workshop

Adgang til dokumentet

Fingeraftryk

Citationsformater