Skip to main content

Scalable continuous query processing by tracking hotspots

Publication ,  Conference
Agarwal, PK; Xie, J; Yang, J; Yu, H
Published in: VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases
January 1, 2006

This paper considers the problem of scalably processing a large number of continuous queries. We propose a flexible framework with novel data structures and algorithms for group-processing and indexing continuous queries by exploiting potential overlaps in query Predicates. Our approach partitions the collection of continuous queries into groups based on the clustering patterns of the query ranges, and then applies specialized processing strategies to those heavily-clustered groups (or hotspots). To maintain the partition dynamically, we present efficient algorithms that maintain a nearly optimal partition in nearly amortized logarithmic time. We show how to use the hotspots to scalably process large numbers of continuous select-join and band-join queries, which are much more chal-lenging than simple range selection queries. Experiments demonstrate that this approach can improve the processing throughput by orders of magnitude. As another application of hotspots, we show how to use them to build a high-quality histogram for intervals in linear time. Copyright 2006 VLDB Endowment, ACM.

Duke Scholars

Published In

VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases

Publication Date

January 1, 2006

Start / End Page

31 / 42
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Agarwal, P. K., Xie, J., Yang, J., & Yu, H. (2006). Scalable continuous query processing by tracking hotspots. In VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases (pp. 31–42).
Agarwal, P. K., J. Xie, J. Yang, and H. Yu. “Scalable continuous query processing by tracking hotspots.” In VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases, 31–42, 2006.
Agarwal PK, Xie J, Yang J, Yu H. Scalable continuous query processing by tracking hotspots. In: VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases. 2006. p. 31–42.
Agarwal, P. K., et al. “Scalable continuous query processing by tracking hotspots.” VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases, 2006, pp. 31–42.
Agarwal PK, Xie J, Yang J, Yu H. Scalable continuous query processing by tracking hotspots. VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases. 2006. p. 31–42.

Published In

VLDB 2006 - Proceedings of the 32nd International Conference on Very Large Data Bases

Publication Date

January 1, 2006

Start / End Page

31 / 42