Storing matrices on disk: Theory and practice revisited
Publication
, Conference
Zhang, Y; Munagala, K; Yang, J
Published in: Proceedings of the VLDB Endowment
January 1, 2011
We consider the problem of storing arrays on disk to support scalable data analysis involving linear algebra. We propose Linearized Array B-tree, or LAB-tree, which supports flexible array layouts and automatically adapts to varying sparsity across parts of an array and over time. We reexamine the B-tree splitting strategy for handling insertions and the flushing policy for batching updates, and show that common practices may in fact be suboptimal. Through theoretical and empirical studies, we propose alternatives with good theoretical guarantees and/or practical performance. © 2011 VLDB Endowment.
Duke Scholars
Published In
Proceedings of the VLDB Endowment
DOI
EISSN
2150-8097
Publication Date
January 1, 2011
Volume
4
Issue
11
Start / End Page
1075 / 1086
Related Subject Headings
- 4605 Data management and data science
- 0807 Library and Information Studies
- 0806 Information Systems
- 0802 Computation Theory and Mathematics
Citation
APA
Chicago
ICMJE
MLA
NLM
Zhang, Y., Munagala, K., & Yang, J. (2011). Storing matrices on disk: Theory and practice revisited. In Proceedings of the VLDB Endowment (Vol. 4, pp. 1075–1086). https://doi.org/10.14778/3402707.3402743
Zhang, Y., K. Munagala, and J. Yang. “Storing matrices on disk: Theory and practice revisited.” In Proceedings of the VLDB Endowment, 4:1075–86, 2011. https://doi.org/10.14778/3402707.3402743.
Zhang Y, Munagala K, Yang J. Storing matrices on disk: Theory and practice revisited. In: Proceedings of the VLDB Endowment. 2011. p. 1075–86.
Zhang, Y., et al. “Storing matrices on disk: Theory and practice revisited.” Proceedings of the VLDB Endowment, vol. 4, no. 11, 2011, pp. 1075–86. Scopus, doi:10.14778/3402707.3402743.
Zhang Y, Munagala K, Yang J. Storing matrices on disk: Theory and practice revisited. Proceedings of the VLDB Endowment. 2011. p. 1075–1086.
Published In
Proceedings of the VLDB Endowment
DOI
EISSN
2150-8097
Publication Date
January 1, 2011
Volume
4
Issue
11
Start / End Page
1075 / 1086
Related Subject Headings
- 4605 Data management and data science
- 0807 Library and Information Studies
- 0806 Information Systems
- 0802 Computation Theory and Mathematics