Skip to main content

Models and resource metrics for parallel and distributed computation

Publication ,  Conference
Li, Z; Mills, PH; Reif, JH
Published in: Proceedings of the Annual Hawaii International Conference on System Sciences
January 1, 1995

Presents a framework of using resource metrics to characterize the various models of parallel computation. Our framework reflects the approach of recent models to abstract architectural details into several generic parameters, which we call resource metrics. We examine the different resource metrics chosen by different parallel models, categorizing the models into four classes: The basic synchronous models, and three extensions of the basic models which more accurately reflect practical machines by incorporating the notions of asynchrony, communication cost and memory hierarchy. We then present a new parallel computation model, the LogP-HMM model, as an illustration of design principles based on the framework of resource metrics. The LogP-HMM model extends an existing parameterized network model (LogP) with a sequential hierarchical memory model (HMM) characterizing each processor. The result accurately captures both network communication costs and the effects of multilevel memory, such as local cache and I/O. We examine the potential utility of our model in the design of near-optimal sorting and FFT algorithms.

Duke Scholars

Published In

Proceedings of the Annual Hawaii International Conference on System Sciences

DOI

ISSN

1530-1605

ISBN

0818669306

Publication Date

January 1, 1995

Volume

2

Start / End Page

51 / 60
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Li, Z., Mills, P. H., & Reif, J. H. (1995). Models and resource metrics for parallel and distributed computation. In Proceedings of the Annual Hawaii International Conference on System Sciences (Vol. 2, pp. 51–60). https://doi.org/10.1109/HICSS.1995.375477
Li, Z., P. H. Mills, and J. H. Reif. “Models and resource metrics for parallel and distributed computation.” In Proceedings of the Annual Hawaii International Conference on System Sciences, 2:51–60, 1995. https://doi.org/10.1109/HICSS.1995.375477.
Li Z, Mills PH, Reif JH. Models and resource metrics for parallel and distributed computation. In: Proceedings of the Annual Hawaii International Conference on System Sciences. 1995. p. 51–60.
Li, Z., et al. “Models and resource metrics for parallel and distributed computation.” Proceedings of the Annual Hawaii International Conference on System Sciences, vol. 2, 1995, pp. 51–60. Scopus, doi:10.1109/HICSS.1995.375477.
Li Z, Mills PH, Reif JH. Models and resource metrics for parallel and distributed computation. Proceedings of the Annual Hawaii International Conference on System Sciences. 1995. p. 51–60.

Published In

Proceedings of the Annual Hawaii International Conference on System Sciences

DOI

ISSN

1530-1605

ISBN

0818669306

Publication Date

January 1, 1995

Volume

2

Start / End Page

51 / 60