Skip to main content
Journal cover image

Just-in-time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs

Publication ,  Journal Article
Freeh, VW; Kappiah, N; Lowenthal, DK; Bletsch, TK
Published in: Journal of Parallel and Distributed Computing
September 1, 2008

Although users of high-performance computing are most interested in raw performance, both energy and power consumption have become critical concerns. As a result, improving energy efficiency of nodes on HPC machines has become important, and the prevalence of power-scalable clusters, where the frequency and voltage can be dynamically modified, has increased. On power-scalable clusters, one opportunity for saving energy with little or no loss of performance exists when the computational load is not perfectly balanced. This situation occurs frequently, as keeping the load balanced between nodes is one of the long-standing fundamental problems in parallel and distributed computing. Indeed, despite the large body of research aimed at balancing load both statically and dynamically, this problem is quite difficult to solve. This paper presents a system called Jitter that reduces the frequency and voltage on nodes that are assigned less computation and, therefore, have idle or slack time. This saves energy on these nodes, and the goal of Jitter is to attempt to ensure that they arrive "just in time" so that they avoid increasing overall execution time. Specifically, we dynamically determine which nodes have enough slack time such that they can execute at a reduced frequency with little performance cost-which will greatly reduce the consumed energy on that node. In particular, Jitter saves 12.8% energy with 0.4% time increase-which is essentially the same as a hand-tuned solution-on the Aztec benchmark. © 2008 Elsevier Inc. All rights reserved.

Duke Scholars

Published In

Journal of Parallel and Distributed Computing

DOI

ISSN

0743-7315

Publication Date

September 1, 2008

Volume

68

Issue

9

Start / End Page

1175 / 1185

Related Subject Headings

  • Distributed Computing
  • 4606 Distributed computing and systems software
  • 0805 Distributed Computing
  • 0803 Computer Software
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Freeh, V. W., Kappiah, N., Lowenthal, D. K., & Bletsch, T. K. (2008). Just-in-time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs. Journal of Parallel and Distributed Computing, 68(9), 1175–1185. https://doi.org/10.1016/j.jpdc.2008.04.007
Freeh, V. W., N. Kappiah, D. K. Lowenthal, and T. K. Bletsch. “Just-in-time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs.” Journal of Parallel and Distributed Computing 68, no. 9 (September 1, 2008): 1175–85. https://doi.org/10.1016/j.jpdc.2008.04.007.
Freeh VW, Kappiah N, Lowenthal DK, Bletsch TK. Just-in-time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs. Journal of Parallel and Distributed Computing. 2008 Sep 1;68(9):1175–85.
Freeh, V. W., et al. “Just-in-time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs.” Journal of Parallel and Distributed Computing, vol. 68, no. 9, Sept. 2008, pp. 1175–85. Scopus, doi:10.1016/j.jpdc.2008.04.007.
Freeh VW, Kappiah N, Lowenthal DK, Bletsch TK. Just-in-time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs. Journal of Parallel and Distributed Computing. 2008 Sep 1;68(9):1175–1185.
Journal cover image

Published In

Journal of Parallel and Distributed Computing

DOI

ISSN

0743-7315

Publication Date

September 1, 2008

Volume

68

Issue

9

Start / End Page

1175 / 1185

Related Subject Headings

  • Distributed Computing
  • 4606 Distributed computing and systems software
  • 0805 Distributed Computing
  • 0803 Computer Software