Skip to main content

A practical method for estimating performance degradation on multicore processors, and its application to HPC workloads

Publication ,  Conference
Dwyer, T; Fedorova, A; Blagodurov, S; Roth, M; Gaud, F; Pei, J
Published in: International Conference for High Performance Computing, Networking, Storage and Analysis, SC
December 1, 2012

When multiple threads or processes run on a multi-core CPU they compete for shared resources, such as caches and memory controllers, and can suffer performance degradation as high as 200%. We design and evaluate a new machine learning model that estimates this degradation online, on previously unseen workloads, and without perturbing the execution. Our motivation is to help data center and HPC cluster operators effectively use workload consolidation. Data center consolidation is about placing many applications on the same server to maximize hardware utilization. In HPC clusters, processes of the same distributed applications run on the same machine. Consolidation improves hardware utilization, but may sacrifice performance as processes compete for resources. Our model helps determine when consolidation is overly harmful to performance. Our work is the first to apply machine learning to this problem domain, and we report on our experience reaping the advantages of machine learning while navigating around its limitations. We demonstrate how the model can be used to improve performance fidelity and save energy for HPC workloads. © 2012 IEEE.

Duke Scholars

Published In

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

DOI

EISSN

2167-4337

ISSN

2167-4329

ISBN

9781467308069

Publication Date

December 1, 2012
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Dwyer, T., Fedorova, A., Blagodurov, S., Roth, M., Gaud, F., & Pei, J. (2012). A practical method for estimating performance degradation on multicore processors, and its application to HPC workloads. In International Conference for High Performance Computing, Networking, Storage and Analysis, SC. https://doi.org/10.1109/SC.2012.11
Dwyer, T., A. Fedorova, S. Blagodurov, M. Roth, F. Gaud, and J. Pei. “A practical method for estimating performance degradation on multicore processors, and its application to HPC workloads.” In International Conference for High Performance Computing, Networking, Storage and Analysis, SC, 2012. https://doi.org/10.1109/SC.2012.11.
Dwyer T, Fedorova A, Blagodurov S, Roth M, Gaud F, Pei J. A practical method for estimating performance degradation on multicore processors, and its application to HPC workloads. In: International Conference for High Performance Computing, Networking, Storage and Analysis, SC. 2012.
Dwyer, T., et al. “A practical method for estimating performance degradation on multicore processors, and its application to HPC workloads.” International Conference for High Performance Computing, Networking, Storage and Analysis, SC, 2012. Scopus, doi:10.1109/SC.2012.11.
Dwyer T, Fedorova A, Blagodurov S, Roth M, Gaud F, Pei J. A practical method for estimating performance degradation on multicore processors, and its application to HPC workloads. International Conference for High Performance Computing, Networking, Storage and Analysis, SC. 2012.

Published In

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

DOI

EISSN

2167-4337

ISSN

2167-4329

ISBN

9781467308069

Publication Date

December 1, 2012