Skip to main content

NetHint: White-Box Networking for Multi-Tenant Data Centers

Publication ,  Conference
Chen, J; Zhang, H; Zhang, W; Luo, L; Chase, J; Stoica, I; Zhuo, D
Published in: Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2022
January 1, 2022

A cloud provider today provides its network resources to its tenants as a black box, such that cloud tenants have little knowledge of the underlying network characteristics. Meanwhile, data-intensive applications have increasingly migrated to the cloud, and these applications have both the ability and the incentive to adapt their data transfer schedules based on the cloud network characteristics. We find that the black-box networking abstraction and the adaptiveness of data-intensive applications together create a mismatch, leading to sub-optimal application performance. This paper explores a white-box approach to resolving this mismatch. We propose NetHint, an interactive mechanism between a cloud tenant and a cloud provider to jointly enhance application performance. With NetHint, the provider provides a hint - an indirect indication of the underlying network characteristics (e.g., link-layer network topologies for a tenant's virtual machines, number of co-locating tenants, network bandwidth utilization), and the tenant's applications then adapt their transfer schedules accordingly. The NetHint design provides abundant network information for cloud tenants to compute their optimal transfer schedules, while introducing little overhead for the cloud provider to collect and expose this information. Evaluation results show that NetHint improves the average performance of allreduce completion time, broadcast completion time, and MapReduce shuffle completion time by 2.7×, 1.5×, and 1.2×, respectively.

Duke Scholars

Published In

Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2022

ISBN

9781939133274

Publication Date

January 1, 2022

Start / End Page

1327 / 1343
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Chen, J., Zhang, H., Zhang, W., Luo, L., Chase, J., Stoica, I., & Zhuo, D. (2022). NetHint: White-Box Networking for Multi-Tenant Data Centers. In Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2022 (pp. 1327–1343).
Chen, J., H. Zhang, W. Zhang, L. Luo, J. Chase, I. Stoica, and D. Zhuo. “NetHint: White-Box Networking for Multi-Tenant Data Centers.” In Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2022, 1327–43, 2022.
Chen J, Zhang H, Zhang W, Luo L, Chase J, Stoica I, et al. NetHint: White-Box Networking for Multi-Tenant Data Centers. In: Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2022. 2022. p. 1327–43.
Chen, J., et al. “NetHint: White-Box Networking for Multi-Tenant Data Centers.” Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2022, 2022, pp. 1327–43.
Chen J, Zhang H, Zhang W, Luo L, Chase J, Stoica I, Zhuo D. NetHint: White-Box Networking for Multi-Tenant Data Centers. Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2022. 2022. p. 1327–1343.

Published In

Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2022

ISBN

9781939133274

Publication Date

January 1, 2022

Start / End Page

1327 / 1343