Skip to main content

Cheating the I/O bottleneck: Network storage with Trapeze/Myrinet

Publication ,  Conference
Anderson, DC; Chase, JS; Gadde, S; Gallatin, AJ; Yocum, KG; Feeley, MJ
Published in: USENIX 1998 Annual Technical Conference
January 1, 2019

© USENIX 1998 Annual Technical Conference. all rights reserved. Recent advances in I/O bus structures (e.g., PCI), highspeed networks, and fast, cheap disks have significantly expanded the I/O capacity of desktop-class systems. This paper describes a messaging system designed to deliver the potential of these advances for network storage systems including cluster file systems and network memory. We describe gmsnet, an RPC-like kernel-kernel messaging system based on Trapeze, a new firmware program for Myrinet network interfaces. We show how the communication features of Trapeze and gms-net are used by the Global Memory Service (GMS), a kernel-based network memory system. The paper focuses on support for zero-copy page migration in GMS/Trapeze using two RPC variants important for peer-peer distributed services: (1) delegated RPC in which a request is delegated to a third party, and (2) nonblocking RPC in which replies are processed from the Trapeze receive interrupt handler. We present measurements of sequential file access from network memory in the GMS/Trapeze prototype on a Myrinet/Alpha cluster, showing the bandwidth effects of file system interfaces and communication choices. GMS/Trapeze delivers a peak read bandwidth of 96 MB/s using memory-mapped file I/O.

Duke Scholars

Published In

USENIX 1998 Annual Technical Conference

Publication Date

January 1, 2019
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Anderson, D. C., Chase, J. S., Gadde, S., Gallatin, A. J., Yocum, K. G., & Feeley, M. J. (2019). Cheating the I/O bottleneck: Network storage with Trapeze/Myrinet. In USENIX 1998 Annual Technical Conference.
Anderson, D. C., J. S. Chase, S. Gadde, A. J. Gallatin, K. G. Yocum, and M. J. Feeley. “Cheating the I/O bottleneck: Network storage with Trapeze/Myrinet.” In USENIX 1998 Annual Technical Conference, 2019.
Anderson DC, Chase JS, Gadde S, Gallatin AJ, Yocum KG, Feeley MJ. Cheating the I/O bottleneck: Network storage with Trapeze/Myrinet. In: USENIX 1998 Annual Technical Conference. 2019.
Anderson, D. C., et al. “Cheating the I/O bottleneck: Network storage with Trapeze/Myrinet.” USENIX 1998 Annual Technical Conference, 2019.
Anderson DC, Chase JS, Gadde S, Gallatin AJ, Yocum KG, Feeley MJ. Cheating the I/O bottleneck: Network storage with Trapeze/Myrinet. USENIX 1998 Annual Technical Conference. 2019.

Published In

USENIX 1998 Annual Technical Conference

Publication Date

January 1, 2019