Skip to main content

ICGMM: CXL-enabled Memory Expansion with Intelligent Caching Using Gaussian Mixture Model

Publication ,  Conference
Chen, H; Wang, Y; Cargnini, V; Soltaniyeh, M; Li, D; Sun, G; Subedi, P; Chang, A; Chen, Y; Hao, C
Published in: Proceedings - Design Automation Conference
November 7, 2024

Compute Express Link (CXL) emerges as a solution for wide gap between computational speed and data communication rates among host and multiple devices. It fosters a unified and coherent memory space between host and CXL storage devices such as such as Solid-state drive (SSD) for memory expansion, with a corresponding DRAM implemented as the device cache. However, this introduces challenges such as substantial cache miss penalties, sub-optimal caching due to data access granularity mismatch between the DRAM "cache"and SSD "memory", and inefficient hardware cache management. To address these issues, we propose a novel solution, named ICGMM, which optimizes caching and eviction directly on hardware, employing a Gaussian Mixture Model (GMM)-based approach. We prototype our solution on an FPGA board, which demonstrates a noteworthy improvement compared to the classic Least Recently Used (LRU) cache strategy. We observe a decrease in the cache miss rate ranging from 0.32% to 6.14%, leading to a substantial 16.23% to 39.14% reduction in the average SSD access latency. Furthermore, when compared to the state-of-the-art Long Short-Term Memory (LSTM)-based cache policies, our GMM algorithm on FPGA showcases an impressive latency reduction of over 10,000 times. Remarkably, this is achieved while demanding much fewer hardware resources.

Duke Scholars

Published In

Proceedings - Design Automation Conference

DOI

ISSN

0738-100X

Publication Date

November 7, 2024
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Chen, H., Wang, Y., Cargnini, V., Soltaniyeh, M., Li, D., Sun, G., … Hao, C. (2024). ICGMM: CXL-enabled Memory Expansion with Intelligent Caching Using Gaussian Mixture Model. In Proceedings - Design Automation Conference. https://doi.org/10.1145/3649329.3656239
Chen, H., Y. Wang, V. Cargnini, M. Soltaniyeh, D. Li, G. Sun, P. Subedi, A. Chang, Y. Chen, and C. Hao. “ICGMM: CXL-enabled Memory Expansion with Intelligent Caching Using Gaussian Mixture Model.” In Proceedings - Design Automation Conference, 2024. https://doi.org/10.1145/3649329.3656239.
Chen H, Wang Y, Cargnini V, Soltaniyeh M, Li D, Sun G, et al. ICGMM: CXL-enabled Memory Expansion with Intelligent Caching Using Gaussian Mixture Model. In: Proceedings - Design Automation Conference. 2024.
Chen, H., et al. “ICGMM: CXL-enabled Memory Expansion with Intelligent Caching Using Gaussian Mixture Model.” Proceedings - Design Automation Conference, 2024. Scopus, doi:10.1145/3649329.3656239.
Chen H, Wang Y, Cargnini V, Soltaniyeh M, Li D, Sun G, Subedi P, Chang A, Chen Y, Hao C. ICGMM: CXL-enabled Memory Expansion with Intelligent Caching Using Gaussian Mixture Model. Proceedings - Design Automation Conference. 2024.

Published In

Proceedings - Design Automation Conference

DOI

ISSN

0738-100X

Publication Date

November 7, 2024