Skip to main content

Rigorous Evaluation of Computer Processors with Statistical Model Checking

Publication ,  Conference
Mazurek, F; Tschand, A; Wang, Y; Pajic, M; Sorin, D
Published in: Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2023
October 28, 2023

Experiments with computer processors must account for the inherent variability in executions. Prior work has shown that real systems exhibit variability, and random effects must be injected into simulators to account for it. Thus, we can run multiple executions of a given benchmark and generate a distribution of results. Prior work uses standard statistical techniques that are not suitable. While the result distributions may take any forms that are unknown a priori, many works naively assume they are Gaussian, which can be far from the truth. To allow rigorous evaluation for arbitrary result distributions, we introduce statistical model checking (SMC) to the world of computer architecture. SMC is a statistical technique that is used in research communities that depend heavily on statistical guarantees. SMC provides a rigorous mathematical methodology that employs experimental sampling for probabilistic evaluation of properties of interest, such that one can determine with a desired confidence whether a property (e.g., System X is 1.1x faster than System Y) is true or not. SMC alone is not enough for computer architects to draw conclusions based on their data. We create an end-to-end framework called SMC for Processor Analysis (SPA) which utilizes SMC techniques to provide insightful conclusions given experimental data.

Duke Scholars

Published In

Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2023

DOI

ISBN

9798400703294

Publication Date

October 28, 2023

Start / End Page

1242 / 1254
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Mazurek, F., Tschand, A., Wang, Y., Pajic, M., & Sorin, D. (2023). Rigorous Evaluation of Computer Processors with Statistical Model Checking. In Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2023 (pp. 1242–1254). https://doi.org/10.1145/3613424.3623785
Mazurek, F., A. Tschand, Y. Wang, M. Pajic, and D. Sorin. “Rigorous Evaluation of Computer Processors with Statistical Model Checking.” In Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2023, 1242–54, 2023. https://doi.org/10.1145/3613424.3623785.
Mazurek F, Tschand A, Wang Y, Pajic M, Sorin D. Rigorous Evaluation of Computer Processors with Statistical Model Checking. In: Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2023. 2023. p. 1242–54.
Mazurek, F., et al. “Rigorous Evaluation of Computer Processors with Statistical Model Checking.” Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2023, 2023, pp. 1242–54. Scopus, doi:10.1145/3613424.3623785.
Mazurek F, Tschand A, Wang Y, Pajic M, Sorin D. Rigorous Evaluation of Computer Processors with Statistical Model Checking. Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2023. 2023. p. 1242–1254.

Published In

Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, MICRO 2023

DOI

ISBN

9798400703294

Publication Date

October 28, 2023

Start / End Page

1242 / 1254