Skip to main content

Load latency tolerance in dynamically scheduled processors

Publication ,  Journal Article
Srinivasan, ST; Lebeck, AR
Published in: Journal of Instruction-Level Parallelism
October 1, 1999

This paper provides a quantitative evaluation of load latency tolerance in a dynamically scheduled processor. To determine the latency tolerance of each memory load operation, our simulations use flexible load completion policies instead of a fixed memory hierarchy that dictates the latency. Although our policies delay load completion as long as possible, they produce performance (instructions committed per cycle (IPC)) comparable to a processor with an ideal memory system where all loads complete in one cycle. Our simulations reveal that to produce IPC values within 12% of a processor with an ideal memory system, between 1% and 71% of loads need to be satisfied within a single cycle and that up to 74% can be satisfied in as many as 32 cycles, depending on the benchmark and processor configuration. Load latency tolerance is largely determined by whether a mispredicted branch is in the load's data dependence graph and the depth of the dependence graph. Our results show that up to 36% of all loads miss in the level one cache yet have latency demands lower than second level cache access times. We also show that a similar percentage of loads hit in the level one cache even though they possess enough latency tolerance to be satisfied by lower levels of the memory hierarchy.

Duke Scholars

Published In

Journal of Instruction-Level Parallelism

Publication Date

October 1, 1999

Volume

1
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Srinivasan, S. T., & Lebeck, A. R. (1999). Load latency tolerance in dynamically scheduled processors. Journal of Instruction-Level Parallelism, 1.
Srinivasan, S. T., and A. R. Lebeck. “Load latency tolerance in dynamically scheduled processors.” Journal of Instruction-Level Parallelism 1 (October 1, 1999).
Srinivasan ST, Lebeck AR. Load latency tolerance in dynamically scheduled processors. Journal of Instruction-Level Parallelism. 1999 Oct 1;1.
Srinivasan, S. T., and A. R. Lebeck. “Load latency tolerance in dynamically scheduled processors.” Journal of Instruction-Level Parallelism, vol. 1, Oct. 1999.
Srinivasan ST, Lebeck AR. Load latency tolerance in dynamically scheduled processors. Journal of Instruction-Level Parallelism. 1999 Oct 1;1.

Published In

Journal of Instruction-Level Parallelism

Publication Date

October 1, 1999

Volume

1