An Efficient 3D ReRAM Convolution Processor Design for Binarized Weight Networks

Journal Article (Journal Article)

Convolutional neural networks (CNNs) have been evolving with tremendous success in visual recognition, obtaining human-level accuracy. The conventional hardware architecture, however, is facing difficulty in realizing real-time and energy-efficient operations on CNN. To efficiently operate CNN algorithms on the hardware, researchers are actively studying processing-in-memory (PIM) with resistive random-access memory (ReRAM). Digital PIM is particularly attractive because analog designs struggle with undesirable device properties and require additional circuits like analog-to-digital converter and digital-to-analog converter. However, the massive area originated from digital PIM is a hindrance to its applications. In this work, we present a three-dimensional (3D) ReRAM convolution logic processor design to tackle the limitation of digital PIM. At the hardware level, we leverage 3D ReRAM to take advantage of its area efficiency. The design simplicity without accuracy loss is accomplished by exploiting binarized weight networks (BWNs) at the algorithm level. Specifically, our 3D ReRAM processor computes the convolution of BWN based on a presumed full adder and a split-half addition scheme, which are proposed in this brief to maximize resource consumption efficiency. As a result, the proposed design achieves 3.7times to 5.7times and 5times to 42.5times area- and time-saving according to the bit precision in comparison to the original digital PIM.

Full Text

Duke Authors

Cited Authors

  • Kim, B; Hanson, E; Li, H

Published Date

  • May 1, 2021

Published In

Volume / Issue

  • 68 / 5

Start / End Page

  • 1600 - 1604

Electronic International Standard Serial Number (EISSN)

  • 1558-3791

International Standard Serial Number (ISSN)

  • 1549-7747

Digital Object Identifier (DOI)

  • 10.1109/TCSII.2021.3067840

Citation Source

  • Scopus