Storage capacity of neural networks: Effect of the fluctuations of the number of active neurons per memory

Journal Article (Academic article)

The storage capacity in an attractor neural network with excitatory couplings is shown to depend not only on the fraction of active neurons per pattern (or coding rate), but also on the fluctuations around this value, in the thermodynamical limit. The capacity is calculated in the case of exactly the same number of active neurons in every pattern. For every coding level the capacity is increased with respect to the case of random patterns. Results are supported by numerical simulations done with an exhaustive search algorithm, and partly solve in the sparse coding limit the paradox of the discrepancy of the capacity of the Willshaw model with optimal capacity.

Full Text

Duke Authors

Cited Authors

  • Brunel, N

Published Date

  • December 1, 1994

Published In

Volume / Issue

  • 27 / 14

Start / End Page

  • 4783 - 4789

International Standard Serial Number (ISSN)

  • 0305-4470

Digital Object Identifier (DOI)

  • 10.1088/0305-4470/27/14/009