Information capacity of a perceptron


Journal Article

The authors study the information storage capacity of a simple perceptron in the error regime. For random unbiased patterns the geometrical analysis gives a logarithmic dependence for the information content in the asymptotic limit. In this case, the statistical physics approach, when used at the simplest level of replica theory, does not give satisfactory results. However for perceptrons with finite stability, the information content can be simply calculated with statistical physics methods in a region above the critical storage level, for biased as well as for unbiased patterns.

Full Text

Duke Authors

Cited Authors

  • Brunel, N; Nadal, J-P; Toulouse, G

Published Date

  • December 1, 1992

Published In

Volume / Issue

  • 25 / 19

Start / End Page

  • 5017 - 5038

International Standard Serial Number (ISSN)

  • 0305-4470

Digital Object Identifier (DOI)

  • 10.1088/0305-4470/25/19/015