Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement


Journal Article

Interval schedules of reinforcement are known to generate habitual behavior, the performance of which is less sensitive to revaluation of the earned reward and to alterations in the action-outcome contingency. Here we report results from experiments using different types of interval schedules of reinforcement in mice to assess the effect of uncertainty, in the time of reward availability, on habit formation. After limited training, lever pressing under fixed interval (FI, low interval uncertainty) or random interval schedules (RI, higher interval uncertainty) was sensitive to devaluation, but with more extended training, performance of animals trained under RI schedules became more habitual, i.e. no longer sensitive to devaluation, whereas performance of those trained under FI schedules remained goal-directed. When the press-reward contingency was reversed by omitting reward after pressing but presenting reward in the absence of pressing, lever pressing in mice previously trained under FI decreased more rapidly than that of mice trained under RI schedules. Further analysis revealed that action-reward contiguity is significantly reduced in lever pressing under RI schedules, whereas action-reward correlation is similar for the different schedules. Thus the extent of goal-directedness could vary as a function of uncertainty about the time of reward availability. We hypothesize that the reduced action-reward contiguity found in behavior generated under high uncertainty is responsible for habit formation. © 2010 DeRusso, Fan, Gupta, Shelest, Costa and Yin.

Full Text

Duke Authors

Cited Authors

  • de Russo, AL; Fan, D; Gupta, J; Shelest, O; Costa, RM; Yin, HH

Published Date

  • December 1, 2010

Published In

Volume / Issue

  • 4 /

International Standard Serial Number (ISSN)

  • 1662-5145

Digital Object Identifier (DOI)

  • 10.3389/fnint.2010.00017

Citation Source

  • Scopus