Skip to main content
release_alert
Welcome to the new Scholars 3.0! Read about new features and let us know what you think.
cancel

Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement

Publication ,  Journal Article
de Russo, AL; Fan, D; Gupta, J; Shelest, O; Costa, RM; Yin, HH
Published in: Frontiers in Integrative Neuroscience
December 1, 2010

Interval schedules of reinforcement are known to generate habitual behavior, the performance of which is less sensitive to revaluation of the earned reward and to alterations in the action-outcome contingency. Here we report results from experiments using different types of interval schedules of reinforcement in mice to assess the effect of uncertainty, in the time of reward availability, on habit formation. After limited training, lever pressing under fixed interval (FI, low interval uncertainty) or random interval schedules (RI, higher interval uncertainty) was sensitive to devaluation, but with more extended training, performance of animals trained under RI schedules became more habitual, i.e. no longer sensitive to devaluation, whereas performance of those trained under FI schedules remained goal-directed. When the press-reward contingency was reversed by omitting reward after pressing but presenting reward in the absence of pressing, lever pressing in mice previously trained under FI decreased more rapidly than that of mice trained under RI schedules. Further analysis revealed that action-reward contiguity is significantly reduced in lever pressing under RI schedules, whereas action-reward correlation is similar for the different schedules. Thus the extent of goal-directedness could vary as a function of uncertainty about the time of reward availability. We hypothesize that the reduced action-reward contiguity found in behavior generated under high uncertainty is responsible for habit formation. © 2010 DeRusso, Fan, Gupta, Shelest, Costa and Yin.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Frontiers in Integrative Neuroscience

DOI

ISSN

1662-5145

Publication Date

December 1, 2010

Volume

4

Related Subject Headings

  • 1702 Cognitive Sciences
  • 1701 Psychology
  • 1109 Neurosciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
de Russo, A. L., Fan, D., Gupta, J., Shelest, O., Costa, R. M., & Yin, H. H. (2010). Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement. Frontiers in Integrative Neuroscience, 4. https://doi.org/10.3389/fnint.2010.00017
Russo, A. L. de, D. Fan, J. Gupta, O. Shelest, R. M. Costa, and H. H. Yin. “Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement.” Frontiers in Integrative Neuroscience 4 (December 1, 2010). https://doi.org/10.3389/fnint.2010.00017.
de Russo AL, Fan D, Gupta J, Shelest O, Costa RM, Yin HH. Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement. Frontiers in Integrative Neuroscience. 2010 Dec 1;4.
de Russo, A. L., et al. “Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement.” Frontiers in Integrative Neuroscience, vol. 4, Dec. 2010. Scopus, doi:10.3389/fnint.2010.00017.
de Russo AL, Fan D, Gupta J, Shelest O, Costa RM, Yin HH. Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement. Frontiers in Integrative Neuroscience. 2010 Dec 1;4.

Published In

Frontiers in Integrative Neuroscience

DOI

ISSN

1662-5145

Publication Date

December 1, 2010

Volume

4

Related Subject Headings

  • 1702 Cognitive Sciences
  • 1701 Psychology
  • 1109 Neurosciences