Skip to main content

Properties of decision-making tasks govern the tradeoff between model-based and model-free learning

Publication ,  Journal Article
Abzug, ZM; Sommer, MA; Beck, JM
August 14, 2019

When decisions must be made between uncertain options, optimal behavior depends on accurate estimations of the likelihoods of different outcomes. The contextual factors that govern whether these estimations depend on model-free learning (tracking outcomes) vs. model-based learning (learning generative stimulus distributions) are poorly understood. We studied model-free and model-based learning using serial decision-making tasks in which subjects selected a rule and then used it to flexibly act on visual stimuli. A factorial approach defined a family of behavioral models that could integrate model-free and model-based strategies to predict rule selection trial-by-trial. Bayesian model selection demonstrated that the subjects strategies varied depending on lower-level task characteristics such as the identities of the rule options. In certain conditions, subjects integrated learned stimulus distributions and tracked reward rates to guide their behavior. The results thus identify tradeoffs between model-based and model-free decision strategies, and in some cases parallel utilization, depending on task context.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

DOI

Publication Date

August 14, 2019
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Abzug, Z. M., Sommer, M. A., & Beck, J. M. (2019). Properties of decision-making tasks govern the tradeoff between model-based and model-free learning. https://doi.org/10.1101/730663
Abzug, Zachary M., Marc A. Sommer, and Jeffrey M. Beck. “Properties of decision-making tasks govern the tradeoff between model-based and model-free learning,” August 14, 2019. https://doi.org/10.1101/730663.
Abzug, Zachary M., et al. Properties of decision-making tasks govern the tradeoff between model-based and model-free learning. Aug. 2019. Crossref, doi:10.1101/730663.

DOI

Publication Date

August 14, 2019