Visual and Semantic Representations Predict Subsequent Memory in Perceptual and Conceptual Memory Tests.

Journal Article (Journal Article)

It is generally assumed that the encoding of a single event generates multiple memory representations, which contribute differently to subsequent episodic memory. We used functional magnetic resonance imaging (fMRI) and representational similarity analysis to examine how visual and semantic representations predicted subsequent memory for single item encoding (e.g., seeing an orange). Three levels of visual representations corresponding to early, middle, and late visual processing stages were based on a deep neural network. Three levels of semantic representations were based on normative observed ("is round"), taxonomic ("is a fruit"), and encyclopedic features ("is sweet"). We identified brain regions where each representation type predicted later perceptual memory, conceptual memory, or both (general memory). Participants encoded objects during fMRI, and then completed both a word-based conceptual and picture-based perceptual memory test. Visual representations predicted subsequent perceptual memory in visual cortices, but also facilitated conceptual and general memory in more anterior regions. Semantic representations, in turn, predicted perceptual memory in visual cortex, conceptual memory in the perirhinal and inferior prefrontal cortex, and general memory in the angular gyrus. These results suggest that the contribution of visual and semantic representations to subsequent memory effects depends on a complex interaction between representation, test type, and storage location.

Full Text

Duke Authors

Cited Authors

  • Davis, SW; Geib, BR; Wing, EA; Wang, W-C; Hovhannisyan, M; Monge, ZA; Cabeza, R

Published Date

  • January 2021

Published In

Volume / Issue

  • 31 / 2

Start / End Page

  • 974 - 992

PubMed ID

  • 32935833

Pubmed Central ID

  • PMC8485078

Electronic International Standard Serial Number (EISSN)

  • 1460-2199

International Standard Serial Number (ISSN)

  • 1047-3211

Digital Object Identifier (DOI)

  • 10.1093/cercor/bhaa269


  • eng