Selective attention and audiovisual integration: is attending to both modalities a prerequisite for early integration?

Published

Journal Article

Interactions between multisensory integration and attention were studied using a combined audiovisual streaming design and a rapid serial visual presentation paradigm. Event-related potentials (ERPs) following audiovisual objects (AV) were compared with the sum of the ERPs following auditory (A) and visual objects (V). Integration processes were expressed as the difference between these AV and (A + V) responses and were studied while attention was directed to one or both modalities or directed elsewhere. Results show that multisensory integration effects depend on the multisensory objects being fully attended--that is, when both the visual and auditory senses were attended. In this condition, a superadditive audiovisual integration effect was observed on the P50 component. When unattended, this effect was reversed; the P50 components of multisensory ERPs were smaller than the unisensory sum. Additionally, we found an enhanced late frontal negativity when subjects attended the visual component of a multisensory object. This effect, bearing a strong resemblance to the auditory processing negativity, appeared to reflect late attention-related processing that had spread to encompass the auditory component of the multisensory object. In conclusion, our results shed new light on how the brain processes multisensory auditory and visual information, including how attention modulates multisensory integration processes.

Full Text

Duke Authors

Cited Authors

  • Talsma, D; Doty, TJ; Woldorff, MG

Published Date

  • March 2007

Published In

Volume / Issue

  • 17 / 3

Start / End Page

  • 679 - 690

PubMed ID

  • 16707740

Pubmed Central ID

  • 16707740

International Standard Serial Number (ISSN)

  • 1047-3211

Digital Object Identifier (DOI)

  • 10.1093/cercor/bhk016

Language

  • eng

Conference Location

  • United States