The spread of attention across modalities and space in a multisensory object.

Journal Article (Journal Article)

Attending to a stimulus is known to enhance the neural responses to that stimulus. Recent experiments on visual attention have shown that this modulation can have object-based characteristics, such that, when certain parts of a visual object are attended, other parts automatically also receive enhanced processing. Here, we investigated whether visual attention can modulate neural responses to other components of a multisensory object defined by synchronous, but spatially disparate, auditory and visual stimuli. The audiovisual integration of such multisensory stimuli typically leads to mislocalization of the sound toward the visual stimulus (ventriloquism illusion). Using event-related potentials and functional MRI, we found that the brain's response to task-irrelevant sounds occurring synchronously with a visual stimulus from a different location was larger when that accompanying visual stimulus was attended versus unattended. The event-related potential effect consisted of sustained, frontally distributed, brain activity that emerged relatively late in processing, an effect resembling attention-related enhancements seen at earlier latencies during intramodal auditory attention. Moreover, the functional MRI data confirmed that the effect included specific enhancement of activity in auditory cortex. These findings indicate that attention to one sensory modality can spread to encompass simultaneous signals from another modality, even when they are task-irrelevant and from a different location. This cross-modal attentional spread appears to reflect an object-based, late selection process wherein spatially discrepant auditory stimulation is grouped with synchronous attended visual input into a multisensory object, resulting in the auditory information being pulled into the attentional spotlight and bestowed with enhanced processing.

Full Text

Duke Authors

Cited Authors

  • Busse, L; Roberts, KC; Crist, RE; Weissman, DH; Woldorff, MG

Published Date

  • December 20, 2005

Published In

Volume / Issue

  • 102 / 51

Start / End Page

  • 18751 - 18756

PubMed ID

  • 16339900

Pubmed Central ID

  • PMC1317940

International Standard Serial Number (ISSN)

  • 0027-8424

Digital Object Identifier (DOI)

  • 10.1073/pnas.0507704102


  • eng

Conference Location

  • United States