Contralateral recruitment remains a controversial phenomenon in both the clinical and normative populations. To investigate the neural correlates of this phenomenon, we explored the tendency for older adults to recruit prefrontal cortex (PFC) regions contralateral to those most active in younger adults. Participants were scanned with diffusion tensor imaging and functional magnetic rresonance imaging during a lateralized word matching task (unilateral vs. bilateral). Cross-hemispheric communication was measured behaviorally as greater accuracy for bilateral than unilateral trials (bilateral processing advantage [BPA]) and at the neural level by functional and structural connectivity between contralateral PFC. Compared with the young, older adults exhibited 1) greater BPAs in the behavioral task, 2) greater compensatory activity in contralateral PFC during the bilateral condition, 3) greater functional connectivity between contralateral PFC during bilateral trials, and 4) a positive correlation between fractional anisotropy in the corpus callosum and both the BPA and the functional connectivity between contralateral PFC, indicating that older adults' ability to distribute processing across hemispheres is constrained by white matter integrity. These results clarify how older adults' ability to recruit extra regions in response to the demands of aging is mediated by existing structural architecture, and how this architecture engenders corresponding functional changes that allow subjects to meet those task demands.