Our subjective experience of remembering guides and monitors the reconstruction of past and simulation of the future, which enables us to identify mistakes and adjust our behavior accordingly. However, what underlies the process of subjective mnemonic experience remains incompletely understood. Here, we combined behavior, repetitive TMS, and functional neuroimaging to probe whether vividness and confidence are generated differently during retrieval. We found that preretrieval repetitive TMS targeting the left angular gyrus (AnG) selectively attenuated the vividness efficiency compared with control stimulation while keeping metacognitive efficiency and objective memory accuracy unaffected. Using trialwise data, we showed that AnG stimulation altered the mediating role of vividness in confidence in the accuracy of memory judgment. Moreover, resting-state functional connectivity of hippocampus and AnG was specifically associated with vividness efficiency, but not metacognitive efficiency across individuals. Together, these results identify the causal involvement of AnG in gauging the vividness, but not the confidence, of memory, thereby suggesting a differentiation account of conscious assessment of memory by functionally and anatomically dissociating the monitoring of vividness from confidence.