Primary brain tumor patients experience high levels of distress. The purpose of this cross-sectional, retrospective study is to evaluate the level and different sources of psychosocial distress and how these pertain to health-related quality of life (HRQoL). The Primary and Recurrent Glioma registry at Duke's The Preston Robert Tisch Brain Tumor Center was queried retrospectively for demographic and clinical information on patients seen between December 2013 and February 2014. Data also included the National Comprehensive Cancer Network's Distress Thermometer (NCCN-DT), Functional Assessment of Cancer Therapy-Brain Cancer (FACT-Br), and Functional Assessment of Chronic Illness Therapy- Fatigue (FACIT-F). 829 subjects completed questionnaires. 54% were male; 96% completed the NCCN-DT; 33.3% had a DT score ≥4 (moderate/severe distress). Women reported DT ≥ 4 more often than men (38.6 vs 29.0%; p = 0.005). Patients within 1 year of diagnosis reported DT ≥ 4 more often than those 1+ years after diagnosis (38.8 vs 30.9%; p = 0.034). 73.0% reported physical problems; the most frequent being fatigue (43.2%) and memory/concentration (40.9%). 42.0% complained of emotional problems with worry (29.4%) and nervousness (22.4%) being the most common. Patients who reported at least one practical, family, emotional or physical problem had significantly lower HRQoL scores (p < 0.001). Primary brain tumor patients experience memory dysfunction, fatigue, nervousness, worry, and financial concerns, which have a negative effect on the patient's HRQoL. By identifying and addressing these stressors, it may be possible to improve patient HRQoL.