OBJECTIVE: To evaluate the interobserver agreement between physicians regarding a abnormal cardiovascular assessment on athletic preparticipation examinations. DESIGN: Cross-sectional clinical survey. SETTING: Outpatient Clinic, United States Military Academy, West Point, NY. PARTICIPANTS: We randomly selected 101 out of 539 cadet-athletes presenting for a preparticipation examination. Two primary care sports medicine fellows and a cardiologist examined the cadets. INTERVENTIONS: After obtaining informed consent from all participants, all 3 physicians separately evaluated all 101 cadets. The physicians recorded their clinical findings and whether they thought further cardiovascular evaluation (echocardiography) was indicated. MAIN OUTCOME MEASURES: Rate of referral for further cardiovascular evaluation, clinical agreement between sports medicine fellows, and clinical agreement between sports medicine fellows and the cardiologist. RESULTS: Each fellow referred 6 of the 101 evaluated cadets (5.9%). The cardiologist referred none. Although each fellow referred 6 cadets, only 1 cadet was referred by both. The kappa statistic for clinical agreement between fellows is 0.114 (95% CI, -0.182 to 0.411). There was no clinical agreement between the fellows and the cardiologist. CONCLUSIONS: This pilot study reveals a low level of agreement between physicians regarding which athletes with an abnormal examination deserved further testing. It challenges the standard of care and questions whether there is a need for improved technologies or improved training in cardiovascular clinical assessment.