Confocal laser endomicroscopy (CLE) is an intraoperative real-time cellular resolution imaging technology that images brain tumor histoarchitecture. Previously, we demonstrated that CLE images may be interpreted by neuropathologists to determine the presence of tumor infiltration at glioma margins. In this study, we assessed neurosurgeons' ability to interpret CLE images from glioma margins and compared their assessments to those of neuropathologists. In vivo CLE images acquired at the glioma margins that were previously reviewed by CLE-experienced neuropathologists were interpreted by four CLE-experienced neurosurgeons. A numerical scoring system from 0 to 5 and a dichotomous scoring system based on pathological features were used. Scores from assessments of hematoxylin and eosin (H&E)-stained sections and CLE images by neuropathologists from a previous study were used for comparison. Neurosurgeons' scores were compared to the H&E findings. The inter-rater agreement and diagnostic performance based on neurosurgeons' scores were calculated. The concordance between dichotomous and numerical scores was determined. In all, 4275 images from 56 glioma margin regions of interest (ROIs) were included in the analysis. With the numerical scoring system, the inter-rater agreement for neurosurgeons interpreting CLE images was moderate for all ROIs (mean agreement, 61%), which was significantly better than the inter-rater agreement for the neuropathologists (mean agreement, 48%) (p < 0.01). The inter-rater agreement for neurosurgeons using the dichotomous scoring system was 83%. The concordance between the numerical and dichotomous scoring systems was 93%. The overall sensitivity, specificity, positive predictive value, and negative predictive value were 78%, 32%, 62%, and 50%, respectively, using the numerical scoring system and 80%, 27%, 61%, and 48%, respectively, using the dichotomous scoring system. No statistically significant differences in diagnostic performance were found between the neurosurgeons and neuropathologists. Neurosurgeons' performance in interpreting CLE images was comparable to that of neuropathologists. These results suggest that CLE could be used as an intraoperative guidance tool with neurosurgeons interpreting the images with or without assistance of the neuropathologists. The dichotomous scoring system is robust yet simple and may streamline rapid, simultaneous interpretation of CLE images during imaging.