The objective is to analyze the radiological diagnosis of orbital lesions and their correlation with the final histopathological findings. We compared the initial reports by extramural radiologists and an in-house radiologist specialized in orbital imaging to evaluate the diagnostic accuracy in the interpretation of orbital imaging. This was a retrospective chart review of forty patients referred to a Tertiary Eye Care Center in South India over a period of 7 years. These patients already had their imaging done elsewhere. The imaging was re-evaluated by an in-house radiologist. The radiological findings were correlated with the histopathological diagnosis. The diagnostic accuracy between the two radiologists was compared. The sensitivity, specificity, positive predictive value (PPV), and negative predictive value in differentiating malignant from benign lesions were calculated in both groups. The sensitivity and PPV of the radiological diagnosis for neoplastic and inflammatory lesions in both groups were analyzed. The accuracy in differentiating malignant from benign and inflammatory lesions by our in-house radiologist and extramural radiologists was 95% (κ = 0.9 [0.764, 0.997]) and 50% (κ = 0.036 [-0.160, 0.232]), respectively. The sensitivity and PPV of the radiological diagnosis by our in-house radiologist were 93.31% and 100% for benign lesions and 95.24% and 95.24% for malignant lesions. On the contrary, reports from the extramural radiologists showed a sensitivity and PPV of 76.92% and 66.67% for benign lesions and 14.28% and 60% for malignant lesions. A high radiological diagnostic accuracy is possible when analyzed by radiologists experienced in orbital imaging.