Retinal vein occlusion (RVO) is one of the most common retinal vascular diseases leading to vision loss if not diagnosed and treated in time. RVO can be classified into two types: CRVO (blockage of the main retinal veins) and BRVO (blockage of one of the smaller branch veins). Automated diagnosis of RVO can improve clinical workflow and optimize treatment strategies. However, to the best of our knowledge, there are few reported methods for automated identification of different RVO types. In this study, we propose a new hypermixed convolutional neural network (CNN) model, namely, the VGG-CAM network, that can classify the two types of RVOs based on retinal fundus images and detect lesion areas using an unsupervised learning method. The image data used in this study is collected and labeled by three senior ophthalmologists in Shanxi Eye Hospital, China. The proposed network is validated to accurately classify RVO diseases and detect lesions. It can potentially assist in further investigating the association between RVO and brain vascular diseases and evaluating the optimal treatments for RVO.