We proposed a deep learning approach to classify various error types in daily VMAT treatment of head and neck cancer patients based on EPID dosimetry, which could provide additional information to support clinical decisions for adaptive planning. 146 arcs from 42 head and neck patients were analyzed. Anatomical changes and setup errors were simulated in 17,820 EPID images of 99 arcs obtained from 30 patients using in-house software for model training, validation, and testing. Subsequently, 141 clinical EPID images from 47 arcs belonging to the remaining 12 patients were utilized for clinical testing. The hierarchical convolutional neural network (HCNN) model was trained to classify error types and magnitudes using EPID dose difference maps. Gamma analysis with 3%/2mm (dose difference/distance to agreement) criteria was also performed. The F1 score, a combination of precision and recall, was utilized to evaluate the performance of the HCNN model and gamma analysis. The adaptive fractioned doses were calculated to verify the HCNN classification results. For error type identification, the overall F1 score of the HCNN model was 0.99 and 0.91 for primary type and subtype identification, respectively. For error magnitude identification, the overall F1 score in the simulation dataset was 0.96 and 0.70 for the HCNN model and gamma analysis, respectively; while the overall F1 score in the clinical dataset was 0.79 and 0.20 for the HCNN model and gamma analysis, respectively. The HCNN model-based EPID dosimetry can identify changes in patient transmission doses and distinguish the treatment error category, which could potentially provide information for head and neck cancer treatment adaption.