This study aimed to investigate the impact of delivery characteristics on the dose delivery accuracy of volumetric modulated arc therapy (VMAT) for different treatment sites. The pretreatment quality assurance (QA) results of 344 VMAT patients diagnosed with gynecological (GYN), head and neck (H&N), rectal or prostate cancer were randomly chosen in this study. Ten metrics reflecting VMAT delivery characteristics were extracted from the QA plans. Compared with GYN and rectal plans, H&N and prostate plans had higher aperture complexity and monitor units (MU), and smaller aperture area. Prostate plans had the smallest aperture area and lowest leaf speed compared with other plans (P < 0.001). No differences in gantry speed were found among the four sites. The gamma passing rates (GPRs) of GYN, rectal and H&N plans were inversely associated with union aperture area (UAA) and leaf speed (Pearson’s r: −0.39 to −0.68). GPRs of prostate plans were inversely correlated with aperture complexity, MU and small aperture score (SAS) (absolute Pearson’s r: 0.34 to 0.49). Significant differences in GPR between high SAS and low SAS subgroups were found only when leaf speed was <0.42 cm s–1 (P < 0.001). No association of GPR with gantry speed was found in four sites. Leaf speed was more strongly associated with UAA. Aperture complexity and MU were more strongly associated with SAS. VMAT plans from different sites have distinct delivery characteristics. Affecting dose delivery accuracy, leaf speed is the key factor for GYN, rectal and H&N plans, while aperture complexity, MU and small apertures have a higher influence on prostate plans.