Abstract. In this study, we assess the homogeneity of aerosol optical depth (AOD) between two sun photometer networks, the Global Atmosphere Watch-Precision Filter Radiometer (GAW-PFR) and the European SKYNET radiometers network (ESR), at the common wavelengths of their main instruments (500 and 870 nm). The main focus of this work is to evaluate the effect of the improved Langley plot calibration method (ILP) used by SKYNET and to investigate the factors affecting its performance. We used data from three intercomparison campaigns that took place during 2017–2021. Each campaign was organized at two locations (mountainous rural – Davos, Switzerland; urban – Rome, Italy). Our analysis shows that differences in AOD due to post-processing and instrument differences are minor. The main factor leading to AOD differences is the calibration method. We found a systematic underestimation of AOD in ESR compared to in GAW-PFR due to underestimation of the calibration constant calculated with the ILP method compared to the calibration transfers using the PFR as a reference. The calibration and AOD differences are smaller in Davos, where the traceability criteria are satisfied at 870 nm and where the median differences are below 0.01 at 500 nm. In Rome, the AOD median differences at 500 nm were in the 0.015–0.034 range. We conducted a sensitivity study, which shows that part of the difference can potentially be explained by errors in the assumed surface albedo and instrument solid-view angle provided as inputs to the ILP code (based on Skyrad pack 4.2). Our findings suggest that the ILP method is mainly sensitive to the measured sky radiance. The underestimation in calibration is probably caused by an error in the retrieved scattering AOD (sc-AOD) through the sky radiance inversion. Using an alternative retrieval method (Skyrad MRI pack version 2) to derive sc-AOD and to recalibrate the instruments with the ILP method, we found no significant differences between the retrieved sc-AOD and no systematic increase in the ILP-derived calibration constant when using the MRI pack for sc-AOD inversion instead of the Skyrad 4.2. The potential error may be a result of the model assumptions used for the sky radiance simulations. In conclusion, the on-site calibration of sun photometers has several advantages, including the fact that instrument shipments and data gaps can be avoided. However, it has also the disadvantages of a larger uncertainty and significant systematic differences compared to the traditional Langley calibration performed under low- and constant-AOD conditions at high-altitude sites. The larger uncertainty of the ILP method can be attributed to the required modelling and input parameters.