Fully automated Assessment of Knee Alignment from Full-Leg X-Rays employing a “YOLOv4 And Resnet Landmark regression Algorithm” (YARLA): Data from the Osteoarthritis Initiative

Abstract

Background and ObjectiveWe present a fully automated method for the quantification of knee alignment from full-leg radiographs. MethodsA state-of-the-art object detector, YOLOv4, was trained to locate regions of interests in full-leg radiographs for the hip joint, knee, and ankle. Residual neural networks were trained to regress landmark coordinates for each region of interest. Based on the detected landmarks the knee alignment, i.e., the hip-knee-ankle (HKA) angle was computed. The accuracy of landmark detection was evaluated by a comparison to manually placed ones for 180 radiographs. The accuracy of HKA angle computations was assessed on the basis of 2,943 radiographs by a comparison to results of two independent image reading studies (Cooke; Duryea) both publicly accessible via the Osteoarthritis Initiative. The agreement was evaluated using Spearman’s Rho, weighted kappa, and regarding the correspondence of the class assignment. ResultsThe average deviation of landmarks manually placed by experts and automatically detected ones by our proposed “YOLOv4 And Resnet Landmark regression Algorithm” (YARLA) was less than 2.0 ± 1.5 mm for all structures. The average mismatch between HKA angle determinations of Cooke and Duryea was 0.09 ± 0.63°; YARLA resulted in a mismatch of 0.09 ± 0.73° compared to Cooke and of 0.18 ± 0.67° compared to Duryea. Cooke and Duryea agreed almost perfectly with respect to a weighted kappa value of 0.86, and showed an excellent reliability as measured by a Spearman’s Rho value of 0.98. Similar values were achieved by YARLA, i.e., a weighted kappa value of 0.83 and 0.87 and a Spearman’s Rho value of 0.98 and 0.98 compared to Cooke and Duryea, respectively. Cooke and Duryea agreed in 91% of all class assignments and YARLA did so in 90% against Cooke and 92% against Duryea. ConclusionsYARLA yields HKA angles similar to those of human experts and provides a basis for an automated assessment of knee alignment in full-leg radiographs.