Comparing accuracy of machine learning approaches to identifying parathyroid adenomas: Lessons and new directions

Abstract

PurposeThe purpose of this investigation is to understand the accuracy of machine learning techniques to detect biopsy-proven adenomas from similar appearing lymph nodes and factors that influence accuracy by comparing support vector machine (SVM) and bidirectional Long short-term memory (Bi-LSTM) analyses. This will provide greater insight into how these tools could integrate multidimensional data and aid the detection of parathyroid adenomas consistently and accurately. MethodsNinety-nine patients were identified; 93 4D-CTs of patients with pathology-proven parathyroid adenomas were reviewed; 94 parathyroid adenomas and 112 lymph nodes were analyzed. A 2D slice through the lesions in each phase was used to perform sequence classification with ResNet50 as the pre-trained network to construct the Bi-LSTM model, and the mean enhancement curves were used to form an SVM model. The model characteristics and accuracy were calculated for the training and validation data sets. ResultsOn the training data, the area under the curve (AUC) of the Bi-LSTM was 0.99, while the SVM was 0.95 and statistically significant on the DeLong test. The overall accuracy of the Bi-LSTM on the validation data set was 92 %, while the SVM was 88 %. The accuracy for parathyroid adenomas specifically was 93 % for the Bi-LSTM and 83 % for the SVM model. ConclusionEnhancement characteristics are a distinguishing feature that accurately identifies parathyroid adenomas alone. The Bi-LSTM performs statistically better in identifying parathyroid adenomas than the SVM analysis when using both morphologic and enhancement information to distinguish between parathyroid adenomas and lymph nodes. Summary statementThe Bi-LSTM more accurately identifies parathyroid adenomas than the SVM analysis, which uses both morphologic and enhancement information to distinguish between parathyroid adenomas and lymph nodes, performs statistically better.