Validation of Combined Deep Learning Triaging and Computer-Aided Diagnosis in 2901 Breast MRI Examinations From the Second Screening Round of the Dense Tissue and Early Breast Neoplasm Screening Trial

Abstract

OBJECTIVES: Computer-aided triaging (CAT) and computer-aided diagnosis (CAD) of screening breast magnetic resonance imaging have shown potential to reduce the workload of radiologists in the context of dismissing normal breast scans and dismissing benign disease in women with extremely dense breasts. The aim of this study was to validate the potential of integrating CAT and CAD to reduce workload and workup on benign lesions in the second screening round of the DENSE trial, without missing cancer. METHODS: We included 2901 breast magnetic resonance imaging scans, obtained from 8 hospitals in the Netherlands. Computer-aided triaging and CAD were previously developed on data from the first screening round. Computer-aided triaging dismissed examinations without lesions. Magnetic resonance imaging examinations triaged to radiological reading were counted and subsequently processed by CAD. The number of benign lesions correctly classified by CAD was recorded. The false-positive fraction of the CAD was compared with that of unassisted radiological reading in the second screening round. Receiver operating characteristics (ROC) analysis was performed and the generalizability of CAT and CAD was assessed by comparing results from first and second screening rounds. RESULTS: Computer-aided triaging dismissed 950 of 2901 (32.7%) examinations with 49 lesions in total; none were malignant. Subsequent CAD classified 132 of 285 (46.3%) lesions as benign without misclassifying any malignant lesion. Together, CAT and CAD yielded significantly fewer false-positive lesions, 53 of 109 (48.6%) and 89 of 109 (78.9%), respectively (P = 0.001), than radiological reading alone. Computer-aided triaging had a smaller area under the ROC curve in the second screening round compared with the first, 0.83 versus 0.76 (P = 0.001), but this did not affect the negative predictive value at the 100% sensitivity operating threshold. Computer-aided diagnosis was not associated with significant differences in area under the ROC curve (0.857 vs 0.753, P = 0.08). At the operating thresholds, the specificities of CAT (39.7% vs 41.0%, P = 0.70) and CAD (41.0% vs 38.2%, P = 0.62) were successfully reproduced in the second round. CONCLUSION: The combined application of CAT and CAD showed potential to reduce workload of radiologists and to reduce number of biopsies on benign lesions. Computer-aided triaging (CAT) correctly dismissed 950 of 2901 (32.7%) examinations with 49 lesions in total; none were malignant. Subsequent computer-aided diagnosis (CAD) classified 132 of 285 (46.3%) lesions as benign without misclassifying any malignant lesion. Together, CAT and CAD yielded significantly fewer false-positive lesions, 53 of 109 (48.6%) and 89 of 109 (78.9%), respectively (P = 0.001), than radiological reading alone.