Automated diagnosis and classification of metacarpal and phalangeal fractures using a convolutional neural network: a retrospective data analysis study
DOI:
https://doi.org/10.2340/17453674.2024.42702Keywords:
Osteoarthrosis, Radiological imagingAbstract
Background and purpose: Hand fractures are commonly presented in emergency departments, yet diagnostic errors persist, leading to potential complications. The use of artificial intelligence (AI) in fracture detection has shown promise, but research focusing on hand metacarpal and phalangeal fractures remains limited. We aimed to train and evaluate a convolutional neural network (CNN) model to diagnose metacarpal and phalangeal fractures using plain radiographs according to the AO/OTA classification system and custom classifiers.
Methods: A retrospective analysis of 7,515 examinations comprising 27,965 images was conducted, with datasets divided into training, validation, and test datasets. A CNN architecture was based on ResNet and implemented using PyTorch, with the integration of data augmentation techniques.
Results: The CNN model achieved a mean weighted AUC of 0.84 for hand fractures, with 86% sensitivity and 76% specificity. The model performed best in diagnosing transverse metacarpal fractures, AUC = 0.91, 100% sensitivity, 87% specificity, and tuft phalangeal fractures, AUC = 0.97, 100% sensitivity, 96% specificity. Performance was lower for complex patterns like oblique phalangeal fractures, AUC = 0.76.
Conclusion: Our study demonstrated that a CNN model can effectively diagnose and classify metacarpal and phalangeal fractures using plain radiographs, achieving a mean weighted AUC of 0.84. 7 categories were deemed as acceptable, 9 categories as excellent, and 3 categories as outstanding. Our findings indicate that a CNN model may be used in the classification of hand fractures.
Downloads
References
Popova D, Welman T, Vamadeva S V, Pahal G S. Management of hand fractures. Br J Hosp Med (Lond) 2020; 81: 1-11. https://doi.org/10.12968/hmed.2020.0140. DOI: https://doi.org/10.12968/hmed.2020.0140
Bhargavan M, Kaye A H, Forman H P, Sunshine J H. Workload of radiologists in United States in 2006–2007 and trends since 1991–1992. Radiology 2009; 252: 458-67. doi: 10.1148/radiol.2522081895. DOI: https://doi.org/10.1148/radiol.2522081895
Dan Lantsman C, Barash Y, Klang E, Guranda L, Konen E, Tau N. Trend in radiologist workload compared to number of admissions in the emergency department. Eur J Radiol 2022; 149: 110195. doi: 10.1016/j.ejrad.2022.110195. DOI: https://doi.org/10.1016/j.ejrad.2022.110195
Lauritzen A D, Rodríguez-Ruiz A, von Euler-Chelpin M C, Lynge E, Vejborg I, Nielsen M, et al. An artificial intelligence-based mammography screening protocol for breast cancer: outcome and radiologist workload. Radiology 2022; 304: 41-9. doi: 10.1148/radiol.210948. DOI: https://doi.org/10.1148/radiol.210948
Guermazi A, Tannoury C, Kompel A J, Murakami A M, Ducarouge A, Gillibert A, et al. Improving radiographic fracture recognition performance and efficiency using artificial intelligence. Radiology 2022; 302: 627-36. doi: 10.1148/radiol.210937. DOI: https://doi.org/10.1148/radiol.210937
Hendrix N, Hendrix W, van Dijke K, Maresch B, Maas M, Bollen S, et al. Musculoskeletal radiologist-level performance by using deep learning for detection of scaphoid fractures on conventional multi-view radiographs of hand and wrist. Eur Radiol 2023; 33: 1575-88. doi: 10.1007/s00330-022-09205-4. DOI: https://doi.org/10.1007/s00330-022-09205-4
Guo J, Li B. The application of medical artificial intelligence technology in rural areas of developing countries. Health Equity 2018; 2: 174-81. doi: 10.1089/heq.2018.0037. DOI: https://doi.org/10.1089/heq.2018.0037
Langerhuizen D W G, Janssen S J, Mallee W H, van den Bekerom M P J, Ring D, Kerkhoffs G M M J, et al. What are the applications and limitations of artificial intelligence for fracture detection and classification in orthopaedic trauma imaging? A systematic review. Clin Orthop Relat Res 2019; 477: 2482-91. doi: 10.1097/CORR.0000000000000848. DOI: https://doi.org/10.1097/CORR.0000000000000848
Olczak J, Fahlberg N, Maki A, Razavian A S, Jilert A, Stark A, et al. Artificial intelligence for analyzing orthopedic trauma radiographs. Acta Orthop 2017; 88: 581-6. doi: 10.1080/17453674.2017.1344459. DOI: https://doi.org/10.1080/17453674.2017.1344459
Collins G S, Reitsma J B, Altman D G, Moons K G M. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ 2015; 350: g7594. doi: 10.1136/bmj.g7594. DOI: https://doi.org/10.1136/bmj.g7594
Meinberg E G, Agel J, Roberts C S, Karam M D, Kellam J F. Fracture and Dislocation Classification Compendium—2018. J Orthop Trauma 2018; 32(Suppl 1): S1-170. doi: 10.1097/BOT.0000000000001063. DOI: https://doi.org/10.1097/BOT.0000000000001063
He K, Zhang X, Ren S, Sun J. Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. 2015 IEEE International Conference on Computer Vision (ICCV). Santiago, Chile: IEEE; 2015, p. 1026-34. doi: 10.1109/ICCV.2015.123. DOI: https://doi.org/10.1109/ICCV.2015.123
Youden W J. Index for rating diagnostic tests. Cancer 1950; 3: 32-5. doi: 10.1002/1097-0142(1950)3: 1<32: : aid-cncr2820030106>3.0.co; 2-3. DOI: https://doi.org/10.1002/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3
Mandrekar J N. Simple statistical measures for diagnostic accuracy assessment. J Thorac Oncol 2010; 5: 763-4. doi: 10.1097/JTO.0b013e3181dab122. DOI: https://doi.org/10.1097/JTO.0b013e3181dab122
Magnéli M, Ling P, Gislén J, Fagrell J, Demir Y, Arverud E D, et al. Deep learning classification of shoulder fractures on plain radiographs of the humerus, scapula and clavicle. PLoS One 2023; 18: e0289808. doi: 10.1371/journal.pone.0289808. DOI: https://doi.org/10.1371/journal.pone.0289808
Kuo R Y L, Harrison C, Curran T-A, Jones B, Freethy A, Cussons D, et al. Artificial intelligence in fracture detection: a systematic review and meta-analysis. Radiology 2022; 304: 50-62. doi: 10.1148/radiol.211785. DOI: https://doi.org/10.1148/radiol.211785
Üreten K, Sevinç H F, İğdeli U, Onay A, Maraş Y. Use of deep learning methods for hand fracture detection from plain hand radiographs. Ulus Travma Acil Cerrahi Derg 2022; 28: 196-201. doi: 10.14744/tjtes.2020.06944. DOI: https://doi.org/10.14744/tjtes.2020.06944
Ozkaya E, Topal F E, Bulut T, Gursoy M, Ozuysal M, Karakaya Z. Evaluation of an artificial intelligence system for diagnosing scaphoid fracture on direct radiography. Eur J Trauma Emerg Surg 2022; 48: 585-92. doi: 10.1007/s00068-020-01468-0. DOI: https://doi.org/10.1007/s00068-020-01468-0
Additional Files
Published
How to Cite
License
Copyright (c) 2025 Michael Axenhus, Anna Wallin, Jonas Havela, Sara Severin, Ablikim Karahan, Max Gordon, Martin Magnéli
This work is licensed under a Creative Commons Attribution 4.0 International License.
