Application and Prospects of Deep Learning Technology in Fracture Diagnosis

Abstract

Artificial intelligence (AI) is an interdisciplinary field that combines computer technology, mathematics, and several other fields. Recently, with the rapid development of machine learning (ML) and deep learning (DL), significant progress has been made in the field of AI. As one of the fastest-growing branches, DL can effectively extract features from big data and optimize the performance of various tasks. Moreover, with advancements in digital imaging technology, DL has become a key tool for processing high-dimensional medical image data and conducting medical image analysis in clinical applications. With the development of this technology, the diagnosis of orthopedic diseases has undergone significant changes. In this review, we describe recent research progress on DL in fracture diagnosis and discuss the value of DL in this field, providing a reference for better integration and development of DL technology in orthopedics.

Keywords

deep learning / artificial intelligence / fracture / diagnosis / medical image analysis / orthopedics

References

[1] Ito S, Nakashima H, Yoshii T, et al. Deep learning-based prediction model for postoperative complications of cervical posterior longitudinal ligament ossification. Eur Spine J, 2023, 32(11): 3797-3806

[2] Duan YY, Liu PR, Huo TT, et al. Application and Development of Intelligent Medicine in Traditional Chinese Medicine. Curr Med Sci, 2021, 41(6): 1116-1122

[3] Noguchi S, Nishio M, Sakamoto R, et al. Deep learning-based algorithm improved radiologists’ performance in bone metastases detection on CT. Eur Radiol, 2022, 32(11): 7976-7987

[4] Hardalac F, Uysal F, Peker O, et al. Fracture Detection in Wrist X-ray Images Using Deep Learning-Based Object Detection Models. Sensors (Basel), 2022, 22(3): 1285

[5] Krogue JD, Cheng KV, Hwang KM, et al. Automatic Hip Fracture Identification and Functional Subclassification with Deep Learning. Radiol Artif Intell, 2020, 2(2): e190023

[6] Pranata YD, Wang KC, Wang JC, et al. Deep learning and SURF for automated classification and detection of calcaneus fractures in CT images. Comput Methods Programs Biomed, 2019, 171: 27-37

[7] Xie Y, Lu L, Gao F, et al. Integration of Artificial Intelligence, Blockchain, and Wearable Technology for Chronic Disease Management: A New Paradigm in Smart Healthcare. Curr Med Sci, 2021, 41(6): 1123-1133

[8] Wang YN, Liu G, Wang L, et al. A Deep-Learning Model for Diagnosing Fresh Vertebral Fractures on Magnetic Resonance Images. World Neurosurg, 2024, 183: e818-e824

[9] Kitamura G. Deep learning evaluation of pelvic radiographs for position, hardware presence, and fracture detection. Eur J Radiol, 2020, 130: 109139

[10] Oka K, Shiode R, Yoshii Y, et al. Artificial intelligence to diagnosis distal radius fracture using biplane plain X-rays. J Orthop Surg Res, 2021, 16(1): 694

[11] Sato Y, Yamamoto N, Inagaki N, et al. Deep Learning for Bone Mineral Density and T Score Prediction from Chest X-rays: A Multicenter Study. Biomedicines, 2022, 10(9): 2323

[12] Li Z, Ren S, Zhou R, et al. Deep Learning-Based Magnetic Resonance Imaging Image Features for Diagnosis of Anterior Cruciate Ligament Injury. J Healthc Eng, 2021, 2021: 4076175

[13] Liu PR, Zhang JY, Xue MD, et al. Artificial Intelligence to Diagnose Tibial Plateau Fractures: An Intelligent Assistant for Orthopedic Physicians. Curr Med Sci, 2021, 41(6): 1158-1164

[14] Yamada Y, Maki S, Kishida S, et al. Automated classification of hip fractures using deep convolutional neural networks with orthopedic surgeon-level accuracy: ensemble decision-making with antero-posterior and lateral radiographs. Acta Orthop, 2020, 91(6): 699-704

[15] Murata K, Endo K, Aihara T, et al. Artificial intelligence for the detection of vertebral fractures on plain spinal radiography. Sci Rep, 2020, 10(1): 20031

[16] Ye P, Li S, Wang Z, et al. Development and validation of a deep learning-based model to distinguish acetabular fractures on pelvic anteroposterior radiographs. Front Physiol, 2023, 14: 1146910

[17] Zhang W, Chen Z, Su Z, et al. Deep learning-based detection and classification of lumbar disc herniation on magnetic resonance images. JOR Spine, 2023, 6(3): e1276

[18] Nakata N. Recent technical development of artificial intelligence for diagnostic medical imaging. Jpn J Radiol, 2019, 37(2): 103-108

[19] Inagaki N, Nakata N, Ichimori S, et al. Detection of Sacral Fractures on Radiographs Using Artificial Intelligence. JB JS Open Access, 2022, 7(3): e22.00030

[20] Kijowski R, Liu F, Caliva F, et al. Deep Learning for Lesion Detection, Progression, and Prediction of Musculoskeletal Disease. J Magn Reson Imaging, 2020, 52(6): 1607-1619

[21] Helm JM, Swiergosz AM, Haeberle HS, et al. Machine Learning and Artificial Intelligence: Definitions, Applications, and Future Directions. Curr Rev Musculoskelet Med, 2020, 13(1): 69-76

[22] Yoon AP, Lee YL, Kane RL, et al. Development and Validation of a Deep Learning Model Using Convolutional Neural Networks to Identify Scaphoid Fractures in Radiographs. JAMA Netw Open, 2021, 4(5): e216096

[23] Qu B, Cao J, Qian C, et al. Current development and prospects of deep learning in spine image analysis: a literature review. Quant Imaging Med Surg, 2022, 12(6): 3454-3479

[24] Lu ZX, Qian P, Bi D, et al. Application of AI and IoT in Clinical Medicine: Summary and Challenges. Curr Med Sci, 2021, 41(6): 1134-1150

[25] van der Velden BHM, Kuijf HJ, Gilhuijs KGA, et al. Explainable artificial intelligence (XAI) in deep learning-based medical image analysis. Med Image Anal, 2022, 79: 102470

[26] Jones RM, Sharma A, Hotchkiss R, et al. Assessment of a deep-learning system for fracture detection in musculoskeletal radiographs. NPJ Digit Med, 2020, 3(1): 144

[27] Prijs J, Liao Z, To MS, et al. Development and external validation of automated detection, classification, and localization of ankle fractures: inside the black box of a convolutional neural network (CNN). Eur J Trauma Emerg Surg, 2023, 49(2): 1057-1069

[28] Urakawa T, Tanaka Y, Goto S, et al. Detecting intertrochanteric hip fractures with orthopedist-level accuracy using a deep convolutional neural network. Skeletal Radiol, 2019, 48(2): 239-244

[29] Ozkaya E, Topal FE, Bulut T, et al. Evaluation of an artificial intelligence system for diagnosing scaphoid fracture on direct radiography. Eur J Trauma Emerg Surg, 2022, 48(1): 585-592

[30] Li T, Yin Y, Yi Z, et al. Evaluation of a convolutional neural network to identify scaphoid fractures on radiographs. J Hand Surg Eur Vol, 2023, 48(5): 445-450

[31] Hendrix N, Hendrix W, van Dijke K, et al. Musculoskeletal radiologist-level performance by using deep learning for detection of scaphoid fractures on conventional multiview radiographs of hand and wrist. Eur Radiol, 2023, 33(3): 1575-1588

[32] Yang TH, Horng MH, Li RS, et al. Scaphoid Fracture Detection by Using Convolutional Neural Network. Diagnostics (Basel), 2022, 12(4): 895

[33] Nellans KW, Kowalski E, Chung KC. The epidemiology of distal radius fractures. Hand Clin, 2012, 28(2): 113-125

[34] Smeraglia F, Del Buono A, Maffulli N. Wrist arthroscopy in the management of articular distal radius fractures. Br Med Bull, 2016, 119(1): 157-165

[35] Tang JB. Distal Radius Fracture Diagnosis, Treatment, and Controversies. Clin Plast Surg, 2014, 41(3): 481-499

[36] Pinto A, Reginelli A, Pinto F, et al. Errors in imaging patients in the emergency setting. Br J Radiol, 2016, 89(1061): 20150914

[37] Kim DH, MacKinnon T. Artificial intelligence in fracture detection: transfer learning from deep convolutional neural networks. Clin Radiol, 2018, 73(5): 439-445

[38] Raisuddin AM, Vaattovaara E, Nevalainen M, et al. Critical evaluation of deep neural networks for wrist fracture detection. Sci Rep, 2021, 11(1): 6006

[39] Anttila TT, Karjalainen TV, Makela TO, et al. Detecting Distal Radius Fractures Using a Segmentation-Based Deep Learning Model. J Digit Imaging, 2023, 36(2): 679-687

[40] Gan K, Xu D, Lin Y, et al. Artificial intelligence detection of distal radius fractures: a comparison between the convolutional neural network and professional assessments. Acta Orthop, 2019, 90(4): 394-400

[41] Kim MW, Jung J, Park SJ, et al. Application of convolutional neural networks for distal radio-ulnar fracture detection on plain radiographs in the emergency room. Clin Exp Emerg Med, 2021, 8(2): 120-127

[42] Suzuki T, Maki S, Yamazaki T, et al. Detecting Distal Radial Fractures from Wrist Radiographs Using a Deep Convolutional Neural Network with an Accuracy Comparable to Hand Orthopedic Surgeons. J Digit Imaging, 2022, 35(1): 39-46

[43] Zhang J, Li Z, Lin H, et al. Deep learning assisted diagnosis system: improving the diagnostic accuracy of distal radius fractures. Front Med (Lausanne), 2023, 10: 1224489

[44] Erdas CB. Automated fracture detection in the ulna and radius using deep learning on upper extremity radiographs. Jt Dis Relat Surg, 2023, 34(3): 598-604

[45] Chung SW, Han SS, Lee JW, et al. Automated detection and classification of the proximal humerus fracture by using deep learning algorithm. Acta Orthop, 2018, 89(4): 468-473

[46] Cheng CT, Ho TY, Lee TY, et al. Application of a deep learning algorithm for detection and visualization of hip fractures on plain pelvic radiographs. Eur Radiol, 2019, 29(10): 5469-5477

[47] Bae J, Yu S, Oh J, et al. External Validation of Deep Learning Algorithm for Detecting and Visualizing Femoral Neck Fracture Including Displaced and Nondisplaced Fracture on Plain X-ray. J Digit Imaging, 2021, 34(5): 1099-1109

[48] Adams M, Chen W, Holcdorf D, et al. Computer vs human: Deep learning versus perceptual training for the detection of neck of femur fractures. J Med Imaging Radiat Oncol, 2019, 63(1): 27-32

[49] Mutasa S, Varada S, Goel A, et al. Advanced Deep Learning Techniques Applied to Automated Femoral Neck Fracture Detection and Classification. J Digit Imaging, 2020, 33(5): 1209-1217

[50] Mawatari T, Hayashida Y, Katsuragawa S, et al. The effect of deep convolutional neural networks on radiologists’ performance in the detection of hip fractures on digital pelvic radiographs. Eur J Radiol, 2020, 130: 109188

[51] Yu JS, Yu SM, Erdal BS, et al. Detection and localization of hip fractures on anteroposterior radiographs with artificial intelligence: proof of concept. Clin Radiol, 2020, 75(3): 237.e1-237.e9

[52] Wang Y, Li Y, Lin G, et al. Lower-extremity fatigue fracture detection and grading based on deep learning models of radiographs. Eur Radiol, 2023, 33(1): 555-565

[53] Ashkani-Esfahani S, Mojahed Yazdi R, Bhimani R, et al. Detection of ankle fractures using deep learning algorithms. Foot Ankle Surg, 2022, 28(8): 1259-1265

[54] Kim T, Goh TS, Lee JS, et al. Transfer learning-based ensemble convolutional neural network for accelerated diagnosis of foot fractures. Phys Eng Sci Med, 2023, 46(1): 265-277

[55] Wang H, Ying J, Liu J, et al. Harnessing ResNet50 and SENet for enhanced ankle fracture identification. BMC Musculoskelet Disord, 2024, 25(1): 250

[56] Kim T, Moon NH, Goh TS, et al. Detection of incomplete atypical femoral fracture on anteroposterior radiographs via explainable artificial intelligence. Sci Rep, 2023, 13(1): 10415

[57] Li YC, Chen HH, Horng-Shing Lu H, et al. Can a Deep-learning Model for the Automated Detection of Vertebral Fractures Approach the Performance Level of Human Subspecialists?. Clin Orthop Relat Res, 2021, 479(7): 1598-1612

[58] Shen L, Gao C, Hu S, et al. Using Artificial Intelligence to Diagnose Osteoporotic Vertebral Fractures on Plain Radiographs. J Bone Miner Res, 2023, 38(9): 1278-1287

[59] Yuh WT, Khil EK, Yoon YS, et al. Deep Learning-Assisted Quantitative Measurement of Thoracolumbar Fracture Features on Lateral Radiographs. Neurospine, 2024, 21(1): 30-43

[60] Rosenberg GS, Cina A, Schiro GR, et al. Artificial Intelligence Accurately Detects Traumatic Thoracolumbar Fractures on Sagittal Radiographs. Medicina (Kaunas), 2022, 58(8): 998

[61] Tomita N, Cheung YY, Hassanpour S. Deep neural networks for automatic detection of osteoporotic vertebral fractures on CT scans. Comput Biol Med, 2018, 98: 8-15

[62] Zhang J, Liu F, Xu J, et al. Automated detection and classification of acute vertebral body fractures using a convolutional neural network on computed tomography. Front Endocrinol (Lausanne), 2023, 14: 1132725

[63] Polzer C, Yilmaz E, Meyer C, et al. AI-based automated detection and stability analysis of traumatic vertebral body fractures on computed tomography. Eur J Radiol, 2024, 173: 111364

[64] Yabu A, Hoshino M, Tabuchi H, et al. Using artificial intelligence to diagnose fresh osteoporotic vertebral fractures on magnetic resonance images. Spine J, 2021, 21(10): 1652-1658

[65] Naguib SM, Hamza HM, Hosny KM, et al. Classification of Cervical Spine Fracture and Dislocation Using Refined Pre-Trained Deep Model and Saliency Map. Diagnostics, 2023, 13(7): 1273

[66] Golla AK, Lorenz C, Buerger C, et al. Cervical spine fracture detection in computed tomography using convolutional neural networks. Phys Med Biol, 2023, 68(11): 115010

[67] Ukai K, Rahman R, Yagi N, et al. Detecting pelvic fracture on 3D-CT using deep convolutional neural networks with multiorientated slab images. Sci Rep, 2021, 11(1): 11716

[68] Rahman R, Yagi N, Hayashi K, et al. Enhancing fracture diagnosis in pelvic X-rays by deep convolutional neural network with synthesized images from 3D-CT. Sci Rep, 2024, 14(1): 8004

[69] Cheng CT, Wang Y, Chen HW, et al. A scalable physician-level deep learning algorithm detects universal trauma on pelvic radiographs. Nat Commun, 2021, 12(1): 1066

[70] Guermazi A, Tannoury C, Kompel AJ, et al. Improving Radiographic Fracture Recognition Performance and Efficiency Using Artificial Intelligence. Radiology, 2022, 302(3): 627-636

[71] Yoon AP, Chung WT, Wang CW, et al. Can a Deep Learning Algorithm Improve Detection of Occult Scaphoid Fractures in Plain Radiographs? A Clinical Validation Study. Clin Orthop Relat Res, 2023, 481(9): 1825-1835

[72] Lindsey R, Daluiski A, Chopra S, et al. Deep neural network improves fracture detection by clinicians. Proc Natl Acad Sci U S A, 2018, 115(45): 11591-11596

[73] Anderson PG, Baum GL, Keathley N, et al. Deep Learning Assistance Closes the Accuracy Gap in Fracture Detection Across Clinician Types. Clin Orthop Relat Res, 2023, 481(3): 580-588

[74] Sato Y, Takegami Y, Asamoto T, et al. Artificial intelligence improves the accuracy of residents in the diagnosis of hip fractures: a multicenter study. BMC Musculoskelet Disord, 2021, 22(1): 407

[75] Ruitenbeek HC, Oei EHG, Schmahl BL, et al. Toward clinical implementation of an AI-algorithm for detection of cervical spine fractures on computed tomography. Eur J Radiol, 2024, 173: 111375