Two novel deep-learning models to predict spontaneous ureteral calculi passage: Model development and validation

Abstract

Objective: The aim of this study was to develop and evaluate two deep-learning (DL) models for predicting spontaneous ureteral stone passage (SSP).

Materials and methods: A total of 1217 patients with thin-layer computed tomography-confirmed ureteral stones in our hospital from January 2019 to December 2022 were retrospectively examined. These patients were grouped into 3 data sets: the training set (n = 1000), the validation set (n = 100), and the test set (n = 117). Two DL models based on residual neural network (ResNet)—2-dimensional (2D) ResNet29 and 3-dimensional (3D) ResNet29—were separately developed, trained, and assessed. The predictive ability of a conventional approach using a stone diameter of <5 mm on computed tomography was investigated, and the results were compared with those of the two DL models.

Results: Of the 1217 patients, SSP was reported in 446 (36.6%). The total accuracy, sensitivity, and specificity were 76.9%, 56.1%, and 90.8% for the stone diameter approach; 87.1%, 84.2%, and 92.7% for the 2D ResNet29 model; and 90.6%, 88.2%, and 95.1% for the 3D ResNet29 model, respectively. Both the 2D and 3D ResNet29 models showed significantly higher accuracy than the stone diameter approach. Receiver operating characteristic curve analysis showed that both DL models had a significantly higher area under the curve than the stone diameter-based classification.

Conclusions: The DL models, particularly the 3D model, are novel and effective methods for predicting SSP rates. Using such models may help determine whether a patient should receive surgical intervention or expect a long interval before stone passage.

Keywords

Ureteral stone / Computed tomography / Spontaneous passage / Artificial neural network / Deep learning / Prediction model

Acknowledgments

None.

Statement of ethics

The ethical committee of the Second Hospital of Shandong University waived the need for ethics approval and written informed consent. This study was retrospective and involved the collection of existing data and records. All procedures performed in this study involving human participants were in accordance with the ethical standards of institutional and/or national research committee(s) and with the Helsinki Declaration.

Conflict of interest statement

The authors declare that they have no conflicts of interest.

Funding source

None.

Author contributions

ZX: Data acquisition and analysis, drafting of the manuscript;

HB: Data acquisition, image processing and analysis;

YZ: Study design, data acquisition and analysis, drafting of the manuscript, critical revision of the manuscript.

Data availabilty

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

[1] Jendeberg J, Geijer H, Alshamari M, Lidén M. Prediction of spontaneous ureteral stone passage: Automated 3D-measurements perform equal to radiologists, and linear measurements equal to volumetric. Eur Radiol 2018; 28(6):2474-2483.

[2] Jendeberg J, Geijer H, Alshamari M, Cierzniak B, Lidén M. Size matters: The width and location of a ureteral stone accurately predict the chance of spontaneous passage. Eur Radiol 2017; 27(11):4775-4785.

[3] Chen X, Wang X, Zhang K, et al. Recent advances and clinical applications of deep learning in medical image analysis. Med Image Anal 2022;79:102444.

[4] Yaqub M, Jinchao F, Arshid K, et al. Deep learning-based image reconstruction for different medical imaging modalities. Comput Math Methods Med 2022;2022:8750648.

[5] Solakhan M, Seckiner SU, Seckiner I. A neural network-based algorithm for predicting the spontaneous passage of ureteral stones. Urolithiasis 2020; 48(6):527-532.

[6] Jendeberg J, Thunberg P, Lidén M. Differentiation of distal ureteral stones and pelvic phleboliths using a convolutional neural network. Urolithiasis 2021; 49(1):41-49.

[7] Haifler M, Kleinmann N, Haramaty R, Zilberman DE. A machine learning model for predicting surgical intervention in renal colic due to ureteral stone(s) < 5 mm. Sci Rep 2022; 12(1):11788.

[8] Chiou T, Meagher MF, Berger JH, Chen TT, Sur RL, Bechis SK. Software-estimated stone volume is better predictor of spontaneous passage for acute nephrolithiasis. J Endourol 2023; 37(1):85-92.

[9] Park JS, Kim DW, Lee D, et al. Development of prediction models of spontaneous ureteral stone passage through machine learning: Comparison with conventional statistical analysis. PLoS One 2021; 16(12):e0260517.

[10] Lee KS, Ha JS, Koo KC. Significance of neutrophil-to-lymphocyte ratio as a novel indicator of spontaneous ureter stone passage. Yonsei Med J 2017; 58(5):988-993.

[11] Katz JE, Abdelrahman L, Nackeeran S, Ezeh U, Visser U, Deane LA. The development of an artificial intelligence model based solely on computer tomography successfully predicts which patients will pass obstructing ureteral calculi. Urology 2023;174:58-63.