Contrast-enhanced ultrasound (CEUS) is a vital technique for lesion identification, where accurate localization and segmentation of target regions are essential tasks. However, extracting reliable quantitative information from CEUS data is significantly challenged by respiratory motion artifacts that disrupt spatial consistency and the inherent fuzziness of lesion boundaries. Existing methods generally use a single-modal signal, i.e., the fundamental or harmonic signal, in the data, failing to leverage the complementary information from multimodal signals. In this work, we developed a bimodal deep learning network for fusing the bimodal features. The model synergistically fuses fundamental and harmonic signals by integrating residual learning and depth-wise separable convolution (DSCNN). The fundamental signal provides anatomical structural details, while the harmonic signal captures dynamic perfusion profiles. Identification of focal liver lesions (FLLs) was performed with a group of CEUS images. The pixel-level fusion strategy effectively enhanced signal resolution and robustness against motion interference, enabling the proposed model to outperform the established models, such as standard U-Net, fully convolutional network (FCN) and Attention U-Net. This work may provide a powerful tool for rapid and accurate FLL identification, offering a technique for processing multimodal signals.
| [1] |
Wan P, Chen F, Liu C R, Kong W T, Zhang D QIEEE Trans. Med. Imaging, 2021, 401646.
|
| [2] |
Chen C, Wang Y, Niu J W, Liu X F, Li Q F, Gong X TIEEE Trans. Med. Imaging, 2021, 402439.
|
| [3] |
de Senneville B D, Novell A, Arthuis C, Mendes V, Dujardin P A, Patat F, Bouakaz A, Escoffre J M, Perrotin FIEEE Trans. Med. Imaging, 2017, 37372.
|
| [4] |
Ansari M Y, Yang Y, Meher P K, Dakua S PComput. Biol. Med., 2023, 153106478.
|
| [5] |
Gu Z W, Cheng J, Fu H Z, Zhou K, Hao H Y, Zhao Y T, Zhang T Y, Gao S H, Liu JIEEE Trans. Med. Imaging, 2019, 382281.
|
| [6] |
Li H M, Fang J H, Liu S F, Liang X W, Yang X, Mai Z X, Van M T, Wang T F, Chen Z Y, Ni DIEEE J. Biomed. Health, 2020, 24974.
|
| [7] |
Turco S, Tiyarattanachai T, Ebrahimkheil K, Eisenbrey J, Kamaya A, Mischi M, Lyshchik A, Kaffas A EIEEE Trans. Ultrason. Ferroelectr. Freq. Control., 2022, 691670.
|
| [8] |
Jiang X Y, Hu Z J, Wang S H, Zhang Y DCancers, 2023, 153608.
|
| [9] |
Attallah O, Pacal IChemometr. Intell. Lab., 2026, 269105609.
|
| [10] |
Chen C, Gu Y J, Xiao Z B, Wang H L, He X L, Jiang Z L, Kong Y, Liu C, Xue L, Vargas J, Wang SAnal. Chim. Acta, 2022, 1229340401.
|
| [11] |
Bengio Y, Lecun Y, Hinton GCommun. Acm., 2021, 6458.
|
| [12] |
Satushe V, Vyas V, Metkar S, Singh P DChemometr. Intell. Lab., 2025, 263105414.
|
| [13] |
Alzubaidi L, Zhang J L, Humaidi AJ, Al-Dujaili A, Duan Y, Al-Shamma O, Santamaría J, Fadhel M A, Al-Amidie M, Farhan LJ. Big. Data, 2021, 853.
|
| [14] |
Ronneberger O, Fischer P, Brox TInternational Conference on Medical Image Computing and Computer-assisted Intervention (MICCAI), 2015
|
| [15] |
Isensee F, Jaeger P F, Kohl S A A, Petersen J, Maier-Hein K HNat. Methods, 2021, 18203.
|
| [16] |
Chen X, Mumme R P, Corrigan K L, Mukai-Sasaki Y, Koutroumpakis E, Palaskas N L, Nguyen C M, Zhao Y, Huang K, Yu C J, Xu T, Daniel A, Balter P A, Zhang X D, Niedzielski J S, Shete S S, Deswal A, Court L E, Liao Z X, Yang J ZRadiother. Oncol., 2024, 191110061.
|
| [17] |
Bird D, Speight R, Andersson S, Wingqvist J, Al-Qaisieh BRadiother. Oncol., 2023, 191110052.
|
| [18] |
Li M D, Hu H T, Ruan S M, Cheng M Q, Chen L D, Huang Z R, Li W, Lin P, Yang H, Kuang M, Li M D, Huang Q H, Wang WIEEE Trans. Image. Process, 2024, 3358.
|
| [19] |
Feng X F, Cai W J, Zheng R Q, Tang L, Zhou J H, Wang H, Liao J T, Luo B M, Cheng W, Wei A, Zhao W A, Jing X, Liang P, Yu J, Huang Q HEng. Appl. Artif. Intel., 2023, 118105635.
|
| [20] |
Ansari M Y, Changaai Mangalote I A, Meher P K, Aboumarzouk O, Al-Ansari A, Halabi O, Dakua S PIEEE Trans. Emerging. Top. Comput. Intell., 2024, 82126.
|
| [21] |
Ramachandram D, Taylor G WIEEE Signal. Process. Mag., 2017, 3496.
|
| [22] |
Wu N, Wong K Y, Yu X, Zhao J W, Zhang X Y, Wang J H, Yang TAnal. Chem., 2024, 9610046.
|
| [23] |
Ruan J, Xu X, Cai Y, Zeng H, Luo M, Zhang W, Liu R, Lin P, Xu Y, Ye Q, Ou B, Luo BRadiology, 2023, 305149.
|
| [24] |
Liu D, Liu F, Xie X Y, Su L Y, Liu M, Xie X H, Kuang M, Huang G L, Wang Y Q, Zhou H, Wang K, Lin M X, Tian JEur. Radiol., 2020, 302365.
|
| [25] |
Zhao Q X, He X L, Wang K, Cheng Z G, Han Z Y, Liu F Y, Yu X L, Hui Z, Yu J, Chao A, Liang PEur. Radiol., 2023, 331895.
|
| [26] |
Huang J Z, Xie X H, Wu H, Zhang X E, Zheng Y L, Xie X Y, Wang Y, Xu MEur. Radiol., 2022, 327965.
|
| [27] |
Xia K J, Yin H S, Wang J QCluster. Comput., 2019, 221515.
|
| [28] |
Weston A D, Korfiatis P, Kline T L, Philbrick K A, Kostandy P, Sakinis T, Sugimoto M, Takahashi N, Erickson B JRadiology, 2018, 290669.
|
| [29] |
Seo H, Huang C, Bassenne M, Xiao R X, Xing LIEEE Trans. Med. Imaging, 2020, 391316.
|
| [30] |
Arora R, Raman B, Nayyar K, Awasthi RBiomed. Signal Process. Control, 2021, 65102358.
|
| [31] |
Chanchal A K, Kumar A, Lal S, Kini JComput. Electr. Eng., 2021, 92107177.
|
| [32] |
Yun J T, Jiang D, Liu Y, Sun Y, Tao B, Kong J Y, Tian J R, Tong X L, Xu M M, Fang Z FFront. Bioeng. Biotechnol., 2022, 10861286.
|
| [33] |
Ali Y, Janabi-Sharifi F, Beheshti SBiomed. Signal. Process Control, 2021, 64102248.
|
| [34] |
He F X, Liu T L, Tao D CNeural Networks Learn Syst., 2020, 315349.
|
| [35] |
Cheng J L, Tian S W, Yu L, Gao C R, Kang X J, Ma X, Wu W D, Liu S J, Lu H CMed. Image. Anal., 2022, 76102313.
|
| [36] |
Wan P, Chen F, Zhu X W, Liu C R, Zhang Y D, Kong W T, Zhang D QIEEE 17th International Symposium on Biomedical Imaging (ISBI), 2020
|
| [37] |
Chen G P, Li L, Dai Y, Zhang J X, Yap M HIEEE Trans. Med. Imaging, 2023, 421289.
|
| [38] |
Zhao X M, Wu Y H, Song G D, Li Z Y, Zhang Y Z, Fan YMed. Image. Anal., 2018, 4398.
|
Rights & permissions
Jilin University, The Editorial Department of Chemical Research in Chinese Universities and Springer-Verlag GmbH
PDF
