A Versatile Near-Infrared Fluorescent Probe for Fast Assessment of Lysosomal Status via a Large Multimodal Model

Abstract

Lysosomes are essential organelles for cells that act as the “recycling center” for decomposing biomolecules and clearing out damaged organelles. The status of lysosomes is tightly regulated by cells to maintain normal homeostasis. To monitor subcellular lysosomal status, super-resolution imaging has emerged as a promising technology that surpasses conventional imaging limitations, offering extraordinary visualization capability. However, existing fluorescent probes for super-resolution imaging still suffer from significant drawbacks, such as complex synthesis, poor intracellular stability, and the lack of near-infrared (NIR) imaging capability. Besides, to quantitatively analyze fluorescence images, traditional human-driven image interpretation is time-consuming and prone to information loss and human error. To tackle these challenges, we first developed a quinolinium-based fluorescent probe, PA-2, for NIR super-resolution imaging of lysosomes with low cytotoxicity and stable fluorescence. Harnessing PA-2's strong resistance to photobleaching, the lysosomal dynamic statuses, encompassing autophagy, mitochondria-lysosome contacts, and mitophagy, were successfully visualized. Building on this, we next demonstrate a novel approach leveraging a large multimodal model (LMM), an advanced artificial intelligence (AI) tool, for automated analysis of super-resolution images. The LMM accurately interprets images of PA-2 and predicts lysosomal status under various drug treatments with remarkable speed, precision, and explainability, significantly outperforming human experts in image analysis. To sum up, this work highlights the strong potential of combining advanced fluorescent probe design with AI-assisted image interpretation to drive revolutionary innovation in bioimaging and beyond.

Keywords

fluorescent probe / large multimodal model / lysosomal status / nanoaggregates / super-resolution imaging

References

[1] J. P. Luzio, P. R. Pryor, and N. A. Bright, “Lysosomes: Fusion and Function,” Nature Reviews Molecular Cell Biology 8 (2007): 622-632.

[2] C. De Duve and R. Wattiaux, “Functions of Lysosomes,” Annual Review of Physiology 28 (1966): 435-492.

[3] H. Xu and D. Ren, “Lysosomal Physiology,” Annual Review of Physiology 77 (2015): 57-80.

[4] Q. Chen, M. Hao, L. Wang, et al., “Prefused Lysosomes Cluster on Autophagosomes Regulated by VAMP8,” Cell Death & Disease 12 (2021): 939.

[5] R. Chen, L. Wang, G. Ding, et al., “Constant Conversion Rate of Endolysosomes Revealed by a pH-Sensitive Fluorescent Probe,” ACS Sensors 8 (2023): 2068-2078.

[6] F. R. Maxfield, “Role of Endosomes and Lysosomes in Human Disease,” Cold Spring Harbor Perspectives in Biology 6 (2014): a016931.

[7] R. A. Nixon, “Endosome Function and Dysfunction in Alzheimer's Disease and Other Neurodegenerative Diseases,” Neurobiology of Aging 26 (2005): 373-382.

[8] Q. Yang and Z. Mao, “Dysregulation of Autophagy and Parkinson's Disease: The MEF2D Link,” Apoptosis 15 (2010): 1410-1414.

[9] A. Picca, J. Faitg, J. Auwerx, L. Ferrucci, and D. D'Amico, “Mitophagy in Human Health, Ageing and Disease,” Nature Metabolism 5 (2023): 2047-2061.

[10] Q. Chen, X. Shao, Z. Tian, et al., “Nanoscale Monitoring of Mitochondria and Lysosome Interactions for Drug Screening and Discovery,” Nano Research 12 (2019): 1009-1015.

[11] Y. C. Wong, D. Ysselstein, and D. Krainc, “Mitochondria-Lysosome Contacts Regulate Mitochondrial Fission via RAB7 GTP Hydrolysis,” Nature 554 (2018): 382-386.

[12] R. A. Nixon, “The Role of Autophagy in Neurodegenerative Disease,” Nature Medicine 19 (2013): 983-997.

[13] B. Levine, “Autophagy and Cancer,” Nature 446 (2007): 745-747.

[14] C. P. Satori, M. M. Henderson, E. A. Krautkramer, V. Kostal, M. M. Distefano, and E. A. Arriaga, “Bioanalysis of Eukaryotic Organelles,” Chemical Reviews 113 (2013): 2733-2811.

[15] X. Xu, K. Qiu, Z. Tian, et al., “Probing the Dynamic Crosstalk of Lysosomes and Mitochondria With Structured Illumination Microscopy,” Trac Trends in Analytical Chemistry 169 (2023): 117370.

[16] S. Liu, P. Hoess, and J. Ries, “Super-Resolution Microscopy for Structural Cell Biology,” Annual Review of Biophysics 51 (2022): 301-326.

[17] C. Zhang, Z. Tian, R. Chen, et al., “Advanced Imaging Techniques for Tracking Drug Dynamics at the Subcellular Level,” Advanced Drug Delivery Reviews 199 (2023): 114978.

[18] L. Wang, M. S. Frei, A. Salim, and K. Johnsson, “Small-Molecule Fluorescent Probes for Live-Cell Super-Resolution Microscopy,” Journal of the American Chemical Society 141 (2019): 2770-2781.

[19] Q. Qiao, W. Liu, W. Chi, et al., “Modulation of Dynamic Aggregation in Fluorogenic SNAP-Tag Probes for Long-Term Super-Resolution Imaging,” Aggregate 4 (2023): e258.

[20] A. T. Krasley, E. Li, J. M. Galeana, C. Bulumulla, A. G. Beyene, and G. S. Demirer, “Carbon Nanomaterial Fluorescent Probes and Their Biological Applications,” Chemical Reviews 124 (2024): 3085-3185.

[21] Z. Zhu, C. Liu, X.-M. Song, Q. Mao, and T. Ma, “Carbon Dots as an Indicator of Acid-Base Titration and a Fluorescent Probe for Endoplasm Reticulum Imaging,” ACS Applied Bio Materials 4 (2021): 3623-3629.

[22] K. Qiu, Y. Chen, T. W. Rees, L. Ji, and H. Chao, “Organelle-Targeting Metal Complexes: From Molecular Design to Bio-Applications,” Coordination Chemistry Reviews 378 (2019): 66-86.

[23] K. Qiu, J. Wang, C. Song, et al., “Crossfire for Two-Photon Photodynamic Therapy With Fluorinated Ruthenium (II) Photosensitizers,” ACS Applied Materials & Interfaces 9 (2017): 18482-18492.

[24] X. Tian, L. C. Murfin, L. Wu, S. E. Lewis, and T. D. James, “Fluorescent Small Organic Probes for Biosensing,” Chemical Science 12 (2021): 3406-3426.

[25] J. Wang, J.-T. Yan, S.-T. Zeng, et al., “Revealing Mitochondrion-Lysosome Dynamic Interactions and pH Variations in Live Cells With a pH-Sensitive Fluorescent Probe,” Analytical Chemistry 95 (2023): 16609-16617.

[26] R. Tian, T. Guo, B. Yang, W. Qu, Z. Geng, and Z. Wang, “NIR Fluorescent Probe With Variable Lipophilicity for Imaging Lysosomal Copper During Cuproptosis in HCC Cells,” Dyes and Pigments 219 (2023): 111590.

[27] Q. Chen, H. Fang, X. Shao, et al., “A Dual-Labeling Probe to Track Functional Mitochondria-Lysosome Interactions in Live Cells,” Nature Communications 11 (2020): 6290.

[28] S. Yu, S. Wu, J. Zhang, et al., “A Single Dual-Targeting Fluorescent Probe Enables Exploration of the Correlation Between the Plasma Membrane and Lysosomes,” Journal of Materials Chemistry B 10 (2022): 582-588.

[29] M. Grossi, M. Morgunova, S. Cheung, et al., “Lysosome Triggered Near-Infrared Fluorescence Imaging of Cellular Trafficking Processes in Real Time,” Nature Communications 7 (2016): 10855.

[30] J. Zhang, S. Gong, Q. Li, S. Zhang, and G. Feng, “Lysosome-Targeted Polarity-Sensitive NIR Fluorescence Probe for Imaging Injured Lung and Liver in Diabetes,” Analytical Chemistry 96 (2024): 14053-14059.

[31] S. Cao, X. Tian, M. Cao, J. Wang, G. Niu, and B. Z. Tang, “Solvatochromic Near-Infrared Aggregation-Induced Emission-Active Acrylonitriles by Acceptor Modulation for Low-Power Stimulated Emission Depletion Nanoscopy,” Chemistry of Materials 35 (2023): 2472-2485.

[32] J. Liu, W. Zhang, C. Zhou, et al., “Precision Navigation of Hepatic Ischemia-Reperfusion Injury Guided by Lysosomal Viscosity-Activatable NIR-II Fluorescence,” Journal of the American Chemical Society 144 (2022): 13586-13599.

[33] K. Wang, R. Guo, X.-Y. Chen, Y.-S. Yang, L.-Q. Qiao, and M.-L. Wang, “Multifunctional Lysosome-Targetable Fluorescent Probe for Imaging Peroxynitrite in Acute Liver Injury Model,” Chemical Engineering Journal 455 (2023): 140491.

[34] Y. He, S. Wang, P. Yu, et al., “NIR-II Cell Endocytosis-Activated Fluorescent Probes for In Vivo High-Contrast Bioimaging Diagnostics,” Chemical Science 12 (2021): 10474-10482.

[35] A. Al Yassin, M. Salehi Sadaghiani, S. Mohan, R. N. Bryan, and I. Nasrallah, “It is About “Time”: Academic Neuroradiologist Time Distribution for Interpreting Brain MRIs,” Academic Radiology 25 (2018): 1521-1525.

[36] B. I. Reiner, N. Knight, and E. L. Siegel, “Radiology Reporting, Past, Present, and Future: The Radiologist's Perspective,” Journal of the American College of Radiology 4 (2007): 313-319.

[37] M. A. Bruno, E. A. Walker, and H. H. Abujudeh, “Understanding and Confronting Our Mistakes: The Epidemiology of Error in Radiology and Strategies for Error Reduction,” Radiographics 35 (2015): 1668-1676.

[38] A. J. E. Carter, K. A. Davis, L. V. Evans, and D. C. Cone, “Information Loss in Emergency Medical Services Handover of Trauma Patients,” Prehospital Emergency Care 13 (2009): 280-285.

[39] N. Clynch and J. Kellett, “Medical Documentation: Part of the Solution, or Part of the Problem? A Narrative Review of the Literature on the Time Spent on and Value of Medical Documentation,” International Journal of Medical Informatics 84 (2015): 221-228.

[40] Q. Li, J. Zhou, S. Jiang, Y. Fu, and M. Su, “Single-Cell Array Enhanced Cell Damage Recognition Using Artificial Intelligence for Anticancer Drug Discovery,” Analytical Chemistry 97 (2025): 4202-4208.

[41] J. Wang, C. Zhou, W. Wang, H. Zhang, A. Zhang, and D. Cui, “A Multimodal Deep Learning Model for Detecting Endoscopic Images of Near-Infrared Fluorescence Capsules,” Biosensors & Bioelectronics 278 (2025): 117251.

[42] V. M. Rao, M. Hla, M. Moor, et al., “Multimodal Generative AI for Medical Image Interpretation,” Nature 639 (2025): 888-896.

[43] M. Moor, O. Banerjee, Z. S. H. Abad, et al., “Foundation Models for Generalist Medical Artificial Intelligence,” Nature 616 (2023): 259-265.

[44] X. Yue, Y. Ni, K. Zhang, et al., “MMMU: A Massive Multi-Discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI,” in 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE, 2023), 9556-9567.

[45] R. Chen, K. Qiu, D. C. Y. Leong, et al., “A General Design of Pyridinium-Based Fluorescent Probes for Enhancing Two-Photon Microscopy,” Biosensors & Bioelectronics 239 (2023): 115604.

[46] J. Heo, D. P. Murale, H. Y. Yoon, et al., “Recent Trends in Molecular Aggregates: An Exploration of Biomedicine,” Aggregate 3 (2022): e159.

[47] D. Wang, H. Su, R. T. K. Kwok, et al., “Rational Design of a Water-Soluble NIR AIEgen, and Its Application in Ultrafast Wash-Free Cellular Imaging and Photodynamic Cancer Cell Ablation,” Chemical Science 9 (2018): 3685-3693.

[48] H. Shen, L. Du, C. Xu, et al., “A Near-Infrared-II Excitable Pyridinium Probe With 1000-Fold ON/OFF Ratio for γ-Glutamyltranspeptidase and Cancer Detection,” ACS Nano 18 (2024): 20268-20282.

[49] R. Chen, K. Qiu, G. Han, et al., “Quantifying Cell Viability Through Organelle Ratiometric Probing,” Chemical Science 14 (2023): 10236-10248.

[50] D. Wang, M. M. S. Lee, G. Shan, et al., “Highly Efficient Photosensitizers With Far-Red/Near-Infrared Aggregation-Induced Emission for In Vitro and In Vivo Cancer Theranostics,” Advanced Materials 30 (2018): 1802105.

[51] C. Xiang, Y. Liu, Q. Ding, et al., “Precise Molecular Engineering of Multi-Suborganelle Targeted NIR Type‑I AIE Photosensitizer and Design of Cell Membrane-Anchored Anti-Tumor Pyroptosis Vaccine,” Advanced Functional Materials 35 (2024): 2417979.

[52] R. Wang, L. Diao, J. Zhang, Z. Chen, and S. Pu, “Aggregation-Induced Emission Compounds Based on 9,10-Dithienylanthracene and Their Applications in Cell Imaging,” Dyes and Pigments 175 (2020): 108112.

[53] J. He, B. Xu, F. Chen, et al., “Aggregation-Induced Emission in the Crystals of 9,10-Distyrylanthracene Derivatives: The Essential Role of Restricted Intramolecular Torsion,” Journal of Physical Chemistry C 113 (2009): 9892-9899.

[54] X. Zhang, Z. Chi, B. Xu, et al., “Multifunctional Organic Fluorescent Materials Derived From 9,10-Distyrylanthracene With Alkoxyl Endgroups of Various Lengths,” Chemical Communications 48 (2012): 10895.

[55] J. Ge, W. Cai, N. Niu, et al., “Viscosity-Responsive NIR-II Fluorescent Probe With Aggregation-Induced Emission Features for Early Diagnosis of Liver Injury,” Biomaterials 300 (2023): 122190.

[56] X. Zhao, C. Ji, L. Ma, Z. Wu, W. Cheng, and M. Yin, “An Aggregation-Induced Emission-Based “Turn-On” Fluorescent Probe for Facile Detection of Gaseous Formaldehyde,” ACS Sensors 3 (2018): 2112-2117.

[57] J. Mei, N. L. C. Leung, R. T. K. Kwok, J. W. Y. Lam, and B. Z. Tang, “Aggregation-Induced Emission: Together We Shine, United We Soar!” Chemical Reviews 115 (2015): 11718-11940.

[58] Q. Peng and Z. Shuai, “Molecular Mechanism of Aggregation-Induced Emission,” Aggregate 2 (2021): e91.

[59] X.-Z. Yang, H. Fang, S. Li, et al., “Aggregation-Based Dual-Target Probe for Dual-Colour Super-Resolution Monitoring Mitophagy and Evaluating Drugs Regulating Mitochondria,” Aggregate 6 (2025): e641.

[60] H. Fang, S. Yao, Q. Chen, et al., “De Novo-Designed Near-Infrared Nanoaggregates for Super-Resolution Monitoring of Lysosomes in Cells, in Whole Organoids, and In Vivo,” ACS Nano 13 (2019): 14426-14436.

[61] L. Wang, R. Chen, G. Han, et al., “Super-Resolution Analyzing Spatial Organization of Lysosomes With an Organic Fluorescent Probe,” Exploration 2 (2022): 20210215.

[62] J. R. Casey, S. Grinstein, and J. Orlowski, “Sensors and Regulators of Intracellular pH,” Nature Reviews Molecular Cell Biology 11 (2010): 50-61.

[63] J. Lin, X. Cai, F. Zou, et al., “Fluorescent Nanoparticles Achieve Efficient Photothermal Conversion and Enhanced Antitumor Efficacy Through Intermolecular Aggregation-Caused Quenching,” Aggregate 6 (2025): e723.

[64] J. Lin, H. Yang, Y. Zhang, et al., “Ferrocene-Based Polymeric Nanoparticles Carrying Doxorubicin for Oncotherapeutic Combination of Chemotherapy and Ferroptosis,” Small 19 (2023): 2205024.

[65] K. Qiu, A. Yadav, Z. Tian, et al., “Ultralong-Term Super-Resolution Tracking of Lysosomes in Brain Organoids by Near-Infrared Noble Metal Nanoclusters,” ACS Materials Letters 4 (2022): 1565-1573.

[66] B. K. Kundu Pragti, R. Chen, J. Diao, and Y. Sun, “Near-Infrared Bioimaging Using Two-Photon Fluorescent Probes,” Advanced Healthcare Materials 14 (2025): 2403272.

[67] Q. Chen, X. Shao, M. Hao, et al., “Quantitative Analysis of Interactive Behavior of Mitochondria and Lysosomes Using Structured Illumination Microscopy,” Biomaterials 250 (2020): 120059.

[68] H. Riezman, P. G. Woodman, G. van Meer, and M. Marsh, “Molecular Mechanisms of Endocytosis,” Cell 91 (1997): 731-738.

[69] J. Mosquera, I. García, and L. M. Liz-Marzán, “Cellular Uptake of Nanoparticles Versus Small Molecules: A Matter of Size,” Accounts of Chemical Research 51 (2018): 2305-2313.

[70] E.-L. Punnonen, K. Ryhänen, and V. S. Marjomi, “At Reduced Temperature, Endocytic Membrane Traffic Is Blocked in Multivesicular Carrier Endosomes in Rat Cardiac Myocytes,” European Journal of Cell Biology 75 (1998): 344-352.

[71] K. Qiu, H. Huang, B. Liu, et al., “Mitochondria-Specific Imaging and Tracking in Living Cells With Two-Photon Phosphorescent Iridium(iii) Complexes,” Journal of Materials Chemistry B 3 (2015): 6690-6697.

[72] M. Mauthe, I. Orhon, C. Rocchi, et al., “Chloroquine Inhibits Autophagic Flux by Decreasing Autophagosome-Lysosome Fusion,” Autophagy 14 (2018): 1435-1455.

[73] P. D. Hart and M. R. Young, “Ammonium Chloride, an Inhibitor of Phagosome-Lysosome Fusion in Macrophages, Concurrently Induces Phagosome-Endosome Fusion, and Opens a Novel Pathway: Studies of a Pathogenic Mycobacterium and a Nonpathogenic Yeast,” Journal of Experimental Medicine 174 (1991): 881-889.

[74] J. D. Rabinowitz and E. White, “Autophagy and Metabolism,” Science 330 (2010): 1344-1348.

[75] D. C. Rubinsztein, G. Mariño, and G. Kroemer, “Autophagy and Aging,” Cell 146 (2011): 682-695.

[76] N. Mizushima, “Methods for Monitoring Autophagy,” International Journal of Biochemistry & Cell Biology 36 (2004): 2491-2502.

[77] Y. C. Wong, S. Kim, W. Peng, and D. Krainc, “Regulation and Function of Mitochondria-Lysosome Membrane Contact Sites in Cellular Homeostasis,” Trends in Cell Biology 29 (2019): 500-513.

[78] W. Brian, C.-G. Aline, G. Stefan, and R. S. Nina, “Artificial Intelligence (AI) and Global Health: How Can AI Contribute to Health in Resource-Poor Settings?” BMJ Global Health 3 (2018): e000798.

[79] M. A. Ganaie, M. Hu, A. K. Malik, M. Tanveer, and P. N. Suganthan, “Ensemble Deep Learning: A Review,” Engineering Applications of Artificial Intelligence 115 (2022): 105151.

[80] C. Shu, Y. Zhu, X. Tang, et al., “MITER: Medical Image-TExt Joint Adaptive pretRaining With Multi-Level Contrastive Learning,” Expert Systems With Applications 238 (2024): 121526.

[81] I. J. Cheetham-Wilkinson, B. Sivalingam, C. Flitton, et al., “RpH-ILV: Probe for Lysosomal pH and Acute LLOMe-Induced Membrane Permeabilization in Cell Lines and Drosophila,” Science Advances 11 (2025): eadr7325.

[82] P. Gahlot, B. Kravic, G. Rota, et al., “Lysosomal Damage Sensing and Lysophagy Initiation by SPG20-ITCH,” Molecular Cell 84 (2024): 1556-1569.

[83] X. Zhai, B. Mustafa, A. Kolesnikov, and L. Beyer, “Sigmoid Loss for Language Image Pre-Training,” in 2023 IEEE/CVF International Conference on Computer Vision (ICCV) (IEEE, 2023), 11941-11952.

[84] H. Fang, L. Hu, Q. Chen, et al., “An ER-Targeted “Reserve-Release” Fluorogen for Topological Quantification of Reticulophagy,” Biomaterials 292 (2023): 121929.

[85] I. D. Raji and J. Buolamwini, “Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products,” in Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society (Association for Computing Machinery, 2019), 429-435.

[86] C. Rastogi, M. T. Ribeiro, N. King, H. Nori, and S. Amershi, “Supporting Human-AI Collaboration in Auditing LLMs With LLMs,” in Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society (Association for Computing Machinery, 2023), 913-926.

RIGHTS & PERMISSIONS

2025 The Author(s). Aggregate published by SCUT, AIEI, and John Wiley & Sons Australia, Ltd.