DropletMask: Leveraging visual data for droplet impact analysis

Abstract

Machine learning-assisted computer vision represents a state-of-the-art technique for extracting meaningful features from visual data autonomously. This approach facilitates the quantitative analysis of images, enabling object detection and tracking. In this study, we utilize advanced computer vision to precisely identify droplet motions and quantify their impact forces with spatiotemporal resolution at the picoliter or millisecond scale. Droplets, captured by a high-speed camera, are denoised through neuromorphic image processing. These processed images are employed to train convolutional neural networks, allowing the creation of segmented masks and bounding boxes around moving droplets. The trained networks further digitize time-varying multi-dimensional droplet features, such as droplet diameters, spreading and sliding motions, and corresponding impact forces. Our innovative method offers accurate measurement of small impact forces with a resolution of approximately 10 piconewtons for droplets in the micrometer range across various configurations with the time resolution at hundreds ofmicroseconds.

References

[1] Cook SS. Erosion by water-hammer. Proc R Soc Lond A Math Phys Eng Sci. 1928;119:481-488.

[2] Ahmad M, Schatz MCMV, Casey MV. Experimental investigation of droplet size influence on low pressure steam turbine blade erosion. Wear. 2013;303:83-86.

[3] Sharma PP, Gupta SC. Sand detachment by single raindrops of varying kinetic energy and momentum. Soil Sci Soc Am J. 1989;53:1005-1010.

[4] Wang L, Song Y, Xu W, et al. Harvesting energy from high-frequency impinging water droplets by a droplet-based electricity generator. EcoMat. 2021;3:e12116.

[5] Kannan R, Vaikuntanathan V, Sivakumar D. Dynamic contact angle beating from drops impacting onto solid surfaces exhibiting anisotropic wetting. Colloids Surf A Physicochem Eng Asp. 2011;386:36-44.

[6] Chhasatia VH, Sun Y. Interaction of bi-dispersed particles with contact line in an evaporating colloidal drop. Soft Matter. 2011;7:10135-10143.

[7] Li X, Zhang L, Feng Y, et al. Visualization of charge dynamics when water droplets bounce on a hydrophobic surface. ACS Nano. 2023;17:23977-23988.

[8] Regtien PPL. Sensors for Mechatronics. Elsevier;2012.

[9] Pruppacher HR, Pitter RL. A semi-empirical determination of the shape of cloud and rain drops. J Atmos Sci. 1971;28:86-94.

[10] Nearing MA, Bradford JM, Holtz RD. Measurement of force vs. time relations for waterdrop impact. Soil Sci Soc Am J. 1986;50:1532-1536.

[11] Li J, Zhang B, Guo P, Lv Q. Impact force of a low speed water droplet colliding on a solid surface. J Appl Phys. 2014;116:214903.

[12] Zhang B, Li J, Guo P, Lv Q. Experimental studies on the effect of Reynolds and Weber numbers on the impact force of low-speed droplets colliding with a solid surface. Exp Fluids. 2017;58:125.

[13] Grinspan AS, Gnanamoorthy R. Impact force of low velocity liquid droplets measured using piezoelectric PVDF film. Colloids Surf A Physicochem Eng Asp. 2010;356:162-168.

[14] Mitchell BR, Bate TE, Klewicki JC, Korkolis YP, Kinsey BL. Experimental investigation of droplet impact on metal surfaces in reduced ambient pressure. Proc Manuf. 2017;10:730-736.

[15] Haller KK, Ventikos Y, Poulikakos D. Wave structure in the contact line region during high speed droplet impact on a surface: solution of the Riemann problem for the stiffened gas equation of state. J Appl Phys. 2003;93:3090-3097.

[16] Haller KK, Ventikos Y, Poulikakos D. Computational study of high-speed liquid droplet impact. J Appl Phys. 2002;92:2821-2828.

[17] Chang K-H. Design Theory and Methods Using CAD/CAE: The Computer Aided Engineering Design Series. Academic Press;2014.

[18] Abo El-Nasr AA. Evaluation of damping behavior of spray deposited SiC particulates reinforced Al composites. In: MF Hassan, SM Megahed, eds. Current Advances in Mechanical Design and Production VII. Pergamon;2000:407-414.

[19] Wang H, Jasim A. 14-Piezoelectric energy harvesting from pavement. In: F Pacheco-Torgal, et al., eds. Eco-Efficient Pavement Construction Materials. Woodhead Publishing;2020:367-382.

[20] Troughton MJ. Handbook of Plastics Joining: A Practical Guide. William Andrew;2008.

[21] Delrio FW, Carraro C, Maboudian R. 33-Small-scale surface engineering problems. In: H Rahnejat, ed. Tribology and Dynamics of Engine and Powertrain. Woodhead Publishing;2010:960-989.

[22] Chen H, Zhang X, Garcia BD, et al. Drop impact onto a cantilever beam: behavior of the lamella and force measurement. Interfacial Phenom Heat Transfer. 2019;7:85-96.

[23] Viola F. Comparison among different rainfall energy harvesting structures. Appl Sci. 2018;8:955.

[24] Hao G, Dong X, Li Z, Liu X. Water drops impact on a PVDF cantilever: droplet dynamics and voltage output. J Adhes Sci Technol. 2021;35:485-503.

[25] Jellard SCJ, Pu SH, Chen S, Yao K, White NM. Water droplet impact energy harvesting with P(VDF-TrFE) piezoelectric cantilevers on stainless steel substrates. Smart Mater Struct. 2019;28:095002.

[26] Gart S, Mates JE, Megaridis CM, Jung S. Droplet impacting a cantilever: a leaf-raindrop system. Phys Rev Appl. 2015;3:044019.

[27] Dong X, Huang X, Liu J. Modeling and simulation of droplet impact on elastic beams based on SPH. Eur J Mech A Solids. 2019;75:237-257.

[28] Zhang R, Zhang B, Lv Q, Li J, Guo P. Effects of droplet shape on impact force of low-speed droplets colliding with solid surface. Exp Fluids. 2019;60:64.

[29] Jayawardena AW, Rezaur RB. Measuring drop size distribution and kinetic energy of rainfall using a force transducer. Hydrol Process. 2000;14:37-49.

[30] Mitchell BR, Klewicki JC, Korkolis YP, Kinsey BL. The transient force profile of low-speed droplet impact: measurements and model. J Fluid Mech. 2019;867:300-322.

[31] Canny J. A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell. 1986;PAMI-8:679-698.

[32] Lim JS. Two-Dimensional Signal and Image Processing. Prentice-Hall, Inc.;1990:478-488.

[33] Chow CK, Kaneko T. Boundary detection of radiographic images by a threshold method. In: S Watanabe, ed. Frontiers of Pattern Recognition. Academic Press;1972:61-82.

[34] Espindola GM, Camara G, Reis IA, Bins LS, Monteiro AM. Parameter selection for region-growing image segmentation algorithms using spatial autocorrelation. Int J Remote Sens. 2006;27:3035-3040.

[35] Li N, Huo H, Zhao Y-M, Chen X, Fang T. A spatial clustering method with edge weighting for image segmentation. IEEE Geosci Remote Sens Lett. 2013;10:1124-1128.

[36] Suh Y, Chandramowlishwaran A, Won Y. Recent progress of artificial intelligence for liquid-vapor phase change heat transfer. npj Comput Mater. 2024;10:65.

[37] Visin F, Romero A, Cho K, et al. Reseg: a recurrent neural network-based model for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA, 2016:426-433.

[38] He K, Gkioxari G, Dollár P, Girshick R, Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 2017:2980-2988.

[39] Delbruck T, Hu Y, He Z. V2E: from video frames to realistic DVS event camera streams. arXiv. Submitted June 13, 2020. Accessed March 1, 2022. https://arxiv.org/abs/2006

[40] Cadena PRG, Qian Y, Wang C, Yang M. SPADE-E2VID: spatially-adaptive denormalization for event-based video reconstruction. IEEE Trans Image Process. 2021;30:2488-2500.

[41] Scheerlinck C, Rebecq H, Gehrig D, Barnes N, Mahony R, Scaramuzza D. Fast image reconstruction with an event camera. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Snowmass, CO, USA, 2020:156-163.

[42] Suh Y, Lee J, Simadiris P, et al. A deep learning perspective on dropwise condensation. Adv Sci. 2021;8:2101794.

[43] Suh Y, Bostanabad R, Won Y. Deep learning predicts boiling heat transfer. Sci Rep. 2021;11:5622.

[44] Suh Y, Chang S, Simadiris P, et al. VISION-iT: a framework for digitizing bubbles and droplets. Energy AI. 2023;15:100309.

[45] Zhao C, Montazeri K, Shao B, Won Y. Mapping between surface wettability, droplets, and their impacting behaviors. Langmuir. 2021;37:9964-9972.

[46] Philippi J, Lagrée PY, Antkowiak A. Drop impact on a solid surface: short-time self-similarity. J Fluid Mech. 2016;795:96-135.

[47] Lichtensteiner P, Posch C, Delbruck T. A 128×128 120 dB 15μs latency asynchronous temporal contrast vision sensor. IEEE J Solid-State Circuits. 2008;43:566-576.

[48] Lu D, Suh Y, Won Y. Rapid identification of boiling crisis with event-based visual streaming analysis. Appl Therm Eng. 2024;239:122004.

[49] Nozaki Y, Delbruck T. Temperature and parasitic photocurrent effects in dynamic vision sensors. IEEE Trans Electron Devices. 2017;64:3239-3245.

RIGHTS & PERMISSIONS

2024 2024 The Author(s). Droplet published by Jilin University and John Wiley & Sons Australia, Ltd.