Recent progress in flexible piezoelectric devices toward human-machine interactions

Abstract

Human-machine interactions are becoming increasingly required for intelligent sensing and effective manipulation. Recent developments in flexible piezoelectric sensors with short response time and high force-electric interconversion efficiency present a tendency toward facilitating diverse human-machine interactive applications. Here, we review the development of flexible piezoelectric human-machine interactions in the context of robotic control, the Internet of Things, sports coaching and acoustic therapeutics. The synthesis of unique materials, the distinct design of device structures, the typical applications of piezoelectric human-machine interactions and the integration of cutting-edge technologies are elaborated in detail based on recent research. Finally, we highlight the current challenges and directions for the development of piezoelectric human-machine interactions for more advanced application scenarios.

Keywords

Piezoelectric devices / human-machine interactions / wearable devices / flexible electronics

References

[1] Zhu M,Lee C.Technologies toward next generation human machine interfaces: From machine learning enhanced tactile sensing to neuromorphic sensory systems.Appl Phys Rev2020;7:031305

[2] Cao X,Sun J,Sun Q.Piezoelectric nanogenerators derived self-powered sensors for multifunctional applications and Artificial Intelligence.Adv Funct Mater2021;31:2102983

[3] Hua Q,Ji K,Hu W.Piezotronics enabled artificial intelligence systems.J Phys Mater2021;4:022003

[4] Yin R,Zhao S,Shen G.Wearable sensors-enabled human machine interaction systems: from design to application.Adv Funct Mater2021;31:2008936

[5] Araromi OA,Dorsey KL.Ultra-sensitive and resilient compliant strain gauges for soft machines.Nature2020;587:219-24

[6] Lee S,Lee C.From flexible electronics technology in the era of IoT and artificial intelligence toward future implanted body sensor networks.APL Mater2019;7:031302

[7] Ma M,Liao Q.Self-powered artificial electronic skin for high-resolution pressure sensing.Nano Energy2017;32:389-96

[8] Yi Z,Li W.Piezoelectric dynamics of arterial pulse for wearable continuous blood pressure monitoring.Adv Mater2022;34:e2110291

[9] Zheng Q,Li Z.Recent progress on piezoelectric and triboelectric energy harvesters in biomedical systems.Adv Sci2017;4:1700029 PMCID:PMC5515112

[10] Park DY,Kim DH.Self-powered real-time arterial pulse monitoring using ultrathin epidermal piezoelectric sensors.Adv Mater2017;29:1702308

[11] Rao Z,Almasri A,Wu X.Soft electronics for the skin: from health monitors to human-machine interfaces.Adv Mater Technol2020;5:2000233

[12] Kim N,Moradnia M.Biocompatible composite thin-film wearable piezoelectric pressure sensor for monitoring of physiological and muscle motions.Soft Sci2022;2:8

[13] Patel S,Zhao M.Wearable electronics for skin wound monitoring and healing.Soft Sci2022;2:9

[14] Yan C,Jin L.Epidermis-inspired ultrathin 3D cellular sensor array for self-powered biomedical monitoring.ACS Appl Mater Interfaces2018;10:41070-5

[15] Ozioko O.Smart tactile gloves for haptic interaction, communication, and rehabilitation.Adv Intell Syst2022;4:2100091

[16] Gao C,Zhong T,Xing L.A self-powered intelligent glove for real-time human-machine gesture interaction based on piezoelectric effect of T-ZnO/PVDF film.J Phys D Appl Phys2022;55:194004

[17] Fuh YK.Near field sequentially electrospun three-dimensional piezoelectric fibers arrays for self-powered sensors of human gesture recognition.Nano Energy2016;30:677-83

[18] Deng C,Liu L,Li M.Self-powered insole plantar pressure mapping system.Adv Funct Mater2018;28:1801606

[19] Zhu M,He T.Self-powered and self-functional cotton sock using piezoelectric and triboelectric hybrid mechanism for healthcare and sports monitoring.ACS Nano2019;13:1940-52

[20] Deng W,Jin L.Cowpea-structured PVDF/ZnO nanofibers based flexible self-powered piezoelectric bending motion sensor towards remote control of gestures.Nano Energy2019;55:516-25

[21] Rao J,Zhao D,Wang X.Recent progress in self-powered skin sensors.Sensors2019;19:2763 PMCID:PMC6631024

[22] Chen Y,Zhang F,Sun X.Recent progress in self-powered multifunctional e-skin for advanced applications.Exploration2022;2:20210112

[23] Lee S,Lee Y.Ultrathin nanogenerators as self-powered/active skin sensors for tracking eye ball motion.Adv Funct Mater2014;24:1163-8

[24] Cha Y,Kim J.Human-computer interface glove using flexible piezoelectric sensors.Smart Mater Struct2017;26:057002

[25] Wen F,He T.Machine learning glove using self-powered conductive superhydrophobic triboelectric textile for gesture recognition in VR/AR applications.Adv Sci2020;7:2000261 PMCID:PMC7375248

[26] Wang C,Feng K.A self-power flexible piezoelectric sensing system for badminton training monitoring.IEICE Electron Expr2021;18:20210119-20210119

[27] Zhou P,Wang B.Self-powered flexible piezoelectric sensors based on self-assembled 10 nm BaTiO₃ nanocubes on glass fiber fabric.Nano Energy2022;99:107400

[28] Liu H,Li Y.An epidermal sEMG tattoo-like patch as a new human-machine interface for patients with loss of voice.Microsyst Nanoeng2020;6:16 PMCID:PMC8433406

[29] Reid T.Inclusion in human-machine interactions.Science2022;375:149-50

[30] Gao S,Kitsos V,Nathan A.User-oriented piezoelectric force sensing and artificial neural networks in interactive displays.IEEE J Electron Devices Soc2018;6:766-73

[31] Zhang H,Xiong D.Carrier concentration-dependent interface engineering for high-performance zinc oxide piezoelectric device.J Colloid Interface Sci2023;629:534-40

[32] Gao Y,Huang H.Microchannel-confined MXene based flexible piezoresistive multifunctional micro-force sensor.Adv Funct Mater2020;30:1909603

[33] Li J,Sun B.Recent progress in flexible and stretchable piezoresistive sensors and their applications.J Electrochem Soc2020;167:037561

[34] Li J,Sun B,Kang SH.Fingerprint-enhanced capacitive-piezoelectric flexible sensing skin to discriminate static and dynamic tactile stimuli.Adv Intell Syst2019;1:1900051

[35] Cotton DPJ,Lacour SP.A multifunctional capacitive sensor for stretchable electronic skins.IEEE Sensors J2009;9:2008-9

[36] Dong K,Wang ZL.Fiber/fabric-based piezoelectric and triboelectric nanogenerators for flexible/stretchable and wearable electronics and Artificial Intelligence.Adv Mater2020;32:e1902549

[37] Zhu J,Zhang M.Recent progress in flexible tactile sensor systems: from design to application.Soft Sci2021;1:3

[38] Zhang Z,Sun Z,He T.Artificial intelligence-enabled sensing technologies in the 5G/internet of things era: from virtual reality/augmented reality to the digital twin.Adv Intell Syst2022;4:2100228

[39] Wang W,Wang X.Ethanol sensing properties of porous ZnO spheres via hydrothermal route.J Mater Sci2013;48:3232-8

[40] Song K,Jin S.Pneumatic actuator and flexible piezoelectric sensor for soft virtual reality glove system.Sci Rep2019;9:8988 PMCID:PMC6639318

[41] Yu X,Yu Y.Skin-integrated wireless haptic interfaces for virtual and augmented reality.Nature2019;575:473-9

[42] Hwang G,Lee J.Self-powered deep brain stimulation via a flexible PIMNT energy harvester.Energy Environ Sci2015;8:2677-84

[43] Qiu Y,Sun S.Bioinspired, multifunctional dual-mode pressure sensors as electronic skin for decoding complex loading processes and human motions.Nano Energy2020;78:105337

[44] Meier M,Fender A.TapID: rapid touch interaction in virtual reality using wearable sensing.IEEE VR2021;519-528

[45] Lu Z,Jia C.A self-powered portable flexible sensor of monitoring speed skating techniques.Biosensors2021;11:108 PMCID:PMC8067624

[46] Han JH,Hong SK.Machine learning-based self-powered acoustic sensor for speaker recognition.Nano Energy2018;53:658-65

[47] Sun Z,Chen Z.Haptic-feedback ring enabled human-machine interface (HMI) aiming at immersive virtual reality experience. In 21st International Conference on Solid-State Sensors, Actuators and Microsystems (Transducers); 2021. pp. 333-6.

[48] Zhu G,Liu Y,Wang ZL.Functional electrical stimulation by nanogenerator with 58 V output voltage.Nano Lett2012;12:3086-90

[49] Charalambides A.Rapid manufacturing of mechanoreceptive skins for slip detection in robotic grasping.Adv Mater Technol2017;2:1600188

[50] Chhowalla M,Eda G,Loh KP.The chemistry of two-dimensional layered transition metal dichalcogenide nanosheets.Nat Chem2013;5:263-75

[51] Yang P,Hsu C.Tin disulfide piezoelectric nanogenerators for biomechanical energy harvesting and intelligent human-robot interface applications.Nano Energy2020;75:104879

[52] Ilyas MA.Piezoelectric energy harvesting from raindrop impacts.Energy2015;90:796-806

[53] Ahn JH,Heo H.Deterministic two-dimensional polymorphism growth of hexagonal n-type SnS₂ and orthorhombic p-type SnS crystals.Nano Lett2015;15:3703-8

[54] Lim S,Kim J.Transparent and stretchable interactive human machine interface based on patterned graphene heterostructures.Adv Funct Mater2015;25:375-83

[55] Lin W,Peng G,Hu H.Skin-inspired piezoelectric tactile sensor array with crosstalk-free row+column electrodes for spatiotemporally distinguishing diverse stimuli.Adv Sci2021;8:2002817 PMCID:PMC7856889

[56] Kim K,Choi J,Lee S.Depth camera-based 3D hand gesture controls with immersive tactile feedback for natural mid-air gesture interactions.Sensors2015;15:1022-46 PMCID:PMC4327062

[57] Heng W,Gao W.Flexible electronics and devices as human-machine interfaces for medical robotics.Adv Mater2022;34:e2107902 PMCID:PMC9035141

[58] Haroun A,Gao S.Progress in micro/nano sensors and nanoenergy for future AIoT-based smart home applications.Nano Express2021;2:022005

[59] Dong B,Yang Y,Zhang Z.Technology evolution from self-powered sensors to AIoT enabled smart homes.Nano Energy2021;79:105414

[60] Lee WH.Design and implementation of a smart traffic signal control system for smart city applications.Sensors2020;20:508 PMCID:PMC7014536

[61] Gao W,Nyein HYY.Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis.Nature2016;529:509-14 PMCID:PMC4996079

[62] Dai Y,Tian W,Gao S.A PVDF/Au/PEN multifunctional flexible human-machine interface for multidimensional sensing and energy harvesting for the internet of things.IEEE Sensors J2020;20:7556-68

[63] Song GJ,Kim K.Development of a pavement block piezoelectric energy harvester for self-powered walkway applications.Appl Energy2019;256:113916

[64] Kim JH,Jhun JP.Development of a hybrid type smart pen piezoelectric energy harvester for an IoT platform.Energy2021;222:119845

[65] Lv P,Yang C.Flexible all-inorganic Sm-doped PMN-PT film with ultrahigh piezoelectric coefficient for mechanical energy harvesting, motion sensing, and human-machine interaction.Nano Energy2022;97:107182

[66] Su Y,Yuan L.Piezoelectric fiber composites with polydopamine interfacial layer for self-powered wearable biomonitoring.Nano Energy2021;89:106321

[67] Kim K,Jabbar H.Optimized composite piezoelectric energy harvesting floor tile for smart home energy management.Energy Convers Manag2018;171:31-7

[68] Le X,Vachon P,Lee C.Piezoelectric MEMS-evolution from sensing technology to diversified applications in the 5G/Internet of Things (IoT) era.J Micromech Microeng2022;32:014005

[69] Liu L,Liu W.Recent progress in the energy harvesting technology-from self-powered sensors to self-sustained IoT, and new applications.Nanomaterials2021;11:2975

[70] Jordan MI.Machine learning: trends, perspectives, and prospects.Science2015;349:255-60

[71] Jian G,Meng Q,Wang F.3D BaTiO₃ flower based polymer composites exhibiting excellent piezoelectric energy harvesting properties.Adv Mater Interfaces2020;7:2000484

[72] Zhao C,Zhu Y.An effective self-powered piezoelectric sensor for monitoring basketball skills.Sensors2021;21:5144

[73] Liu W,Yang G.A self-powered wearable motion sensor for monitoring volleyball skill and building big sports data.Biosensors2022;12:60

[74] Tian G,Gao Y.Rich lamellar crystal baklava-structured PZT/PVDF piezoelectric sensor toward individual table tennis training.Nano Energy2019;59:574-81

[75] Yao D,Hensleigh R.Achieving the upper bound of piezoelectric response in tunable, wearable 3D printed nanocomposites.Adv Funct Mater2019;29:1903866

[76] Mao Y,Zhao T.A portable and flexible self-powered multifunctional sensor for real-time monitoring in swimming.Biosensors2021;11:147 PMCID:PMC8151083

[77] Han JH,Joe DJ.Basilar membrane-inspired self-powered acoustic sensor enabled by highly sensitive multi tunable frequency band.Nano Energy2018;53:198-205

[78] Viola G,Maltby T.Bioinspired multiresonant acoustic devices based on electrospun piezoelectric polymeric nanofibers.ACS Appl Mater Interfaces2020;12:34643-57 PMCID:PMC7460092

[79] Wang J,Lee C.Development of neural interfaces and energy harvesters towards self-powered implantable systems for healthcare monitoring and rehabilitation purposes.Nano Energy2019;65:104039

[80] Shi Q,Lee C.MEMS based broadband piezoelectric ultrasonic energy harvester (PUEH) for enabling self-powered implantable biomedical devices.Sci Rep2016;6:24946 PMCID:PMC4844957

[81] Jiang L,Chen R.Ultrasound-induced wireless energy harvesting for potential retinal electrical stimulation application.Adv Funct Mater2019;29:1902522

[82] Zhang T,Wang Z.Piezoelectric ultrasound energy-harvesting device for deep brain stimulation and analgesia applications.Sci Adv2022;8:eabk0159 PMCID:PMC9012468

[83] Jiang L,Zeng Y.Flexible ultrasound-induced retinal stimulating piezo-arrays for biomimetic visual prostheses.Nat Commun2022;13:3853 PMCID:PMC9253314

[84] Piech DK,Shen K.A wireless millimetre-scale implantable neural stimulator with ultrasonically powered bidirectional communication.Nat Biomed Eng2020;4:207-22

[85] Wang HS,Han JH.Biomimetic and flexible piezoelectric mobile acoustic sensors with multiresonant ultrathin structures for machine learning biometrics.Sci Adv2021;7:eabe5683 PMCID:PMC7880591

[86] Kyamakya K,Haj Mosa A,Chedjou JC.Emotion and stress recognition related sensors and machine learning technologies.Sensors2021;21:2273 PMCID:PMC8037255

[87] Qi Y,Gao S.Emotion recognition based on piezoelectric keystroke dynamics and Machine Learning. In 2021 IEEE International Conference on Flexible and Printable Sensors and Systems (FLEPS); 2021. pp. 1-4.

[88] Gao S,Kitsos V,Qu X.High three-dimensional detection accuracy in piezoelectric-based touch panel in interactive displays by optimized artificial neural networks.Sensors2019;19:753 PMCID:PMC6412906

[89] Gao S,Shao M.A touch orientation classification-based force-voltage responsivity stabilization method for piezoelectric force sensing in interactive displays.IEEE Sensors J2020;20:8147-54

[90] Zhou Z,Li X.Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays.Nat Electron2020;3:571-8

[91] Jung YH,Wang HS.Flexible piezoelectric acoustic sensors and machine learning for speech processing.Adv Mater2020;32:e1904020

[92] Novoselov S,Shchemelinin V.Deep CNN based feature extractor for text-prompted speaker recognition. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP); 2018. pp. 5334-8

[93] Wang M,Wang T.artificial skin perception.Adv Mater2021;33:e2003014

[94] Chung J,Lim M.Object classification based on piezoelectric actuator-sensor pair on robot hand using neural network.Smart Mater Struct2020;29:105020

[95] Jia W,Huang A,Gao S.High security user authentication based on piezoelectric keystroke dynamics applying to multiple emotional responses.IEEE Sensors J2022;22:2814-22

[96] Jeong YC,Shin A,Lee KJ.Progress in brain-compatible interfaces with soft nanomaterials.Adv Mater2020;32:e1907522

[97] Liu Y,Song Z.Electronic skin as wireless human-machine interfaces for robotic VR.Sci Adv2022;8:eabl6700 PMCID:PMC8759751

[98] Zhu G,Zhang L.Piezoelectricity in β-phase PVDF crystals: a molecular simulation study.Comput Mater Sci2008;44:224-9

[99] Zhang J,Bowen C.Piezoelectric effects and electromechanical theories at the nanoscale.Nanoscale2014;6:13314-27

[100] Zhang M,Chen Y.Polyoxovanadate-polymer hybrid electrolyte in solid state batteries.Energy Stor Mater2020;29:172-81

[101] Zhang L,Wu Z.Enhanced performance of piezoelectric nanogenerator based on aligned nanofibers and three-dimensional interdigital electrodes.Nano Energy2019;65:103924

[102] Chu Y,Liu H.Human pulse diagnosis for medical assessments using a wearable piezoelectret sensing system.Adv Funct Mater2018;28:1803413

[103] Han M,Yang Y.Three-dimensional piezoelectric polymer microsystems for vibrational energy harvesting, robotic interfaces and biomedical implants.Nat Electron2019;2:26-35

[104] Liu X,Qiu Y.Advanced flexible skin-like pressure and strain sensors for human health monitoring.Micromachines2021;12:695

[105] Jella V,Eom J.A comprehensive review of flexible piezoelectric generators based on organic-inorganic metal halide perovskites.Nano Energy2019;57:74-93

[106] Liu H,Lee C,Lin L.A comprehensive review on piezoelectric energy harvesting technology: materials, mechanisms, and applications.Appl Phys Rev2018;5:041306

[107] Kang S,Lee HB.High-power energy harvesting and imperceptible pulse sensing through peapod-inspired hierarchically designed piezoelectric nanofibers.Nano Energy2022;99:107386

[108] Mahapatra SD,Aria AI.Piezoelectric materials for energy harvesting and sensing applications: roadmap for future smart materials.Adv Sci2021;8:e2100864

[109] Yi F,Shan J,Wei D.Wearable energy sources based on 2D materials.Chem Soc Rev2018;47:3152-88

[110] Gao Z,Gu Y.Effects of piezoelectric potential on the transport characteristics of metal-ZnO nanowire-metal field effect transistor.J Appl Phys2009;105:113707

[111] Huang X,Zhang X.Ultrarobust, hierarchically anisotropic structured piezoelectric nanogenerators for self-powered sensing.Nano Energy2022;99:107379

[112] Chen G,Zhao X,Bick M.Electronic textiles for wearable point-of-care systems.Chem Rev2022;122:3259-91

[113] Deng W,Libanori A,Yang W.Piezoelectric nanogenerators for personalized healthcare.Chem Soc Rev2022;51:3380-435