Prospects of soft biopotential interfaces for wearable human-machine interactive devices and applications

Abstract

Human interaction with machines can be made easy, comfortable, and accessible by introducing user-friendly interfaces. In the case of wearable devices, their sensors and other interfacing elements are very well within the proximity of users. Since biopotential signals can be accessed from the surface of the human skin, users can have seamless interaction with wearable human-computer interactive devices. Rigid interfaces can hinder the user experience, and therefore, the need for soft biopotential interfaces is important. Imperceptible and unobtrusive soft biopotential interfaces will drastically enhance many aspects of human-computer interaction. This paper reviews the use of soft, flexible, and stretchable biopotential interfaces in wearable human-machine interactive devices. Additionally, attention is brought to the scope of other possible applications of soft biopotential interfaces in wearable devices.

Keywords

Biopotential / soft interface / wearable / interface / human-machine interface (HMI) / human-computer interaction (HCI)

References

[1] Gong C.Human-machine interface: design principles of visual information in human-machine interface design. In: 2009 International Conference on Intelligent Human-Machine Systems and Cybernetics; 2009 Aug 26-27; Hangzhou, China. IEEE; 2009. p. 262-5.

[2] Hristov H.Generations of human-computer interactions: evolution, tendencies and perspectives.J Phys Conf Ser2022;2339:012009

[3] Francés-Morcillo L,Rodríguez-Ferradas MI.Wearable design requirements identification and evaluation.Sensors2020;20:2599 PMCID:PMC7248989

[4] Yin R,Zhao S,Shen G.Wearable sensors-enabled human-machine interaction systems: from design to application.Adv Funct Mater2021;31:2008936

[5] Shi Q,He T.Progress in wearable electronics/photonics-moving toward the era of artificial intelligence and internet of things.InfoMat2020;2:1131-62

[6] Godfrey A,Shum H,Lovell NH.From A to Z: wearable technology explained.Maturitas2018;113:40-7

[7] Tang G,Zhang Z,Sun Z.Hybridized wearable patch as a multi-parameter and multi-functional human-machine interface.Nano Energy2021;81:105582

[8] Park S.Enhancing the quality of life through wearable technology.IEEE Eng Med Biol Mag2003;22:41-8

[9] Zhu M,Zhang Z.Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications.Sci Adv2020;6:eaaz8693 PMCID:PMC7209995

[10] Gao W,Nyein HYY.Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis.Nature2016;529:509-14 PMCID:PMC4996079

[11] Bifulco P,Fratini A,Pasquariello G.A wearable device for recording of biopotentials and body movements. In: 2011 IEEE International Symposium on Medical Measurements and Applications; 2011 May 30-31; Bari, Italy. IEEE; 2011. p. 469-72.

[12] Vehkaoja A.Wearable wireless biopotential measurement device. Proceedings of 26th annual international conference of the IEEE engineering in medicine and biology society; 2004 Feb p. 2177-9; San Francisco, CA, USA. IEEE; 2004.

[13] Cinar E.EOG controlled mobile robot using radial basis function networks. In: 2009 Fifth International Conference on Soft Computing, Computing with Words and Perceptions in System Analysis, Decision and Control; 2009 Feb 2-4; Famagusta . North Cyprus. IEEE; 2009. p. 1-4.

[14] Sasaki M,Rusyidi MI.Robot control systems using bio-potential signals.AIP Conf Proc2020;2217:020008.

[15] Ding J,Zhang L,Gu X.A novel front-end design for bioelectrical signal wearable acquisition.IEEE Sensors J2019;19:8009-18

[16] Magno M,Spagnol C.Wearable low power dry surface wireless sensor node for healthcare monitoring application. In: 2013 IEEE 9th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob); 2013 Oct 7-9; Lyon, France.IEEE; 2013. p. 189-95.

[17] Cohen MX.Where does EEG come from and what does it mean?.Trends Neurosci2017;40:208-18

[18] Waldert S.Invasive vs. Non-invasive neuronal signals for brain-machine interfaces: will one prevail?.Front Neuros2016;10:295 PMCID:PMC4921501

[19] Reilly RB.Electrograms (ECG, EEG, EMG, EOG).Technol Health Care2010;18:443-58

[20] Pascual-Valdunciel A,Pons JL.Non-invasive electrical stimulation of peripheral nerves for the management of tremor.J Neurol Sci2022;435:120195 PMCID:PMC9590374

[21] Koutsou AD,Del Ama AJ,Pons JL.Advances in selective activation of muscles for non-invasive motor neuroprostheses.J Neuroeng Rehabil2016;13:56 PMCID:PMC4907085

[22] Caramenti M,Gasperotti L,Berger TW.Challenges in neurorehabilitation and neural engineering. In: Pons JL, Raya R, González J, editors. Emerging Therapies in Neurorehabilitation II. Cham: Springer International Publishing; 2016. pp. 1-27.

[23] Kruse J. Biopotential electrode sensors in ECG/EEG/EMG systems. Analog Devices 2008;200:1 2. Available from: https://www.analog.com/en/technical-articles/biopotential-electrode-sensors-ecg-eeg-emg.html#/. [Last accessed on 21 Jun]

[24] Picton TW,Berg P.Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria.Psychophysiol2000;37:127-52

[25] Albulbul A.Evaluating major electrode types for idle biological signal measurements for modern medical technology.Bioengineering2016;3:20 PMCID:PMC5597189

[26] Bao S,Chen W.Wearable health monitoring system using flexible materials electrodes. In: 2020 IEEE 6th World Forum on Internet of Things (WF-IoT); 2020 Jun 2-16; New Orleans, LA, USA. IEEE; 2020. p. 1-2.

[27] Lopez-Gordo MA,Pelayo Valle F.Dry EEG electrodes.Sensors2014;14:12847-70 PMCID:PMC4168519

[28] Fu Y,Dong Y.Dry electrodes for human bioelectrical signal monitoring.Sensors2020;20:3651 PMCID:PMC7374322

[29] Herbert R,Yeo AW.Soft material-enabled electronics for medicine, healthcare, and human-machine interfaces.Materials2020;13:517 PMCID:PMC7040651

[30] Herbert R,Kim YS,Yeo WH.Soft Material-enabled, flexible hybrid electronics for medicine, healthcare, and human-machine interfaces.Materials2018;11:187 PMCID:PMC5848884

[31] Kim T,Yu KJ.Flexible and stretchable bio-integrated electronics based on carbon nanotube and graphene.Materials2018;11:1163 PMCID:PMC6073353

[32] Yu X,Yu Y.Skin-integrated wireless haptic interfaces for virtual and augmented reality.Nature2019;575:473-9

[33] Zhao Y,Wang Y.All-fiber structure covered with two-dimensional conductive MOF materials to construct a comfortable, breathable and high-quality self-powered wearable sensor system.J Mater Chem A2022;10:1248-56

[34] Zheng Y,Zhang S.A molecular design approach towards elastic and multifunctional polymer electronics.Nat Commun2021;12:5701 PMCID:PMC8481247

[35] Matsuhisa N,O'Neill SJK.High-frequency and intrinsically stretchable polymer diodes.Nature2021;600:246-52

[36] Jiang Y,Wang YX.Topological supramolecular network enabled high-conductivity, stretchable organic bioelectronics.Science2022;375:1411-7

[37] Zheng YQ,Zhong D.Monolithic optical microlithography of high-density elastic circuits.Science2021;373:88-94

[38] Vallem V,Ozturk M,Dickey MD.Energy harvesting and storage with soft and stretchable materials.Adv Mater2021;33:e2004832

[39] Song Y,Hu C,Yang Y.Soft triboelectric nanogenerators for mechanical energy scavenging and self-powered sensors.Nano Energy2021;84:105919

[40] Song Y,Yu Y.Wireless battery-free wearable sweat sensor powered by human motion.Sci Adv2020;6:eaay9842 PMCID:PMC7527225

[41] Park Y,Kwak SS.Wireless, skin-interfaced sensors for compression therapy.Sci Adv2020;6:eabe1655 PMCID:PMC7821894

[42] Kwon YT,Mahmood M,Demolder C.Printed, wireless, soft bioelectronics and deep learning algorithm for smart human-machine interfaces.ACS Appl Mater Interfaces2020;12:49398-406

[43] Wei H,Liu WG,Zhang PX.3D printing of free-standing stretchable electrodes with tunable structure and stretchability.Adv Eng Mater2017;19:1700341

[44] Zhou LY,Fu JZ.Multimaterial 3D printing of highly stretchable silicone elastomers.ACS Appl Mater Interfaces2019;11:23573-83

[45] Muth JT,Truby RL.Embedded 3D printing of strain sensors within highly stretchable elastomers.Adv Mater2014;26:6307-12

[46] Zhu Z,McAlpine MC.3D printed deformable sensors.Sci Adv2020;6:eaba5575 PMCID:PMC7299613

[47] Farina D.Human?machine interfacing by decoding the surface electromyogram [Life Sciences].IEEE Signal Process Mag2015;32:115-20

[48] Farina D,Rehbaum H.The extraction of neural information from the surface EMG for the control of upper-limb prostheses: emerging avenues and challenges.IEEE Trans Neural Syst Rehabil Eng2014;22:797-809

[49] Holobar A.Noninvasive neural interfacing with wearable muscle sensors: combining convolutive blind source separation methods and deep learning techniques for neural decoding.IEEE Signal Process Mag2021;38:103-18

[50] Kollmitzer J,Kopf A.Reliability of surface electromyographic measurements.Clin Neurophysiol1999;110:725-34

[51] Yeon SH,Rogers EA.Flexible dry electrodes for emg acquisition within lower extremity prosthetic sockets. In: 2020 8th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob). 2020. pp. 1088-95. PMCID:PMC8365363

[52] Murphy BB,Driscoll N.A gel-free Ti₃C₂T_x-based electrode array for high-density, high-resolution surface electromyography.Adv Mater Technol2020;5:2000325 PMCID:PMC7939071

[53] Driscoll N,Murphy BB.MXene-infused bioelectronic interfaces for multiscale electrophysiology and stimulation.Sci Transl Med2021;13:eabf8629 PMCID:PMC8722432

[54] Hammock ML,Tee BC,Bao Z.25th anniversary article: the evolution of electronic skin (e-skin): a brief history, design considerations, and recent progress.Adv Mater2013;25:5997-6038

[55] Goyal K,Day SW.Dependence of skin-electrode contact impedance on material and skin hydration.Sensors2022;22:8510 PMCID:PMC9656728

[56] Yu Y,Solomon SA.All-printed soft human-machine interface for robotic physicochemical sensing.Sci Robot2022;7:eabn0495 PMCID:PMC9302713

[57] Zeng X,Wang X.Flexible electrode by hydrographic printing for surface electromyography monitoring.Materials2020;13:2339 PMCID:PMC7287936

[58] Motti VG.Human factors considerations in the design of wearable devices. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting 2014;58:1820-4.

[59] Huang C.Facile fabrication of a stretchable and flexible nanofiber carbon film-sensing electrode by electrospinning and its application in smart clothing for ECG and EMG monitoring.ACS Appl Electron Mater2021;3:676-86

[60] Li J,Huang D.High-performance flexible microneedle array as a low-impedance surface biopotential dry electrode for wearable electrophysiological recording and polysomnography.Nanomicro Lett2022;14:132 PMCID:PMC9198145

[61] Scott SH.Neuroscience: converting thoughts into action.Nature2006;442:141-2

[62] Tyagi A,Shah G. A review of EEG sensors used for data acquisition.In: National Conference on Future Aspects of Artificial intelligence in Industrial Automation (NCFAAIIA 2012), Proceedings published by International Journal of Computer Applications® (IJCA),2012:13-7. Acailable from: https://www.researchgate.net/publication/308259085_A_Review_of_Eeg_Sensors_used_for_Data_Acquisition.[Last accessed on 21 Jun]

[63] Ganzer PD,Schwemmer MA.Restoring the sense of touch using a sensorimotor demultiplexing neural interface.Cell2020;181:763-773.e12

[64] Bouton CE,Annetta NV.Restoring cortical control of functional movement in a human with quadriplegia.Nature2016;533:247-50

[65] McFarland DJ,Wolpaw JR.Electroencephalographic (EEG) control of three-dimensional movement.J Neural Eng2010;7:036007 PMCID:PMC2907523

[66] McNaughton BL,Barnes CA.The stereotrode: a new technique for simultaneous isolation of several single units in the central nervous system from multiple unit records.J Neurosci Methods1983;8:391-7

[67] Vidal JJ.Toward direct brain-computer communication.Annu Rev Biophys Bioeng1973;2:157-80

[68] Ponce CR,Livingstone MS.Posterior inferotemporal cortex cells use multiple input pathways for shape encoding.J Neurosci2017;37:5019-34 PMCID:PMC5426187

[69] Huang Z,Zeng J,Wu H.Flexible electrodes for non-invasive brain-computer interfaces: a perspective.APL Materials2022;10:090901

[70] Abiri R,Sellers EW,Zhao X.A comprehensive review of EEG-based brain-computer interface paradigms.J Neural Eng2019;16:011001

[71] Nicolas-Alonso LF.Brain computer interfaces, a review.Sensors2012;12:1211-79 PMCID:PMC3304110

[72] Orban M,Guo K,Yang H.A review of brain activity and EEG-Based brain-computer interfaces for rehabilitation application.Bioengineering2022;9:768 PMCID:PMC9774292

[73] Li G,Duan YY.Towards conductive-gel-free electrodes: understanding the wet electrode, semi-dry electrode and dry electrode-skin interface impedance using electrochemical impedance spectroscopy fitting.Sensor Actuat B-Chem2018;277:250-60

[74] Pradhapan P,Witteveen JA,Mihajlović V.The role of features types and personalized assessment in detecting affective state using dry electrode EEG.Sensors2020;20:6810 PMCID:PMC7731105

[75] Marini F,Wagner J,Gola M.A comparative evaluation of signal quality between a research-grade and a wireless dry-electrode mobile EEG system.J Neural Eng2019;16:054001

[76] Baum U,Deike R.Eignung eines mobilen trockenelektroden-EEG-Gerätes im Rahmen der Epilepsiediagnostik.Klin Neurophysiol2020;51:156-60

[77] Mota A,Rodrigues D.Development of a quasi-dry electrode for EEG recording.Sensor Actuat A-Phys2013;199:310-7

[78] Lin S,Li W.A flexible, robust, and gel-free electroencephalogram electrode for noninvasive brain-computer interfaces.Nano Lett2019;19:6853-61

[79] Huang K,Lin S.Flexible silver nanowire dry electrodes for long-term electrocardiographic monitoring.Adv Compos Hybrid Mater2022;5:220-8

[80] Lee JH,Zhu J.Flexible conductive composite integrated with personal earphone for wireless, real-time monitoring of electrophysiological signs.ACS Appl Mater Interfaces2018;10:21184-90

[81] Grozea C,Fazli S.Bristle-sensors--low-cost flexible passive dry EEG electrodes for neurofeedback and BCI applications.J Neural Eng2011;8:025008

[82] Wang L,Yang B.PDMS-based low cost flexible dry electrode for long-term EEG measurement.IEEE Sensors J2012;12:2898-904

[83] Li G,Xia Y.Towards emerging EEG applications: a novel printable flexible Ag/AgCl dry electrode array for robust recording of EEG signals at forehead sites.J Neural Eng2020;17:026001

[84] Golparvar A,Yapici MK.Gel-free wearable electroencephalography (eeg) with soft graphene textiles. In: 2021 IEEE Sensors; 2021 31 Oct-3 Nov; Sydney, Australia. IEEE; 2021. p. 1-4.

[85] Carneiro MR,Tavakoli M.Wearable and comfortable e-textile headband for long-term acquisition of forehead EEG signals.IEEE Sensors J2020;20:15107-16

[86] Li G,Wang S.Novel passive ceramic based semi-dry electrodes for recording electroencephalography signals from the hairy scalp.Sensor Actuat B-Chem2016;237:167-78

[87] Liu J,Li W.Ten-hour stable noninvasive brain-computer interface realized by semidry hydrogel-based electrodes.Research2022;2022:9830457 PMCID:PMC8933689

[88] Krishnan A,Venkatesh P,Grover P.Low-cost carbon fiber-based conductive silicone sponge EEG electrodes. In: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC); 2018 Jul 18-21; Honolulu, HI, USA. IEEE; 2018. p. 1287-90.

[89] Tseghai GB,Fante KA.The status of textile-based dry EEG electrodes.Autex Res J2021;21:63-70

[90] He G,Qi M.From the perspective of material science: a review of flexible electrodes for brain-computer interface.Mater Res Express2020;7:102001

[91] Stevenson C,He C.Emerging non-invasive brain-computer interface technologies and their clinical applications. In: Chaurasia, M.A., Juang, CF , editors. Emerging IT/ICT and AI technologies affecting society. Singaporer: Springer; 2023. p. 269-90.

[92] Dupre A,Iaizzo PA.Basic ECG theory, recordings, and interpretation. In: Iaizzo PA, editor. Handbook of Cardiac Anatomy, Physiology, and Devices. Totowa, NJ: Humana Press; 2005. p. 191-201.

[93] Frederiks J,Kors JA.Within-subject electrocardiographic differences at equal heart rates: role of the autonomic nervous system.Pflugers Arch2001;441:717-24

[94] Park C,Han S.Single-lead ECG based autonomic nervous system assessment for meditation monitoring.Sci Rep2022;12:22513 PMCID:PMC9800362

[95] Madona P,Zain MM.PQRST wave detection on ECG signals.Gac Sanit2021;35 Suppl 2:S364-9

[96] AlGhatrif M.A brief review: history to understand fundamentals of electrocardiography.J Community Hosp Intern Med Perspect2012;2:14383 PMCID:PMC3714093

[97] Martis RJ,Adeli H.Current methods in electrocardiogram characterization.Comput Biol Med2014;48:133-49

[98] Ramasamy S.Wearable sensors for ECG measurement: a review.Sensor Review2018;38:412-9

[99] Strik M,Weigel D.The use of smartwatch electrocardiogram beyond arrhythmia detection.Trends Cardiovasc Med2023:S1050-1738(22)00153

[100] Isakadze N.How useful is the smartwatch ECG?.Trends Cardiovasc Med2020;30:442-8

[101] Abt G,Benson AC.The validity and inter-device variability of the apple watch™ for measuring maximal heart rate.J Sports Sci2018;36:1447-52

[102] Yu J,Kwon S,Lee H.AI-based stroke disease prediction system using ECG and PPG bio-signals.IEEE Access2022;10:43623-38

[103] Kim T,Sohn J,Jeon S.Bioinspired, highly stretchable, and conductive dry adhesives based on 1D-2D hybrid carbon nanocomposites for all-in-one ECG electrodes.ACS Nano2016;10:4770-8

[104] Ankhili A,Cochrane C,Coulon D.Ambulatory evaluation of ECG signals obtained using washable textile-based electrodes made with chemically modified PEDOT:PSS.Sensors2019;19:416 PMCID:PMC6359744

[105] Creel DJ.Chapter 33 - the electrooculogram. In: Levin KH, Chauvel P, editors. Handbook of Clinical Neurology. 2019. p. 495-9.

[106] Soundariya RS.Eye movement based emotion recognition using electrooculography. In: 2017 Innovations in Power and Advanced Computing Technologies (i-PACT). 2017 Apr 21-22; Vellore, India.IEEE; 2017. p. 1-5.

[107] Usakli AB,Aloise F,Babiloni F.On the use of electrooculogram for efficient human computer interfaces.Comput Intell Neurosci2010;2010:135629 PMCID:PMC2763213

[108] Choudhari AM,Jonnalagedda V.An electrooculography based human machine interface for wheelchair control.Biocybern Biomed Eng2019;39:673-85

[109] Ramkumar S,Sathesh Kumar K,Maheswari K.Task identification system for elderly paralyzed patients using electrooculography and neural networks. In: Haldorai A, Ramu A, Mohanram S, Onn CC, editors. EAI International Conference on Big Data Innovation for Sustainable Cognitive Computing; 2019 Oct 19; Springer, Cham; 2020. p. 151-61.

[110] Kumar D.Electrooculogram-based virtual reality game control using blink detection and gaze calibration. In: 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI); 2016 Sep 21-24; Jaipur, India. IEEE;2016. p. 2358-62.

[111] Chang WD.Electrooculograms for human-computer interaction: a review.Sensors2019;19:2690 PMCID:PMC6630230

[112] Won Y,Shin J,Kim S.Biocompatible, transparent, and high-areal-coverage kirigami PEDOT:PSS electrodes for electrooculography-derived human-machine interactions.ACS Sens2021;6:967-75

[113] Ameri SK,Kuang IA.Imperceptible electrooculography graphene sensor system for human-robot interface.npj 2D Mater Appl2018;2

[114] Xiao J,Li Y.An electrooculogram-based interaction method and its music-on-demand application in a virtual reality environment.IEEE Access2019;7:22059-70

[115] Beach C,Casson AJ.A graphene-based sleep mask for comfortable wearable eye tracking. In: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC); 2019 Jul 23-27; Berlin, Germany. IEEE; 2019. p. 6693 6.

[116] Liang S,Lee Y.Development of an EOG-based automatic sleep-monitoring eye mask.IEEE Trans Instrum Meas2015;64:2977-85

[117] Li W,Chen L,Ge Q.Self-powered wireless flexible ionogel wearable devices.ACS Appl Mater Interfaces2023;15:14768-76

[118] Wang W,Rastak R.Strain-insensitive intrinsically stretchable transistors and circuits.Nat Electron2021;4:143-50

[119] Fatayerji HR,Qaisar SM,Al Talib R.Application of wavelet decomposition and ma-chine learning for the semg signal based ges-ture recognition. In: Qaisar SM, Nisar H, Subasi A, editors. Advances in Non-Invasive Biomedical Signal Sensing and Processing with Machine Learning. Cham: Springer International Publishing; 2023. pp. 133-58.

[120] Dong P,Yu S.Electromyogram-based lip-reading via unobtrusive dry electrodes and machine learning methods.Small2023;19:e2205058

[121] Bi Z,Wang H.Wearable EMG bridge-a multiple-gesture reconstruction system using electrical stimulation controlled by the volitional surface electromyogram of a healthy forearm.IEEE Access2020;8:137330-41

[122] Wei Y,Browne M,Worsley P.Wearable electrical stimulation to improve lymphatic function.IEEE Sens Lett2019;3:1-4

[123] Ohm Y,Ford MJ,Liao J.An electrically conductive silver-polyacrylamide-alginate hydrogel composite for soft electronics.Nat Electron2021;4:185-92

[124] Botzanowski B,Ejneby MS.Noninvasive stimulation of peripheral nerves using temporally-interfering electrical fields.Adv Healthc Mater2022;11:e2200075

[125] Wang J,He T,Thakor NV.Investigation of low-current direct stimulation for rehabilitation treatment related to muscle function loss using self-powered TENG system.Adv Sci2019;6:1900149 PMCID:PMC6662055