Progress on flexible tactile sensors in robotic applications on objects properties recognition, manipulation and human-machine interactions

Abstract

The robotic with integrated tactile sensors can accurately perceive contact force, pressure, vibration, temperature and other tactile stimuli. Flexible tactile sensing technologies have been widely utilized in intelligent robotics for stable grasping, dexterous manipulation, object recognition and human-machine interaction. This review presents promising flexible tactile sensing technologies and their potential applications in robotics. The significance of robotic sensing and tactile sensing performance requirements are first described. The commonly used six types of sensing mechanisms of tactile sensors are briefly illustrated, followed by the progress of novel structural design and performance characteristics of several promising tactile sensors, such as highly sensitive pressure and tri-axis force sensor, flexible distributed sensor array, and multi-modal tactile sensor. Then, the applications of using tactile sensors in robotics such as object properties recognition, grasping and manipulation, and human-machine interactions are thoroughly discussed. Finally, the challenges and future prospects of robotic tactile sensing technologies are discussed. In summary, this review will be conducive to the novel design of flexible tactile sensors and is a heuristic for developing the next generation of intelligent robotics with advanced tactile sensing functions in the future.

Keywords

Intelligent robotic / tactile sensing / object recognition / human-machine interaction / tactile sensor / electronic skin

References

[1] Dargahi J.Human tactile perception as a standard for artificial tactile sensing - a review.Int J Med Robot Comput Assist Surg2004;1:23-5

[2] Lee Y,Choe A,Kim J.Mimicking human and biological skins for multifunctional skin electronics.Adv Funct Mater2020;30:1904523

[3] Navarro SE,Alagi H.Proximity perception in human-centered robotics: a survey on sensing systems and applications.IEEE Trans Robot2022;38:1599-620

[4] Gao Y,Yeo JC.Flexible hybrid sensors for health monitoring: materials and mechanisms to render wearability.Adv Mater2020;32:e1902133

[5] Romeo RA.Methods and sensors for slip detection in robotics: a survey.IEEE Access2020;8:73027-50

[6] Yamaguchi A.Recent progress in tactile sensing and sensors for robotic manipulation: can we turn tactile sensing into vision?.Adv Robot2019;33:661-73

[7] Luo S,Dahiya R.Robotic tactile perception of object properties: a review.Mechatronics2017;48:54-67

[8] Sun Z,Shan X.Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions.Nat Commun2022;13:5224 PMCID:PMC9445040

[9] Pyo S,Bae K,Kim J.Recent progress in flexible tactile sensors for human-interactive systems: from sensors to advanced applications.Adv Mater2021;33:e2005902

[10] Nie B,Yao T.Sensing arbitrary contact forces with a flexible porous dielectric elastomer.Mater Horiz2021;8:962-71

[11] Duan Y,Wu J,Wang Y.Recent progress in flexible pressure sensor arrays.Nanomaterials2022;12:2495 PMCID:PMC9319019

[12] Duan S,Wu J.Multimodal sensors and ML-based data fusion for advanced robots.Adv Intell Syst2022;4:2200213

[13] Yuan Z,Gao W.Flexible and stretchable strategies for electronic skins: materials, structure, and integration.ACS Appl Electron Mater2022;4:1-26

[14] Ruth SRA,Tran H.Microengineering pressure sensor active layers for improved performance.Adv Funct Mater2020;30:2003491

[15] Zhang F,Xue Z.Recent progress in three-dimensional flexible physical sensors.Int J Smart Nano Mater2022;13:17-41

[16] Yousef H,Althoefer K.Tactile sensing for dexterous in-hand manipulation in robotics - a review.Sens Actuator A Phys2011;167:171-87

[17] Li Q,Su Z,Kaboli M.A review of tactile information: perception and action through touch.IEEE Trans Robot2020;36:1619-34

[18] Trung TQ.Flexible and stretchable physical sensor integrated platforms for wearable human-activity monitoringand personal healthcare.Adv Mater2016;28:4338-72

[19] Tang L,Jiang X.Multilayered electronic transfer tattoo that can enable the crease amplification effect.Sci Adv2021;7:eabe3778 PMCID:PMC7806229

[20] Gu G,Xu H.A soft neuroprosthetic hand providing simultaneous myoelectric control and tactile feedback. Nat Biomed Eng 2021.

[21] Patel S,Zhao M.Wearable electronics for skin wound monitoring and healing.Soft Sci2022;2:9

[22] Cheng G,Bergner F,Leboutet Q.A comprehensive realization of robot skin: sensors, sensing, control, and applications.Proc IEEE2019;107:2034-51

[23] Khatib O,Brantner G.Ocean one: a robotic avatar for oceanic discovery.IEEE Robot Automat Mag2016;23:20-9

[24] Xu DF,Fishel JA.Tactile identification of objects using Bayesian exploration. In Proceedings of the ICRA 2013: IEEE International Conference on Robotics and Automation, 6-10 May 2013; Karlsruhe, Germany; pp.3056-61.

[25] Li J,Tao J,Pan C.Recent progress in flexible pressure sensor arrays: from design to applications.J Mater Chem C2018;6:11878-92

[26] Wang S,Lin Q.Flexible three-dimensional force sensor of high sensing stability with bonding and supporting composite structure for smart devices.Smart Mater Struct2021;30:105004

[27] Wang Y,Mei D,Chen J.Flexible tactile sensor array for distributed tactile sensing and slip detection in robotic hand grasping.Sens Actuator A Phys2019;297:111512

[28] Guo Y,Gao S,Li Y.Recent advances in carbon material-based multifunctional sensors and their applications in electronic skin systems.Adv Funct Mater2021;31:2104288

[29] Li G,Wang L.Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition.Sci Robot2020;5:eabc8134

[30] Yan Y,Yang Z.Soft magnetic skin for super-resolution tactile sensing with force self-decoupling.Sci Robot2021;6:eabc8801

[31] Soni M.Soft eSkin: distributed touch sensing with harmonized energy and computing.Philos Trans A Math Phys Eng Sci2020;378:20190156 PMCID:PMC6939237

[32] Lee Y,Cho S.Flexible ferroelectric sensors with ultrahigh pressure sensitivity and linear response over exceptionally broad pressure range.ACS Nano2018;12:4045-54

[33] Jiang X,Zhu H.Recent progress in wearable tactile sensors combined with algorithms based on machine learning and signal processing.APL Mater2021;9:030906

[34] Sundaram S,Li Y,Torralba A.Learning the signatures of the human grasp using a scalable tactile glove.Nature2019;569:698-702

[35] Pressure profile systems®. The TactArray - pressure mapping sensor pads. Available from: https://pressureprofile.com/sensors/tactarray [Last accessed on 8 Mar 2023]

[36] Iwata H.Design of human symbiotic robot TWENDY-ONE. In Proceedings of the ICRA 2009: IEEE International Conference on Robotics and Automation; 12-17 May 2009; Kobe, Japan; p. 3294.

[37] Someya T,Iba S,Kawaguchi H.A large-area, flexible pressure sensor matrix with organic field-effect transistors for artificial skin applications.Proc Natl Acad Sci USA2004;101:9966-70 PMCID:PMC454198

[38] SynTouch Inc. SynTouch® BioTac® Tactile sensor. Available from: https://syntouchinc.com/sensor-documents/ [Last accessed on 8 Mar 2023]

[39] Fishel JA.Bayesian exploration for intelligent identification of textures.Front Neurorobot2012;6:4

[40] Su Z,Loeb GE,Schaal S.Learning manipulation graphs from demonstrations using multimodal sensory signals. In Proceedings of the ICRA 2018: IEEE International Conference on Robotics and Automation; 21-25 May 2018; Brisbane, QLD, Australia; pp. 2758-65.

[41] Yuan W,Adelson EH.GelSight: High-resolution robot tactile sensors for estimating geometry and force.Sensors2017;17:2762 PMCID:PMC5751610

[42] Li R,Yuan WZ.Localization and manipulation of small parts using GelSight tactile sensing. In Proceedings of the IROS 2014: IEEE/RSJ International Conference on Intelligent Robots and Systems; 14-18 September 2014; Chicago, IL, USA; pp. 3988-93.

[43] Yuan W,Owens A,Adelson EH.Shape-independent hardness estimation using deep learning and a GelSight tactile sensor. In Proceedings of the ICRA 2017: IEEE International Conference on Robotics and Automation; 29 May-3 June 2017; Singapore; pp. 951-8.

[44] Mannsfeld SC,Stoltenberg RM.Highly sensitive flexible pressure sensors with microstructured rubber dielectric layers.Nat Mater2010;9:859-64

[45] OnRobot. OMD-20-SE-40N DATASHEET. Available from: https://www.g4.com.tw/userfiles/files/Datasheet/onrobot_3d_force_sensor_omd_20_se_40n.pdf [Last accessed on 8 Mar 2023]

[46] Yao KP,Cheng G.Tactile-based object center of mass exploration and discrimination. In Proceedings of the humanoids 2017: IEEE-RAS 17th International Conference on Humanoid Robotics; 15-17 November 2017; Birmingham, UK; pp.876-81.

[47] Kim DH,Ma R.Epidermal electronics.Science2011;333:838-43

[48] Tenzer Y,Howe RD.The feel of MEMS barometers: inexpensive and easily customized tactile array sensors.IEEE Robot Automat Mag2014;21:89-95

[49] Ades C,AlSaidi M.Robotic finger force sensor fabrication and evaluation through a glove.Proc Fla Conf Recent Adv Robot2018;2018:60-65 PMCID:PMC8676113

[50] Lin L,Wang S.Triboelectric active sensor array for self-powered static and dynamic pressure detection and tactile imaging.ACS Nano2013;7:8266-74

[51] Kim J,Shim HJ.Stretchable silicon nanoribbon electronics for skin prosthesis.Nat Commun2014;5:5747

[52] Boutry CM,Jorda M.A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics.Sci Robot2018;3:eaau6914

[53] Sim K,Zou Z.Metal oxide semiconductor nanomembrane-based soft unnoticeable multifunctional electronics for wearable human-machine interfaces.Sci Adv2019;5:eaav9653 PMCID:PMC6677552

[54] Yu Y,Solomon SA.All-printed soft human-machine interface for robotic physicochemical sensing.Sci Robot2022;7:eabn0495 PMCID:PMC9302713

[55] Yancheng W,Wen D.Recent progress on three-dimensional printing processes to fabricate flexible tactile sensors.Chin J Mech Eng2020;56:239

[56] Wang C,Peng D.Tactile sensors for advanced intelligent systems.Adv Intell Syst2019;1:1900090

[57] Zhu J,Zhang M.Recent progress in flexible tactile sensor systems: from design to application.Soft Sci2021;1:3

[58] Wang Y,Mei D.A highly flexible tactile sensor with an interlocked truncated sawtooth structure based on stretchable graphene/silver/silicone rubber composites.J Mater Chem C2019;7:8669-79

[59] Park J,Hong J.Giant tunneling piezoresistance of composite elastomers with interlocked microdome arrays for ultrasensitive and multimodal electronic skins.ACS Nano2014;8:4689-97

[60] Zhang J,Zhang HM.Highly sensitive flexible three-axis tactile sensors based on the interface contact resistance of microstructured graphene.Nanoscale2018;10:7387-95

[61] Qin J,Hao YN.Flexible and stretchable capacitive sensors with different microstructures.Adv Mater2021;33:e2008267

[62] Viry L,Totaro M.Flexible three-axial force sensor for soft and highly sensitive artificial touch.Adv Mater2014;26:2659-64 PMCID:PMC4264044

[63] Wan Y,Guo CF.Recent progresses on flexible tactile sensors.Mater Today Phys2017;1:61-73

[64] Pan M,Liang X,Zhang Y.Triboelectric and piezoelectric nanogenerators for future soft robots and machines.iScience2020;23:101682 PMCID:PMC7607424

[65] Wu W,Wang ZL.Taxel-addressable matrix of vertical-nanowire piezotronic transistors for active and adaptive tactile imaging.Science2013;340:952-7

[66] Yan Y,Shen Y.Surface texture recognition by deep learning-enhanced tactile sensing.Adv Intell Syst2022;4:2100076

[67] Ge J,Drack M.A bimodal soft electronic skin for tactile and touchless interaction in real time.Nat Commun2019;10:4405 PMCID:PMC6764954

[68] Kawasetsu T,Ishihara H.Flexible tri-axis tactile sensor using spiral inductor and magnetorheological elastomer.IEEE Sensors J2018;18:5834-41

[69] Wang H,Kow J.Design methodology for magnetic field-based soft tri-axis tactile sensors.Sensors2016;16:1356 PMCID:PMC5038634

[70] Jiang C,Pan J,Zhang L.Finger-skin-inspired flexible optical sensor for force sensing and slip detection in robotic grasping.Adv Mater Technol2021;6:2100285

[71] D’Abbraccio J,Oddo CM et al.Design and development of large-area fbg-based sensing skin for collaborative robotics. In Proceedings of the METROIND4.0&IOT 2019: IEEE International Workshop on Metrology for Industry 4.0 and Internet of Things; 04-06 June 2019; Naples, Italy; pp.410-3.

[72] Wang C,Lin M.Continuous monitoring of deep-tissue haemodynamics with stretchable ultrasonic phased arrays.Nat Biomed Eng2021;5:749-58

[73] Deng W,Hu Y,Chen G.Thermoelectric and mechanical performances of ionic liquid-modulated PEDOT:PSS/SWCNT composites at high temperatures.Soft Sci2022;1:14

[74] Park C,Kim HH.Stretchable conductive nanocomposites and their applications in wearable devices.Appl Phys Rev2022;9:021312

[75] Wang X,Zhang H,Pan C.Recent progress in electronic skin.Adv Sci2015;2:1500169

[76] Kaltenbrunner M,Reeder J.An ultra-lightweight design for imperceptible plastic electronics.Nature2013;499:458-63

[77] Tien NT,Kim DI.A flexible bimodal sensor array for simultaneous sensing of pressure and temperature.Adv Mater2014;26:796-804

[78] Lipomi DJ,Tee BC.Skin-like pressure and strain sensors based on transparent elastic films of carbon nanotubes.Nat Nanotechnol2011;6:788-92

[79] Lee JH,Kim YJ.A behavior-learned cross-reactive sensor matrix for intelligent skin perception.Adv Mater2020;32:e2000969

[80] Ruth SRA,Tran H,Matsuhisa N.Rational design of capacitive pressure sensors based on pyramidal microstructures for specialized monitoring of biosignals.Adv Funct Mater2020;30:1903100

[81] Lee Y,Cho S.Bioinspired gradient conductivity and stiffness for ultrasensitive electronic skins.ACS Nano2021;15:1795-804

[82] Yang J,Zhou X.Flexible, tunable, and ultrasensitive capacitive pressure sensor with microconformal graphene electrodes.ACS Appl Mater Interfaces2019;11:14997-5006

[83] Liu W,Yue Y.Piezoresistive pressure sensor based on synergistical innerconnect polyvinyl alcohol nanowires/wrinkled graphene film.Small2018;14:e1704149

[84] Wang Y,Mei D,Wang S.Highly sensitive and flexible tactile sensor with truncated pyramid-shaped porous graphene/silicone rubber composites for human motion detection.Compos Sci Technol2022;217:109078

[85] Ha M,Cho S.Skin-inspired hierarchical polymer architectures with gradient stiffness for spacer-free, ultrathin, and highly sensitive triboelectric sensors.ACS Nano2018;12:3964-74

[86] Wu Y,Zhou Y.A skin-inspired tactile sensor for smart prosthetics.Sci Robot2018;3:eaat0429

[87] Pan J,Zhang Z,Wang X.Flexible liquid-filled fiber adapter enabled wearable optical sensors.Adv Mater Technol2020;5:2000079

[88] Zhu L,Mei D,Jiang C.Fully elastomeric fingerprint-shaped electronic skin based on tunable patterned graphene/silver nanocomposites.ACS Appl Mater Interfaces2020;12:31725-37

[89] Xiong J,Lee PS.Functional fibers and fabrics for soft robotics, wearables, and human-robot interface.Adv Mater2021;33:e2002640

[90] Okatani T,Noda K,Matsumoto K.A tactile sensor using piezoresistive beams for detection of the coefficient of static friction.Sensors2016;16:718 PMCID:PMC4883409

[91] Cao D,Li Y,Liu H.Polymer-based optical waveguide triaxial tactile sensing for 3-dimensional curved shell.IEEE Robot Autom Lett2022;7:3443-50

[92] Cheng X,Liu Y,Hu X.Flexible tactile sensors for dynamic triaxial force measurement based on piezoelectric elastomer.Smart Mater Struct2020;29:075007

[93] Lee JI,Kim MO.Multidirectional flexible force sensors based on confined, self-adjusting carbon nanotube arrays.Nanotechnology2018;29:055501

[94] Liang G,Mei D,Chen Z.Flexible capacitive tactile sensor array with truncated pyramids as dielectric layer for three-axis force measurement.J Microelectromech Syst2015;24:1510-9

[95] Wang Z,Li N,Lv D.Triboelectric self-powered three-dimensional tactile sensor.IEEE Access2020;8:172076-85

[96] Zhao XF,Wen XH.Ultrahigh-sensitive finlike double-sided e-skin for force direction detection.ACS Appl Mater Interfaces2020;12:14136-44

[97] Chen S,Zhang C.Flexible piezoresistive three-dimensional force sensor based on interlocked structures.Sens Actuator A Phys2021;330:112857

[98] Xu K,Lu Y.A wearable body condition sensor system with wireless feedback alarm functions.Adv Mater2021;33:e2008701

[99] Wang Z,Yang Y.Star-nose-inspired multi-mode sensor for anisotropic motion monitoring.Nano Energy2021;80:105559

[100] Zhang S,Yang J,Tan SC.Augmenting sensor performance with machine learning towards smart wearable sensing electronic systems.Adv Intell Syst2022;4:2100194

[101] Takei K,Ho JC.Nanowire active-matrix circuitry for low-voltage macroscale artificial skin.Nat Mater2010;9:821-6

[102] Zheng YQ,Zhong D.Monolithic optical microlithography of high-density elastic circuits.Science2021;373:88-94

[103] Sun H.Guiding the design of superresolution tactile skins with taxel value isolines theory.Sci Robot2022;7:eabm0608

[104] Ye J,Shen Z.Tunable seesaw-like 3D capacitive sensor for force and acceleration sensing.NPJ Flex Electron2021;5

[105] Wang S,Chen Z.Kirigami design of flexible and conformal tactile sensor on sphere-shaped surface for contact force sensing.Adv Mater Technol2023;8:2200993

[106] Jiang S,Liu J.Flexible metamaterial electronics.Adv Mater2022;34:e2200070

[107] Luo Y,Sharma P.Learning human-environment interactions using conformal tactile textiles.Nat Electron2021;4:193-201

[108] Yang T,Li Z.Recent advances in wearable tactile sensors: materials, sensing mechanisms, and device performance.Mater Sci Eng R Rep2017;115:1-37

[109] Park J,Lee Y,Ko H.Fingertip skin-inspired microstructured ferroelectric skins discriminate static/dynamic pressure and temperature stimuli.Sci Adv2015;1:e1500661 PMCID:PMC4646817

[110] Zhang F,Huang D,Zhu D.Flexible and self-powered temperature-pressure dual-parameter sensors using microstructure-frame-supported organic thermoelectric materials.Nat Commun2015;6:8356 PMCID:PMC4595753

[111] You I,Matsuhisa N.Artificial multimodal receptors based on ion relaxation dynamics.Science2020;370:961-5

[112] Pang C,Kim TI.A flexible and highly sensitive strain-gauge sensor using reversible interlocking of nanofibres.Nat Mater2012;11:795-801

[113] Park J,Hong J.Tactile-direction-sensitive and stretchable electronic skins based on human-skin-inspired interlocked microstructures.ACS Nano2014;8:12020-9

[114] Park S,Vosgueritchian M.Stretchable energy-harvesting tactile electronic skin capable of differentiating multiple mechanical stimuli modes.Adv Mater2014;26:7324-32

[115] Zhu L,Mei D.Large-area hand-covering elastomeric electronic skin sensor with distributed multifunctional sensing capability.Adv Intell Syst2022;4:2100118

[116] Jo H, An S, Kwon HJ, Yarin AL, Yoon SS. Transparent body-attachable multifunctional pressure, thermal, and proximity sensor and heater.Sci Rep2020;10:2701

[117] Yang R,Tiwari N,Li T.Multimodal sensors with decoupled sensing mechanisms.Adv Sci2022;9:e2202470 PMCID:PMC9475538

[118] Someya T,Sekitani T.Conformable, flexible, large-area networks of pressure and thermal sensors with organic transistor active matrixes.Proc Natl Acad Sci USA2005;102:12321-5 PMCID:PMC1187825

[119] Harada S,Yamamoto Y,Akita S.Fully printed flexible fingerprint-like three-axis tactile and slip force and temperature sensors for artificial skin.ACS Nano2014;8:12851-7

[120] Yu P,Gu C,Fu X.Flexible piezoelectric tactile sensor array for dynamic three-axis force measurement.Sensors2016;16:819 PMCID:PMC4934245

[121] Ho DH,Kim SY,Kim DH.Stretchable and multimodal all graphene electronic skin.Adv Mater2016;28:2601-8

[122] Hua Q,Liu H.Skin-inspired highly stretchable and conformable matrix networks for multifunctional sensing.Nat Commun2018;9:244 PMCID:PMC5770430

[123] Rashid M,Alhaisoni M.A sustainable deep learning framework for object recognition using multi-layers deep features fusion and selection.Sustainability2020;12:5037

[124] Wang Y,Mei D.Flexible tactile sensor array for slippage and grooved surface recognition in sliding movement.Micromachines2019;10:579 PMCID:PMC6780987

[125] Cao G,Bollegala D.Spatio-temporal attention model for tactile texture recognition. In Proceedings of the IROS 2020: IEEE/RSJ International Conference on Intelligent Robots and Systems; 25-29 October 2020; Las Vegas, Nevada, USA; pp. 9896-902.

[126] Drimus A,Bilberg A.Design of a flexible tactile sensor for classification of rigid and deformable objects.Robot Auton Syst2014;62:3-15

[127] Cui Z,Guo L.Haptically quantifying young’s modulus of soft materials using a self-locked stretchable strain sensor.Adv Mater2022;34:e2104078

[128] Kerr E,Coleman S.Material classification based on thermal properties - a robot and human evaluation. In Proceedings of the ROBIO 2013: IEEE International Conference on Robotics and Biomimetics; 12-14 December 2013; Shenzhen, China; pp.1048-53.

[129] Hattori Y,Lee W.Multifunctional skin-like electronics for quantitative, clinical monitoring of cutaneous wound healing.Adv Healthc Mater2014;3:1597-607 PMCID:PMC4177017

[130] Gao W,Nyein HYY.Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis.Nature2016;529:509-14 PMCID:PMC4996079

[131] Seok D,Kim U,Choi HR.Compensation of environmental influences on sensorized-forceps for practical surgical tasks.IEEE Robot Autom Lett2019;4:2031-7

[132] Dai Y.A flexible multi-functional smart skin for force, touch position, proximity, and humidity sensing for humanoid robots.IEEE Sensors J2021;21:26355-63

[133] Kanoulas D,Caldwell DG.Center-of-mass-based grasp pose adaptation using 3D range and force/torque sensing.Int J Human Robot2018;15:1850013

[134] McGovern S.Learning and predicting center of mass through manipulation and torque sensing. In Proceedings of the ICMRE 2022: 8th International Conference on Mechatronics and Robotics Engineering; 10-12 February 2022; Munich, Germany; pp. 60-6.

[135] Yi ZK,Veiga F et al.Active tactile object exploration with gaussian processes. In Proceedings of the IROS 2016: IEEE/RSJ International Conference on Intelligent Robots and Systems; 9-14 October 2016; Daejeon, Korea; pp. 4925-30.

[136] Lee WY,Huang HP.Learning robot tactile sensing of object for shape recognition using multi-fingered robot hands. In Proceedings of the RO-MAN 2017: IEEE International Symposium on Robot and Human Interactive Communication; 28 August-1 September 2017; Lisbon, Portugal; pp.1311-6.

[137] Luo S,Althoefer K.iCLAP: shape recognition by combining proprioception and touch sensing.Auton Robot2019;43:993-1004

[138] Murali PK,Gentner M,Dahiya R.Active visuo-tactile interactive robotic perception for accurate object pose estimation in dense clutter.IEEE Robot Autom Lett2022;7:4686-93

[139] Dikhale S,Dhingra D.VisuoTactile 6D pose estimation of an in-hand object using vision and tactile sensor data.IEEE Robot Autom Lett2022;7:2148-55

[140] Zhao D,Wang Z.A novel accurate positioning method for object pose estimation in robotic manipulation based on vision and tactile sensors.Int J Adv Manuf Technol2021;116:2999-3010

[141] Saal HP,Vijayakumar S.Active estimation of object dynamics parameters with tactile sensors. In Proceedings of the IROS 2010: IEEE/RSJ International Conference on Intelligent Robots and Systems; 18-22 October 2010; Taipei, Taiwan; pp. 916-21.

[142] Miyamoto T,Matsubara T.Exploiting visual-outer shape for tactile-inner shape estimation of objects covered with soft materials.IEEE Robot Autom Lett2020;5:6278-85

[143] Chun S,Kim H,Pang C.Self-powered pressure- and vibration-sensitive tactile sensors for learning technique-based neural finger skin.Nano Lett2019;19:3305-12

[144] Yeo JC,Zhang Z,Wang Z.Wearable mechanotransduced tactile sensor for haptic perception.Adv Mater Technol2017;2:1700006

[145] Chun S,Son W,Park W.Recognition, classification, and prediction of the tactile sense.Nanoscale2018;10:10545-53

[146] Qiu Y,Wang X.Nondestructive identification of softness via bioinspired multisensory electronic skins integrated on a robotic hand.NPJ Flex Electron2022;6:45

[147] Zou Q,Wang Y.Highly sensitive flexible modulus sensor for softness perception and clinical application.J Micromech Microeng2022;32:035004

[148] Zhao S.A smart artificial finger with multisensations of matter, temperature, and proximity.Adv Mater Technol2018;3:1800056

[149] Ciui B,Mishra RK.Chemical sensing at the robot fingertips: toward automated taste discrimination in food samples.ACS Sens2018;3:2375-84

[150] Chitta S,Piccoli M.Tactile sensing for mobile manipulation.IEEE Trans Robot2011;27:558-68

[151] Xia Z,Fang B,Sun F.A review on sensory perception for dexterous robotic manipulation.Int J Adv Robot Syst2022;19:172988062210959

[152] Guo ZH,Shao J.Bioinspired soft electroreceptors for artificial precontact somatosensation.Sci Adv2022;8:eabo5201 PMCID:PMC9140963

[153] Ham J,Cutkosky MR.UV-laser-machined stretchable multi-modal sensor network for soft robot interaction.NPJ Flex Electron2022;6:94

[154] Cheng Y,Jia YY.Data correlation approach for slippage detection in robotic manipulations using tactile sensor array. In Proceedings of the IROS 2015: IEEE/RSJ International Conference on Intelligent Robots and Systems; 28 September-3 October 2015; Hamburg, Germany; pp. 2717-22.

[155] James JW,Lepora NF.Slip detection with a biomimetic tactile sensor.IEEE Robot Autom Lett2018;3:3340-6

[156] Van Wyk K, Falco J. Calibration and analysis of tactile sensors as slip detectors. In Proceedings of the ICRA 2018: IEEE International Conference on Robotics and Automation; 21-25 May 2018; Brisbane, Australia; pp. 2744-51.

[157] Su Z,Chebotar Y.Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor. In Proceedings of the Humanoids 2015: IEEE-RAS International Conference on Humanoid Robots; 3-5 November 2015; Seoul, Korea; pp. 297-303.

[158] Bhattacharjee T,Kemp CC.Inferring object properties with a tactile-sensing array given varying joint stiffness and velocity.Int J Human Robot2018;15:1750024

[159] Meier M,Haschke R.Distinguishing sliding from slipping during object pushing. In Proceedings of the IROS 2016: IEEE/RSJ International Conference on Intelligent Robots and Systems; 9-14 October 2016; Daejeon, Korea; pp. 5579-84

[160] Hogan FR,Dong SY.Tactile dexterity: manipulation primitives with tactile feedback. In Proceedings of the ICRA 2020: IEEE International Conference on Robotics and Automation; 31 May-31 August 2020; Paris, France; pp. 8863-9.

[161] Hellebrekers T,Veloso M,Majidi C.Localization and force-feedback with soft magnetic stickers for precise robot manipulation. In Proceedings of the IROS 2020: IEEE/RSJ International Conference on Intelligent Robots and Systems; 25-29 October 2020; Las Vegas, Nevada, USA; pp. 8867-74.

[162] Kappler D,Kalakrishnant M,Schaal S.Data-driven online decision making for autonomous manipulation. Robot Sci Syst 2015.

[163] Hoffmann H,Earl D,Salemi B.Adaptive robotic tool use under variable grasps.Robot Auton Syst2014;62:833-46

[164] Zhang K,Veloso M.Leveraging multimodal haptic sensory data for robust cutting. In Proceedings of the Humanoids 2019: IEEE-RAS 19th International Conference on Humanoid Robots; 15-17 October 2019; Toronto, Ontario, Canada; pp. 409-16.

[165] Ding H,Zheng N,Lai Y.Tri-Co robot: a Chinese robotic research initiative for enhanced robot interaction capabilities.Natl Sci Rev2018;5:799-801

[166] Wei P,Cao Z.Flexible and stretchable electronic skin with high durability and shock resistance via embedded 3D printing technology for human activity monitoring and personal healthcare.Adv Mater Technol2019;4:1900315

[167] Webb RC,Behnaz A.Ultrathin conformal devices for precise and continuous thermal characterization of human skin.Nat Mater2013;12:938-44 PMCID:PMC3825211

[168] Guo H,Zhou Z,Wei D.Transparent, flexible, and stretchable WS₂ based humidity sensors for electronic skin.Nanoscale2017;9:6246-53

[169] Li Z,Wang ZL.Nanogenerator-based self-powered sensors for wearable and implantable electronics.Research2020;2020:8710686 PMCID:PMC7085499

[170] Liu Z,Ouyang H.Transcatheter self-powered ultrasensitive endocardial pressure sensor.Adv Funct Mater2019;29:1807560

[171] Suzuki K,Okumiya Y.Rapid-response, widely stretchable sensor of aligned MWCNT/elastomer composites for human motion detection.ACS Sens2016;1:817-25

[172] Lin R,Achavananthadith S.Wireless battery-free body sensor networks using near-field-enabled clothing.Nat Commun2020;11:444 PMCID:PMC6978350

[173] Wong TH,Zhou J.Tattoo-like epidermal electronics as skin sensors for human machine interfaces.Soft Sci2021;1:10

[174] Su M,Chen S.Nanoparticle based curve arrays for multirecognition flexible electronics.Adv Mater2016;28:1369-74

[175] Yan Z,Wang D.Stretchable micromotion sensor with enhanced sensitivity using serpentine layout.ACS Appl Mater Interfaces2019;11:12261-71

[176] Pyo S,Kim W,Kim J.Multi-layered, hierarchical fabric-based tactile sensors with high sensitivity and linearity in ultrawide pressure range.Adv Funct Mater2019;29:1902484

[177] Zhou Y,Liu R,Zhang Q.Multichannel noninvasive human-machine interface via stretchable µm thick sEMG patches for robot manipulation.J Micromech Microeng2018;28:014005

[178] He T,Shi Q.Self-powered glove-based intuitive interface for diversified control applications in real/cyber space.Nano Energy2019;58:641-51

[179] Dong W,Hu W,Huang Y.Wearable human-machine interface based on PVDF piezoelectric sensor.Trans Inst Meas Control2017;39:398-403

[180] Mishra S,Lee Y.Soft, conformal bioelectronics for a wireless human-wheelchair interface.Biosens Bioelectron2017;91:796-803 PMCID:PMC5323068

[181] Li Y,Yan Y.Multifunctional biomimetic tactile system via a stick-slip sensing strategy for human-machine interactions.NPJ Flex Electron2022;6:46

[182] Guo W,Yin Z.On-skin stimulation devices for haptic feedback and human-machine interfaces.Adv Mater Technol2022;7:2100452

[183] Yang C,Chen Y.A review of human-machine cooperation in the robotics domain.IEEE Trans Human Mach Syst2022;52:12-25

[184] Yu X,Yu Y.Skin-integrated wireless haptic interfaces for virtual and augmented reality.Nature2019;575:473-9

[185] Sun Z,Zhang Z.Artificial intelligence of things (AIoT) enabled virtual shop applications using self-powered sensor enhanced soft robotic manipulator.Adv Sci2021;8:e2100230 PMCID:PMC8292889