Reconstruction method with twisting measurement and compensation for shape sensing of flexible robots

Abstract

Flexible robots can reach a target treatment part with a complex shape and zigzagging path in a limited space owing to the advantages of a highly flexible structure and high accuracy. Thus, research of the shape detection of flexible robots is important. A reconstruction method including torsion compensation is proposed, then the method with a numerical method that does not include torsion compensation is compared. The microsegment arc between two adjacent measurement points is regarded as an arc in a close plane and a circular helix in three-dimensional (3D) space during the shape reconstruction process. The simulation results show that the two algorithms perform equally well regarding 2D curves. For the 3D curves, the Frenet-based reconstruction method with torsion compensation produced a higher fitting accuracy compared with the numerical method. For the microsegment arc lengths of 40 mm and 20 mm, the maximum relative errors were reduced by 11.3% and 20.1%, respectively, for the 3D curves when the reconstruction method based on Frenet with twisting compensation was used. The lengths of the packaging grid points were 40 mm and 20 mm, and the sensing length was 260 mm for the no-substrate sensor. In addition, a shape reconstruction experiment was performed, and the shape reconstruction accuracies of the sensors were 2.817% and 1.982%.

Keywords

Flexible robots / Reconstruction method / Twisting compensation / Frenet-Serret / Shape reconstruction

References

[1.] Burgner-Kahrs J, Rucker DC, Choset H. Continuum robots for medical applications: a survey. IEEE Trans Rob, 2015, 31(6): 1261-1280.

[2.] Gilbert HB, Rucker DC, Webster RJ. Concentric tube robots: the state of the art and future directions. Robot Res, 2016, 114: 253-269.

[3.] Bergeles C, Yang CZ. From passive tool holders to microsurgeons: safer, smaller, smarter surgical robots. IEEE Trans Biomed Eng, 2013, 61(5): 1565-1576.

[4.] Berg NJV, Gerwen DGV, Dankelman J, et al. Design choices in needle steering—a review. IEEE/ASME Trans Mechatron, 2014, 20(5): 2172-2183.

[5.] Presti DL, Massaroni C, Leitão CSJ, et al. Fiber bragg gratings for medical applications and future challenges: a review. IEEE Access, 2020, 8: 156863-156888.

[6.] Yeung BMP, Chiu WY. Application of robotics in gastrointestinal endoscopy: a review. World J Gastroenterol, 2016, 22(5): 1811-1825.

[7.] Nisha P, Carlo S, Yang GZ, et al. Flexible platforms for natural orifice transluminal and endoluminal surgery. Endosc Int Open, 2014, 2: 117-123.

[8.] Shi C, Luo X, Qi P, et al. Shape sensing techniques for continuum robots in minimally invasive surgery: a survey. IEEE Trans Biomed Eng, 2016, 64(8): 1665-1678.

[9.] Rone WS, Ben-Tzvi P, et al. Continuum robot dynamics utilizing the principle of virtual power. IEEE Trans Rob, 2014, 30(1): 275-287.

[10.] Chirikjian GS. Conformational modeling of continuum structures in robotics and structural biology: a review. Adv Robot, 2015, 29(13): 817-829.

[11.] Xie SP, Ni FL, Wanget HR, et al. An overview of research on configuration detection of continuum robots. Mech Electron, 2015, 8: 68-71.

[12.] Croom JM, Rucker DC, Romano JM et al (2010) Visual sensing of continuum robot shape using self-organizing maps. In: IEEE international conference on robotics and automation, 3–8 May, Anchorage, Alaska, pp 4591–4596

[13.] Song S, Li Z, Yu H, et al. Electromagnetic positioning for tip tracking and shape sensing of flexible robots. IEEE Sens J, 2015, 15(8): 4565-4575.

[14.] Song S, Zhang C, Liu L, et al. Preliminary study on magnetic tracking-based planar shape sensing and navigation for flexible surgical robots in transoral surgery: methods and phantom experiments. Int J Comput Assist Radiol Surg, 2018, 13(2): 241-251.

[15.] Ryu SC, Dupont PE (2014) Dupont FBG-based shape sensing tubes for continuum robots. In: IEEE international conference on robotics and automation (ICRA), 31 May–7 June, Hong Kong, China, pp 3531–3537

[16.] Qi F, Chen B, She SG, et al. Shape sensing and feedback control of the catheter robot for interventional surgery. Indus Robot Int J Robot Res Appl, 2020, 48(2): 259-269.

[17.] Zhang LW, Qian JW, Shen LY et al (2004) FBG sensor devices for spatial shape detection of intelligent colonoscope. In: IEEE international conference on robotics and automation, 26 April–1 May, New Orleans, USA, pp 834–840

[18.] Zhang LW, Qian JW, Zhang YN, et al. Novel FBG sensor net system for real-time shape detection of intelligent endoscope. Chin J Mech Eng, 2006, 3(2): 177-182.

[19.] Park YL, Elayaperumal S, Daniel B, et al. Real-time estimation of 3-D needle shape and deflection for MRI-guided interventions. IEEE/ASME Trans Mechatron, 2010, 15(6): 906-915.

[20.] Henken K, Gerwen DV, Dankelman J, et al. Accuracy of needle position measurements using fiber bragg gratings. Minim Invasive Ther Allied Technol, 2012, 21(6): 408-414.

[21.] Shahriar S, Hegeman R, Alambeigi F et al (2019) FBG-based position estimation of highly deformable continuum manipulators: model-dependent vs. data-driven approaches. In: 2019 International symposium on medical robotics (ISMR), 3–5 April, Atlanta, USA. https://doi.org/10.1109/ismr.2019.8710179

[22.] Roesthuis RJ, Kemp M, Dobbelsteen VD, et al. Three-dimensional needle shape reconstruction using an array of fiber bragg grating sensors. IEEE/ASME Trans Mechatron, 2013, 19(4): 1115-1126.

[23.] Abayazid M, Kemp M, Misra M et al (2013) 3D flexible needle steering in soft-tissue phantoms using fiber bragg grating sensors. In: IEEE international conference on robotics and automation, 6–10 May, Karlsruhe, Germany, pp 5843–5849

[24.] Roesthuis RJ, Misra S, et al. Steering of multisegment continuum manipulators using rigid-link modeling and FBG-based shape sensing. IEEE Trans Rob, 2016, 32(2): 372-382.

[25.] Xu R, Yurkewich A, Patel RV. Curvature, torsion and force sensing in continuum robots using helically wrapped FBG sensors. IEEE Robotics and Automation Letters, 2016, 1(2): 1052-1059.

[26.] Wei J, Wang S, Li J, et al. Novel integrated helical design of single optic fiber for shape sensing of flexible robot. IEEE Sens J, 2017, 17(20): 6627-6636.

[27.] Khan F, Denasi A, Barrera D, et al. Multi-core optical fibers with bragg gratings as shape sensor for flexible medical instruments. IEEE Sens J, 2019, 19(14): 5878-5884.

[28.] Jäckle S, Eixmann T, Schulz-Hildebrandt T, et al. Fiber optical shape sensing of flexible instruments for endovascular navigation. Int J Comput Assist Radiol Surg, 2019, 14(12): 2137-2145.

[29.] Khan F, Barrera D, Sales S, et al. Curvature, twist and pose measurements using fiber bragg gratings in multi-core fiber: a comparative study between helical and straight core fibers. Sens Actuators A, 2021, 317.

[30.] Zhao SY, Cui JW, Chen MM. Review on optical fibers shape sensing technology. Opt Precision Eng, 2020, 28(1): 10-29.

[31.] Yang DY, Wu JQ, Qian JW. A research on the 3D reconstruction of the shape of the Endoscope. J Appl Sci, 2003, 5(4): 406-410.

[32.] Moore JP (2015) Shape sensing using multicore fiber. In: Optical fiber communications conference and exhibition (OFC), Los Angeles, 22–26 March, pp 1–3

[33.] Moore JP, Rogge MD. Shape sensing using multi-core fiber optic cable and parametric curve solutions. Opt Express, 2012, 20(3): 2967-2973.

[34.] Cui J, Zhao S, Yang C, et al. Parallel transport frame for fiber shape sensing. IEEE Photonics J, 2017, 10(1): 1-12.

[35.] Lim S, Han S. Helical extension method for solving the natural equation of a space curve. Surf Topogr Metrol Prop, 2017, 5(3): .

[36.] Lim S, Han S. Shape estimation of a bent and twisted cylinder using strain from a sensor array in triple helices. Meas Sci Technol, 2018, 29(9): .

[37.] Floris I, Madrigal J, Sales S. Twisting measurement and compensation of optical shape sensor based on spun multicore fiber. Mech Syst Signal Process, 2021, 150.

[38.] Meng LX, Xu H, Huang YY. High-accuracy 3D shape sensor based on anti-twist packaged high uniform multicore fiber FBGs. Adv Fiber Mater, 2023, 5: 1467-1477.

[39.] Mahjoubi S, Tan X, Bao Y. Inverse analysis of strain distributions sensed by distributed fiber optic sensors subject to strain transfer. Mech Syst Signal Process, 2022, 166.

[40.] Lally EM, Reaves M, Horrell E et al (2012) Fiber optic shape sensing for monitoring of flexible structures. Sensors and smart structures technologies for civil. In: SPIE 8345, sensors and smart structures technologies for civil, mechanical, and aerospace systems, 6 April. https://doi.org/10.1117/12.917490

[41.] Westbrook PS, Feder KS, Kremp T et al (2014) Integrated optical fiber shape sensor modules based on twisted multicore fiber grating arrays. In: Optical fibers and sensors for medical diagnostics and treatment applications XIV, 20 February, San Francisco. https://doi.org/10.1117/12.2041775

[42.] Chen XY, Zhang YN, Qian JW, et al. Accuracy of position tracking and fabrication of thin diameter sensor. Meas Sci Technol, 2021, 32.

[43.] Floris I, Adam JM, Calderón PA, et al. Fiber optic shape sensors: a comprehensive review. Opt Lasers Eng, 2021, 139.

[44.] Chen WH. Differential geometry, 2006, Beijing: Peking University Press

[45.] Chen XY, Yi XH, Qian JW, et al. Updated shape sensing algorithm for space curves with FBG sensors. Opt Lasers Eng, 2020, 129.

[46.] Chen XY, Zhang YN, Shen LY, et al. Fabrication and shape detection of a catheter using fiber bragg grating. Adv Manuf, 2020, 8(1): 107-118.

[47.] Chen XY, Zhang YN, Qian JW, et al. Analysis of strain transfer characteristics of no-substrate and thin diameter sensor. Opt Fiber Technol, 2021, 61.

[48.] Laura ET. Mathematics and social utopias in france: olinde rodrigues and his times. Hist Math, 2008, 35: 47-60.

Funding

National Natural Science Foundation of China http://dx.doi.org/10.13039/501100001809(52075314)