Continuous adaptive gaits manipulation for three-fingered robotic hands via bioinspired fingertip contact events

Abstract

The remarkable skill of changing its grasp status and relocating its fingers to perform continuous in-hand manipulation is essential for a multifingered anthropomorphic hand. A commonly utilized method of manipulation involves a series of basic movements executed by a high-level controller. However, it remains unclear how these primitives evolve into sophisticated finger gaits during manipulation. Here, we propose an adaptive finger gait-based manipulation method that offers real-time regulation by dynamically changing the primitive interval to ensure the force/moment balance of the object. Successful manipulation relies on contact events that act as triggers for real-time online replanning of multifinger manipulation. We identify four basic motion primitives of finger gaits and create a heuristic finger gait that enables the continuous object rotation of a round cup. Our experimental results verify the effectiveness of the proposed method. Despite the constant breaking and reengaging of contact between the fingers and the object during manipulation, the robotic hand can reliably manipulate the object without failure. Even when the object is subjected to interfering forces, the proposed method demonstrates robustness in managing interference. This work has great potential for application to the dexterous operation of anthropomorphic multifingered hands.

Keywords

Adaptive switch / Contact event / Continuous manipulation / Multifinger gait / Primitive

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (U2013212), the Key Research and Development Program of Zhejiang, China (2021C04015), and the Fundamental Research Funds for the Provincial Universities of Zhejiang, China (RF-C2019004).

References

[1] M.T. Mason, Toward robotic manipulation, Annu. Rev. Control Robot. Auton. Syst. 1 (2018) 1-28.

[2] A. Ude, A. Gams, T. Asfour, J. Morimoto, Task-specific generalization of discrete and periodic dynamic movement primitives, IEEE Trans. Robot. 26 (5) (2010) 800-815.

[3] A. Rodriguez, M.T. Mason, S. Ferry, From caging to grasping Int. J. Robot. Res. 31 (7) (2012) 886-900.

[4] H. Yuan, Y. Ge, C. Gan, Control strategy for gait transition of an underac-tuated 3D bipedal robot, Front. Inf. Technol. Electron. Eng. 20 (8) (2019) 1026-1035.

[5] A. Sylvain, et al., A dexterous soft robotic hand for delicate in-hand mnipulation, IEEE Robot. Autom. Lett. 5 (4) (2020) 5502-5509.

[6] M. Raymond, et al., Toward robust, whole-hand caging manipulation with underactuated hands, in: 2017 IEEE International Conference on Robotics and Automation, ICRA, 2017, pp. 1336-1342.

[7] N. Daoud, J.P. Gazeau, et al., A real-time strategy for dexterous manipula-tion: Fingertips motion planning, force sensing, and grasp stability, Robot. Auton. Syst. 60 (1) (2012) 377-386.

[8] Hélio Ochoa, Rui Cortesão, Impedance control architecture for robotic-assisted mold polishing based on human demonstration, IEEE Trans. Ind. Electron. 69 (4) (2022) 3822-3830.

[9] A. Bicchi, Hands for dexterous manipulation and robust grasping: A difficult road toward simplicity, IEEE Trans. Robot. Autom. 16 (6) (2000) 652-662.

[10] B. Sundaralingam, T. Hermans, Geometric in-hand regrasp planning: Al-ternating optimization of finger gaits and in-grasp manipulation, in: Proc. IEEE Int. Conf. Robot. Autom., 2018, pp. 231-238.

[11] S. Gokhan, L. Jamone, Learning by demonstration and robust control of dexterous in-hand robotic manipulation skills, in: 2019 IEEE/RSJ Inter-national Conference on Intelligent Robots and Systems, IROS, 2019, pp. 8246-8251.

[12] G. Chen, P. Qi, Z. Guo, H. Yu, Gait-event-based synchronization method for gait rehabilitation robots via a bioinspired adaptive oscillator, IEEE Trans. Biomed. Eng. 64 (6) (2017) 1345-1356.

[13] N. Karnati, B.A. Kent, E.D. Engeberg, Bioinspired sinusoidal finger joint synergies for a dexterous robotic hand to screw and unscrew objects with different diameters, IEEE/ASME Trans. Mechatronics 18 (2) (2013) 612-623.

[14] D. Aoyagi, W.E. Ichinose, et al., An assistive robotic device that can synchronize to the pelvic motion during human gait training,in: 9th International Conference on Rehabilitation Robotics, 2005, ICORR 2005, 2005, pp. 565-568.

[15] T. Nishimura, K. Shimizu, S. Nojiri, et al., Soft robotic hand with finger-bending/friction-reduction switching mechanism through 1-degree-of-freedom flow control, IEEE Robot. Autom. Lett. 7 (2) (2022) 5695-5702.

[16] Tracker, Tracker video analysis and modeling software, version 5.0.7, Comput. Softw. (2019) [Online]. Available: https://physlets.org/tracker.

[17] I.M. Chen, J.W. Burdick, Finding antipodal point grasps on irregularly shaped objects, IEEE Trans. Robot. Autom. 9 (4) (1993) 507-512.

[18] A.S. Morgan, K. Hang, B. Wen, K. Bekris, A.M. Dollar, Complex in-hand manipulation via compliance-enabled finger gaiting and multi-modal planning, IEEE Robot. Autom. Lett. 7 (2) (2022) 4821-4828.

[19] X. Ma, Y. Ye, H. Meng, et al., Sensor embedded soft fingertip for precise manipulation and softness recognition, IEEE Robot. Autom. Lett. 6 (4)(2021) 8734-8741.

[20] O.M. Andrychowicz others,Learning dexterous in-hand manipulation, Int.J. Robot. Res. 39 (1) (2020) 3-20.

[21] C.B. Teeple, T.N. Koutros, M.A. Graule, R.J. Wood, Multi-segment soft robotic fingers enable robust precision grasping, Int. J. Robot. Res. (2020).

[22] T. Nishimura, T. Watanabe, Single-motor robotic gripper with three func-tional modes for grasping in confined spaces, IEEE Robot. Autom. Lett. 8(11) (2023) 7408-7415.

[23] O. Azulay, I.B. David, A. Sintov, Learning haptic-based object pose estima-tion for in-hand manipulation control with underactuated robotic hands, IEEE Trans. Haptics 16 (1) (2023) 73-85.

[24] Revanth Konda, David Bombara, Steven Swanbeck, Jun Zhang, Anthropo-morphic twisted string-actuated soft robotic gripper with tendon-based stiffening, IEEE Trans. Robot. 39 (2) (2023) 1178-1195.

[25] A. Alian, M. Zareinejad, H.A. Talebi, Curvature tracking of a two-segmented soft finger using an adaptive sliding-mode controller, IEEE/ASME Trans. Mechatronics 28 (1) (2023) 50-59.

[26] W. Chen, C. Xiong, et al., Mechanical implementation of kinematic synergy for continual grasping generation of anthropomorphic hand, IEEE/ASME Trans. Mechatronics 20 (3) (2014) 1249-1263.

[27] P. Michelman, P. Allen,Forming complex dextrous manipulations from task primitives, in:Proceedings of the 1994 IEEE International Conference on Robotics and Automation, 1994, pp. 3383-3388.

[28] T. Oomichi, T. Miyatake, et al., Mechanics and multiple sensory bilateral control of a fingered manipulator,in: Proceedings of the 4th International Symposium on Robotics Research, 1988, pp. 145-153.

[29] K.B. Shimoga, A survey of perceptual feedback issues in dexterous telema-nipulation. II. Finger touch feedback, in:Proceedings of IEEE Virtual Reality Annual International Symposium, 1993, pp. 271-279.