Real-time mobile robot teleoperation via Internet based on predictive control

Abstract

A remote control system that can control a mobile robot in real time via the internet is proposed. To compensate for the network delay and counteract its impact on the teleoperation system, a predictive control scheme based on the modified Smith predictor proposed is selected. To ensure the stability and transparency of the system, a dynamic model manager is designed based on the information exchange between the sensors at the master and slave sides. To precisely predict the time delay, a new timer synchronization algorithm is proposed. To decrease delay- jitter, a new data buffer scheme is performed. Force feedback and a virtual predictive display are introduced to enhance the real-time efficiency of teleoperation. The usefulness and effectiveness of the proposed method and system are proven by teleoperation experiments via the internet over a long distance.

References

1. Goldberg K Mascha M Gentner S et al.Desktop teleoperation via the World Wide WebIn: Proceedings of the IEEE International Conference on Robotics &Automation Piscataway, NJUSAIEEE 1995 654659
2. Paulos E Canny J Delivering real reality tothe World Wide Web via teleroboticsIn: Proceedings of theIEEE International Conference on Robotics and Automation Piscataway, NJUSAIEEE 1996 16941699
3. Baruch J E F Cox M J Remote control and robots:an Internet solutionComputing & ControlEngineering Journal 1996 7(1)3944. doi:10.1049/cce:19960108
4. Brady K Tarn T J Internet-based remote teleoperationIn: Proceedings of the IEEE International Conference on Roboticsand Automation Piscataway, NJUSAIEEE 1998 6570
5. Simmons R Fernandez J L et al.Lessons learned fromXavierIEEE Robotics & Automation Magazine 2000 7(2)3339. doi:10.1109/100.848266
6. Stein M R InteractiveInternet artistryIEEE Robotics & AutomationMagazine 2000 7(2)2832. doi:10.1109/100.848265
7. Churms C L Prozesky V M Springhorn K A The remote control of nuclear microprobes over the InternetNuclear Instruments and Methods in Physics ResearchSection B: Beam Interactions with Materials and Atoms 1999 158(1–4)124128. doi:10.1016/S0168‐583X(99)00306‐7
8. Saucy P Mondada F KhepOn TheWeb: open accessto a mobile robot on the InternetIEEE Robotics &Automation Magazine 2000 7(1)4147. doi:10.1109/100.833574
9. Taylor K Dalton B Internet robots: A new roboticsnicheIEEE Robotics & Automation Magazine 2000 7(1)2734. doi:10.1109/100.833572
10. Anderson R J Spong M W Bilateral control of teleoperatorswith time delayIEEE Transactions on AutomaticControl 1989 34(5)494501. doi:10.1109/9.24201
11. Lawrence D A Stabilityand transparency in bilateral teleoperationIEEE Transactions on Robotics and Automation 1993 9(5)624637. doi:10.1109/70.258054
12. Elhajj I Xi N Fung W K et al.Haptic information in Internet-based teleoperationIEEE/ASME Transactions on Mechatronics 2001 6(3)295304. doi:10.1109/3516.951367
13. Elhajj I Xi N Song B H et al.Transparency and synchronization in supermedia enhancedInternet2based teleoperationIn: Proceedings of the IEEEInternational Conference on Robotics &Automation Piscataway, NJUSAIEEE 2002 27132718
14. Liu P X Meng M Q H Liu P R et al.An end-to-end transmission structure for the remotecontrol of robots over IP networksIEEE/ASMETransactions on Mechatronics 2005 10(5)560570. doi:10.1109/TMECH.2005.856110
15. Oboe R Force-reflectingteleoperation over the Internet: The JBIT projectIn: Proceedings of the IEEE 2003 91(3)449462. doi:10.1109/JPROC.2003.809216
16. Andreu D Fraisse P Segovia De Los Rios J A et al.Teleoperation over an IP Network:From control to architectural considerationsIn: Proceedingsof the International Conference on Control, Automation, Robotics andVision Piscataway, NJUSAIEEE 2004 765770
17. Uchimura Y Yakoh T Bilateral robot system on thereal-time network structureIEEE Transactionson Industrial Electronics 2004 51(5)940946. doi:10.1109/TIE.2004.834942
18. Tsuji T Kato A Ohnishi K et al.Safety control of teleoperation system under timevarying communication delayIn: Proceedings of the 8th IEEEInternational Workshop on Advanced Motion Control Piscataway, NJUSAIEEE 2004 463468
19. Fong T Thorpe C Baur C Robot, asker of questionsRoboticsand Autonomous Systems 2003 42(3–4)235243. doi:10.1016/S0921‐8890(02)00378‐0
20. Wang M Liu J N K Interactive control for Internet-basedmobile robot teleoperationRobotics andAutonomous Systems 2005 52(2–3)160179
21. Sim K B Byun K S Harashima F Internet-based teleoperation of an intelligent robot withoptimal two-layer fuzzy controllerIEEETransactions on Industrial Electronics 2006 53(4)13621372. doi:10.1109/TIE.2006.878295
22. Smith O J Acontroller to overcome dead timeISA Journal 1959 6(2)2833
23. Sheridan T B Spaceteleoperation through time delay: Review and prognosisIEEE Transactions on Robotics and Automation 1993 9(5)592606. doi:10.1109/70.258052
24. Wang S H Xu B G Wang Q Y Delays analysis for teleoperation over Internet and Smithp redictor with adaptive time-delay controlIn: Proceedingsof the IEEE International Conference on Robotics and Biomimetics Piscataway, NJUSAIEEE 2005 664669
25. Casavola A Mosca E Papini M Predictive teleoperation of constrained dynamic systemsvia Internet-like channelsIEEE Transactionson Control Systems Technology 2006 14(4)681694. doi:10.1109/TCST.2006.876637
26. Ramos J J G Maeta S M Mirisola L G B et al.Internet-based solutions in the development andoperation of an unmanned robotic airshipProceedings of the IEEE 2003 91(3)463474. doi:10.1109/JPROC.2003.809219
27. Bruemmer D J Few D A Walton M C et al.“Turn off the television!”: Real-worldrobotic exploration experiments with a virtual 3-D displayIn: Proceedings of the 38th Annual Hawaii International Conferenceon System Sciences PiscatawayUSAIEEE 2005 18
28. Itoh T Yudate K Ito S et al.New predictive display method of motion and forceinformation for network teleoperation without using virtual environmentmodelIn: Proceedings of the IEEE/RSJ International Conferenceon Intelligent Robotics and Systems Piscataway, NJUSAIEEE 2003 28152822
29. Kheddar A Teleoperationbased on the hidden robot conceptIEEE Transactionson Systems, Man, and Cybernetics 2001 31(1)113
30. Wang S H Xu B G Wang Q Y et al.Modified Smith predictor and controller for time-delayprocess with uncertaintyIn: Proceedings of the 6th WorldConference on Intelligent Control and Automation Piscataway,NJUSAIEEE 2006 623627