Planning robotic agent actions using semantic knowledge for a home environment

Abstract

Autonomous mobile robotic agents are increasingly present in highly dynamic environments, thus making the planning and execution of their tasks challenging. Task planning is vital in directing the actions of a robotic agent in domains where a causal chain could lock the agent into a dead-end state. This paper proposes a framework that integrates a domain ontology (home environment ontology) with a task planner (ROSPlan) to translate the objectives coming from a given agent (robot or human) into executable actions by a robotic agent.

Keywords

Ontologies / autonomous robotics / planning / knowledge representation / semantic maps

References

[1] Burke JL,Rogers E,Scholtz J.Final report for the DARPA/NSF interdisciplinary study on human-robot interaction..IEEE Trans Syst, Man, Cybern C2004;34:103-12

[2] Thrun S.Toward a framework for human-robot interaction..Human–Computer Interaction2004;19:9-24

[3] Olszewska JI,Bermejo-Alonso J.Ontology for autonomous robotics. In: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN)2017;IEEE189-94

[4] de Freitas EP,Carbonera JL.Ontological concepts for information sharing in cloud robotics..J Ambient Intell Human Comput2020;1-12

[5] Kostavelis I.Semantic mapping for mobile robotics tasks: A survey..Robotics and Autonomous Systems2015;66:86-103

[6] Hanheide M,Horn GS.Robot task planning and explanation in open and uncertain worlds..Artificial Intelligence2017;247:119-50

[7] Toscano C,Veiga G.Enhancement of industrial logistic systems with semantic 3D representations for mobile manipulators..In: Iberian Robotics conference.2018;ChamSpringer International Publishing617-28

[8] Olivares-Alarcos A,Khamis A,Habib MK.A review and comparison of ontology-based approaches to robot autonomy..The Knowledge Engineering Review2019;34

[9] Guarino N.Formal ontology in information systems: Proceedings of the first international conference (FOIS’98); June 6-81998;Trento, Italy vol. 46IOS press

[10] Niles I.Towards a standard upper ontology. In: Proceedings of the international conference on Formal Ontology in Information Systems-Volume 20012001;2-9

[11] Lenat D.Building large knowledge-based systems: Representation and inference in the CYC project..Artificial Intelligence1993;61:53-63

[12] Arp R,Spear AD.Building ontologies with basic formal ontology.2015;Mit Press

[13] Masolo C,Gangemi A,Oltramari A.Wonderweb deliverable d18: Ontology library..Technical report, ISTC-CNR2003;

[14] Prestes E,Rama Fiorini S.Towards a core ontology for robotics and automation..Robotics and Autonomous Systems2013;61:1193-204

[15] Balakirsky S,Rama Fiorini S.Towards a robot task ontology standard. In: International Manufacturing Science and Engineering Conference. vol. 507492017;American Society of Mechanical EngineersV003T04A049

[16] Efficient integration of metric and topological maps for directed exploration of unknown environments..Robotics and Autonomous Systems2002;41:21-39

[17] Sim R.Autonomous vision-based robotic exploration and mapping using hybrid maps and particle filters..Image and Vision Computing2009;27:167-77

[18] He Z,Hou J,Schwertfeger S.Hierarchical topometric representation of 3D robotic maps..Auton Robot2021;45:755-71

[19] Niloy A,Chakrabortty RK,Badal FR.Critical design and control issues of indoor autonomous mobile robots: a review..IEEE Access2021;9:35338-70

[20] Liu J,Tian X,Wang J.Towards Semantic Sensor Data: An Ontology Approach..Sensors (Basel)2019;19:1193

[21] Günther M,Albrecht S.Model-based furniture recognition for building semantic object maps..Artificial Intelligence2017;247:336-51

[22] Lim GH,Suh H.Ontology-based unified robot knowledge for service robots in indoor environments..IEEE Trans Syst, Man, Cybern A2011;41:492-509

[23] Rusu RB,Blodow N,Beetz M.Model-based and learned semantic object labeling in 3D point cloud maps of kitchen environments. In: 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems2009;IEEE3601-8

[24] Galindo C.Inferring robot goals from violations of semantic knowledge..Robotics and Autonomous Systems2013;61:1131-43

[25] Wang T.Object semantic map representation for indoor mobile robots. In: Proceedings 2011 International Conference on System Science and Engineering2011;IEEE309-13

[26] Vasudevan S.Bayesian space conceptualization and place classification for semantic maps in mobile robotics..Robotics and Autonomous Systems2008;56:522-37

[27] Diab M,Beßler D.An ontology for failure interpretation in automated planning and execution. In: Iberian Robotics conference2019;Springer381-90

[28] Balakirsky S.Ontology based action planning and verification for agile manufacturing..Robotics and Computer-Integrated Manufacturing2015;33:21-28

[29] Garg S,Dayoub F.Semantics for robotic mapping, perception and interaction: a survey..FNT in Robotics2020;8:1-224

[30] Manzoor S,Joo SH.Ontology-based knowledge representation in robotic systems: a survey oriented toward applications..Applied Sciences2021;11:4324

[31] Tenorth M.KnowRob: A knowledge processing infrastructure for cognition-enabled robots..The International Journal of Robotics Research2013;32:566-90

[32] Beßler D,Beetz M.Owl-enabled assembly planning for robotic agents. In: Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems2018;1684-92

[33] Schlenoff C,Madhavan R.An IEEE standard ontology for robotics and automation. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems2012;IEEE1337-42

[34] Stenmark M.Knowledge-Based Industrial Robotics..In: SCAI2013;265-74

[35] Bruno B,Kamide H.The CARESSES EU-Japan project: making assistive robots culturally competent. In: Italian Forum of Ambient Assisted Living2017;Springer151-69

[36] Waibel M,Civera J.Roboearth..IEEE Robot Automat Mag2011;18:69-82

[37] Saxena A,Sener O,Misra DK.Robobrain: Large-scale knowledge engine for robots..arXiv preprint arXiv: 141206912014;

[38] Dogmus Z,Patoglu V.RehabRobo-Onto: Design, development and maintenance of a rehabilitation robotics ontology on the cloud..Robotics and Computer-Integrated Manufacturing2015;33:100-9

[39] Gonçalves PJS.Knowledge representation applied to robotic orthopedic surgery..Robotics and Computer-Integrated Manufacturing2015;33:90-9

[40] Bayat B,Carbonera J.Requirements for building an ontology for autonomous robots..IR2016;43:469-80

[41] IEEEStandard ontologies for robotics and automation..IEEE Std 1872-20152015;1-60

[42] Crespo J,Mozos O.Relational model for robotic semantic navigation in indoor environments..J Intell Robot Syst2017;86:617-39

[43] Crespo J,Mozos O,Beetz M.Reasoning Systems for Semantic Navigation in Mobile Robots. In: 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)2018;IEEE5654-59

[44] Protégé. Protégé; Access May, 2020. Available from: https://protege.stanford.edu

[45] Reasoner H. Hermit Reasoner; Access May, 2020. Available from: http://www.hermit-reasoner.com.

[46] Gangemi A,Catenacci C.Task taxonomies for knowledge content..Metokis Deliverable D2004;7:2004

[47] Fox M.PDDL2.1: An extension to PDDL for expressing temporal planning domains, jair2003;20:61-124

[48] Edelkamp S.PDDL2.2: The language for the classical part of the 4th international planning competition. Technical Report 1952004;University of Freiburg

[49] Gerevini A.Plan constraints and preferences in PDDL3..Technical Report 2005-08-07, Department of Electronics for Automation …2005;

[50] Cashmore M,Long D.Rosplan: Planning in the robot operating system. In: Proceedings of the International Conference on Automated Planning and Scheduling. vol. 252015;

[51] Gayathri R.Ontology based knowledge representation technique, domain modeling languages and planners for robotic path planning: A survey..ICT Express2018;4:69-74

[52] Gonçalves PJS,Santos S,Misson A.Computer vision intelligent approaches to extract human pose and its activity from image sequences..Electronics2020;9:159