RISMO: Riemannian Information-Geometric Swarm Motion Orchestration for Heterogeneous UAV–UGV Cooperative Exploration in Unknown Environments

Abstract

The orchestration of heterogeneous swarm systems, such as Unmanned Aerial Vehicle (UAV) and Unmanned Ground Vehicle (UGV) teams, in unknown, GPS-denied environments requires coordination among active perception, collision avoidance, and topological flexibility. Traditional Artificial Potential Field (APF) methods can suffer from local-minimum deadlocks, while optimization-based Control Barrier Function Quadratic Programs (CBF-QPs) may produce high-frequency control variation in narrow corridors. To address these limitations, this paper proposes the Riemannian Information-geometric Swarm Motion Orchestration (RISMO) framework. RISMO integrates objective-driven navigation, perception-aware motion generation, and obstacle avoidance within a common non-Euclidean metric representation. We construct a Riemannian metric tensor that incorporates the Fisher Information Matrix (FIM) to encourage the UGVs to preserve line-of-sight tracking of the UAVs. To accommodate formation deformation in narrow passages, the swarm topology is modeled as a Semi-Markov Jump System (S-MJS). Under the enforced positive per-agent inter-event bound and the stated Average Dwell Time (ADT) condition, the modeled switching sequence has a bounded transition frequency and cannot exhibit Zeno accumulation. Furthermore, a goal-aligned tangential flux supplies a deterministic local directional bias near saddle-like stagnation. The numerical and ablation results show that this mechanism facilitates escape from the tested non-convex traps. In the planar simulations, RISMO reduces the observed gradient stagnation of APF and the high-frequency control variation of CBF-QP while preserving positive obstacle clearance and cooperative perception.

Keywords

Riemannian information geometry / Heterogeneous swarm orchestration / Semi-Markov jump systems / Nonlinear multi-agent consensus

References

[1] Z. Du, C. Luo, G. Min, J. Wu, C. Luo, J. Pu, S. Li, A survey on autonomous and intelligent swarms of uncrewed aerial vehicles (UAVs). IEEE Trans. Intell. Transp. Syst. (2025)

[2] Arshid K., Krayani A., Marcenaro L., Gomez D.M., Regazzoni C.. Toward autonomous UAV swarm navigation: a review of trajectory design paradigms. Sensors, 2025, 25185877.

[3] J.P. Queralta, Collaborative autonomy in heterogeneous multi-robot systems. PhD thesis, University of Turku (2022)

[4] Liu H., Zhang Z., Dong J., Benndorf J., Jia X., Wang X., Wu X., Chen G.. A review of positioning technologies for personnel and equipment in underground mines. Int. J. Digit. Earth, 2025, 1812506493

[5] S. Psarros, T. Hatzichristos, Positioning technologies in location-based services for emergency management: a review and future perspectives. Surv. Rev., 1–20 (2026)

[6] Wang S., Ahmad N.S.. A comprehensive review on sensor fusion techniques for localization of a dynamic target in gps-denied environments. IEEE Access, 2024, 13: 2252-2285.

[7] M. Tranzatto, M. Dharmadhikari, L. Bernreiter, M. Camurri, S. Khattak, F. Mascarich, V. Pimentel, V. Reijgwart, P. Roques, R. Buchanan, et al., Team cerberus wins the darpa subterranean challenge: technical overview and lessons learned (2022). arXiv preprint. arXiv:2207.04914

[8] Rouček T., Pecka M., Čížek P., Petrícek T., Bayer J., Šalanskỳ V., Heřt D., Petrík V., Krajník T., Faigl J., et al. Darpa subterranean challenge: multi-robotic exploration of underground environments. International Conference on Modelling and Simulation for Autonomous Systems, 2019, Berlin: Springer, 274-290

[9] Loquercio A., Kaufmann E., Ranftl R., Müller M., Koltun V., Scaramuzza D.. Learning high-speed flight in the wild. Sci. Robot., 2021, 6595810.

[10] Zhang H., Huo J., Huang Y., Wang D.. Perception-aware based quadrotor translation and yaw angle planner in unpredictable dynamic situations. IEEE Trans. Aerosp. Electron. Syst., 2024, 6114760.

[11] Wen X., Hou B., Chen Y., et al. Coordinated control of unmanned ground vehicle and unmanned aerial vehicle under line-of-sight maintenance constraint. Drones, 2026, 102151.

[12] Ghommam J., Sinan S., Fareh R., et al. Fixed-time adaptive cooperative control architecture for air-ground target tracking using UAV and UGV with dynamic constraints. Int. J. Control, 2025, 981228582875.

[13] Ropero F., Muñoz P., R-Moreno M.D.. Terra: a path planning algorithm for cooperative UGV–UAV exploration. Eng. Appl. Artif. Intell., 2019, 78: 260-272.

[14] Roncero A.S., Muchacho R.I.C., Ögren P.. Multi-agent obstacle avoidance using velocity obstacles and control barrier functions. 2025 IEEE International Conference on Robotics and Automation (ICRA), 2025IEEE66386644.

[15] Zhang S., So O., Garg K., et al. Gcbf+: a neural graph control barrier function framework for distributed safe multiagent control. IEEE Trans. Robot., 2025, 41: 1533-1552.

[16] G. Tadevosyan, V. Serpiva, A. Fedoseev, et al., Attentionswarm: reinforcement learning with attention control barier function for crazyflie drones in dynamic environments (2025). arXiv preprint. arXiv:2503.07376

[17] Garg K., Hamilton S., Fan C.. Deadlock resolution of connected multi-agent systems using hierarchical control. 2024 IEEE 63rd Conference on Decision and Control (CDC), 2024IEEE12751282.

[18] Chandra R., Zinage V., Bakolas E., et al. Deadlock-free, safe, and decentralized multi-robot navigation in social mini-games via discrete-time control barrier functions. Auton. Robots, 2025, 49212.

[19] Wingo B., Murtaza M., Azimi V., et al. Adaptively robust control policy synthesis through Riemannian motion policies. IEEE Control Syst. Lett., 2020, 6: 31-36.

[20] Marew D., Lvovsky M., Yu S., et al. Integration of Riemannian motion policy with whole-body control for collision-free legged locomotion. 2023 IEEE-RAS 22nd International Conference on Humanoid Robots (Humanoids), 2023IEEE18

[21] Sun Y., Liu H.. Zeno-free distributed event-triggered containment control for multi-agent systems. 2025 Third International Conference on Cyber-Energy Systems and Intelligent Energy (ICCSIE), 2025IEEE16

[22] Wang L., Xu X., Han B.. Fixed-time event-triggered control for multi-agent systems with input delay. PLoS ONE, 2023, 18110293424

[23] Zhang G., Wang Y.N., Li F., et al. Asynchronous event-triggered passive consensus of semi-Markov jump multiagent systems with two-time-scale feature under dos attacks. IEEE Syst. J., 2024, 18212771287.

[24] Zhang L., Shen Z., Niu B., et al. Dynamic-event-based reachable set synthesis for nonlinear delayed hidden semi-Markov jump systems under multiple cyber-attacks. IEEE Trans. Syst. Man Cybern. Syst., 2024, 551587598.

[25] Pan S., Xie X., Zhu Y., et al. Resilient and finite-time $h_{\infty }$ control of semi-Markov jump systems with both upper and lower thresholds of sojourn time. Int. J. Robust Nonlinear Control, 2024, 34956055623.

[26] Adderson R., Pan Y.J.. Continuously varying formation for heterogeneous multi-agent systems with novel potential field avoidance. IEEE Trans. Ind. Electron., 2024, 72217741783.

[27] Zhang Y., Chen J., Chen M., et al. Integrated the artificial potential field with the leader–follower approach for unmanned aerial vehicles cooperative obstacle avoidance. Mathematics, 2024, 127954.

[28] V. Bohara, S. Farzan, Safety-critical formation control of non-holonomic multi-robot systems in communication-limited environments (2024). arXiv preprint. arXiv:2406.13707

[29] Zhu L., Ma C., Li J., et al. Connectivity-maintenance UAV formation control in complex environment. Drones, 2023, 74229.

[30] Guo F., Shen R., Zhang J., et al. Adaptive and resilient consensus for UAV-UGV teams via virtual agent mediation and topology switching. 2025 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2025IEEE745750.

[31] Khaldi B., Harrou F., Cherif F., et al. Toward emerging cubic-spline patterns with a mobile robotics swarm system. IEEE Trans. Cogn. Dev. Syst., 2021, 142565577.

[32] Li R., Xin B., Zhang S., Lyu M., Cui J.. Swarm navigation based on smoothed particle hydrodynamics in complex obstacle environments. IEEE Robot. Autom. Lett., 2025, 10878517858.

[33] Chen Y.H., Lai Y.Y., Li T.H.S.. Collision-free motion policy for manipulator with multi-constraint coordination in dynamic environment. 2024 International Conference on Advanced Robotics and Intelligent Systems (ARIS), 2024IEEE18

[34] Hosogaya H., Inagaki S., Kato R., et al. Multiple local controls integrated by rmps for fcp-based hexapod walking. SICE J. Control Meas. Syst. Integr., 2024, 171195210.

[35] Wang Y., Sagawa R., Yoshiyasu Y.. Learning advanced locomotion for quadrupedal robots: a distributed multi-agent reinforcement learning framework with Riemannian motion policies. Robotics, 2024, 13686.

[36] Y. Li, J. Qiu, S. Calinon, A Riemannian take on distance fields and geodesic flows in robotics. Int. J. Robot. Res., 02783649261420233 (2024)

[37] Reijgwart V., Pantic M., Siegwart R., et al. Waverider: leveraging hierarchical, multi-resolution maps for efficient and reactive obstacle avoidance. 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024IEEE1315713163.

[38] Ali U., Sukkar F., Mueller A., et al. Enabling safe, active and interactive human-robot collaboration via smooth distance fields. 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI), 2025IEEE439446.

[39] J. Yang, J.J. Liu, Y. Li, et al., Deep reactive policy: learning reactive manipulator motion planning for dynamic environments (2025). arXiv preprint. arXiv:2509.06953

[40] F. Cladera, Z. Ravichandran, J. Hughes, et al., Air-ground collaboration for language-specified missions in unknown environments. IEEE Trans. Field Robot. (2025)

[41] Jiang W., Lei B., Ashton K., et al. Multimodal llm guided exploration and active mapping using Fisher information. Proceedings of the IEEE/CVF International Conference on Computer Vision, 202553925404

[42] Guo F., Shen R., Sun C., Zhang J., Zhan Q., Wang Y., Zhang J.. Large-scale tunnel air–ground collaboration with FLISP: fast LiDAR–IMU synchronized path planner. IEEE Trans. Field Robot., 2026, 3: 494-517.

[43] Jiang W., Lei B., Daniilidis K.. Fisherrf: active view selection and mapping with radiance fields using Fisher information. European Conference on Computer Vision, 2024, Berlin: Springer, 422-440

[44] J. Wang, Y. Kang, L. Fu, et al., Observability-aware active calibration of multi-sensor extrinsics for ground robots via online trajectory optimization. IEEE Sens. J. (2025)

[45] Wu K., Gao Y., Zhang M., et al. Time-varying formation tracking control of heterogeneous unmanned system with obstacle and collision avoidance. International Conference on Autonomous Unmanned Systems, 2023, Berlin: Springer, 342-352

[46] Y. Xia, H. Li, Reference model-based event-triggered impulsive control for fixed-time consensus of nonlinear multi-agent system. IEEE Access (2025)

[47] Tian Y., Ning Z., Yan H., et al. Time-elapsed-reliant observer-based control of semi-Markov jump linear systems with bilaterally bounded sojourn time. IEEE Trans. Circuits Syst. II, Express Briefs, 2024, 721218222

[48] Zhang W., Zhong S., Jiang X.. Finite-time annular domain stability and asynchronous $h_{\infty }$ control for stochastic switching Markov jump systems. IEEE Trans. Autom. Control, 2024, 69962776284.

[49] W. Zuo, Y.N. Wang, F. Li, et al., Output-feedback synchronization of semi-Markov jump two-time-scale neural networks: dual event-triggered scheme. Neurocomputing, 131479 (2025)

[50] R. Abinandhitha, T. Satheesh, R. Sakthivel, et al., Design of attack resistant robust fuzzy control of chaotic semi-Markov jump stochastic systems with multiple cyber attacks. Int. J. Gen. Syst., 1–26 (2025)

[51] Bullo F., Lewis A.D.. Geometric Control of Mechanical Systems: Modeling, Analysis, and Design for Simple Mechanical Control Systems, 2005, New York: Springer

[52] Do Carmo M.P., Flaherty F.J.. Riemannian Geometry, 1992, Boston: Birkhäuser

[53] Khalil H.K., Grizzle J.W.. Nonlinear Systems, 2002, Upper Saddle River: Prentice hall

[54] Olfati-Saber R., Murray R.M.. Consensus problems in networks of agents with switching topology and time-delays. IEEE Trans. Autom. Control, 2004, 49915201533.

[55] Khatib O.. Real-time obstacle avoidance for manipulators and mobile robots. Int. J. Robot. Res., 1986, 519098.

[56] Ames A.D., Coogan S., Egerstedt M., Notomista G., Sreenath K., Tabuada P.. Control barrier functions: theory and applications. 2019 18th European Control Conference (ECC), 2019IEEE34203431.

[57] Pantic M., Meijer I., Bähnemann R., Alatur N., Andersson O., Cadena C., Siegwart R., Ott L.. Obstacle avoidance using raycasting and Riemannian motion policies at kHz rates for MAVs. 2023 IEEE International Conference on Robotics and Automation (ICRA), 202316661672.

[58] A. Li, M. Mukadam, M. Egerstedt, B. Boots, Multi-objective policy generation for multi-robot systems using Riemannian motion policies (2019). arXiv preprint. arXiv:1902.05177

Rights & permissions

The Author(s)