Symplectic geometry in hybrid and impulsive optimal control

i

This article has been updated. A Correction to this article was published on .

i

The Original Article was published on

i

The Original Article was published on

i

This article has been updated

i

This article was retracted on

i

This article has been updated

Abstract

Hybrid dynamical systems are systems which undergo both continuous and discrete transitions. The Bolza problem from optimal control theory was applied to these systems and a hybrid version of Pontryagin’s maximum principle was presented. This hybrid maximum principle was presented to emphasize its geometric nature which made its study amenable to the tools of geometric mechanics and symplectic geometry. One explicit benefit of this geometric approach was that the symplectic structure (and hence the induced volume) was preserved. This allowed for a hybrid analog of caustics and conjugate points. Additionally, an introductory analysis of singular solutions (beating and Zeno) was discussed geometrically. This work concluded on a biological example where beating can occur.

Keywords

hybrid systems / optimal control / symplectic geometry

CHANGE HISTORY

A Correction to this paper has been published:
https://doi.org

The Retraction Note was updated to reflect reception of statements of disagreement from all authors.

This article has been retracted.Please see the Retraction Notice for more detail:
https://doi.org

References

[1] K. Aihara, H. Suzuki, Theory of hybrid dynamical systems and its applications to biological and medical systems, Philos Trans A Math Phys Eng Sci., 368 (2010), 4893-4914 https://doi.org/10.1098/rsta.2010.0237

[2] V. Azhmyakov, S. A. Attia, D. Gromov, J. Raisch, Necessary optimality conditions for a class of hybrid optimal control problems, in Hybrid Systems: Computation and Control (eds. A. Bemporad, A. Bicchi, and G. Buttazzo), Springer Berlin Heidelberg, 2007, 637-640. https://doi.org/10.1007/978-3-540-71493-4_50

[3] A. Pakniyat, P. E. Caines, On the minimum principle and dynamic programming for hybrid systems, IFAC Proceedings Volumes, 47 (2014), 9629-9634. https://doi.org/10.3182/20140824-6-ZA-1003.02700

[4] T. Westenbroek, X. Xiong, A. Ames, S. Sastry, Optimal control of piecewise-smooth control systems via singular perturbations, in 2019 IEEE Conference on Decision and Control (CDC), 2019, 3046-3053. https://doi.org/10.1109/CDC40024.2019.9029232

[5] K. Yunt, C. Glocker, Modeling and optimal control of hybrid rigidbody mechanical systems, in Hybrid Systems: Computation and Control (eds. A. Bemporad, A. Bicchi, and G. Buttazzo), Springer Berlin Heidelberg, 2007, 614-627. https://doi.org/10.1007/978-3-540-71493-4_47

[6] V. Azhmyakov, S. A. Attia, J. Raisch, On the maximum principle for impulsive hybrid systems, in Hybrid Systems: Computation and Control (eds. M. Egerstedt and B. Mishra), Springer Berlin Heidelberg, 2008, 30-42. https://doi.org/10.1007/978-3-540-78929-1_3

[7] A. Cristofaro, C. Possieri, M. Sassano, Time-optimal control for the hybrid double integrator with state-driven jumps, in 2019 IEEE Conference on Decision and Control (CDC), 2019, 6301-6306. https://doi.org/10.1109/CDC40024.2019.9030262

[8] A. Pakniyat, P. E. Caines, On the minimum principle and dynamic programming for hybrid systems with low dimensional switching manifolds, in 2015 IEEE Conference on Decision and Control (CDC) , 2015, 2567-2573. https://doi.org/10.1109/CDC.2015.7402603

[9] D. N. Pekarek, J. E. Marsden, Variational collision integrators and optimal control, in Proc. of the 18th International Symposium on Mathematical Theory of Networks and Systems (MTNS), 2008.

[10] D. Liberzon, Calculus of variations and optimal control theory: A concise introduction , Princeton University Press, 2012.

[11] L. S. Pontryagin, V. G. Boltyanskii, R. V. Gamkrelidze, E. F. Mishchenko, The mathematical theory of optimal processes , New York: Interscience Publishers, Inc., 1962.

[12] M. Barbero-Liñan, M.C. Muñoz-Lecanda, Geometric approach to pontryagin’s maximum principle, Acta Appl Math, 108 (2009), 429-485. https://doi.org/10.1007/s10440-008-9320-5

[13] B. Piernicola, C. Franco, Lagrangian submanifold landscapes of necessary conditions for maxima in optimal control: global parameterizations and generalized solutions, J Math Sci, 135 (2006), 3125-3144. https://doi.org/10.1007/s10958-006-0149-z

[14] W. Clark, A. Bloch, Invariant forms in hybrid and impact systems and a taming of Zeno, Arch Rational Mech Anal, 247 (2023), 13. https://doi.org/10.1007/s00205-023-01844-1

[15] S. N. Simic, K. H. Johansson, J. Lygeros, S. Sastry, Structural stability of hybrid systems, in 2001 European Control Conference (ECC), 2001, 3858-3863. https://doi.org/10.23919/ECC.2001.7076536

[16] M. Barbero-Liñan, J. Cortés, D. Martín de Diego, S. Martínez, M. C. Muñoz Lecanda, Global controllability tests for geometric hybrid control systems, Nonlinear Analysis: Hybrid Systems, 38 (2020), 100935. https://doi.org/10.1016/j.nahs.2020.100935

[17] R. Geobel, R. G. Sanfelice, A. R. Teel, Hybrid dynamical systems , Princeton University Press, 2012. https://doi.org/10.23943/princeton/9780691153896.001.0001

[18] W. M. Haddad, V. Chellaboina, S. G. Nersesov, Impulsive and hybrid dynamical systems: stability, dissipativity, and control , Princeton University Press, 2006. https://doi.org/10.1515/9781400865246

[19] N. J. Kong, J. J. Payne, J. Zhu, A. M. Johnson, Saltation matrices: The essential tool for linearizing hybrid dynamical systems, Proceedings of the IEEE, 112 (2024), 585-608. https://doi.org/10.1109/JPROC.2024.3440211

[20] A. D. Ames, H. Zheng, R. D. Gregg, S. Sastry, Is there life after Zeno? Taking executions past the breaking (Zeno) point, Proceedings of the 25th American Control Conference, 2006, 2652-2657. https://doi.org/10.1109/ACC.2006.1656623

[21] B. Brogliato, Nonsmooth mechanics, In: Communications and Control Engineering, Springer International Publishing, 2016. https://doi.org/10.1007/978-3-319-28664-8

[22] I. Gelfand, S. Fomin, Calculus of variations, In: Dover Books on Mathematics, Dover Publications, 2000.

[23] J. Guckenheimer, P. Holmes, Nonlinear oscillations, dynamical systems, and bifurcations of vector fields, In: Applied Mathematical Sciences, Springer-Verlag New York, 1983. https://doi.org/10.1007/978-1-4612-1140-2

[24] R. C. Fetecau, J. E. Marsden, M. Oritz, M. West, Nonsmooth Lagrangian mechanics and variational collision integrators, SIAM J. Appl. Dyn. Syst., 2 (2003), 381-416. https://doi.org/10.1137/S1111111102406038

[25] W. A. Clark, M. Oprea, A. Shaw, Optimal control of hybrid systems with submersive resets, IFAC-PapersOnLine, 58 (2024), 89-94. https://doi.org/10.1016/j.ifacol.2024.08.262

[26] L. Colombo, M. de León, M. E. E. Irazú, A. López-Gordón, Hamilton-Jacobi theory for nonholonomic and forced hybrid mechanical systems, Geom. Mech., 1 (2024), 123-152. https://doi.org/10.1142/S2972458924500059

[27] A. Pakniyat, Optimal control of deterministic and stochastic hybrid systems: Theory and applications , Ph.D thesis, McGill University, 2016.

[28] W. Clark, A. Bloch, Stable orbits for a simple passive walker experiencing foot slip, in 2018 IEEE Conference on Decision and Control (CDC), 2018, 2366-2371. https://doi.org/10.1109/CDC.2018.8618880

[29] R. Abraham, J. Marsden, Foundations of mechanics , AMS Chelsea Pub./American Mathematical Society, 2008.

[30] W. Clark, M. Oprea, Optimal control of hybrid systems via hybrid Lagrangian submanifolds, in 7th IFAC Workshop on Lagrangian and Hamiltonian Methods for Optimal Control, 2021, 88-93. https://doi.org/10.1016/j.ifacol.2021.11.060

[31] A. A. Agrachev, Y. L. Sachkov, Control theory from the geometric viewpoint , Springer Berlin Heidelberg, 2004. https://doi.org/10.1007/978-3-662-06404-7

[32] W. Clark, M. Oprea, Optimality of Zeno executions in hybrid systems, in 2023 American Control Conference (ACC) , 2023, 3983-3988. https://doi.org/10.23919/ACC55779.2023.10155928

[33] S. Phillips, R. G. Sanfelice, A Framework for modeling and analysis of dynamical properties of spiking neurons, in 2014 American Control Conference, 2014, 1414-1419. https://doi.org/10.1109/ACC.2014.6859494

[34] W. Gerstner, W. M. Kistler, R. Naud, L. Paninski, Neuronal dynamics: From single neurons to networks and models of cognition , Cambridge University Press, 2014.

[35] O. V. Popovych, P. A. Tass, Control of abnormal synchronization in neurological disorders, Front. Neurol., 5 (2014), 268. https://doi.org/10.3389/fneur.2014.00268

[36] C. J. Wilson, B. Beverlin, T. Netoff, Chaotic desynchronization as the therapeutic mechanism of deep brain stimulation, Front. Syst. Neurosci., 5 (2011), 50. https://doi.org/10.3389/fnsys.2011.00050

[37] B. Duchet, G. Weerasinghe, H. Cagnan, P. Brown, C. Bick, R. Bogacz, Phase-dependence of response curves to deep brain stimulation and their relationship: from essential tremor patient data to a Wilson-Cowan model, J. Math. Neurosci., 10 (2020), 4. https://doi.org/10.1186/s13408-020-00081-0

[38] T. Kreuz, F. Mormann, R. Andrezejak, A. Kraskov, K. Lehertz, P. Grassberger, Measuring synchronization in coupled model systems: A comparison of different approaches, Physica D, 225 (2007), 29-42. https://doi.org/10.1016/j.physd.2006.09.039

[39] M. Rungger, O. Stursberg, Optimal control for deterministic hybrid systems using dynamic programming, IFAC Proceedings Volumes, 42 (2009), 316-321. https://doi.org/10.3182/20090916-3-ES-3003.00055

[40] E. Gutkin, A. Katok, Caustics for inner and outer billiards, Commun. Math. Phys., 173 (1995), 101-133. https://doi.org/10.1007/BF02100183

[41] X. Wang, J. Liu, H. Peng, Symplectic pseudospectral methods for optimal control , Springer Singapore, Singapore, 2021. https://doi.org/10.1007/978-981-15-3438-6