A Variational Formula of Forward-Backward Stochastic Differential System of Mean-Field Type with Observation Noise and Some Application

Abstract

This paper examines an optimal control problem for mean-field systems under partial observation. The state system is described by a controlled mean-field forward-backward stochastic differential equation that features correlated noises between the system and the observation. Furthermore, the observation coefficients are allowed to depend not only on the control process but also on its probability distribution. Assuming a convex control domain and allowing all coefficients of the systems to be random, we derive directly a variational formula for the cost function in a given control process direction in terms of the Hamiltonian and the associated adjoint system without relying on variational systems under standard assumptions on the coefficients. As an application, we present the necessary and sufficient conditions for the optimality of our control problem using Pontryagin’s maximum principle in a unified manner. The research provides insights into the optimization of mean-field systems under partial observation, which has practical implications for various applications.

Keywords

Mean-field / Forward-backward stochastic differential equation (FBSDE) / Partial observation / Girsanov’s theorem / Maximum principle / 65K05 / 90C46

References

[1] Antonelli F. Backward-forward stochastic differential equations. Ann. Appl. Prob., 1993, 3: 777-793

[2] Buckdahn R, Djehiche B, Li J. A general stochastic maximum principle for SDEs of mean-field type. Appl. Math. Optim., 2011, 64(2): 197-216

[3] Delavarkhalafi A, Fatemion Aghda AS, Tahmasebi M. Maximum principle for infinite horizon optimal control of mean-field backward stochastic systems with delay and noisy memory. Int. J. Control, 2022, 95(2): 535-543

[4] Du K, Huang J, Wu Z. Linear quadratic mean-field-game of backward stochastic differential systems. Math. Control Relat. Fields, 2018, 8(3/4): 653

[5] Duffie D, Epstein LG. Asset pricing with stochastic differential utility. Rev. Fin. Stud., 1992, 53411-436

[6] El Karoui N, Peng S, Quenez MC. A dynamic maximum principle for the optimization of recursive utilities under constraints. Ann. Appl. Prob., 2001, 11: 664-693

[7] Fu Q, Xu F, Shen T, Takai K. Distributed optimal energy consumption control of HEVs under MFG-based speed consensus. Control Theory Technol., 2020, 18(2): 193-203

[8] Hafayed M, Ghebouli M, Boukaf S, Shi Y. Partial information optimal control of mean-field forward-backward stochastic system driven by Teugels martingales with applications. Neurocomputing, 2016, 200: 11-2

[9] Hao T, Meng Q. Singular optimal control problems with recursive utilities of mean-field type. Asian J. Control, 2021, 23(3): 1524-1535

[10] Hu M. Stochastic global maximum principle for optimization with recursive utilities. Prob. Uncertain. Quant. Risk, 2017, 2(1): 1

[11] Huang J, Shi J. Maximum principle for optimal control of fully coupled forward-backward stochastic differential delayed equations. ESAIM Control Optim. Calc. Var., 2012, 1841073-1096

[12] Huang J, Wang BC, Yong J. Social optima in mean field linear-quadratic-Gaussian control with volatility uncertainty. SIAM J. Control. Optim., 2021, 59(2): 825-856

[13] Kac, M.: Foundations of kinetic theory. In: Proceedings of the 3rd Berkeley Symposium on Mathematical Statistics and Probability, vol. 3, pp. 171–197 (1956)

[14] Kizilkale AC, Salhab R, Malham RP. An integral control formulation of mean field game based large scale coordination of loads in smart grids. Automatica, 2019, 100: 312-322

[15] Li J, Wei Q. Optimal control problems of fully coupled FBSDEs and viscosity solutions of Hamilton-Jacobi-Bellman dquations. SIAM J. Control. Optim., 2014, 52(3): 1622-1662

[16] Li R, Liu B. Necessary and sufficient near-optimal conditions for mean-field singular stochastic controls. Asian J. Control, 2015, 17(4): 1209-1221

[17] Li X, Shi J, Yong J. Mean-field linear-quadratic stochastic differential games in an infinite horizon. ESAIM Control Optim. Calc. Var., 2021, 27: 81

[18] Li X, Sun J, Xiong J. Linear quadratic optimal control problems for mean-field backward stochastic differential equations. Appl. Math. Optim., 2019, 80(1): 223-250

[19] Ma H, Liu B. Linear-quadratic optimal control problem for partially observed forward-backward stochastic differential equations of mean-field type. Asian J. Control, 2016, 18(6): 2146-2157

[20] Ma H, Liu B. Optimal control problem for risk-sensitive mean-field stochastic delay differential equation with partial information. Asian J. Control, 2017, 19(6): 2097-2115

[21] Ma J, Wu Z, Zhang D, Zhang J. On well-posedness of forward-backward SDEs—a unified approach. Ann. Appl. Probab., 2015, 25(4): 2168-2214

[22] Ma L, Zhang T, Zhang W. H∞\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$H_{\infty }$$\end{document} control for continuous-time mean-field stochastic systems. Asian J. Control, 2016, 18(5): 1630-1640

[23] McKean HPJr. A class of Markov processes associated with nonlinear parabolic equations. Proc. Natl. Acad. Sci. USA, 1966, 56(6): 1907

[24] Meng, Q., Shi, Q., Tang, M.: Maximum principle of forward-backward stochastic differential system of mean-field type with observation noise. (2017). arXiv:1708.05663

[25] Meyer-Brandis T, Øksendal B, Zhou XY. A mean-field stochastic maximum principle via Malliavin calculus. Stoch. Int. J. Prob. Stoch. Process., 2012, 845/6643-666

[26] Mou L, Yong J. A variational formula for stochastic controls and some applications. Pure Appl. Math. Q., 2007, 3(2): 539-567

[27] Øksendal B, Sulem A. Maximum principles for optimal control of forward-backward stochastic differential equations with jumps. SIAM J. Control. Optim., 2010, 48(5): 2945-2976

[28] Peng S, Wu Z. Fully coupled forward-backward stochastic differential equations and applications to optimal control. SIAM J. Control. Optim., 1999, 37(3): 825-843

[29] Shen Y, Meng Q, Shi P. Maximum principle for mean-field jump-diffusion stochastic delay differential equations and its application to finance. Automatica, 2014, 50(6): 1565-1579

[30] Song T, Liu B. Discrete-time mean-field stochastic linear-quadratic optimal control problem with finite horizon. Asian J. Control, 2021, 23(2): 979-989

[31] Tang M, Meng Q. Linear-quadratic optimal control problems for mean-field stochastic differential equations with jumps. Asian J. Control, 2019, 21(2): 809-823

[32] Wang B, Huang M. Mean-field production output control with sticky prices: Nash and social solutions. Automatica, 2019, 100: 90-98

[33] Wang BC, Zhang H. Indefinite linear quadratic mean field social control problems with multiplicative noise. IEEE Trans. Autom. Control, 2020, 66(11): 5221-5236

[34] Wang BC, Zhang H, Zhang JF. Mean field linear quadratic control: uniform stabilization and social optimality. Automatica, 2020, 121109088

[35] Wang G, Wu Z. A maximum principle for mean-field stochastic control system with noisy observation. Automatica, 2022, 137110135

[36] Wang G, Xiao H, Xing G. An optimal control problem for mean-field forward-backward stochastic differential equation with noisy observation. Automatica, 2017, 86: 104-109

[37] Wang G, Zhang H. Mean-field backward stochastic differential equation with non-Lipschitz coefficient. Asian J. Control, 2020, 22(5): 1986-1994

[38] Wu Z. A general maximum principle for optimal control of forward-backward stochastic systems. Automatica, 2013, 49(5): 1473-1480

[39] Ye W, Yu Z. Exact controllability of linear mean-field stochastic systems and observability inequality for mean-field backward stochastic differential equations. Asian J. Control, 2022, 24(1): 237-248

[40] Yong J. A stochastic linear quadratic optimal control problem with generalized expectation. Stoch. Anal. Appl., 2008, 26(6): 1136-1160

[41] Yong J. Optimality variational principle for controlled forward-backward stochastic differential equations with mixed initial-terminal conditions. SIAM J. Control. Optim., 2010, 48(6): 4119-4156

[42] Yong J. Linear-quadratic optimal control problems for mean-field stochastic differential equations. SIAM J. Control. Optim., 2013, 51(4): 2809-2838

[43] Yu W, Wang F, Huang Y, Liu H. Social optimal mean field control problem for population growth model. Asian J. Control, 2020, 22(6): 2444-2451

[44] Zhang H, Qi Q, Fu M. Optimal stabilization control for discrete-time mean-field stochastic systems. IEEE Trans. Autom. Control, 2018, 64(3): 1125-1136

[45] Zhang S, Xiong J, Liu X. Stochastic maximum principle for partially observed forward-backward stochastic differential equations with jumps and regime switching. Sci. China Inf. Sci., 2018, 61(7): 1-13

[46] Zhou Q, Ren Y, Wu W. On optimal mean-field control problem of mean-field forward-backward stochastic system with jumps under partial information. J. Syst. Sci. Complex., 2017, 30(4): 828-856

Funding

Natural Science Foundation of Zhejiang Province(LZ22A010005)

RIGHTS & PERMISSIONS

Shanghai University