Pointwise Second-Order Necessary Conditions for Stochastic Optimal Control with Jump Diffusions

Abstract

In this paper, we establish a second-order necessary conditions for stochastic optimal control for jump diffusions. The controlled system is described by a stochastic differential systems driven by Poisson random measure and an independent Brownian motion. The control domain is assumed to be convex. Pointwise second-order maximum principle for controlled jump diffusion in terms of the martingale with respect to the time variable is proved. The proof of the main result is based on variational approach using the stochastic calculus of jump diffusions and some estimates on the state processes.

Keywords

Optimal control / Stochastic systems with jumps / Pointwise second-order necessary condition / Maximum principle / Variational equation

References

[1] Bonnans JF, Silva FJ. First and second order necessary conditions for stochastic optimal control problems. Appl. Math. Optim.. 2012, 65 3 403-439

[2] Bouchard B, Elie R. Discrete time approximation of decoupled forward-backward SDE with jumps. Stoch. Process. Appl.. 2008, 118 53-75

[3] Cadenillas A. A stochastic maximum principle for systems with jumps, with applications to finance. Syst. Control Lett.. 2002, 47 5 433-444

[4] Cadenillas A, Haussmann UG. The stochastic maximum principle for a singular control problem. Stoch. Int. J. Probab. Stoch. Process.. 1994, 49 3–4 211-237

[5] Deepa, R., Muthukumar, P.: Infinite horizon optimal control of mean-field delay system with semi-Markov modulated jump-diffusion processes. J. Anal. 1–19 (2018)

[6] Dong Y, Meng QX. Second-order necessary conditions for optimal control with recursive utilities. Optim. Theory Appl.. 2019, 182 2 494-524

[7] Framstad NC, Øksendal B, Sulem A. Sufficient stochastic maximum principle for the optimal control of jump diffusions and applications to finance. J. Optim. Theory Appl.. 2004, 121 77-98

[8] Frankowska H, Tonon D. Pointwise second-order necessary optimality conditions for the Mayer problem with control constraints. Siam J. Control Optim.. 2013, 51 5 3814-3843

[9] Frankowska H, Zhang H, Zhang X. Necessary optimality conditions for local minimizers of stochastic optimal control problems with state constraints. Trans. Am. Math. Soc.. 2019, 372 2 1289-1331

[10] Gabasov R, Kirillova F. High order necessary conditions for optimality. Siam J. Control Optim.. 1972, 10 1 127-168

[11] Hafayed M. A mean-field maximum principle for optimal control of forward-backward stochastic differential equations with Poisson jump processes. Int. J. Dyn. Control. 2013, 1 4 300-315

[12] Hafayed M, Abbas S. Stochastic near-optimal singular controls for jump diffusions: necessary and sufficient conditions. J. Dyn. Control Syst.. 2013, 19 4 503-517

[13] Haussmann UG, Suo W. Singular optimal control I. II. Siam J. Control Optim.. 1995, 33 3 916-936

[14] Meng Q. General linear quadratic optimal stochastic control problem driven by a Brownian motion and a Poisson random martingale measure with random coefficients. Stoch. Anal. Appl.. 2014, 32 1 88-109

[15] Meng Q, Shen Y. Optimal control of mean-field jump-diffusion systems with delay: a stochastic maximum principle approach. J. Comput. Appl. Math.. 2015, 279 13-30

[16] Øksendal B, Sulem A. Applied Stochastic Control of Jump Diffusions. 2005 Berlin: Springer

[17] Peng S. A general stochastic maximum principle for optimal control problems. Siam J. Control Optim.. 1990, 28 4 966-979

[18] Rishel, R.: A Minimum Principle for Controlled Jump Processes. Lecture Notes in Economics and Mathematical Systems, vol. 107, pp. 493–508. Springer, Berlin (1975)

[19] Shen Y, Meng Q, Shi P. Maximum principle for mean-field jump diffusion stochastic delay differential equations and its application to finance. Automatica. 2014, 50 6 1565-1579

[20] Shi J, Wu Z. Maximum principle for forward-backward stochastic control system with random jumps and application to finance. J. Syst. Sci. Complex.. 2010, 23 219-231

[21] Situ, R.: A maximum principle for optimal controls of stochastic with random jumps. In: Proceedings of National Conference on Control Theory and its Applications, Qingdao, China (1991)

[22] Tang S. A second order maximum principle for singular optimal stochastic controls. Dyn. Syst. Ser. B. 2010, 4 4 1581-1599

[23] Tang S, Li X. Necessary conditions for optimal control of stochastic systems with random jumps. Siam J. Control Optim.. 1994, 32 5 1447-1475

[24] Tang M, Meng QX. Stochastic evolution equations of jump type with random coefficients: existence, uniqueness and optimal control. Sci. China Inf. Sci.. 2017, 60 118-202

[25] Tang M, Meng Q. Linear-quadratic optimal control problems for mean-field stochastic differential equations with jumps. Asian J. Control. 2019, 21 2 809-823

[26] Xiao H, Wang G. The filtering equations of forward-backward stochastic systems with random jumps and applications to partial information stochastic optimal control. Stoch. Anal. Appl.. 2010, 28 1003-1019

[27] Zhang, H., Zhang, X.: Pointwise second-order necessary conditions for stochastic optimal controls. Part I: the case of convex control constraint. Siam J. Control Optim. 53(4), 2267–2296 (2015)

[28] Zhang H, Zhang X. Pointwise second-order necessary conditions for stochastic optimal controls, Part II: the general case. Siam J. Control Optim.. 2017, 55 5 2841-2875

[29] Zhang X, Elliott RJ, Siu TK. A stochastic maximum principle for a Markov regime-switching jump-diffusion model and its application to finance. Siam J. Control Optim.. 2012, 50 2 964-990