Spatial Localization for Nonlinear Dynamical Stochastic Models for Excitable Media

Abstract

Nonlinear dynamical stochastic models are ubiquitous in different areas. Their statistical properties are often of great interest, but are also very challenging to compute. Many excitable media models belong to such types of complex systems with large state dimensions and the associated covariance matrices have localized structures. In this article, a mathematical framework to understand the spatial localization for a large class of stochastically coupled nonlinear systems in high dimensions is developed. Rigorous mathematical analysis shows that the local effect from the diffusion results in an exponential decay of the components in the covariance matrix as a function of the distance while the global effect due to the mean field interaction synchronizes different components and contributes to a global covariance. The analysis is based on a comparison with an appropriate linear surrogate model, of which the covariance propagation can be computed explicitly. Two important applications of these theoretical results are discussed. They are the spatial averaging strategy for efficiently sampling the covariance matrix and the localization technique in data assimilation. Test examples of a linear model and a stochastically coupled FitzHugh-Nagumo model for excitable media are adopted to validate the theoretical results. The latter is also used for a systematical study of the spatial averaging strategy in efficiently sampling the covariance matrix in different dynamical regimes.

Keywords

Large state dimensions / Diffusion / Mean field interaction / Spatial averaging strategy / Efficiently sampling

References

[1] Anderson B D, Moore J B. Optimal filtering. Englewood Cliffs, 1979, 21: 22-95

[2] Anderson J L. Exploring the need for localization in ensemble data assimilation using a hierarchical ensemble filter. Physica D: Nonlinear Phenomena, 2007, 230(1-2): 99-111

[3] Bai Z D, Yin Y Q. Convergence to the semicircle law. Ann. Probab., 1988, 16(2): 863-875

[4] Bellman R E. Adaptive Control Processes: A Guided Tour, 2015

[5] Bickel P, Levina E. Covariance regularization by thresholding. The Annals of Statistics, 2008, 36(1): 199-227

[6] Biktasheva I V, Holden A V, Biktashev V N. Localization of response functions of spiral waves in the fitzhugh-nagumo system. International Journal of Bifurcation and Chaos, 2006, 16(05): 1547-1555

[7] Bui-Thanh T, Ghattas O, Martin J, Stadler G. A computational framework for infinite-dimensional Bayesian inverse problems. Part I: The linearized case, with application to global seismic inversion. SIAM J. Sci. Comput., 2013, 36(4): A2494-A2523

[8] Chen N, Majda A J. Beating the curse of dimension with accurate statistics for the Fokker-Planck equation in complex turbulent systems. Proc. Natl. Acad. Sci. USA, 2017, 114(49): 12864-12869

[9] Chen N, Majda A J. Efficient statistically accurate algorithms for the Fokker-Planck equation in large dimensions. J. Comput. Phys., 2018, 354: 242-268

[10] Chen, N., Majda, A. J. and Tong, X. T., Rigorous analysis for efficient statistically accurate algorithms for solving fokker-planck equations in large dimensions, arXiv: 1709.05585.

[11] Chen N, Majda A J, Tong X T. Noisy lagrangian tracers for filtering random rotating compressible flows. J. Non. Sci., 2014, 25(3): 451-488

[12] Chen N, Majda A J, Tong X T. Information barriers for noisy lagrangian tracers in filtering random incompressible flows. Nonlinearity, 2014, 27: 2133-2163

[13] Cotter S L, Roberts G O, Stuart A M, White D. MCMC methods for functions: modifying old algorithms to make them faster. Stat. Sci., 2013, 28(3): 424-446

[14] Cui T, Law K J H, Marzouk Y M. Dimension-independent likelihood-informed MCMC. J. Comput. Phys., 2016, 304: 109-137

[15] Cui T, Martin J, Marzouk Y M Likelihood-informed dimension reduction for nonlinear inverse problems. Inverse Probl., 2014, 29: 114015

[16] Physical Review E, 2005, 72 3

[17] Evensen G. The ensemble Kalman filter: Theoretical formulation and practical implementation. Ocean Dynamics, 2003, 53(4): 343-367

[18] Evensen G. Data Assimilation: The Ensemble Kalman Filter, 2009

[19] Flath H P, Wilcox L C, Akçcelik V Fast algorithms for Bayesian uncertainty quantification in large-scale linear inverse problems based on low-rank partial Hessian approximations. SIAM J. Sci. Comput., 2011, 33(1): 407-432

[20] Guckenheimer J, Holmes P. Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields, Applied Mathematical Sciences, 1983

[21] Hamill T M, Whitaker C, Snyder C. Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Weather Rev., 2001, 129: 2776-2790

[22] Hamill T M, Whitaker J S, Snyder C. Distance-dependent filtering of background covariance estimates in an ensemble Kalman filter. Mon. Weather Rev., 2001, 129: 2776-2790

[23] Holdenm A V, Markus M, Othmer H G. Nonlinear Wave Processes in Excitable Media, 2013

[24] Houtekamer P L, Mitchell H L. Data assimilation using an ensemble kalman filter technique. Mon. Wea. Rev., 1998, 126(3): 796-811

[25] Houtekamer P L, Mitchell H L. A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Weather Rev., 2001, 129: 123-136

[26] Houtekamer P L, Mitchell H L, Pellerin G Atmospheric data assimilation with an ensemble Kalman filter: Results with real observations. Mon. Weather Rev., 2005, 133: 604-620

[27] Hunt B R, Kostelich E J, Szunyogh I. Efficient data assimilation for spatiotemporal chaos: a local ensemble transform Kalman filter. Physica D, 2007, 230(1): 112-126

[28] Iserles A. How large is the exponential of a banded matrix?. New Zealand Journal of Mathematics, 2000, 29: 177-192

[29] Kalman R E. A new approach to linear filtering and prediction problems. Journal of basic Engineering, 1960, 82(1): 35-45

[30] Kalnay E. Atmospheric Modeling, Data Assimilation and Predictability, Cambridge university press, 2003

[31] Law K, Stuart A, Zygalakis K. Data Assimilation: A Mathematical Introduction, 2015

[32] Lee Y, Majda A J. Multiscale methods for data assimilation in turbulent systems. Multiscale Modeling & Simulation, 2015, 13(2): 691-713

[33] Lindner B, Garcia-Ojalvo J, Neiman A, Schimansky-Geier L. Effects of noise in excitable systems. Physics Reports, 2004, 392(6): 321-424

[34] Lorenz E N. Predictability: A problem partly solved. Proceedings of Seminar on Predictability, 1996 1-18

[35] Majda A J. Introduction to Turbulent Dynamical Systems in Complex Systems, 2016

[36] Majda A J, Harlim J. Filtering Complex Turbulent Systems, 2012

[37] Majda A J, Wang X M. Nonlinear Dynamics and Statistical Theories for Basic Geophysical Flows, 2006

[38] Majda A J, Qi D, Sapsis T P. Blended particle filters for large-dimensional chaotic dynamical systems. Proceedings of the National Academy of Sciences, 2014, 111(21): 7511-7516

[39] McKean H P. A class of markov processes associated with nonlinear parabolic equations. Proceedings of the National Academy of Sciences, 1966, 56(6): 1907-1911

[40] Miyoshi T, Yamane S. Local ensemble transform Kalman filtering with an AGCM at a T159/L48 resolution. Mon. Wea. Rev., 2007, 135(11): 3841-3861

[41] Morzfeld, M., Tong, T. and Marzouk, Y. M., Localization for MCMC: Sampling high-dimensional posterior distributions with banded structure, arXiv:1710.07747.

[42] Nerger L. On serial observation processing in localized ensemble kalman filters. Mon. Wea. Rev., 2015, 143(5): 1554-1567

[43] Nualart D. The Malliavin Calculus and Related Topics, 1995

[44] Ohta T, Mimura M, Kobayashi R. Higher-dimensional localized patterns in excitable media. Physica D: Nonlinear Phenomena, 1989, 34(1-2): 115-144

[45] Physical Review E, 2005, 72 1

[46] Petra N, Martin J, Stadler G, Ghattas O. A computational framework for infinite-dimensional Bayesian inverse problems, Part II: Stochastic Newton MCMC with application to ice sheet ow inverse problems. SIAM J. Sci. Comput., 2014, 36(4): 1525-1555

[47] Powell W B. Approximate Dynamic Programming: Solving the Curses of Dimensionality, 2007

[48] Rekleitis I M. A particle filter tutorial for mobile robot localization, Centre for Intelligent Machines, 2004

[49] Ricketson L F. A multilevel monte carlo method for a class of mckean-vlasov processes, 2015

[50] Sheard S A, Mostashari A. Principles of complex systems for systems engineering. Systems Engineering, 2009, 12(4): 295-311

[51] Spantini A, Solonen A, Cui T Optimal low-rank approximations of Bayesian linear inverse problems. SIAM J. Sci. Comput., 2015, 37(6): A2451-A2487

[52] Stelling J, Kremling A, Ginkel M Foundations of Systems Biology, 2001

[53] Tong X T. Performance analysis of local ensemble Kalman filter. J. Nonlinear Science, 2018, 28(4): 1397-1442

[54] Tong X T, Majda A J, Kelly D. Nonlinear stability of the ensemble Kalman filter with adaptive covariance inflation. Commun. Math. Sci., 2016, 14(5): 1283-1313

[55] Tong X T, Majda A J, Kelly D. Nonlinear stability and ergodicity of ensemble based Kalman filters. Nonlinearity, 2016, 29: 657-691

[56] Tyson J J, Keener J P. Singular perturbation theory of traveling waves in excitable media (a review). Physica D: Nonlinear Phenomena, 1988, 32(3): 327-361

[57] Whitaker J S, Hamill T M. Ensemble data assimilation without perturbed observations. Mon. Wea. Rev., 2002, 130(7): 1913-1924