%A Xi-Ren CAO %T Stochastic learning and optimization — Ideas vs mathematics? %0 Journal Article %D 0 %J Front. Electr. Electron. Eng. %J Frontiers of Electrical and Electronic Engineering %@ 2095-2732 %R 10.1007/s11460-011-0161-z %P 398-411 %V %N %U {https://journal.hep.com.cn/fee/EN/10.1007/s11460-011-0161-z %8 2011-09-05 %X

What are the roles that ideas and mathematics play in research of engineering subjects? This article tries to answer this question with the author’s own research experience. In the past 30 years, the author’s research started from perturbation analysis (PA) of queueing networks, to PA of Markov systems, to Markov decision processes (MDP), and to stochastic control; and based on these research, the author has successfully developed a sensitivity-based optimization approach to the area of learning and optimization of stochastic systems, leading to a simple and unified framework for the area, new research directions, and new results in the area. This paper reviews the above research topics and the history of their development with an emphasis on what the roles that ideas and mathematics play in each of the advances along the path.