Enhancing fund recommendations with multi-round feedback-based reinforcement learning

Yanshen YI , Chao WANG , Ying SUN , Qi ZHANG , Xunpeng HUANG , Hui XIONG

Front. Comput. Sci. ›› 2027, Vol. 21 ›› Issue (9) : 2109356

PDF (3798KB)
Front. Comput. Sci. ›› 2027, Vol. 21 ›› Issue (9) :2109356 DOI: 10.1007/s11704-026-51887-2
Artificial Intelligence
RESEARCH ARTICLE
Enhancing fund recommendations with multi-round feedback-based reinforcement learning
Author information +
History +
PDF (3798KB)

Abstract

Mutual funds are essential financial products for investors. However, existing fund recommendation systems often struggle to capture personalized, multi-dimensional needs like risk tolerance and investment goals, and face challenges from data privacy regulations and fragmented user interaction data. To address these limitations, we propose the Multi-round Adaptive Fund Recommendation Reinforcement Learning (MAFR-RL) framework. MAFR-RL innovatively employs a multi-round ratings-based scenario with a simulated user to overcome data limitations and efficiently infer feedback. We process rich multi-view fund attributes (e.g., historical profitability, risk, investment domains) using specialized encoders and self-attention mechanisms for comprehensive representation. Our actor network features a unique hierarchical Mixture-of-Experts (MoE) architecture with Mamba-based experts. This design first divides experts into shared and view-specific groups, then further employs MoE within each group for deeply adaptive feature fusion and precise policy generation. Furthermore, we introduce a novel dual-critic network, coupled with an adaptive multi-task Q-value formulation, to effectively balance fund-level appeal and constituent stock preferences. A specifically designed fund pool sampling strategy further enhances recommendation diversity and robustness. Extensive offline experiments and a small-scale online study demonstrate the effectiveness and efficiency of the MAFR-RL framework.

Graphical abstract

Keywords

fund recommendation / finance / reinforcement learning

Cite this article

Download citation ▾
Yanshen YI, Chao WANG, Ying SUN, Qi ZHANG, Xunpeng HUANG, Hui XIONG. Enhancing fund recommendations with multi-round feedback-based reinforcement learning. Front. Comput. Sci., 2027, 21 (9) : 2109356 DOI:10.1007/s11704-026-51887-2

登录浏览全文

4963

注册一个新账户 忘记密码

References

[1]

Investment Company Institute. 2024 investment company fact book: a review of trends and activities in the investment company industry. Washington: Investment Company Institute, 2024

[2]

Markowitz H . Portfolio selection. The Journal of Finance, 1952, 7( 1): 77–91

[3]

Sharpe W F . Capital asset prices: a theory of market equilibrium under conditions of risk. The Journal of Finance, 1964, 19( 3): 425–442

[4]

Zhao X, Zhang W, Wang J. Risk-hedged venture capital investment recommendation. In: Proceedings of the 9th ACM Conference on Recommender Systems. 2015, 75−82

[5]

Shen Y, Huang Y . Introduction to the special issue: internet finance in China. China Economic Journal, 2016, 9( 3): 221–224

[6]

Ko H, Lee S, Park Y, Choi A . A survey of recommendation systems: recommendation models, techniques, and application fields. Electronics, 2022, 11( 1): 141

[7]

Akoglu L, Chawla N, Kumar S, Nagrecha S, Das M, Naware V M, Faruquie T. KDD workshop on machine learning in finance. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 5863−5864

[8]

Felfernig A, Kiener A. Knowledge-based interactive selling of financial services with FSAdvisor. In: Proceedings of the 17th Conference on Innovative Applications of Artificial Intelligence. 2005, 1475−1482

[9]

Gonzales R M D, Hargreaves C A . How can we use artificial intelligence for stock recommendation and risk management? A proposed decision support system. International Journal of Information Management Data Insights, 2022, 2( 2): 100130

[10]

Wang C, Zhu H, Wang P, Zhu C, Zhang X, Chen E, Xiong H . Personalized and explainable employee training course recommendations: a Bayesian variational approach. ACM Transactions on Information Systems (TOIS), 2022, 40( 4): 70

[11]

Li T, Song J . Deep learning-powered financial product recommendation system in banks: Integration of Transformer and transfer learning. Journal of Organizational and End User Computing, 2024, 36( 1): 1–29

[12]

Li Z, Lu Z, Yin M. Modeling human trust and reliance in AI-assisted decision making: a Markovian approach. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence. 2023, 6056−6064

[13]

Zhang Z, Ji Y, Shen J, Chen Y, Zhang X, Yang G. Collaborative metapath enhanced corporate default risk assessment on heterogeneous graph. In: Proceedings of the ACM Web Conference 2024. 2024, 446−456

[14]

Bodie Z, Kane A, Marcus A J. Investments. 9th ed. New York: McGraw-Hill, 2011

[15]

Sharpe W F . Mutual fund performance. The Journal of Business, 1966, 39( 1): 119–138

[16]

Chen N F, Roll R, Ross S A . Economic forces and the stock market. Journal of Business, 1986, 59( 3): 383–403

[17]

Marathe A, Shawky H A . Categorizing mutual funds using clusters. Advances in Quantitative Analysis of Finance and Accounting, 1999, 7( 1): 199–204

[18]

Deldjoo Y, He Z, McAuley J, Korikov A, Sanner S, Ramisa A, Vidal R, Sathiamoorthy M, Kasirzadeh A, Milano S. A review of modern recommender systems using generative models (Gen-RecSys). In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 6448−6458

[19]

Wang C, Zhu H, Zhu C, Qin C, Xiong H. SetRank: a setwise Bayesian approach for collaborative ranking from implicit feedback. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020, 6127−6136

[20]

Zhang X, Chen Y, Ma C, Fang Y, King I. Influential exemplar replay for incremental learning in recommender systems. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 9368−9376

[21]

Zhang W, Liu H, Wang F, Xu T, Xin H, Dou D, Xiong H. Intelligent electric vehicle charging recommendation based on multi-agent reinforcement learning. In: Proceedings of the Web Conference 2021. 2021, 1856−1867

[22]

Sun Y, Zhuang F, Zhu H, He Q, Xiong H. Cost-effective and interpretable job skill recommendation with deep reinforcement learning. In: Proceedings of the Web Conference 2021. 2021, 3827−3838

[23]

Zhang Y, Liu J, Li C, Niu Y, Yang Y, Liu Y, Ouyang W. A perspective of Q-value estimation on offline-to-online reinforcement learning. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 16908−16916

[24]

Zheng G, Zhang F, Zheng Z, Xiang Y, Yuan N J, Xie X, Li Z. DRN: a deep reinforcement learning framework for news recommendation. In: Proceedings of 2018 World Wide Web Conference. 2018, 167−176

[25]

Chen M, Beutel A, Covington P, Jain S, Belletti F, Chi E H. Top-K off-policy correction for a REINFORCE recommender system. In: Proceedings of the 12th ACM International Conference on Web Search and Data Mining. 2019, 456−464

[26]

Chen X, Li S, Li H, Jiang S, Qi Y, Song L. Generative adversarial user model for reinforcement learning based recommendation system. In: Proceedings of the 36th International Conference on Machine Learning. 2019, 1052−1061

[27]

Liu Z, Zhou D, Liu H, Wang H, Niu Z Y, Wu H, Che W, Liu T, Xiong H . Graph-grounded goal planning for conversational recommendation. IEEE Transactions on Knowledge and Data Engineering, 2023, 35( 5): 4923–4939

[28]

Wang T, Deng L, Wang C, Lian J, Yan Y, Yuan N J, Zhang Q, Xiong H. COMET: NFT price prediction with wallet profiling. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 5893−5904

[29]

He H, Wang T, Yang H, Fu J, Yuan N J, Yin J, Chao H, Zhang Q. Learning profitable NFT image diffusions via multiple visual-policy guided reinforcement learning. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 6831−6840

[30]

Wang C, Liu Q, Wu R, Chen E, Liu C, Huang X, Huang Z. Confidence-aware matrix factorization for recommender systems. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 2018, 434−442

[31]

Yang Y, Li J, Yang Y . An efficient stock recommendation model based on big order net inflow. Mathematical Problems in Engineering, 2016, 2016: 5725143

[32]

Lei Z, Zhang C, Xu Y, Li X . DR-GAT: dynamic routing graph attention network for stock recommendation. Information Sciences, 2024, 654: 119833

[33]

Wang C, Liang H, Wang B, Cui X, Xu Y . MG-Conv: a spatiotemporal multi-graph convolutional neural network for stock market index trend prediction. Computers and Electrical Engineering, 2022, 103: 108285

[34]

Li S, Liu Y, Chen X, Wu J, Xu K . Forecasting turning points in stock price by integrating chart similarity and multipersistence. IEEE Transactions on Knowledge and Data Engineering, 2024, 36( 12): 8251–8266

[35]

Zhu Y, Wang C, Zhang Q, Xiong H. Graph signal diffusion model for collaborative filtering. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 1380−1390

[36]

Lee Y, Kim Y, Sanz-Cruzado J, McCreadie R, Lee Y. Stock recommendations for individual investors: a temporal graph network approach with mean-variance efficient sampling. In: Proceedings of the 5th ACM International Conference on AI in Finance. 2024, 795−803

[37]

Jiang Z, Xu D, Liang J. A deep reinforcement learning framework for the financial portfolio management problem. 2017, arXiv preprint arXiv: 1706.10059

[38]

Elton E J, Gruber M J, Das S, Hlavka M . Efficiency with costly information: a reinterpretation of evidence from managed portfolios. The Review of Financial Studies, 1993, 6( 1): 1–22

[39]

Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, Kaiser Ł, Polosukhin I. Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017, 6000−6010

[40]

Wang C, Zhu H, Hao Q, Xiao K, Xiong H. Variable interval time sequence modeling for career trajectory prediction: deep collaborative perspective. In: Proceedings of the Web Conference 2021. 2021, 612− 623

[41]

Gu A, Dao T. Mamba: linear-time sequence modeling with selective state spaces. 2023, arXiv preprint arXiv: 2312.00752

[42]

Zhu L, Liao B, Zhang Q, Wang X, Liu W, Wang X. Vision mamba: efficient visual representation learning with bidirectional state space model. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[43]

Ma J, Li F, Wang B. U-Mamba: enhancing long-range dependency for biomedical image segmentation. 2024, arXiv preprint arXiv: 2401.04722

[44]

Shazeer N, Mirhoseini A, Maziarz K, Davis A, Le Q V, Hinton G E, Dean J. Outrageously large neural networks: the sparsely-gated mixture-of-experts layer. In: Proceedings of the 5th International Conference on Learning Representations. 2017

[45]

Cipolla R, Gal Y, Kendall A. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In: Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 7482−7491

[46]

Fung W, Hsieh D A . A primer on hedge funds. Journal of Empirical Finance, 1999, 6( 3): 309–331

[47]

Stulz R M . Hedge funds: past, present, and future. Journal of Economic Perspectives, 2007, 21( 2): 175–194

[48]

Desfiandi A, Desfiandi A, Ali H . Composite stock price index (IHSG) macro factor in investment in stock (Equity Funds). International Journal of Economics and Financial Issues, 2017, 7( 3): 534–536

[49]

Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, Riedmiller M. Playing atari with deep reinforcement learning. 2013, arXiv preprint arXiv: 1312.5602

[50]

Schulman J, Wolski F, Dhariwal P, Radford A . Klimov O. Proximal policy optimization algorithms.. arXiv preprint arXiv: 1707.06347, 2017,

[51]

Konda V R, Tsitsiklis J N. Actor-critic algorithms. In: Proceedings of the 13th International Conference on Neural Information Processing Systems. 1999, 1008−1014

[52]

Lillicrap T P, Hunt J J, Pritzel A, Heess N, Erez T, Tassa Y, Silver D, Wierstra D. . Continuous control with deep reinforcement learning.. arXiv preprint arXiv: 1509.02971, 2015,

[53]

Haarnoja T, Zhou A, Abbeel P, Levine S. Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor. In: Proceedings of the 35th International Conference on Machine Learning. 2018, 1861−1870

Rights & permissions

Higher Education Press

PDF (3798KB)

Supplementary files

Highlights

468

Accesses

0

Citation

Detail

Sections
Recommended

/

〈 〉