Influence of reinforcement learning on the inhibitory control of Internet gaming disorder

Abstract

Reward processing dysfunction and inhibition control deficiency have been observed in Internet gaming disorder (IGD). However, it is still unclear whether the previous reinforcement learning depends on reward/punishment feedback influences on the cognitive inhibitory control of IGD. This study compared the differences between an IGD group and healthy people without game experiences in the probability selection task and the subsequent stop signal task by the method of behavioral experiments, in order to explore whether the reward learning ability is impaired in the IGD group. We also discuss the influence of previous reward learning on subsequent inhibition control. The results showed that (1) during the reward learning phase, the IGD group’s accuracy was significantly lower than that of the control group; (2) compared with the control group, the IGD group’s reaction times were longer in the transfer phase; (3) for no-go trials of the inhibitory control phase after reward learning, the accuracy of the reward-related stimulation in the IGD group was lower than that of punishment-related or neutral stimulation, but there was no significant difference among the three conditions in the control group. These findings indicated that the reinforcement learning ability of the IGD group was impaired, which further caused the abnormal response to reinforcement stimuli.

Keywords

inhibitory control / Internet gaming disorder / reinforcement learning

References

[1] Addicott, M. A., Sweitzer, M. M., & McClernon, F. J. (2019). The effects of nicotine and tobacco use on brain reward function: Interaction with nicotine dependence severity. Nicotine & Tobacco Research: Official Journal of the Society for Research on Nicotine and Tobacco, 21(6), 764–771.

[2] American Psychiatric Association. (2022). Diagnostic and statistical manual of mental disorders (5th ed. text revision). American Psychiatric Association.

[3] Anderson, B. A., Folk, C. L., Garrison, R., & Rogers, L. (2016). Mechanisms of habitual approach: Failure to suppress irrelevant responses evoked by previously reward-associated stimuli. Journal of Experimental Psychology. General, 145(6), 796–805.

[4] Antons, S., Brand, M., & Potenza, M. N. (2020). Neurobiology of cue-reactivity, craving, and inhibitory control in non-substance addictive behaviors. Journal of the Neurological Sciences, 415, 116952.

[5] Bağci, B., Düsmez, S., Zorlu, N., Bahtiyar, G., Isikli, S., Bayrakci, A., Heinz, A., Schad, D. J., & Sebold, M. (2022). Computational analysis of probabilistic reversal learning deficits in male subjects with alcohol use disorder. Frontiers in Psychiatry, 13, 960238.

[6] Baker, T. E., Stockwell, T., Barnes, G., & Holroyd, C. B. (2011). Individual differences in substance dependence: at the intersection of brain, behaviour and cognition. Addiction Biology, 16(3), 458–466.

[7] Baker, T. E., Stockwell, T., & Holroyd, C. B. (2013). Constraints on decision making: Implications from genetics, personality, and addiction. Cognitive, Affective, & Behavioral Neuroscience, 13(3), 417–436.

[8] Balconi, M., Finocchiaro, R., & Canavesio, Y. (2014). Reward-system effect (BAS rating), left hemispheric "unbalance" (alpha band oscillations) and decisional impairments in drug addiction. Addictive Behaviors, 39(6), 1026–1032.

[9] Balconi, M., Venturella, I., & Finocchiaro, R. (2017). Evidences from rewarding system, FRN and P300 effect in internet-addiction in Young people SHORT TITLE: Rewarding system and EEG in internet-addiction. Brain Sciences, 7(7), 81.

[10] Belin, D., Belin-Rauscent, A., Murray, J. E., & Everitt, B. J. (2013). Addiction: Failure of control over maladaptive incentive habits. Current Opinion in Neurobiology, 23(4), 564–572.

[11] Bühringer, G., Wittchen, H. U., Gottlebe, K., Kufeld, C., & Goschke, T. (2008). Why people change? The role of cognitive-control processes in the onset and cessation of substance abuse disorders. International Journal of Methods in Psychiatric Research, 17(Suppl 1), S4–S15.

[12] Cabedo-Peris, J., González-Sala, F., Merino-Soto, C., Pablo, J. Á. C., & Toledano-Toledano, F. (2022). Decision making in addictive behaviors based on Prospect theory: A systematic review. Healthcare (Basel, Switzerland), 10(9), 1659.

[13] Cai, C., Yuan, K., Yin, J., Feng, D., Bi, Y., Li, Y., Yu, D., Jin, C., Qin, W., & Tian, J. (2016). Striatum morphometry is associated with cognitive control deficits and symptom severity in internet gaming disorder. Brain Imaging and Behavior, 10(1), 12–20.

[14] Camara, E., Manohar, S., & Husain, M. (2013). Past rewards capture spatial attention and action choices. Experimental Brain Research, 230(3), 291–300.

[15] Chen, C. Y., Huang, M. F., Yen, J. Y., Chen, C. S., Liu, G. C., Yen, C. F., & Ko, C. H. (2015). Brain correlates of response inhibition in internet gaming disorder. Psychiatry and Clinical Neurosciences, 69(4), 201–209.

[16] Chen, J., Li, X., Zhang, Q., Zhou, Y., Wang, R., Tian, C., & Xiang, H. (2021). Impulsivity and response inhibition related brain networks in adolescents with internet gaming disorder: A preliminary study utilizing resting-state fMRI. Frontiers in Psychiatry, 11, 618319.

[17] Cox, L. S., Tiffany, S. T., & Christen, A. G. (2001). Evaluation of the brief questionnaire of smoking urges (QSU-brief) in laboratory and clinical settings. Nicotine & Tobacco Research: Official Journal of the Society for Research on Nicotine and Tobacco, 3(1), 7–16.

[18] Davidow, J. Y., Sheridan, M. A., Van Dijk, K. R. A., Santillana, R. M., Snyder, J., Vidal Bustamante, C. M., Rosen, B. R., & Somerville, L. H. (2019). Development of prefrontal cortical connectivity and the enduring effect of learned value on cognitive control. Journal of Cognitive Neuroscience, 31(1), 64–77.

[19] Ding, W. N., Sun, J. H., Sun, Y. W., Chen, X., Zhou, Y., Zhuang, Z. G., Li, L., Zhang, Y., Xu, J. R., & Du, Y. S. (2014). Trait impulsivity and impaired prefrontal impulse inhibition function in adolescents with internet gaming addiction revealed by a go/No-go fMRI study. Behavioral and Brain Functions: BBF, 10, 20.

[20] Dong, G., Huang, J., & Du, X. (2011). Enhanced reward sensitivity and decreased loss sensitivity in internet addicts: An fMRI study during a guessing task. Journal of Psychiatric Research, 45(11), 1525–1529.

[21] Dong, G., Zheng, H., Liu, X., Wang, Y., Du, X., & Potenza, M. N. (2018). Gender-related differences in cue-elicited cravings in internet gaming disorder: The effects of deprivation. Journal of Behavioral Addictions, 7(4), 953–964.

[22] Everitt, B. J., & Robbins, T. W. (2016). Drug addiction: Updating actions to habits to compulsions ten years on. Annual Review of Psychology, 67, 23–50.

[23] Frank, M. J., Seeberger, L. C., & O’reilly, R. C. (2004). By carrot or by stick: Cognitive reinforcement learning in parkinsonism. Science (New York, N.Y.), 306(5703), 1940–1943.

[24] García-García, I., Horstmann, A., Jurado, M. A., Garolera, M., Chaudhry, S. J., Margulies, D. S., Villringer, A., & Neumann, J. (2014). Reward processing in obesity, substance addiction and non-substance addiction. Obesity Reviews: An Official Journal of the International Association for the Study of Obesity, 15(11), 853–869.

[25] Gentile, D. (2009). Pathological video-game use among youth ages 8 to 18: A national study. Psychological Science, 20(5), 594–602.

[26] Gluth, S., Spektor, M. S., & Rieskamp, J. (2018). Value-based attentional capture affects multi-alternative decision making. eLife, 7, e39659.

[27] Hahn, T., Notebaert, K. H., Dresler, T., Kowarsch, L., Reif, A., & Fallgatter, A. J. (2014). Linking online gaming and addictive behavior: Converging evidence for a general reward deficiency in frequent online gamers. Frontiers in Behavioral Neuroscience, 8, 385.

[28] Heuer, A., Mennig, M., Schubö A., & Barke, A. (2021). Impaired disengagement of attention from computer-related stimuli in internet gaming disorder: Behavioral and electrophysiological evidence. Journal of Behavioral Addictions, 10(1), 77–87.

[29] Hong, W., Liang, P., Pan, Y., Jin, J., Luo, L., Li, Y., Jin, C., Lü W., Wang, M., Liu, Y., Chen, H., Gou, H., Wei, W., Ma, Z., Tao, R., Zha, R., & Zhang, X. (2023). Reduced loss aversion in value-based decision-making and edge-centric functional connectivity in patients with internet gaming disorder. Journal of Behavioral Addictions, 12(2), 458–470.

[30] Hou, H., Jia, S., Hu, S., Fan, R., Sun, W., Sun, T., & Zhang, H. (2012). Reduced striatal dopamine transporters in people with internet addiction disorder. Journal of Biomedicine & Biotechnology, 2012, 854524.

[31] Ikemoto, S., & Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: A unifying interpretation with special reference to reward-seeking. Brain Research. Brain Research Reviews, 31(1), 6–41.

[32] Itthipuripat, S., Cha, K., Rangsipat, N., & Serences, J. T. (2015). Value-based attentional capture influences context-dependent decision-making. Journal of Neurophysiology, 114(1), 560–569.

[33] Jeong, E. J., & Kim, D. H. (2011). Social activities, self-efficacy, game attitudes, and game addiction. Cyberpsychology, Behavior and Social Networking, 14(4), 213–221.

[34] Kim, B. M., Lee, J., Choi, A. R., Chung, S. J., Park, M., Koo, J. W., Kang, U. G., & Choi, J. S. (2021). Event-related brain response to visual cues in individuals with internet gaming disorder: Relevance to attentional bias and decision-making. Translational Psychiatry, 11(1), 258.

[35] Kim, H., & Anderson, B. A. (2019). Neural evidence for automatic value-modulated approach behaviour. NeuroImage, 189, 150–158.

[36] Kim, J. E., Son, J. W., Choi, W. H., Kim, Y. R., Oh, J. H., Lee, S., & Kim, J. K. (2014). Neural responses to various rewards and feedback in the brains of adolescent internet addicts detected by functional magnetic resonance imaging. Psychiatry and Clinical Neurosciences, 68(6), 463–470.

[37] Ko, C. H., Hsieh, T. J., Chen, C. Y., Yen, C. F., Chen, C. S., Yen, J. Y., Wang, P. W., & Liu, G. C. (2014). Altered brain activation during response inhibition and error processing in subjects with internet gaming disorder: A functional magnetic imaging study. European Archives of Psychiatry and Clinical Neuroscience, 264(8), 661–672.

[38] Koob, G. F. (2013). Theoretical frameworks and mechanistic aspects of alcohol addiction: Alcohol addiction as a reward deficit disorder. Current Topics in Behavioral Neurosciences, 13, 3–30.

[39] Koob, G. F., & Vendruscolo, L. (2023). Theoretical frameworks and mechanistic aspects of alcohol addiction: Alcohol addiction as a reward deficit/stress surfeit disorder. Current Topics in Behavioral Neurosciences. Advance online publication.

[40] Kräplin, A., Scherbaum, S., Kraft, E. M., Rehbein, F., Bühringer, G., Goschke, T., & Mößle, T. (2020). The role of inhibitory control and decision-making in the course of internet gaming disorder. Journal of Behavioral Addictions, 9(4), 990–1001. Advance online publication.

[41] Krebs, R. M., Boehler, C. N., Egner, T., & Woldorff, M. G. (2011). The neural underpinnings of how reward associations can both guide and misguide attention. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience, 31(26), 9752–9759.

[42] Le Pelley, M. E., Pearson, D., Griffiths, O., & Beesley, T. (2015). When goals conflict with values: Counterproductive attentional and oculomotor capture by reward-related stimuli. Journal of Experimental Psychology. General, 144(1), 158–171.

[43] Lei, W., Liu, K., Chen, G., Tolomeo, S., Liu, C., Peng, Z., Liu, B., Liang, X., Huang, C., Xiang, B., Zhou, J., Zhao, F., Yu, R., & Chen, J. (2022). Blunted reward prediction error signals in internet gaming disorder. Psychological Medicine, 52(11), 2124–2133.

[44] Leppink, E. W., Redden, S. A., Chamberlain, S. R., & Grant, J. E. (2016). Cognitive flexibility correlates with gambling severity in young adults. Journal of Psychiatric Research, 81, 9–15.

[45] Li, Q., Wang, Y., Yang, Z., Dai, W., Zheng, Y., Sun, Y., & Liu, X. (2020). Dysfunctional cognitive control and reward processing in adolescents with internet gaming disorder. Psychophysiology, 57(2), e13469.

[46] Liao, M. R., Grégoire, L., & Anderson, B. A. (2020). The influence of threat and aversive motivation on conflict processing in the Stroop task. Attention, Perception & Psychophysics, 82(6), 2802–2813.

[47] Lu, J., Zhang, Q., Zhong, N., Chen, J., Zhai, Y., Guo, L., Lu, C., Chen, T., Jiang, Z., & Zheng, H. (2022). Addiction symptom network of Young internet users: Network analysis. Journal of Medical Internet Research, 24(11), e38984.

[48] Lu, L., Hope, B. T., Dempsey, J., Liu, S. Y., Bossert, J. M., & Shaham, Y. (2005). Central amygdala ERK signaling pathway is critical to incubation of cocaine craving. Nature Neuroscience, 8(2), 212–219.

[49] Luke, C., & Goudriaan, A. E. (2018). The neuroscience and neuropsychology of gambling and gambling addiction: An introduction to the special issue. International Gambling Studies, 2, 173–177.

[50] Luque, D., Molinero, S., Watson, P., López, F. J., & Le Pelley, M. E. (2020). Measuring habit formation through goal-directed response switching. Journal of Experimental Psychology. General, 149(8), 1449–1459.

[51] Mantsch, J. R., Baker, D. A., Funk, D., Lê A. D., & Shaham, Y. (2016). Stress-induced reinstatement of drug seeking:20 years of Progress. Neuropsychopharmacology: Official Publication of the American College of Neuropsychopharmacology, 41(1), 335–356.

[52] Marchner, J. R., & Preuschhof, C. (2022). The influence of associative reward learning on motor inhibition. Psychological Research, 86(1), 125–140.

[53] Muller-Gass, A., Duncan, M., & Campbell, K. (2017). Brain states predict individual differences in perceptual learning. Personality & Individual Differences, 118, 29–38.

[54] Myers, C. E., Sheynin, J., Balsdon, T., Luzardo, A., Beck, K. D., Hogarth, L., Haber, P., & Moustafa, A. A. (2016). Probabilistic reward-and punishment-based learning in opioid addiction: Experimental and computational data. Behavioural Brain Research, 296, 240–248.

[55] Nesic, J., Rusted, J., Duka, T., & Jackson, A. (2011). Degree of dependence influences the effect of smoking on cognitive flexibility. Pharmacology, Biochemistry, and Behavior, 98(3), 376–384.

[56] Ostovar, S., Allahyar, N., Aminpoor, H., Moafian, F., Nor, M., & Griffiths, M. (2016). Internet addiction and its psychosocial risks (depression, anxiety, stress and loneliness) among Iranian adolescents and Young adults: A structural equation model in a cross-sectional study. International Journal of Mental Health & Addiction, 14(3), 257–267.

[57] Pan, N., Yang, Y., Du, X., Qi, X., Du, G., Zhang, Y., Li, X., & Zhang, Q. (2018). Brain structures associated with internet addiction tendency in adolescent online game players. Frontiers in Psychiatry, 9, 67.

[58] Petry, N. M., Rehbein, F., Gentile, D. A., Lemmens, J. S., Rumpf, H. J., Mößle, T., Bischof, G., Tao, R., Fung, D. S., Borges, G., Auriacombe, M., González Ibáñez, A., Tam, P., & O’Brien, C. P. (2014). An international consensus for assessing internet gaming disorder using the new DSM-5 approach. Addiction (Abingdon, England), 109(9), 1399–1406.

[59] Rai, L. A., O’Halloran, L., Jollans, L., Vahey, N., O’Brolchain, C., & Whelan, R. (2019). Individual differences in learning from probabilistic reward and punishment predicts smoking status. Addictive Behaviors, 88, 73–76.

[60] Raiha, S., Yang, G., Wang, L., Dai, W., Wu, H., Meng, G., Zhong, B., & Liu, X. (2020). Altered reward processing system in internet gaming disorder. Frontiers in Psychiatry, 11, 599141.

[61] Roper, Z. J., Vecera, S. P., & Vaidya, J. G. (2014). Value-driven attentional capture in adolescence. Psychological Science, 25(11), 1987–1993.

[62] Schultz, W., Dayan, P., & Montague, P. R. (1997). A neural substrate of prediction and reward. Science (New York, N.Y.), 275(5306), 1593–1599.

[63] Siciliano, C. A., Noamany, H., Chang, C. J., Brown, A. R., Chen, X., Leible, D., Lee, J. J., Wang, J., Vernon, A. N., Vander Weele, C. M., Kimchi, E. Y., Heiman, M., & Tye, K. M. (2019). A cortical-brainstem circuit predicts and governs compulsive alcohol drinking. Science (New York, N.Y.), 366(6468), 1008–1012.

[64] Sjoerds, Z., de Wit, S., van den Brink, W., Robbins, T. W., Beekman, A. T., Penninx, B. W., & Veltman, D. J. (2013). Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients. Translational Psychiatry, 3(12), e337.

[65] Theeuwes, J. (2018). Visual selection: Usually fast and automatic; seldom slow and volitional. Journal of Cognition, 1(1), 29.

[66] Tian, M., Chen, Q., Zhang, Y., Du, F., Hou, H., Chao, F., & Zhang, H. (2014). PET imaging reveals brain functional changes in internet gaming disorder. European Journal of Nuclear Medicine and Molecular Imaging, 41(7), 1388–1397.

[67] Van Rooij, A. J., Kuss, D. J., Griffiths, M. D., Shorter, G. W., Schoenmakers, M. T., & Van De Mheen, D. (2014). The (co-)occurrence of problematic video gaming, substance use, and psychosocial problems in adolescents. Journal of Behavioral Addictions, 3(3), 157–165.

[68] Villiamma, P., Casby, J., & Groman, S. M. (2022). Adolescent reinforcement-learning trajectories predict cocaine-taking behaviors in adult male and female rats. Psychopharmacology, 239(9), 2885–2901.

[69] Volkow, N. D., Koob, G. F., & McLellan, A. T. (2016). Neurobiologic advances from the brain disease model of addiction. The New England Journal of Medicine, 374(4), 363–371.

[70] Wang, L., Tian, M., Zheng, Y., Li, Q., & Liu, X. (2020). Reduced loss aversion and inhibitory control in adolescents with internet gaming disorder. Psychology of Addictive Behaviors: Journal of the Society of Psychologists in Addictive Behaviors, 34(3), 484–496.

[71] Wang, M., Zheng, H., Zhou, W., Yang, B., Wang, L., Chen, S., & Dong, G. H. (2023). Disrupted dynamic network reconfiguration of the executive and reward networks in internet gaming disorder. Psychological Medicine, 53(12), 5478–5487.

[72] Wang, Y., Wu, L., Wang, L., Zhang, Y., Du, X., & Dong, G. (2017). Impaired decision-making and impulse control in internet gaming addicts: Evidence from the comparison with recreational internet game users. Addiction Biology, 22(6), 1610–1621.

[73] Williams, B. R., Ponesse, J. S., Schachar, R. J., Logan, G. D., & Tannock, R. (1999). Development of inhibitory control across the life span. Developmental Psychology, 35(1), 205–213.

[74] Xing, L., Yuan, K., Bi, Y., Yin, J., Cai, C., Feng, D., Li, Y., Song, M., Wang, H., Yu, D., Xue, T., Jin, C., Qin, W., & Tian, J. (2014). Reduced fiber integrity and cognitive control in adolescents with internet gaming disorder. Brain Research, 1586, 109–117.

[75] Yan, W. S., Chen, R. T., Liu, M. M., & Zheng, D. H. (2021). Monetary reward discounting, inhibitory control, and trait impulsivity in Young adults with internet gaming disorder and nicotine dependence. Frontiers in Psychiatry, 12, 628933.

[76] Yao, Y. W., Liu, L., Ma, S. S., Shi, X. H., Zhou, N., Zhang, J. T., & Potenza, M. N. (2017). Functional and structural neural alterations in internet gaming disorder: A systematic review and meta-analysis. Neuroscience and Biobehavioral Reviews, 83, 313–324.

[77] Yau, Y. H., Potenza, M. N., Mayes, L. C., & Crowley, M. J. (2015). Blunted feedback processing during risk-taking in adolescents with features of problematic internet use. Addictive Behaviors, 45, 156–163.

[78] Young, K. S. (1996). Psychology of computer use: XL. Addictive use of the internet: A case that breaks the stereotype. Psychological Reports, 79(3 Pt 1), 899–902.

[79] Yuan, K., Qin, W., Yu, D., Bi, Y., Xing, L., Jin, C., & Tian, J. (2016). Core brain networks interactions and cognitive control in internet gaming disorder individuals in late adolescence/early adulthood. Brain Structure & Function, 221(3), 1427–1442.

[80] Zhang, J., Chen, S., Jiang, Q., Dong, H., Zhao, Z., Du, X., & Dong, G. H. (2021). Disturbed craving regulation to gaming cues in internet gaming disorder: Implications for uncontrolled gaming behaviors. Journal of Psychiatric Research, 140, 250–259.

[81] Zhang, J., Hu, Y., Wang, Z., Wang, M., & Dong, G. H. (2020). Males are more sensitive to reward and less sensitive to loss than females among people with internet gaming disorder: fMRI evidence from a card-guessing task. BMC Psychiatry, 20(1), 357.

[82] Zhang, Z., Zheng, H., Zhou, W., & Dong, G. H. (2023). Brain responses to decision-making in easy and hard choices in internet gaming disorder: Implications for irrepressible gaming behaviours. Journal of Psychiatric Research, 165, 233–240.

[83] Zheng, Y. B., Dong, H. H., Wang, M., Zhou, W., Lin, X., & Dong, G. H. (2022). Similarities and differences between internet gaming disorder and tobacco use disorder: A large-scale network study. Addiction Biology, 27(2), e13119.

[84] Zhou, B., Wang, W., Zhang, W., Li, Y., & Nie, J. (2018). Succumb to habit: Behavioral evidence for overreliance on habit learning in internet addicts. Computers in Human Behavior, 89, 230–236.

[85] Zhou, W., Zheng, H., Wang, M., Zheng, Y., Chen, S., Wang, M. J., & Dong, G. H. (2021). The imbalance between goal-directed and habitual systems in internet gaming disorder: Results from the disturbed thalamocortical communications. Journal of Psychiatric Research, 134, 121–128.

[86] Zhou, Y., Stubbs, R. J., & Finlayson, G. (2023). A neurocognitive perspective on the relationship between exercise and reward: Implications for weight management and drug addiction. Appetite, 182, 106446.

[87] Zhou, Z., Yuan, G., & Yao, J. (2012). Cognitive biases toward internet game-related pictures and executive deficits in individuals with an internet game addiction. PLoS One, 7(11), e48961.

RIGHTS & PERMISSIONS

2024 The Author(s). PsyCh Journal published by Institute of Psychology, Chinese Academy of Sciences and John Wiley & Sons Australia, Ltd.