Gaze behavior when looking at paintings may predict autistic traits

Abstract

From infancy, we spend considerable time absorbing social information from the external world. Social information processing, which starts with looking at facial expressions, affects behavior and cognition. Previous research has demonstrated that looking behaviors at social cues such as faces may differ in individuals with autism spectrum disorder (ASD) by using eye-tracking studies with real photographs and movies. However, mixed results have been reported. In this study, we examined whether autistic traits in adults affected gaze behavior when participants viewed paintings. The eye-tracking results indicate that gaze patterns change over time during a 20-s free-viewing task. Although the fixations were not influenced during the first 10 s of the viewing, autistic tendencies affected gaze behavior after the overview of the painting was completed: the higher the autism-spectrum quotient scores, the shorter the fixation duration and the fewer the fixations on the facial areas of the paintings during the latter 10 s of viewing time. This result indicates that the atypical gaze behavior was more likely to be modulated by a generalized attentional process for endogenous orienting with reduced interest in social cues. Gaze patterns of viewing paintings may be used to predict autistic tendencies among people undiagnosed but suspected of having ASD.

Keywords

artwork / eye tracking / gaze behavior / social attention

References

[1] Akechi, H., Senju, A., Uibo, H., Kikuchi, Y., Hasegawa, T., & Hietanen, J. K. (2013). Attention to eye contact in the west and east: Autonomic responses and evaluative ratings. PLoS One, 8(3), e59312. https://doi.org/10.1371/journal.pone.0059312

[2] American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association. https://doi.org/10.1176/appi.books.9780890425596

[3] Anderson, C. J., Colombo, J., & Shaddy, D. J. (2006). Visual scanning and pupillary responses in young children with autism spectrum disorder. Journal of Clinical and Experimental Neuropsychology, 28(7), 1238-1256. https://doi.org/10.1080/13803390500376790

[4] Atherton, G., Morimoto, Y., Nakashima, S., & Cross, L. (2023). Does the study of culture enrich our understanding of autism? A cross-cultural exploration of life on the spectrum in Japan and the west. Journal of Cross-Cultural Psychology, 54(5), 610-634. https://doi.org/10.1177/00220221231169945

[5] Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001). The autism-spectrum quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, men and women, scientists and mathematicians. Journal of Autism and Developmental Disorders, 31(1), 5-17. https://doi.org/10.1023/a:1005653411471

[6] Belarmino, M., & Roberts, M. R. (2019). Japanese gender role expectations and attitudes: A qualitative analysis of gender inequality. Journal of International Women's Studies, 20(7), 272-288.

[7] Bird, G., Press, C., & Richardson, D. C. (2011). The role of alexithymia in reduced eye-fixation in autism spectrum conditions. Journal of Autism and Developmental Disorders, 41(11), 1556-1564. https://doi.org/10.1007/s10803-011-1183-3

[8] Birmingham, E., Cerf, M., & Adolphs, R. (2011). Comparing social attention in autism and amygdala lesions: Effects of stimulus and task condition. Social Neuroscience, 6(5-6), 420-435. https://doi.org/10.1080/17470919.2011.561547

[9] Chawarska, K., Macari, S., & Shic, F. (2012). Context modulates attention to social scenes in toddlers with autism. Journal of Child Psychology and Psychiatry, 53(8), 903-913. https://doi.org/10.1111/j.1469-7610.2012.02538.x

[10] Elsabbagh, M., Gliga, T., Pickles, A., Hudry, K., Charman, T., Johnson, M. H., & BASIS Team. (2013). The development of face orienting mechanisms in infants at-risk for autism. Behavioural Brain Research, 251, 147-154. https://doi.org/10.1016/j.bbr.2012.07.030

[11] Falck-Ytter, T., Kleberg, J. L., Portugal, A. M., & Thorup, E. (2023). Social attention: Developmental foundations and relevance for autism spectrum disorder. Biological Psychiatry, 94(1), 8-17. https://doi.org/10.1016/j.biopsych.2022.09.035

[12] Falck-Ytter, T., & von Hofsten, C. (2010). How special is social looking in ASD: A review. Progress in Brain Research, 189, 209-222. https://doi.org/10.1016/b978-0-444-53884-0.00026-9

[13] Fletcher-Watson, S., Leekam, S. R., Benson, V., Frank, M. C., & Findlay, J. M. (2009). Eye-movements reveal attention to social information in autism spectrum disorder. Neuropsychologia, 47(1), 248-257. https://doi.org/10.1016/j.neuropsychologia.2008.07.016

[14] Gastgeb, H. Z., Wilkinson, D. A., Minshew, N. J., & Strauss, M. S. (2011). Can individuals with autism abstract prototypes of natural faces? Journal of Autism and Developmental Disorders, 41(12), 1609-1618. https://doi.org/10.1007/s10803-011-1190-4

[15] Ghosn, F., Perea, M., Castelló, J., Vázquez, M. Á., Yáñez, N., Marcos, I., Sahuquillo, R., Vento, M., & García-Blanco, A. (2019). Attentional patterns to emotional faces versus scenes in children with autism spectrum disorders. Journal of Autism and Developmental Disorders, 49(4), 1484-1492. https://doi.org/10.1007/s10803-018-3847-8

[16] Gliga, T., & Csibra, G. (2007). Seeing the face through the eyes: A developmental perspective on face expertise. Progress in Brain Research, 164, 323-339. https://doi.org/10.1016/S0079-6123(07)64018-7

[17] Heidenreich, S. M., & Turano, K. A. (2011). Where does one look when viewing artwork in a museum? Empirical Studies of the Arts, 29(1), 51-72. https://doi.org/10.2190/EM.29.1.d

[18] Jack, R. E., & Schyns, P. G. (2015). The human face as a dynamic tool for social communication. Current Biology, 25(14), 621-634. https://doi.org/10.1016/j.cub.2015.05.052

[19] Japan Student Services Organization. (2018). Survey result report on actual educational support for students with disabilities in universities, junior colleges and technical colleges in 2018. https://www.jasso.go.jp/en/statistics/shougai_gakusei/__icsFiles/afieldfile/2022/07/15/fy2018_survey.pdf

[20] Kapsetaki, M. E., & Zeki, S. (2022). Human faces and face-like stimuli are more memorable. PsyCh Journal, 11(5), 715-719. https://doi.org/10.1002/pchj.564

[21] Kemner, C., van der Geest, J. N., Verbaten, M. N., & van Engeland, H. (2007). Effects of object complexity and type on the gaze behavior of children with pervasive developmental disorder. Brain and Cognition, 65(1), 107-111. https://doi.org/10.1016/j.bandc.2006.05.006

[22] Kennedy, D. P., D'Onofrio, B. M., Quinn, P. D., Bölte, S., Lichtenstein, P., & Falck-Ytter, T. (2017). Genetic influence on eye movements to complex scenes at short timescales. Current Biology, 27(22), 3554-3560.e3. https://doi.org/10.1016/j.cub.2017.10.007

[23] Klein, C., Betz, J., Hirschbuehl, J., Fuchs, C., Schmiedtová, B., Engelbrecht, M., Mueller-Paul, J., & Rosenberg, R. (2014). Describing art - An interdisciplinary approach to the effects of speaking on gaze movements during the beholding of paintings. PLoS One, 9(12), e102439. https://doi.org/10.1371/journal.pone.0102439

[24] Klin, A., Jones, W., Schultz, R., Volkmar, F., & Cohen, D. (2002). Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Archives of General Psychiatry, 59(9), 809-816. https://doi.org/10.1001/archpsyc.59.9.809

[25] Komogortsev, O. V., Gobert, D. V., Jayarathna, S., Koh, D. H., & Gowda, S. (2010). Standardization of automated analyses of oculomotor fixation and saccadic behaviors. IEEE Transactions on Bio-Medical Engineering, 57(11), 2635-2645. https://doi.org/10.1109/TBME.2010.2057429

[26] Kuhn, G., Kourkoulou, A., & Leekam, S. R. (2010). How magic changes our expectations about autism. Psychological Science, 21(10), 1487-1493. https://doi.org/10.1177/0956797610383435

[27] Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1-26. https://doi.org/10.18637/jss.v082.i13

[28] Locher, P., Krupinski, E. A., Mello-Thoms, C., & Nodine, C. F. (2007). Visual interest in pictorial art during an aesthetic experience. Spatial Vision, 21(1-2), 55-77. https://doi.org/10.1163/156856807782753868

[29] Loomes, R., Hull, L., & Mandy, W. P. L. (2017). What is the male-to-female ratio in autism spectrum disorder? A systematic review and meta-analysis. Journal of the American Academy of Child and Adolescent Psychiatry, 56(6), 466-474. https://doi.org/10.1016/j.jaac.2017.03.013

[30] Massaro, D., Savazzi, F., Di Dio, C., Freedberg, D., Gallese, V., Gilli, G., & Marchetti, A. (2012). When art moves the eyes: A behavioral and eye-tracking study. PLoS One, 7(5), e37285. https://doi.org/10.1371/journal.pone.0037285

[31] Mazza, M., Pino, M. C., Vagnetti, R., Peretti, S., Valenti, M., Marchetti, A., & Di Dio, C. (2020). Discrepancies between explicit and implicit evaluation of aesthetic perception ability in individuals with autism: A potential way to improve social functioning. BMC Psychology, 8(1), 74. https://doi.org/10.1186/s40359-020-00437-x

[32] Morsbach, H. (1973). Aspects of nonverbal communication in Japan. Journal of Nervous and Mental Disease, 157(4), 262-277. https://doi.org/10.1097/00005053-197310000-00006

[33] Niehorster, D. C., Andersson, R., & Nyström, M. (2020). Titta: A toolbox for creating PsychToolbox and Psychopy experiments with Tobii eye trackers. Behavior Research Methods, 52, 1970-1979. https://doi.org/10.3758/s13428-020-01358-8

[34] Oshio, A., Abe, S., & Cutrone, P. (2012). Development, reliability, and validity of the Japanese version of ten item personality inventory (TIPI-J). The Japanese Journal of Personality, 21(1), 40-52. https://doi.org/10.2132/personality.21.40

[35] Riby, D. M., & Hancock, P. J. (2008). Viewing it differently: Social scene perception in Williams syndrome and autism. Neuropsychologia, 46(11), 2855-2860. https://doi.org/10.1016/j.neuropsychologia.2008.05.003

[36] Riby, D. M., & Hancock, P. J. (2009). Do faces capture the attention of individuals with Williams syndrome or autism? Evidence from tracking eye movements. Journal of Autism and Developmental Disorders, 39(3), 421-431. https://doi.org/10.1007/s10803-008-0641-z

[37] Rice, K., Moriuchi, J. M., Jones, W., & Klin, A. (2012). Parsing heterogeneity in autism spectrum disorders: Visual scanning of dynamic social scenes in school-aged children. Journal of the American Academy of Child & Adolescent Psychiatry, 51(3), 238-248. https://doi.org/10.1016/j.jaac.2011.12.017

[38] Sahuquillo-Leal, R., Perea, M., Moreno-Giménez, A., Salmerón, L., Andreu, J., Pons, D., Vento, M., & García-Blanco, A. (2024). Emotional face processing in autism spectrum condition: A study of attentional orienting and inhibitory control. Journal of Autism and Developmental Disorders, 1-9. https://doi.org/10.1007/s10803-023-06200-6.

[39] Salvucci, D. D., & Goldberg, J. H. (2000). Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the symposium on eye tracking research & applications - ETRA 00 (pp. 71-78). ACM Press. https://doi.org/10.1145/355017.355026

[40] Shah, P., Gaule, A., Bird, G., & Cook, R. (2013). Robust orienting to protofacial stimuli in autism. Current Biology, 23(24), R1087-R1088. https://doi.org/10.1016/j.cub.2013.10.034

[41] Shic, F., Bradshaw, J., Klin, A., Scassellati, B., & Chawarska, K. (2011). Limited activity monitoring in toddlers with autism spectrum disorder. Brain Research, 1380, 246-254. https://doi.org/10.1016/j.brainres.2010.11.074

[42] Smith, J. K., & Smith, L. F. (2001). Spending time on art. Empirical Studies of the Arts, 19(2), 229-236. https://doi.org/10.2190/5MQM-59JH-X21R-JN5J

[43] Uljarevic, M., & Hamilton, A. (2013). Recognition of emotions in autism: A formal meta-analysis. Journal of Autism and Developmental Disorders, 43(7), 1517-1526. https://doi.org/10.1007/s10803-012-1695-5

[44] Vuilleumier, P. (2002). Facial expression and selective attention. Current Opinion in Psychiatry, 15, 291-300. https://doi.org/10.1097/00001504-200205000-00011

[45] Wakabayashi, A., Tojo, Y., Baron-Cohen, S., & Wheelwright, S. (2004). The autism-spectrum quotient (AQ) Japanese version: Evidence from high functioning clinical group and normal adults. The Japanese Journal of Psychology, 75(1), 78-84.

[46] Wassiliwizky, E., & Menninghaus, W. (2021). Why and how should cognitive science care about aesthetics? Trends in Cognitive Sciences, 25(6), 437-449. https://doi.org/10.1016/j.tics.2021.03.008

[47] Weigelt, S., Koldewyn, K., & Kanwisher, N. (2012). Face identity recognition in autism spectrum disorders: A review of behavioral studies. Neuroscience & Biobehavioral Reviews, 36(3), 1060-1084.

[48] Zhang, Y., Zhang, K., Chen, J., Liu, L., Luo, M., Chen, Q., Zeng, X., & Wang, G. (2022). Eye tracking study of social intensity on social orientation of autistic children. Behavioral Sciences, 12(9), 322. https://doi.org/10.3390/bs12090322

[49] Zhou, Y., Kawabata, H., & Zeki, S. (2024). Roving eye: Variations of gaze during the free-viewing of paintingsarticle-title. [Manuscript in preparation]. Keio University.

RIGHTS & PERMISSIONS

2025 The Author(s). PsyCh Journal published by Institute of Psychology, Chinese Academy of Sciences and John Wiley & Sons Australia, Ltd.