A survey on learning from graphs with heterophily: recent advances and future directions

Abstract

Graphs are structured data that models complex relations between real-world entities. Heterophilic graphs, where linked nodes trend to have different labels or dissimilar features, have recently attracted significant attention and found many real-world applications. Meanwhile, increasing efforts have been made to advance learning from graphs with heterophily. Various graph heterophily measures, benchmark datasets, and learning paradigms are emerging rapidly. In this survey, we comprehensively review existing works on learning from graphs with heterophily. First, we overview over 500 publications, of which more than 300 are directly related to heterophilic graphs. After that, we survey existing metrics of graph heterophily and list recent benchmark datasets. Further, we systematically categorize existing methods based on a hierarchical taxonomy including GNN models, learning paradigms and practical applications. In addition, broader topics related to graph heterophily are also included. Finally, we discuss the primary challenges of existing studies and highlight promising avenues for future research.

Graphical abstract

Keywords

graphs with heterophily / heterophilic graphs / graph neural networks / graph learning

References

[1] McPherson M, Smith-Lovin L, Cook J M . Birds of a feather: homophily in social networks. Annual Review of Sociology, 2001, 27: 415–444

[2] Kimura D, Hayakawa Y . Coevolutionary networks with homophily and heterophily. Physical Review E, 2008, 78( 1): 016103

[3] Zheng X, Wang Y, Liu Y, Li M, Zhang M, Jin D, Yu P S, Pan S. Graph neural networks for graphs with heterophily: a survey. 2022, arXiv preprint arXiv: 2202.07082

[4] Zhu J, Yan Y, Heimann M, Zhao L, Akoglu L, Koutra D . Heterophily and graph neural networks: past, present and future. IEEE Data Engineering Bulletin, 2023, 46( 2): 12–34

[5] Luan S, Hua C, Lu Q, Ma L, Wu L, Wang X, Xu M, Chang X W, Precup D, Ying R, Li S Z, Tang J, Wolf G, Jegelka S. The heterophilic graph learning handbook: benchmarks, models, theoretical analysis, applications and challenges. 2024, arXiv preprint arXiv: 2407.09618

[6] Brachten F, Stieglitz S, Hofeditz L, Kloppenborg K, Reimann A. Strategies and influence of social bots in a 2017 German state election - a case study on twitter. 2017, arXiv preprint arXiv: 1710.07562

[7] Shao C, Ciampaglia G L, Varol O, Flammini A, Menczer F. The spread of fake news by social bots. 2017, arXiv preprint arXiv: 1707.07592

[8] Shao C, Ciampaglia G L, Varol O, Yang K C, Flammini A, Menczer F . The spread of low-credibility content by social bots. Nature Communications, 2018, 9( 1): 4787

[9] Doshi J, Novacic I, Fletcher C, Borges M, Zhong E, Marino M C, Gan J, Mager S, Sprague D, Xia M. Sleeper social bots: a new generation of AI disinformation bots are already a political threat. 2024, arXiv preprint arXiv: 2408.12603

[10] Wan H, Luo M, Ma Z, Dai G, Zhao X. How do social bots participate in misinformation spread? A comprehensive dataset and analysis. 2024, arXiv preprint arXiv: 2408.09613

[11] Lynn C W, Bassett D S . The physics of brain network structure, function and control. Nature Reviews Physics, 2019, 1( 5): 318–332

[12] Cho H, Sim J, Wu G, Kim W H. Neurodegenerative brain network classification via adaptive diffusion with temporal regularization. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[13] Zheng Y, Capra L, Wolfson O, Yang H . Urban computing: concepts, methodologies, and applications. ACM Transactions on Intelligent Systems and Technology (TIST), 2014, 5( 3): 38

[14] Xiao C, Zhou J, Huang J, Xu T, Xiong H. Spatial heterophily aware graph neural networks. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 2752−2763

[15] Kipf T N, Welling M. Semi-supervised classification with graph convolutional networks. In: Proceedings of the 5th International Conference on Learning Representations. 2017

[16] Hamilton W L, Ying Z, Leskovec J. Inductive representation learning on large graphs. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017, 1025−1035

[17] Veličković P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y. Graph attention networks. 2017, arXiv preprint arXiv: 1710.10903

[18] Gilmer J, Schoenholz S S, Riley P F, Vinyals O, Dahl G E. Neural message passing for quantum chemistry. In: Proceedings of the 34th International Conference on Machine Learning. 2017, 1263−1272

[19] Gilmer J, Schoenholz S S, Riley P F, Vinyals O, Dahl G E. Message passing neural networks. In: Schütt K T, Chmiela S, von Lilienfeld O A, Tkatchenko A, Tsuda K, Müller K R, eds. Machine Learning Meets Quantum Physics. Cham: Springer, 2020, 199−214

[20] Zhu J, Yan Y, Zhao L, Heimann M, Akoglu L, Koutra D. Beyond homophily in graph neural networks: current limitations and effective designs. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. 2020, 653

[21] Li Q, Han Z, Wu X M. Deeper insights into graph convolutional networks for semi-supervised learning. In: Proceedings of the 32nd AAAI Conference on Artificial Intelligence. 2018, 433

[22] Alon U, Yahav E. On the bottleneck of graph neural networks and its practical implications. In: Proceedings of the 9th International Conference on Learning Representations. 2021

[23] Corso G, Cavalleri L, Beaini D, Liò P, Veličković P. Principal neighbourhood aggregation for graph nets. In: Proceedings of the 34th International Conference on Neural Information Processing System. 2020, 1112

[24] Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, Kaiser Ł, Polosukhin I. Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017, 6000−6010

[25] Devlin J, Chang M W, Lee K, Toutanova K. BERT: pre-training of deep bidirectional transformers for language understanding. In: Proceedings of 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2019, 4171−4186

[26] Brown T, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A, Agarwal S, Herbert-Voss A, Krueger G, Henighan T, Child R, Ramesh A, Ziegler D M, Wu J, Winter C, Hesse C, Chen M, Sigler E, Litwin M, Gray S, Chess B, Clark J, Berner C, McCandlish S, Radford A, Sutskever I, Amodei D. Language models are few-shot learners. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. 2020, 159

[27] Patwardhan N, Marrone S, Sansone C . Transformers in the real world: a survey on NLP applications. Information, 2023, 14( 4): 242

[28] Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, Uszkoreit J, Houlsby N. An image is worth 16x16 words: transformers for image recognition at scale. In: Proceedings of the 9th International Conference on Learning Representations. 2021

[29] Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Lin S, Guo B. Swin transformer: hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021, 9992−10002

[30] Han K, Wang Y, Chen H, Chen X, Guo J, Liu Z, Tang Y, Xiao A, Xu C, Xu Y, Yang Z, Zhang Y, Tao D . A survey on vision transformer. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45( 1): 87–110

[31] Khan S, Naseer M, Hayat M, Zamir S W, Khan F S, Shah M . Transformers in vision: a survey. ACM Computing Surveys (CSUR), 2022, 54( 10s): 200

[32] Min E, Chen R, Bian Y, Xu T, Zhao K, Huang W, Zhao P, Huang J, Ananiadou S, Rong Y. Transformer for graphs: an overview from architecture perspective. 2022, arXiv preprint arXiv: 2202.08455

[33] Shehzad A, Xia F, Abid S, Peng C, Yu S, Zhang D, Verspoor K. Graph transformers: a survey. 2024, arXiv preprint arXiv: 2407.09777

[34] Ying C, Cai T, Luo S, Zheng S, Ke G, He D, Shen Y, Liu T Y. Do transformers really perform bad for graph representation? In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 2212

[35] Dwivedi V P, Luu A T, Laurent T, Bengio Y, Bresson X. Graph neural networks with learnable structural and positional representations. In: Proceedings of the 10th International Conference on Learning Representations. 2022

[36] Bouritsas G, Frasca F, Zafeiriou S, Bronstein M M . Improving graph neural network expressivity via subgraph isomorphism counting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45( 1): 657–668

[37] Kreuzer D, Beaini D, Hamilton W, Létourneau V, Tossou P. Rethinking graph transformers with spectral attention. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 1654

[38] Ma L, Lin C, Lim D, Romero-Soriano A, Dokania P K, Coates M, Torr P H S, Lim S N. Graph inductive biases in transformers without message passing. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 971

[39] Zhang K, Zhu Y, Wang J, Zhang J. Adaptive structural fingerprints for graph attention networks. In: Proceedings of the 8th International Conference on Learning Representations. 2020

[40] Chung F R K. Spectral Graph Theory. Providence: American Mathematical Society, 1997

[41] Luan S, Zhao M, Hua C, Chang X W, Precup D. Complete the missing half: augmenting aggregation filtering with diversification for graph convolutional networks. 2020, arXiv preprint arXiv: 2008.08844

[42] Daković M, Stanković L, Sejdić E . Local smoothness of graph signals. Mathematical Problems in Engineering, 2019, 2019( 1): 3208569

[43] Liao N, Liu H, Zhu Z, Luo S, Lakshmanan L V S. Benchmarking spectral graph neural networks: a comprehensive study on effectiveness and efficiency. 2024, arXiv preprint arXiv: 2406.09675

[44] Xu K, Hu W, Leskovec J, Jegelka S. How powerful are graph neural networks? In: Proceedings of the 7th International Conference on Learning Representations. 2019

[45] Liu X, Zhang F, Hou Z, Mian L, Wang Z, Zhang J, Tang J . Self-supervised learning: generative or contrastive. IEEE Transactions on Knowledge and Data Engineering, 2023, 35( 1): 857–876

[46] Liu Y, Jin M, Pan S, Zhou C, Zheng Y, Xia F, Yu P S . Graph self-supervised learning: a survey. IEEE Transactions on Knowledge and Data Engineering, 2023, 35( 6): 5879–5900

[47] Hu W, Liu B, Gomes J, Zitnik M, Liang P, Pande V S, Leskovec J. Strategies for pre-training graph neural networks. In: Proceedings of the 8th International Conference on Learning Representations. 2020

[48] Liu P, Yuan W, Fu J, Jiang Z, Hayashi H, Neubig G . Pre-train, prompt, and predict: a systematic survey of prompting methods in natural language processing. ACM Computing Surveys, 2023, 55( 9): 195

[49] Rozemberczki B, Allen C, Sarkar R . Multi-scale attributed node embedding. Journal of Complex Networks, 2021, 9( 2): cnab014

[50] Pei H, Wei B, Chang K C C, Lei Y, Yang B. Geom-GCN: geometric graph convolutional networks. In: Proceedings of the 8th International Conference on Learning Representations. 2020

[51] Lim D, Li X, Hohne F, Lim S N. New benchmarks for learning on non-homophilous graphs. 2021, arXiv preprint arXiv: 2104.01404

[52] Lim D, Hohne F, Li X, Huang S L, Gupta V, Bhalerao O, Lim S N. Large scale learning on non-homophilous graphs: new benchmarks and strong simple methods. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 1598

[53] Platonov O, Kuznedelev D, Diskin M, Babenko A, Prokhorenkova L. A critical look at the evaluation of GNNs under heterophily: are we really making progress? In: Proceedings of the 11th International Conference on Learning Representations. 2023

[54] Luan S, Lu Q, Hua C, Wang X, Zhu J, Chang X W, Wolf G, Tang J. Are heterophily-specific GNNs and homophily metrics really effective? Evaluation pitfalls and new benchmarks. 2024, arXiv preprint arXiv: 2409.05755

[55] Xiao T, Zhu H, Chen Z, Wang S. Simple and asymmetric graph contrastive learning without augmentations. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 710

[56] Cavallo A, Grohnfeldt C, Russo M, Lovisotto G, Vassio L. 2-hop neighbor class similarity (2NCS): a graph structural metric indicative of graph neural network performance. 2022, arXiv preprint arXiv: 2212.13202

[57] Platonov O, Kuznedelev D, Babenko A, Prokhorenkova L. Characterizing graph datasets for node classification: homophily-heterophily dichotomy and beyond. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 25

[58] Newman M E J . Mixing patterns in networks. Physical Review E, 2003, 67( 2): 026126

[59] Li S, Kim D, Wang Q. Restructuring graph for higher homophily via adaptive spectral clustering. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence. 2023, 8622−8630

[60] Gong S, Zhou J, Xie C, Xuan Q. Neighborhood homophily-based graph convolutional network. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 3908−3912

[61] Luan S, Hua C, Lu Q, Zhu J, Zhao M, Zhang S, Chang X W, Precup D. Revisiting heterophily for graph neural networks. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 100

[62] Yang L, Li M, Liu L, Niu B, Wang C, Cao X, Guo Y. Diverse message passing for attribute with heterophily. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 363

[63] Jin D, Wang R, Ge M, He D, Li X, Lin W, Zhang W. RAW-GNN: RAndom walk aggregation based graph neural network. In: Proceedings of the 31st International Joint Conference on Artificial Intelligence. 2022, 2108−2114

[64] Lee S Y, Kim S, Bu F, Yoo J, Tang J, Shin K. Feature distribution on graph topology mediates the effect of graph convolution: homophily perspective. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[65] Luan S, Hua C, Xu M, Lu Q, Zhu J, Chang X W, Fu J, Leskovec J, Precup D. When do graph neural networks help with node classification? Investigating the homophily principle on node distinguishability. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 1251

[66] Ojha I, Bose K, Das S. Affinity-based homophily: can we measure homophily of a graph without using node labels? In: Proceedings of the 12th International Conference on Learning Representations. 2024

[67] Zheng Y, Luan S, Chen L. What is missing in homophily? Disentangling graph homophily for graph neural networks. 2024, arXiv preprint arXiv: 2406.18854

[68] Ma Y, Liu X, Shah N, Tang J. Is homophily a necessity for graph neural networks? In: Proceedings of the 10th International Conference on Learning Representations. 2022

[69] Huang X, Li J, Hu X. Label informed attributed network embedding. In: Proceedings of the 10th ACM International Conference on Web Search and Data Mining. 2017, 731−739

[70] Zhou Z Y, Zhou S, Mao B, Zhou X, Chen J, Tan Q, Zha D, Feng Y, Chen C, Wang C. OpenGSL: a comprehensive benchmark for graph structure learning. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 787

[71] Tang J, Sun J, Wang C, Yang Z. Social influence analysis in large-scale networks. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2009, 807−816

[72] García-Plaza A P, Fresno V, Unanue R M, Zubiaga A . Using fuzzy logic to leverage HTML markup for web page representation. IEEE Transactions on Fuzzy Systems, 2017, 25( 4): 919–933

[73] Dwivedi V P, Joshi C K, Luu A T, Laurent T, Bengio Y, Bresson X . Benchmarking graph neural networks. The Journal of Machine Learning Research, 2023, 24( 1): 43

[74] Traud A L, Mucha P J, Porter M A . Social structure of facebook networks. Physica A: Statistical Mechanics and its Applications, 2012, 391( 16): 4165–4180

[75] Jure L, Andrej J. Stanford large network dataset collection. See Snap.stanford.edu/data website, 2014

[76] Lim D, Benson A R. Expertise and dynamics within crowdsourced musical knowledge curation: a case study of the genius platform. In: Proceedings of the 15th International AAAI Conference on Web and Social Media. 2021, 373−384

[77] Rozemberczki B, Sarkar R. Twitch gamers: a dataset for evaluating proximity preserving and structural role-based node embeddings. 2021, arXiv preprint arXiv: 2101.03091

[78] Rozemberczki B, Sarkar R. Characteristic functions on graphs: birds of a feather, from statistical descriptors to parametric models. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, 1325−1334

[79] Hu W, Fey M, Zitnik M, Dong Y, Ren H, Liu B, Catasta M, Leskovec J. Open graph benchmark: datasets for machine learning on graphs. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. 2020, 1855

[80] Leskovec J, Kleinberg J, Faloutsos C. Graphs over time: densification laws, shrinking diameters and possible explanations. In: Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining. 2005, 177−187

[81] Lhoest Q, del Moral A V, Jernite Y, Thakur A, von Platen P, Patil S, Chaumond J, Drame M, Plu J, Tunstall L, Davison J, Šaško M, Chhablani M, Malik B, Brandeis S, Le Scao T, Sanh V, Xu C, Patry N, McMillan-Major A, Schmid P, Gugger S, Delangue C, Matussière T, Debut L, Bekman S, Cistac P, Goehringer T, Mustar V, Lagunas F, Rush A, Wolf T. Datasets: a community library for natural language processing. In: Proceedings of 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2021, 175−184

[82] Luo Y, Shi L, Wu X M. Classic GNNs are strong baselines: reassessing GNNs for node classification. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024

[83] Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R . Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 2014, 15( 1): 1929–1958

[84] Shu J, Xi B, Li Y, Wu F, Kamhoua C, Ma J. Understanding dropout for graph neural networks. In: Proceedings of Companion Proceedings of the Web Conference 2022. 2022, 1128−1138

[85] Cai T, Luo S, Xu K, He D, Liu T Y, Wang L. GraphNorm: a principled approach to accelerating graph neural network training. In: Proceedings of the 38th International Conference on Machine Learning. 2021, 1204−1215

[86] He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016, 770−778

[87] Li G, Müller M, Thabet A, Ghanem B. DeepGCNs: can GCNs go as deep as CNNs? In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2019, 9266−9275

[88] Li G, Xiong C, Thabet A, Ghanem B. DeeperGCN: all you need to train deeper GCNs. 2020, arXiv preprint arXiv: 2006.07739

[89] Xu K, Li C, Tian Y, Sonobe T, Kawarabayashi K I, Jegelka S. Representation learning on graphs with jumping knowledge networks. In: Proceedings of the 35th International Conference on Machine Learning. 2018, 5449−5458

[90] Chen M, Wei Z, Huang Z, Ding B, Li Y. Simple and deep graph convolutional networks. In: Proceedings of the 37th International Conference on Machine Learning. 2020, 1725−1735

[91] Chien E, Peng J, Li P, Milenkovic O. Adaptive universal generalized PageRank graph neural network. In: Proceedings of the 9th International Conference on Learning Representations. 2021

[92] Chanpuriya S, Musco C. Simplified graph convolution with heterophily. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 1971

[93] He M, Wei Z, Wen J R. Convolutional neural networks on graphs with chebyshev approximation, revisited. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 527

[94] Guo Y, Wei Z. Clenshaw graph neural networks. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 614−625

[95] He M, Wei Z, Huang Z, Xu H. BernNet: learning arbitrary graph spectral filters via bernstein approximation. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 1091

[96] Chen J, Xu L . Improved modeling and generalization capabilities of graph neural networks with Legendre polynomials. IEEE Access, 2023, 11: 63442–63450

[97] Wang T, Jin D, Wang R, He D, Huang Y. Powerful graph convolutional networks with adaptive propagation mechanism for homophily and heterophily. In: Proceedings of the 36th AAAI Conference on Artificial Intelligence. 2022, 4210−4218

[98] Guo Y, Wei Z. Graph neural networks with learnable and optimal polynomial bases. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 12077−12097

[99] Du Z, Liang J, Liang J, Yao K, Cao F . Graph regulation network for point cloud segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46( 12): 7940–7955

[100] Li M, Guo X, Wang Y, Wang Y, Lin Z. G²CN: graph gaussian convolution networks with concentrated graph filters. In: Proceedings of the 39th International Conference on Machine Learning. 2022, 12782−12796

[101] Ekbote C, Deshpande A P, Iyer A, Bairi R, Sellamanickam S. FiGURe: simple and efficient unsupervised node representations with filter augmentations. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 1538

[102] Geng H, Chen C, He Y, Zeng G, Han Z, Chai H, Yan J. Pyramid graph neural network: a graph sampling and filtering approach for multi-scale disentangled representations. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 518−530

[103] Lu Q, Zhu J, Luan S, Chang X W. Flexible diffusion scopes with parameterized Laplacian for heterophilic graph learning. 2024, arXiv preprint arXiv: 2409.09888

[104] Li B, Pan E, Kang Z. PC-Conv: unifying homophily and heterophily with two-fold filtering. In: Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence. 2024, 13437−13445

[105] Xu J, Dai E, Luo D, Zhang X, Wang S. Shape-aware graph spectral learning. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, 2692−2701

[106] Huang K, Cao W, Ta H, Xiao X, Liò P. Optimizing polynomial graph filters: a novel adaptive Krylov subspace approach. In: Proceedings of the ACM Web Conference 2024. 2024, 1057−1068

[107] Huang K, Wang Y G, Li M, Liò P. How universal polynomial bases enhance spectral graph neural networks: heterophily, over-smoothing, and over-squashing. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[108] Han H, Li J, Huang W, Tang X, Lu H, Luo C, Liu H, Tang J. Node-wise filtering in graph neural networks: a mixture of experts approach. 2024, arXiv preprint arXiv: 2406.03464

[109] Zheng S, Zhu Z, Liu Z, Li Y, Zhao Y . Node-oriented spectral filtering for graph neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46( 1): 388–402

[110] Abu-El-Haija S, Perozzi B, Kapoor A, Alipourfard N, Lerman K, Harutyunyan H, Ver Steeg G, Galstyan A. MixHop: higher-order graph convolutional architectures via sparsified neighborhood mixing. In: Proceedings of the 36th International Conference on Machine Learning. 2019, 21−29

[111] Jin D, Yu Z, Huo C, Wang R, Wang X, He D, Han J. Universal graph convolutional networks. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 815

[112] Maurya S K, Liu X, Murata T . Simplifying approach to node classification in graph neural networks. Journal of Computational Science, 2022, 62: 101695

[113] Xu J, Dai E, Zhang X, Wang S. HP-GMN: graph memory networks for heterophilous graphs. In: Proceedings of 2022 IEEE International Conference on Data Mining (ICDM). 2022, 1263−1268

[114] Zhao Z, Yang Z, Li C, Zeng Q, Guan W, Zhou M . Dual feature interaction-based graph convolutional network. IEEE Transactions on Knowledge and Data Engineering, 2023, 35( 9): 9019–9030

[115] Choi S, Kim G, Yun S Y. Node mutual information: enhancing graph neural networks for heterophily. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023

[116] Wang Y, Derr T. Tree decomposed graph neural network. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 2021, 2040−2049

[117] Song Y, Zhou C, Wang X, Lin Z. Ordered GNN: ordering message passing to deal with heterophily and over-smoothing. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[118] Sun Y, Deng H, Yang Y, Wang C, Xu J, Huang R, Cao L, Wang Y, Chen L. Beyond homophily: structure-aware path aggregation graph neural network. In: Proceedings of the 31st International Joint Conference on Artificial Intelligence. 2022, 2233−2240

[119] Zhou J, Xie C, Gong S, Qian J, Yu S, Xuan Q, Yang X . PathMLP: smooth path towards high-order homophily. Neural Networks, 2024, 180: 106650

[120] Jin W, Derr T, Wang Y, Ma Y, Liu Z, Tang J. Node similarity preserving graph convolutional networks. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 2021, 148−156

[121] Suresh S, Budde V, Neville J, Li P, Ma J. Breaking the limit of graph neural networks by improving the assortativity of graphs with local mixing patterns. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 2021, 1541−1551

[122] Ai G, Gao Y, Wang H, Li X, Wang J, Yan H . Neighbors selective graph convolutional network for homophily and heterophily. Pattern Recognition Letters, 2024, 184: 44–51

[123] Liu S, He D, Yu Z, Jin D, Feng Z . Beyond homophily: neighborhood distribution-guided graph convolutional networks. Expert Systems with Applications, 2025, 259: 125274

[124] Wang Y, Xiang S, Pan C. Improving the homophily of heterophilic graphs for semi-supervised node classification. In: Proceedings of 2023 IEEE International Conference on Multimedia and Expo (ICME). 2023, 1865−1870

[125] Liu M, Wang Z, Ji S . Non-local graph neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44( 12): 10270–10276

[126] Yang T, Wang Y, Yue Z, Yang Y, Tong Y, Bai J. Graph pointer neural networks. In: Proceedings of the 36th AAAI Conference on Artificial Intelligence. 2022, 8832−8839

[127] Dong Y, Dupty M H, Deng L, Liu Z, Goh Y L, Lee W S. Differentiable cluster graph neural network. 2024, arXiv preprint arXiv: 2405.16185

[128] Park J, Yun S, Park H, Kang J, Jeong J, Kim K M, Ha J W, Kim H J. Deformable graph transformer. 2022, arXiv preprint arXiv: 2206.14337

[129] Zhu J, Rossi R A, Rao A, Mai T, Lipka N, Ahmed N K, Koutra D. Graph neural networks with heterophily. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 11168−11176

[130] Zhong Z, Ivanov S, Pang J. Simplifying node classification on heterophilous graphs with compatible label propagation. 2022 , arXiv preprint arXiv: 2205.09389

[131] Zheng Z, Bei Y, Zhou S, Ma Y, Gu M, Xu H, Lai C, Chen J, Bu J. Revisiting the message passing in heterophilous graph neural networks. 2024, arXiv preprint arXiv: 2405.17768

[132] Li X, Zhu R, Cheng Y, Shan C, Luo S, Li D, Qian W. Finding global homophily in graph neural networks when meeting heterophily. In: Proceedings of the 39th International Conference on Machine Learning. 2022, 13242−13256

[133] He D, Liang C, Liu H, Wen M, Jiao P, Feng Z. Block modeling-guided graph convolutional neural networks. In: Proceedings of the 36th AAAI Conference on Artificial Intelligence. 2022, 4022−4029

[134] Yu Z, Feng B, He D, Wang Z, Huang Y, Feng Z. LG-GNN: local-global adaptive graph neural network for modeling both homophily and heterophily. In: Proceedings of the 33rd International Joint Conference on Artificial Intelligence. 2024, 2515−2523

[135] Liu H, Liao N, Luo S. SIMGA: a simple and effective heterophilous graph neural network with efficient global aggregation. 2023, arXiv preprint arXiv: 2305.09958

[136] Liu X, Zhang L, Guan H. Uplifting message passing neural network with graph original information. 2022, arXiv preprint arXiv: 2210.05382

[137] Bo D, Wang X, Shi C, Shen H. Beyond low-frequency information in graph convolutional networks. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 3950−3957

[138] Wu Y, Hu L, Wang Y . Signed attention based graph neural network for graphs with heterophily. Neurocomputing, 2023, 557: 126731

[139] Lai Y, Zhang T, Fan R. Self-attention dual embedding for graphs with heterophily. 2023, arXiv preprint arXiv: 2305.18385

[140] Yan Y, Hashemi M, Swersky K, Yang Y, Koutra D. Two sides of the same coin: heterophily and oversmoothing in graph convolutional neural networks. In: Proceedings of 2022 IEEE International Conference on Data Mining (ICDM). 2022, 1287−1292

[141] Choi Y, Choi J, Ko T, Kim C K. Is signed message essential for graph neural networks. 2023, arXiv preprint arXiv: 2301.08918

[142] Liang L, Kim S, Shin K, Xu Z, Pan S, Qi Y. Sign is not a remedy: multiset-to-multiset message passing for learning on heterophilic graphs. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[143] Sun H, Li X, Wu Z, Su D, Li R H, Wang G. Breaking the entanglement of homophily and heterophily in semi-supervised node classification. In: Proceedings of IEEE 40th International Conference on Data Engineering (ICDE). 2024, 2379−2392

[144] Chaudhary C, Boran N K, Sangeeth N, Singh V. GNNDLD: graph neural network with directional label distribution. In: Proceedings of the 16th International Conference on Agents and Artificial Intelligence. 2024, 165−176

[145] Rossi E, Charpentier B, Di Giovanni F, Frasca F, Günnemann S, Bronstein M M. Edge directionality improves learning on heterophilic graphs. In: Proceedings of the 2nd Learning on Graphs Conference. 2023, 25

[146] Koke C, Cremers D. HoloNets: spectral convolutions do extend to directed graphs. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[147] Zhuo W, Tan G. Commute graph neural networks. 2024, arXiv preprint arXiv: 2407.01635

[148] Du L, Shi X, Fu Q, Ma X, Liu H, Han S, Zhang D. GBK-GNN: gated bi-kernel graph neural networks for modeling both homophily and heterophily. In: Proceedings of the ACM Web Conference 2022. 2022, 1550−1558

[149] Wang K, Zhang G, Zhang X, Fang J, Wu X, Li G, Pan S, Huang W, Liang Y. The heterophilic snowflake hypothesis: training and empowering GNNs for heterophilic graphs. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 3164−3175

[150] Cheng Y, Chen M, Li X, Shan C, Gao M. Prioritized propagation in graph neural networks. 2023, arXiv preprint arXiv: 2311.02832

[151] Deng G, Zhou H, Kannan R, Prasanna V. Learning personalized scoping for graph neural networks under heterophily. 2024, arXiv preprint arXiv: 2409.06998

[152] Wang J, Guo Y, Yang L, Wang Y . Heterophily-aware graph attention network. Pattern Recognition, 2024, 156: 110738

[153] Rusch T K, Chamberlain B P, Mahoney M W, Bronstein M M, Mishra S. Gradient gating for deep multi-rate learning on graphs. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[154] Finkelshtein B, Huang X, Bronstein M M, Ceylan I I. Cooperative graph neural networks. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[155] Ma J, He M, Wei Z. PolyFormer: scalable node-wise filters via polynomial graph transformer. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 2118−2129

[156] Deng C, Yue Z, Zhang Z. Polynormer: polynomial-expressive graph transformer in linear time. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[157] Chen J, Li G, Hopcroft J E, He K. SignGT: signed attention-based graph transformer for graph representation learning. 2023, arXiv preprint arXiv: 2310.11025

[158] Chen S, Chen J, Zhou S, Wang B, Han S, Su C, Yuan Y, Wang C. SIGformer: sign-aware graph transformer for recommendation. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 1274−1284

[159] Kuang W, Wang Z, Wei Z, Li Y, Ding B . When transformer meets large graphs: an expressive and efficient two-view architecture. IEEE Transactions on Knowledge and Data Engineering, 2024, 36( 10): 5440–5452

[160] Liu C, Zhan Y, Ma X, Ding L, Tao D, Wu J, Hu W. Gapformer: graph transformer with graph pooling for node classification. In: Proceedings of the 32nd International Joint Conference on Artificial Intelligence. 2023, 2196−2205

[161] Li W, Chen K, Liu S, Zheng T, Huang W, Song M. Learning a mini-batch graph transformer via two-stage interaction augmentation. In: Proceedings of the 27th European Conference on Artificial Intelligence. 2024, 3015−3022

[162] Fu D, Hua Z, Xie Y, Fang J, Zhang S, Sancak K, Wu H, Malevich A, He J, Long B. VCR-Graphormer: a mini-batch graph transformer via virtual connections. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[163] Xing Y, Wang X, Li Y, Huang H, Shi C. Less is more: on the over-globalizing problem in graph transformers. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[164] Zhang Z, Liu Q, Hu Q, Lee C K. Hierarchical graph transformer with adaptive node sampling. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 1539

[165] Chen J, Jiang S, He K. NTFormer: a composite node tokenized graph transformer for node classification. 2024, arXiv preprint arXiv: 2406.19249

[166] Li D, Qi B, Gao J, Xiong H, Gu B, Chen X. MPformer: advancing graph modeling through heterophily relationship-based position encoding. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[167] Ma X, Chen Q, Wu Y, Song G, Wang L, Zheng B. Rethinking structural encodings: adaptive graph transformer for node classification task. In: Proceedings of the ACM Web Conference 2023. 2023, 533−544

[168] Müller L, Galkin M, Morris C, Rampásek L. Attending to graph transformers. 2023, arXiv preprint arXiv: 2302.04181

[169] Bo D, Shi C, Wang L, Liao R. Specformer: spectral graph neural networks meet transformers. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[170] Wang X, Zhu Y, Shi H, Liu Y, Hong C. Graph triple attention network: a decoupled perspective. 2024, arXiv preprint arXiv: 2408.07654

[171] Chen Q, Wang Y, Wang Y, Yang J, Lin Z. Optimization-induced graph implicit nonlinear diffusion. In: Proceedings of the 39th International Conference on Machine Learning. 2022, 3648−3661

[172] Eliasof M, Haber E, Treister E. PDE-GCN: novel architectures for graph neural networks motivated by partial differential equations. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 293

[173] Rusch T K, Chamberlain B, Rowbottom J, Mishra S, Bronstein M M. Graph-coupled oscillator networks. In: Proceedings of the 39th International Conference on Machine Learning. 2022, 18888−18909

[174] Zhao K, Kang Q, Song Y, She R, Wang S, Tay W P. Graph neural convection-diffusion with heterophily. In: Proceedings of the 32nd International Joint Conference on Artificial Intelligence. 2023, 4656–4664

[175] Wang Y, Yi K, Liu X, Wang Y G, Jin S. ACMP: Allen-Cahn message passing with attractive and repulsive forces for graph neural networks. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[176] Choi J, Hong S, Park N, Cho S B. GREAD: graph neural reaction-diffusion networks. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 5722−5747

[177] Eliasof M, Haber E, Treister E. ADR-GNN: advection-diffusion-reaction graph neural networks. 2023, arXiv preprint arXiv: 2307.16092

[178] Maskey S, Paolino R, Bacho A, Kutyniok G. A fractional graph Laplacian approach to oversmoothing. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 571

[179] Zhang A, Li P. Unleashing the power of high-pass filtering in continuous graph neural networks. In: Proceedings of the 15th Asian Conference on Machine Learning. 2023, 1683−1698

[180] Shao Z, Shi D, Han A, Guo Y, Zhao Q, Gao J. Unifying over-smoothing and over-squashing in graph neural networks: a physics informed approach and beyond. 2023, arXiv preprint arXiv: 2309.02769

[181] Gravina A, Bacciu D, Gallicchio C. Anti-symmetric DGN: a stable architecture for deep graph networks. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[182] Bodnar C, Di Giovanni F, Chamberlain B P, Liò P, Bronstein M. Neural sheaf diffusion: a topological perspective on heterophily and oversmoothing in GNNs. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 1346

[183] Barbero F, Bodnar C, de Ocáriz Borde H S, Bronstein M, Veličković P, Liò P. Sheaf neural networks with connection Laplacians. In: Proceedings of Topological, Algebraic, and Geometric Learning Workshops 2022. 2022, 28−36

[184] Markovich T. QDC: quantum diffusion convolution kernels on graphs. 2023, arXiv preprint arXiv: 2307.11234

[185] Di Giovanni F, Rowbottom J, Chamberlain B P, Markovich T, Bronstein M M. Understanding convolution on graphs via energies. 2022, arXiv preprint arXiv: 2206.10991

[186] Zhang A, Li P, Chen G. Steering graph neural networks with pinning control. 2023, arXiv preprint arXiv: 2303.01265

[187] Wan L, Han H, Sun L, Zhang Z, Ning Z, Yan X, Xia F. Flexible graph neural diffusion with latent class representation learning. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 2936−2947

[188] Li Y, Wang X, Liu H, Shi C. A generalized neural diffusion framework on graphs. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 8707−8715

[189] Chen R T Q, Rubanova Y, Bettencourt J, Duvenaud D. Neural ordinary differential equations. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. 2018, 6572−6583

[190] Ortega A, Frossard P, Kovačević J, Moura J M F, Vandergheynst P . Graph signal processing: overview, challenges, and applications. Proceedings of the IEEE, 2018, 106( 5): 808–828

[191] Nt H, Maehara T. Revisiting graph neural networks: all we have is low-pass filters. 2019, arXiv preprint arXiv: 1905.09550

[192] Gasteiger J, Bojchevski A, Günnemann S. Predict then propagate: graph neural networks meet personalized PageRank. 2018, arXiv preprint arXiv: 1810.05997

[193] Li Q, Wu X M, Liu H, Zhang X, Guan Z. Label efficient semi-supervised learning via graph filtering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, 9574−9583

[194] Gasteiger J, Weißenberger S, Günnemann S. Diffusion improves graph learning. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019, 1197

[195] Li P, Chien I, Milenkovic O. Optimizing generalized PageRank methods for seed-expansion community detection. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019, 1050

[196] Defferrard M, Bresson X, Vandergheynst P. Convolutional neural networks on graphs with fast localized spectral filtering. In: Proceedings of the 30th International Conference on Neural Information Processing Systems. 2016, 3844−3852

[197] Gil A, Segura J, Temme N M. Numerical Methods for Special Functions. Philadelphia: SIAM, 2007

[198] Weber A . Analysis of the physical Laplacian and the heat flow on a locally finite graph. Journal of Mathematical Analysis and Applications, 2010, 370( 1): 146–158

[199] Kroeker J P . Wiener analysis of nonlinear systems using Poisson-Charlier crosscorrelation. Biological Cybernetics, 1977, 27( 4): 221–227

[200] Hildebrand F B. Introduction to Numerical Analysis. 2nd ed. St. Mineola: Dover Publications, Inc., 1987

[201] Liesen J, Strakos Z. Krylov Subspace Methods: Principles and Analysis. Oxford: Oxford Academic, 2013

[202] Cai W, Jiang J, Wang F, Tang J, Kim S, Huang J. A survey on mixture of experts. 2024, arXiv preprint arXiv: 2407.06204

[203] Xu H, Yan Y, Wang D, Xu Z, Zeng Z, Abdelzaher T F, Han J, Tong H. SLOG: an inductive spectral graph neural network beyond polynomial filter. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[204] Tenenbaum J B, De Silva V, Langford J C . A global geometric framework for nonlinear dimensionality reduction. Science, 2000, 290( 5500): 2319–2323

[205] Nickel M, Kiela D. Poincaré embeddings for learning hierarchical representations. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017, 6341−6350

[206] Ribeiro L F R, Saverese P H P, Figueiredo D R. struc2vec: learning node representations from structural identity. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2017, 385−394

[207] Grover A, Leskovec J. node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 855−864

[208] Vinyals O, Fortunato M, Jaitly N. Pointer networks. In: Proceedings of the 29th International Conference on Neural Information Processing Systems. 2015, 2692−2700

[209] Liang L, Hu X, Xu Z, Song Z, King I. Predicting global label relationship matrix for graph neural networks under heterophily. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 480

[210] Jeh G, Widom J. SimRank: a measure of structural-context similarity. In: Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2002, 538−543

[211] Cao Z, Qin T, Liu T Y, Tsai M F, Li H. Learning to rank: from pairwise approach to listwise approach. In: Proceedings of the 24th International Conference on Machine Learning. 2007, 129−136

[212] Wang K, Li G, Wang S, Zhang G, Wang K, You Y, Fang J, Peng X, Liang Y, Wang Y. The snowflake hypothesis: training deep GNN with one node one receptive field. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 3152−3163

[213] Katz L . A new status index derived from sociometric analysis. Psychometrika, 1953, 18( 1): 39–43

[214] Zhang P, Yan Y, Li C, Wang S, Xie X, Kim S. Can transformer and GNN help each other? 2023, arXiv preprint arXiv: 2308.14355

[215] Xu J, Wu Z, Lin M, Zhang X, Wang S. LLM and GNN are complementary: distilling LLM for multimodal graph learning. 2024, arXiv preprint arXiv: 2406.01032

[216] Fan W, Wang S, Huang J, Chen Z, Song Y, Tang W, Mao H, Liu H, Liu X, Yin D, Li Q. Graph machine learning in the era of large language models (LLMs). 2024, arXiv preprint arXiv: 2404.14928

[217] Chamberlain B, Rowbottom J, Gorinova M I, Bronstein M M, Webb S, Rossi E. Grand: graph neural diffusion. In: Proceedings of the 38th International Conference on Machine Learning. 2021, 1407−1418

[218] Han A, Shi D, Lin L, Gao J. From continuous dynamics to graph neural networks: neural diffusion and beyond. 2023, arXiv preprint arXiv: 2310.10121

[219] Chamberlain B, Rowbottom J, Eynard D, Di Giovanni F, Dong X, Bronstein M M. Beltrami flow and neural diffusion on graphs. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 123

[220] Thorpe M, Nguyen T M, Xia H, Strohmer T, Bertozzi A L, Osher S J, Wang B. GRAND++: graph neural diffusion with a source term. In: Proceedings of the 10th International Conference on Learning Representations. 2022

[221] Allen S M, Cahn J W . A microscopic theory for antiphase boundary motion and its application to antiphase domain coarsening. Acta Metallurgica, 1979, 27( 6): 1085–1095

[222] Fisher R A . The wave of advance of advantageous genes. Annals of Eugenics, 1937, 7( 4): 355–369

[223] Gilding B H, Kersner R. Travelling Waves in Nonlinear Diffusion-Convection Reaction. Basel: Springer, 2004

[224] Hansen J, Ghrist R . Toward a spectral theory of cellular sheaves. Journal of Applied and Computational Topology, 2019, 3( 4): 315–358

[225] Yu W, Chen G, Lü J, Kurths J . Synchronization via pinning control on general complex networks. SIAM Journal on Control and Optimization, 2013, 51( 2): 1395–1416

[226] Park M, Heo J, Kim D. Mitigating oversmoothing through reverse process of GNNs for heterophilic graphs. In: Proceedings of the 41st International Conference on Machine Learning. 2024, 1606

[227] Jaiswal A, Babu A R, Zadeh M Z, Banerjee D, Makedon F . A survey on contrastive self-supervised learning. Technologies, 2020, 9( 1): 2

[228] Jing L, Tian Y . Self-supervised visual feature learning with deep neural networks: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43( 11): 4037–4058

[229] Gui J, Chen T, Zhang J, Cao Q, Sun Z, Luo H, Tao D . A survey on self-supervised learning: algorithms, applications, and future trends. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46( 12): 9052–9071

[230] Zhang Q, Zhao Z, Zhou H, Li X, Li C . Self-supervised contrastive learning on heterogeneous graphs with mutual constraints of structure and feature. Information Sciences, 2023, 640: 119026

[231] Ju W, Wang Y, Qin Y, Mao Z, Xiao Z, Luo J, Yang J, Gu Y, Wang D, Long Q, Yi S, Luo X, Zhang M. Towards graph contrastive learning: a survey and beyond. 2024, arXiv preprint arXiv: 2405.11868

[232] Guo X, Wang Y, Wei Z, Wang Y. Architecture matters: uncovering implicit mechanisms in graph contrastive learning. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 1242

[233] Yang W, Mirzasoleiman B. Graph contrastive learning under heterophily via graph filters. In: Proceedings of the 40th Conference on Uncertainty in Artificial Intelligence. 2024, 184

[234] Liu Y, Zheng Y, Zhang D, Lee V C S, Pan S. Beyond smoothing: unsupervised graph representation learning with edge heterophily discriminating. In: Proceedings of the 37th AAAI Conference on Artificial Intelligence. 2023, 4516−4524

[235] Chen J, Lei R, Wei Z. PolyGCL: GRAPH CONTRASTIVE LEARNING via learnable spectral polynomial filters. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[236] Veličković P, Fedus W, Hamilton W L, Liò P, Bengio Y, Hjelm R D. Deep graph infomax. In: Proceedings of the 7th International Conference on Learning Representations. 2019

[237] You Y, Chen T, Sui Y, Chen T, Wang Z, Shen Y. Graph contrastive learning with augmentations. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. 2020, 488

[238] Zhu Y, Xu Y, Yu F, Liu Q, Wu S, Wang L. Deep graph contrastive representation learning. 2020, arXiv preprint arXiv: 2006.04131

[239] Liu C, Yu C, Gui N, Yu Z, Deng S . SimGCL: graph contrastive learning by finding homophily in heterophily. Knowledge and Information Systems, 2024, 66( 3): 2089–2114

[240] Chen J, Zhu G, Qi Y, Yuan C, Huang Y. Towards self-supervised learning on graphs with heterophily. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 201−211

[241] Wang C, Liu Y, Yang Y, Li W. HeterGCL: graph contrastive learning framework on heterophilic graph. In: Proceedings of the 33rd International Joint Conference on Artificial Intelligence. 2024, 2397−2405

[242] Yang L, Hu W, Xu J, Shi R, He D, Wang C, Cao X, Wang Z, Niu B, Guo Y. GAUSS: GrAph-customized universal self-supervised learning. In: Proceedings of the ACM Web Conference 2024. 2024, 582−593

[243] Wang H, Zhang J, Zhu Q, Huang W, Kawaguchi K, Xiao X. Single-pass contrastive learning can work for both homophilic and heterophilic graph. 2022, arXiv preprint arXiv: 2211.10890

[244] Wang H, Zhang J, Zhu Q, Huang W. Augmentation-free graph contrastive learning with performance guarantee. 2022, arXiv preprint arXiv: 2204.04874

[245] Khan A, Storkey A. Contrastive learning for non-local graphs with multi-resolution structural views. 2023, arXiv preprint arXiv: 2308.10077

[246] Coifman R R, Maggioni M . Diffusion wavelets. Applied and Computational Harmonic Analysis, 2006, 21( 1): 53–94

[247] Yuan M, Chen M, Li X. MUSE: multi-view contrastive learning for heterophilic graphs. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 3094−3103

[248] Altenburger K M, Ugander J . Monophily in social networks introduces similarity among friends-of-friends. Nature Human Behaviour, 2018, 2( 4): 284–290

[249] Xiao T, Zhu H, Zhang Z, Guo Z, Aggarwal C C, Wang S, Honavar V G. Efficient contrastive learning for fast and accurate inference on graphs. In: Proceedings of Forty-First International Conference on Machine Learning. 2024

[250] Wan G, Tian Y, Huang W, Chawla N V, Ye M. S3GCL: spectral, swift, spatial graph contrastive learning. In: Proceedings of the 41st International Conference on Machine Learning. 2024, 2044

[251] He D, Zhao J, Guo R, Feng Z, Jin D, Huang Y, Wang Z, Zhang W. Contrastive learning meets homophily: two birds with one stone. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 12775−12789

[252] Li W Z, Wang C D, Xiong H, Lai J H. HomoGCL: rethinking homophily in graph contrastive learning. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 1341−1352

[253] Zhuo J, Qin F, Cui C, Fu K, Niu B, Wang M, Guo Y, Wang C, Wang Z, Cao X, Yang L. Improving graph contrastive learning via adaptive positive sampling. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2024, 23179−23187

[254] Zhuo J, Cui C, Fu K, Niu B, He D, Wang C, Guo Y, Wang Z, Cao X, Yang L. Graph contrastive learning reimagined: exploring universality. In: Proceedings of the ACM Web Conference 2024. 2024, 641−651

[255] Zhao T, Zhang X, Wang S. Disambiguated node classification with graph neural networks. In: Proceedings of the ACM Web Conference 2024. 2024, 914−923

[256] Kipf T N, Welling M. Variational graph auto-encoders. 2016, arXiv preprint arXiv: 1611.07308

[257] Li J, Wu R, Sun W, Chen L, Tian S, Zhu L, Meng C, Zheng Z, Wang W. What’s behind the mask: understanding masked graph modeling for graph autoencoders. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 1268−1279

[258] Zhong Z, Gonzalez G, Grattarola D, Pang J. Unsupervised network embedding beyond homophily. 2022, arXiv preprint arXiv: 2203.10866

[259] Lin B, Li Y, Gui N, Xu Z, Yu Z . Multi-view graph representation learning beyond homophily. ACM Transactions on Knowledge Discovery from Data, 2023, 17( 8): 114

[260] Li M, Zhang Y, Wang S, Hu Y, Yin B . Redundancy is not what you need: an embedding fusion graph auto-encoder for self-supervised graph representation learning. IEEE Transactions on Neural Networks and Learning Systems, 2025, 36( 2): 3519–3533

[261] Li Y, Lin B, Luo B, Gui N . Graph representation learning beyond node and homophily. IEEE Transactions on Knowledge and Data Engineering, 2022, 35( 5): 4880–4893

[262] Tang M, Li P, Yang C. Graph auto-encoder via neighborhood Wasserstein reconstruction. In: Proceedings of the 10th International Conference on Learning Representations. 2022

[263] Tian Y, Zhang C, Kou Z, Liu Z, Zhang X, Chawla N V. UGMAE: a unified framework for graph masked autoencoders. 2024, arXiv preprint arXiv: 2402.08023

[264] Luo Y, Li S, Sui Y, Wu J, Wu J, Wang X. Masked graph modeling with multi-view contrast. In: Proceedings of the 40th IEEE International Conference on Data Engineering (ICDE). 2024, 2584−2597

[265] Fang D, Zhu F, Xie D, Min W. Masked graph autoencoders with contrastive augmentation for spatially resolved transcriptomics data. In: Proceedings of 2024 IEEE International Conference on Bioinformatics and Biomedicine. 2024, 515−520

[266] Yang W, Zhou L. CMGAE: enhancing graph masked autoencoders through the use of contrastive learning. In: Proceedings of the 2nd International Conference on Machine Learning, Control, and Robotics (MLCR). 2023, 42−47

[267] Xiao T, Chen Z, Guo Z, Zhuang Z, Wang S. Decoupled self-supervised learning for graphs. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 45

[268] Wei J, Bosma M, Zhao V Y, Guu K, Yu A W, Lester B, Du N, Dai A M, Le Q V. Finetuned language models are zero-shot learners. In: Proceedings of the 10th International Conference on Learning Representations. 2022

[269] Jia C, Yang Y, Xia Y, Chen Y T, Parekh Z, Pham H, Le Q V, Sung Y H, Li Z, Duerig T. Scaling up visual and vision-language representation learning with noisy text supervision. In: Proceedings of the 38th International Conference on Machine Learning. 2021, 4904−4916

[270] Jia M, Tang L, Chen B C, Cardie C, Belongie S, Hariharan B, Lim S N. Visual prompt tuning. In: Proceedings of the 17th European Conference on Computer Vision. 2022, 709−727

[271] Sun X, Zhang J, Wu X, Cheng H, Xiong Y, Li J. Graph prompt learning: a comprehensive survey and beyond. 2023, arXiv preprint arXiv: 2311.16534

[272] Long Q, Yan Y, Zhang P, Fang C, Cui W, Ning Z, Xiao M, Cao N, Luo X, Xu L, Jiang S, Fang Z, Chen C, Hua X S, Zhou Y. Towards graph prompt learning: a survey and beyond. 2024, arXiv preprint arXiv: 2408.14520

[273] Wang L, Zhang M, Jia Z, Li Q, Ma K, Bao C, Zhu J, Zhong Y. AFEC: active forgetting of negative transfer in continual learning. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 1714

[274] Sun M, Zhou K, He X, Wang Y, Wang X. GPPT: graph pre-training and prompt tuning to generalize graph neural networks. In: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2022, 1717−1727

[275] Liu Z, Yu X, Fang Y, Zhang X. GraphPrompt: unifying pre-training and downstream tasks for graph neural networks. In: Proceedings of the ACM Web Conference 2023. 2023, 417−428

[276] Yu X, Liu Z, Fang Y, Liu Z, Chen S, Zhang X . Generalized graph prompt: toward a unification of pre-training and downstream tasks on graphs. IEEE Transactions on Knowledge and Data Engineering, 2024, 36( 11): 6237–6250

[277] Huang Q, Ren H, Chen P, Kržmanc G, Zeng D, Liang P S, Leskovec J. PRODIGY: enabling in-context learning over graphs. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 718

[278] Zhu Y, Guo J, Tang S. SGL-PT: a strong graph learner with graph prompt tuning. 2023, arXiv preprint arXiv: 2302.12449

[279] Sun X, Cheng H, Li J, Liu B, Guan J. All in one: multi-task prompting for graph neural networks. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 2120−2131

[280] Zi C, Zhao H, Sun X, Lin Y, Cheng H, Li J. ProG: a graph prompt learning benchmark. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024

[281] Liu H, Feng J, Kong L, Liang N, Tao D, Chen Y, Zhang M. One for all: towards training one graph model for all classification tasks. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[282] Fang T, Zhang Y, Yang Y, Wang C, Chen L. Universal prompt tuning for graph neural networks. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023

[283] Tan Z, Guo R, Ding K, Liu H. Virtual node tuning for few-shot node classification. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 2177−2188

[284] Lee J, Yang W, Kang J. Subgraph-level universal prompt tuning. 2024, arXiv preprint arXiv: 2402.10380

[285] Yu X, Zhou C, Fang Y, Zhang X. MultiGPrompt for multi-task pre-training and prompting on graphs. In: Proceedings of the ACM Web Conference 2024. 2024, 515−526

[286] Jiang B, Wu H, Zhang Z, Wang B, Tang J. A unified graph selective prompt learning for graph neural networks. 2024, arXiv preprint arXiv: 2406.10498

[287] Yan Y, Zhang P, Fang Z, Long Q. Inductive graph alignment prompt: bridging the gap between graph pre-training and inductive fine-tuning from spectral perspective. In: Proceedings of the ACM Web Conference 2024. 2024, 4328−4339

[288] Chen M, Liu Z, Liu C, Li J, Mao Q, Sun J. ULTRA-DP: unifying graph pre-training with multi-task graph dual prompt. 2023, arXiv preprint arXiv: 2310.14845

[289] Wang J, Deng Z, Lin T, Li W, Ling S. A novel prompt tuning for graph transformers: tailoring prompts to graph topologies. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 3116−3127

[290] Ma Y, Yan N, Li J, Mortazavi M, Chawla N V. HetGPT: harnessing the power of prompt tuning in pre-trained heterogeneous graph neural networks. In: Proceedings of the ACM Web Conference 2024. 2024, 1015−1023

[291] Yu X, Fang Y, Liu Z, Zhang X. HGPrompt: bridging homogeneous and heterogeneous graphs for few-shot prompt learning. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 1848

[292] Yu X, Liu Z, Fang Y, Zhang X. DyGPrompt: learning feature and time prompts on dynamic graphs. 2024, arXiv preprint arXiv: 2405.13937

[293] Song Y, Singh R, Palanisamy B. Krait: a backdoor attack against graph prompt tuning. 2024, arXiv preprint arXiv: 2407.13068

[294] Lyu X, Han Y, Wang W, Qian H, Tsang I, Zhang X. Cross-context backdoor attacks against graph prompt learning. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 2094−2105

[295] Wang Y, Xiong Y, Wu X, Sun X, Zhang J, Zheng G. DDIPrompt: drug-drug interaction event prediction based on graph prompt learning. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, 2431−2441

[296] Ye R, Zhang C, Wang R, Xu S, Zhang Y. Language is all a graph needs. In: Proceedings of the Association for Computational Linguistics. 2024, 1955−1973

[297] Duan Y, Liu J, Chen S, Chen L, Wu J . G-Prompt: graphon-based prompt tuning for graph classification. Information Processing & Management, 2024, 61( 3): 103639

[298] Fang Y, Fan D, Zha D, Tan Q. GAugLLM: improving graph contrastive learning for text-attributed graphs with large language models. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 747−758

[299] Jiang W, Wu W, Zhang L, Yuan Z, Xiang J, Zhou J, Xiong H. Killing two birds with one stone: cross-modal reinforced prompting for graph and language tasks. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 1301−1312

[300] Jin J, Song Y, Kan D, Zhu H, Sun X, Li Z, Sun X, Zhang J. Urban region pre-training and prompting: a graph-based approach. 2024, arXiv preprint arXiv: 2408.05920

[301] Zhang P, Yan Y, Zhang X, Kang L, Li C, Huang F, Wang S, Kim S. GPT4Rec: graph prompt tuning for streaming recommendation. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 1774−1784

[302] Gong C, Li X, Yu J, Cheng Y, Tan J, Yu C. Self-pro: a self-prompt and tuning framework for graph neural networks. In: Proceedings of European Conference on Machine Learning and Knowledge Discovery in Databases. 2024, 197−215

[303] Yu X, Zhang J, Fang Y, Jiang R. Non-homophilic graph pre-training and prompt learning. 2024, arXiv preprint arXiv: 2408.12594

[304] Zhou K, Yang J, Loy C C, Liu Z. Conditional prompt learning for vision-language models. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022, 16795−16804

[305] Ge Q, Zhao Z, Liu Y, Cheng A, Li X, Wang S, Yin D. Enhancing graph neural networks with structure-based prompt. 2023, arXiv preprint arXiv: 2310.17394

[306] Wang S, Yang J, Yao J, Bai Y, Zhu W . An overview of advanced deep graph node clustering. IEEE Transactions on Computational Social Systems, 2024, 11( 1): 1302–1314

[307] Tian F, Gao B, Cui Q, Chen E, Liu T Y. Learning deep representations for graph clustering. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence. 2014

[308] Pan E, Kang Z. Multi-view contrastive graph clustering. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 165

[309] Zhao H, Yang X, Wang Z, Yang E, Deng C. Graph debiased contrastive learning with joint representation clustering. In: Proceedings of the 30th International Joint Conference on Artificial Intelligence. 2021, 3434−3440

[310] Xie X, Chen W, Kang Z, Peng C . Contrastive graph clustering with adaptive filter. Expert Systems with Applications, 2023, 219: 119645

[311] Wen Z, Ling Y, Ren Y, Wu T, Chen J, Pu X, Hao Z, He L. Homophily-Related: adaptive hybrid graph filter for multi-view graph clustering. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 15841−15849

[312] Pan E, Kang Z. Beyond homophily: reconstructing structure for graph-agnostic clustering. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 26868−26877

[313] Xie X, Pan E, Kang Z, Chen W, Li B. Provable filter for real-world graph clustering. 2024, arXiv preprint arXiv: 2403.03666

[314] Zhu P, Li J, Wang Y, Xiao B, Zhang J, Lin W, Hu Q. Boosting pseudo-labeling with curriculum self-reflection for attributed graph clustering. IEEE Transactions on Neural Networks and Learning Systems, 2024

[315] Gu M, Yang G, Zhou S, Ma N, Chen J, Tan Q, Liu M, Bu J. Homophily-enhanced structure learning for graph clustering. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 577−586

[316] Lü L, Zhou T . Link prediction in complex networks: a survey. Physica A: Statistical Mechanics and Its Applications, 2011, 390( 6): 1150–1170

[317] Zhang M, Chen Y. Link prediction based on graph neural networks. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. 2018, 5171−5181

[318] Li X, Ye T, Shan C, Li D, Gao M. SeeGera: self-supervised semi-implicit graph variational auto-encoders with masking. In: Proceedings of the ACM Web Conference 2023. 2023, 143−153

[319] Tan Q, Liu N, Huang X, Choi S H, Li L, Chen R, Hu X. S2GAE: self-supervised graph autoencoders are generalizable learners with graph masking. In: Proceedings of the 16th ACM International Conference on Web Search and Data Mining. 2023, 787−795

[320] Zhou S, Guo Z, Aggarwal C C, Zhang X, Wang S. Link prediction on heterophilic graphs via disentangled representation learning. 2022, arXiv preprint arXiv: 2208.01820

[321] Di Francesco A G, Caso F, Bucarelli M S, Silvestri F. Link prediction under heterophily: a physics-inspired graph neural network approach. 2024, arXiv preprint arXiv: 2402.14802

[322] Zhu J, Li G, Yang Y A, Zhu J, Cui X, Koutra D. On the impact of feature heterophily on link prediction with graph neural networks. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024

[323] Yang J, Medya S, Ye W. Incorporating heterophily into graph neural networks for graph classification. In: Proceedings of 2024 IEEE International Conference on Systems, Man, and Cybernetics. 2024, 1544−1551

[324] Ding Y, Liu Z, Hao H. Self-supervised learning and graph classification under heterophily. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 3849−3853

[325] Papachristou M, Goel R, Portman F, Miller M, Jin R. GLINKX: a scalable unified framework for homophilous and heterophilous graphs. 2022, arXiv preprint arXiv: 2211.00550

[326] Liao N, Luo S, Li X, Shi J. LD²: scalable heterophilous graph neural network with decoupled embeddings. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 446

[327] Chen J, Li Z, Zhu Y, Zhang J, Pu J. From node interaction to hop interaction: new effective and scalable graph learning paradigm. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 7876−7885

[328] Das S S, Ferdous S, Halappanavar M M, Serra E, Pothen A. AGS-GNN: attribute-guided sampling for graph neural networks. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 538−549

[329] Wu Q, Zhao W, Li Z, Wipf D, Yan J. NodeFormer: a scalable graph structure learning transformer for node classification. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 1986

[330] Wu Q, Yang C, Zhao W, He Y, Wipf D, Yan J. DIFFormer: scalable (graph) transformers induced by energy constrained diffusion. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[331] Wu Q, Zhao W, Yang C, Zhang H, Nie F, Jiang H, Bian Y, Yan J. SGFormer: simplifying and empowering transformers for large-graph representations. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 2826

[332] Kong K, Chen J, Kirchenbauer J, Ni R, Bruss C B, Goldstein T. GOAT: a global transformer on largescale graphs. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 17375−17390

[333] Sun Y, Zhu D, Wang Y, Tian Z, Cao N, O’Hared G. SpikeGraphormer: a high-performance graph transformer with spiking graph attention. 2024, arXiv preprint arXiv: 2403.15480

[334] Ghosh-Dastidar S, Adeli H . Spiking neural networks. International Journal of Neural Systems, 2009, 19( 4): 295–308

[335] Tavanaei A, Ghodrati M, Kheradpisheh S R, Masquelier T, Maida A . Deep learning in spiking neural networks. Neural Networks, 2019, 111: 47–63

[336] Chakraborty A, Alam M, Dey V, Chattopadhyay A, Mukhopadhyay D. Adversarial attacks and defences: a survey. 2018, arXiv preprint arXiv: 1810.00069

[337] Silva S H, Najafirad P. Opportunities and challenges in deep learning adversarial robustness: a survey. 2020, arXiv preprint arXiv: 2007.00753

[338] Xu J, Chen J, You S, Xiao Z, Yang Y, Lu J . Robustness of deep learning models on graphs: a survey. AI Open, 2021, 2: 69–78

[339] Zügner D, Akbarnejad A, Günnemann S. Adversarial attacks on neural networks for graph data. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2018, 2847−2856

[340] Dai H, Li H, Tian T, Huang X, Wang L, Zhu J, Song L. Adversarial attack on graph structured data. In: Proceedings of the 35th International Conference on Machine Learning. 2018, 1123−1132

[341] Zhu J, Jin J, Loveland D, Schaub M T, Koutra D. How does heterophily impact the robustness of graph neural networks? Theoretical connections and practical implications. In: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2022, 2637−2647

[342] Huang J, Du L, Chen X, Fu Q, Han S, Zhang D. Robust mid-pass filtering graph convolutional networks. In: Proceedings of the ACM Web Conference 2023. 2023, 328−338

[343] Zhu Y, Lai Y, Ai X, Zhou K. Universally robust graph neural networks by preserving neighbor similarity. 2024, arXiv preprint arXiv: 2401.09754

[344] Lei R, Wang Z, Li Y, Ding B, Wei Z. EvenNet: ignoring odd-hop neighbors improves robustness of graph neural networks. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 339

[345] Qiu C, Nan G, Xiong T, Deng W, Wang D, Teng Z, Sun L, Cui Q, Tao X. Refining latent homophilic structures over heterophilic graphs for robust graph convolution networks. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 8930−8938

[346] Zhang S, Liu Y, Sun Y, Shah N. Graph-less neural networks: teaching old MLPs new tricks via distillation. In: Proceedings of the Tenth International Conference on Learning Representations. 2022

[347] Deng B, Chen J, Hu Y, Xu Z, Chen C, Zhang T. PROSPECT: learn MLPs on graphs robust against adversarial structure attacks. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, 425−435

[348] Cheng Y, Shan C, Shen Y, Li X, Luo S, Li D. Resurrecting label propagation for graphs with heterophily and label noise. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 433−444

[349] He X, Wen R, Wu Y, Backes M, Shen Y, Zhang Y. Node-level membership inference attacks against graph neural networks. 2021, arXiv preprint arXiv: 2102.05429

[350] Liao P, Zhao H, Xu K, Jaakkola T S, Gordon G J, Jegelka S, Salakhutdinov R. Information obfuscation of graph neural networks. In: Proceedings of the 38th International Conference on Machine Learning. 2021, 6600−6610

[351] Hu H, Cheng L, Vap J P, Borowczak M. Learning privacy-preserving graph convolutional network with partially observed sensitive attributes. In: Proceedings of the ACM Web Conference 2022. 2022, 3552−3561

[352] Yuan H, Xu J, Wang C, Yang Z, Wang C, Yin K, Yang Y. Unveiling privacy vulnerabilities: investigating the role of structure in graph data. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 4059−4070

[353] Wu R, Fang G, Zhang M, Pan Q, Liu T, Wang W, Zhao W. On provable privacy vulnerabilities of graph representations. In: Proceedings of the 38th International Conference on Neural Information Processing Systems. 2024

[354] Mueller T T, Chevli M, Daigavane A, Rueckert D, Kaissis G. Privacy-utility trade-offs in neural networks for medical population graphs: insights from differential privacy and graph structure. 2023, arXiv preprint arXiv: 2307.06760

[355] Dai E, Wang S. Say no to the discrimination: learning fair graph neural networks with limited sensitive attribute information. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 2021, 680−688

[356] Li P, Wang Y, Zhao H, Hong P, Liu H. On dyadic fairness: exploring and mitigating bias in graph connections. In: Proceedings of the 9th International Conference on Learning Representations. 2021

[357] Loveland D, Zhu J, Heimann M, Fish B, Schaub M T, Koutra D. On graph neural network fairness in the presence of heterophilous neighborhoods. 2022, arXiv preprint arXiv: 2207.04376

[358] Zhu Y, Xu W, Zhang J, Liu Q, Wu S, Wang L. Deep graph structure learning for robust representations: a survey. 2021, arXiv preprint arXiv: 2103.03036

[359] Ye Y, Ji S . Sparse graph attention networks. IEEE Transactions on Knowledge and Data Engineering, 2023, 35( 1): 905–916

[360] Xue Y, Jin Z, Gao W . A data-centric graph neural network for node classification of heterophilic networks. International Journal of Machine Learning and Cybernetics, 2024, 15( 8): 3413–3423

[361] Yang Y, Sun Y, Wang S, Guo J, Gao J, Ju F, Yin B. Graph neural networks with soft association between topology and attribute. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 1030

[362] Deac A, Tang J. Evolving computation graphs. 2023, arXiv preprint arXiv: 2306.12943

[363] Zheng Y, Zhang H, Lee V C S, Zheng Y, Wang X, Pan S. Finding the missing-half: graph complementary learning for homophily-prone and heterophily-prone graphs. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 42492−42505

[364] Xu Z, Chen Y, Zhou Q, Wu Y, Pan M, Yang H, Tong H. Node classification beyond homophily: towards a general solution. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 2862−2873

[365] Bi W, Du L, Fu Q, Wang Y, Han S, Zhang D . Make heterophilic graphs better fit GNN: a graph rewiring approach. IEEE Transactions on Knowledge and Data Engineering, 2024, 36( 12): 8744–8757

[366] Choi Y, Choi J, Ko T, Byun H, Kim C K. Finding heterophilic neighbors via confidence-based subgraph matching for semi-supervised node classification. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 283−292

[367] Nie F, Zeng Z, Tsang I W, Xu D, Zhang C . Spectral embedded clustering: a framework for in-sample and out-of-sample spectral clustering. IEEE Transactions on Neural Networks, 2011, 22( 11): 1796–1808

[368] Jiang M, Liu G, Su Y, Wu X. GCN-SL: graph convolutional networks with structure learning for graphs under heterophily. 2021, arXiv preprint arXiv: 2105.13795

[369] Box G E P, Tiao G C. Bayesian Inference in Statistical Analysis. Hoboken: John Wiley & Sons, 2011

[370] Wang R, Mou S, Wang X, Xiao W, Ju Q, Shi C, Xie X. Graph structure estimation neural networks. In: Proceedings of the Web Conference 2021. 2021, 342−353

[371] Wu L, Tan C, Liu Z, Gao Z, Lin H, Li S Z. Learning to augment graph structure for both homophily and heterophily graphs. In: Proceedings of European Conference on Machine Learning and Knowledge Discovery in Databases. 2023, 3−18

[372] Dong M, Kluger Y. Towards understanding and reducing graph structural noise for GNNs. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 8202−8226

[373] Liu Y, Zheng Y, Zhang D, Chen H, Peng H, Pan S. Towards unsupervised deep graph structure learning. In: Proceedings of the ACM Web Conference 2022. 2022, 1392−1403

[374] Wu L, Lin H, Liu Z, Liu Z, Huang Y, Li S Z . Homophily-enhanced self-supervision for graph structure learning: insights and directions. IEEE Transactions on Neural Networks and Learning Systems, 2024, 35( 9): 12358–12372

[375] Vincent P, Larochelle H, Bengio Y, Manzagol P A. Extracting and composing robust features with denoising autoencoders. In: Proceedings of the 25th International Conference on Machine Learning. 2008, 1096−1103

[376] Wu L, Lin H, Zhao G, Tan C, Li S Z. Learning to model graph structural information on MLPs via graph structure self-contrasting. IEEE Transactions on Neural Networks and Learning Systems, 2024

[377] Li Z, Sun X, Luo Y, Zhu Y, Chen D, Luo Y, Zhou X, Liu Q, Wu S, Wang L, Yu J X. GSLB: the graph structure learning benchmark. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 1319

[378] Gong Z, Wang G, Sun Y, Liu Q, Ning Y, Xiong H, Peng J. Beyond homophily: robust graph anomaly detection via neural sparsification. In: Proceedings of the 32nd International Joint Conference on Artificial Intelligence. 2023, 2104−2113

[379] Wen J, Jiang N, Li L, Zhou J, Li Y, Zhan H, Kou G, Gu W, Zhao J. TA-Detector: a GNN-based anomaly detector via trust relationship. ACM Transactions on Multimedia Computing, Communications, and Applications, 2024

[380] Gao Y, Wang X, He X, Liu Z, Feng H, Zhang Y. Addressing heterophily in graph anomaly detection: a perspective of graph spectrum. In: Proceedings of the ACM Web Conference 2023. 2023, 1528−1538

[381] Qiao H, Pang G. Truncated affinity maximization: one-class homophily modeling for graph anomaly detection. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 2154

[382] Zhang R, Cheng D, Liu X, Yang J, Ouyang Y, Wu X, Zheng Y. Generation is better than modification: combating high class homophily variance in graph anomaly detection. 2024, arXiv preprint arXiv: 2403.10339

[383] Tang J, Li J, Gao Z, Li J. Rethinking graph neural networks for anomaly detection. In: Proceedings of the 39th International Conference on Machine Learning. 2022, 21076−21089

[384] Chai Z, You S, Yang Y, Pu S, Xu J, Cai H, Jiang W. Can abnormality be detected by graph neural networks? In: Proceedings of the 31st International Joint Conference on Artificial Intelligence. 2022, 1945−1951

[385] Jin W, Ma H, Zhang Y, Li Z, Chang L . Multi-view discriminative edge heterophily contrastive learning network for attributed graph anomaly detection. Expert Systems with Applications, 2024, 255: 124460

[386] Roy A, Shu J, Li J, Yang C, Elshocht O, Smeets J, Li P. GAD-NR: graph anomaly detection via neighborhood reconstruction. In: Proceedings of the 17th ACM International Conference on Web Search and Data Mining. 2024, 576−585

[387] Gao Y, Wang X, He X, Liu Z, Feng H, Zhang Y. Alleviating structural distribution shift in graph anomaly detection. In: Gao Y, Wang X, He X, Liu Z, Feng H, Zhang Y. 2023, 357−365

[388] Pourhabibi T, Ong K L, Kam B H, Boo Y L . Fraud detection: a systematic literature review of graph-based anomaly detection approaches. Decision Support Systems, 2020, 133: 113303

[389] Shi F, Cao Y, Shang Y, Zhou Y, Zhou C, Wu J. H2-FDetector: a GNN-based fraud detector with homophilic and heterophilic connections. In: Proceedings of the ACM Web Conference 2022. 2022, 1486−1494

[390] Kim H, Choi J, Whang J J. Dynamic relation-attentive graph neural networks for fraud detection. In: Proceedings of 2023 IEEE International Conference on Data Mining Workshops (ICDMW). 2023, 1092−1096

[391] Wang Y, Zhang J, Huang Z, Li W, Feng S, Ma Z, Sun Y, Yu D, Dong F, Jin J, Wang B, Luo J. Label information enhanced fraud detection against low homophily in graphs. In: Proceedings of the ACM Web Conference 2023. 2023, 406−416

[392] Duan M, Zheng T, Gao Y, Wang G, Feng Z, Wang X. DGA-GNN: dynamic grouping aggregation GNN for fraud detection. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 11820−11828

[393] Wu B, Yao X, Zhang B, Chao K M, Li Y. SplitGNN: spectral graph neural network for fraud detection against heterophily. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 2737−2746

[394] Xu F, Wang N, Wu H, Wen X, Zhao X, Wan H. Revisiting graph-based fraud detection in sight of heterophily and spectrum. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 9214−9222

[395] Bergstrom C T, Bak-Coleman J B . Information gerrymandering in social networks skews collective decision-making. Nature, 2019, 573( 7772): 40–41

[396] Deb A, Luceri L, Badaway A, Ferrara E. Perils and challenges of social media and election manipulation analysis: the 2018 US midterms. In: Proceedings of Companion Proceedings of the 2019 World Wide Web Conference. 2019, 237−247

[397] Ferrara E. Disinformation and social bot operations in the run up to the 2017 French presidential election. 2017 , arXiv preprint arXiv: 1707.00086

[398] Ashmore B, Chen L. HOVER: homophilic oversampling via edge removal for class-imbalanced bot detection on graphs. In: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2023, 3728−3732

[399] Zhou M, Feng W, Zhu Y, Zhang D, Dong Y, Tang J. Semi-supervised social bot detection with initial residual relation attention networks. In: Proceedings of European Conference on Machine Learning and Knowledge Discovery in Databases. 2023, 207−224

[400] Li S, Qiao B, Li K, Lu Q, Lin M, Zhou W. Multi-modal social bot detection: learning homophilic and heterophilic connections adaptively. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 3908−3916

[401] Ye S, Tan Z, Lei Z, He R, Wang H, Zheng Q, Luo M. HOFA: twitter bot detection with homophily-oriented augmentation and frequency adaptive attention. 2023, arXiv preprint arXiv: 2306.12870

[402] Shi S, Qiao K, Wang Z, Yang J, Song B, Chen J, Yan B. Muti-scale graph neural network with signed-attention for social bot detection: a frequency perspective. 2023, arXiv preprint arXiv: 2307.01968

[403] Wu Q, Yang Y, He B, Liu H, Wang X, Liao Y, Yang R, Zhou P. Heterophily-aware social bot detection with supervised contrastive learning. 2023, arXiv preprint arXiv: 2306.07478

[404] Chen X, Zhou F, Trajcevski G, Bonsangue M . Multi-view learning with distinguishable feature fusion for rumor detection. Knowledge-Based Systems, 2022, 240: 108085

[405] Yang X, Lyu Y, Tian T, Liu Y, Liu Y, Zhang X. Rumor detection on social media with graph structured adversarial learning. In: Proceedings of the 29th International Conference on International Joint Conferences on Artificial Intelligence. 2021, 197

[406] Yan Y, Wang Y, Zheng P . A graph-based pivotal semantic mining framework for rumor detection. Engineering Applications of Artificial Intelligence, 2023, 118: 105613

[407] Nguyen T T, Ren Z, Nguyen T T, Jo J, Nguyen Q V H, Yin H . Portable graph-based rumour detection against multi-modal heterophily. Knowledge-Based Systems, 2024, 284: 111310

[408] Wang C, Lin Z, Yang X, Sun J, Yue M, Shahabi C. HAGEN: homophily-aware graph convolutional recurrent network for crime forecasting. In: Proceedings of the 36th AAAI Conference on Artificial Intelligence. 2022, 4193−4200

[409] He X, Deng K, Wang X, Li Y, Zhang Y, Wang M. LightGCN: simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval. 2020, 639−648

[410] Wang X, He X, Wang M, Feng F, Chua T S. Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on Research and development in Information Retrieval. 2019, 165−174

[411] Sun J, Guo W, Zhang D, Zhang Y, Regol F, Hu Y, Guo H, Tang R, Yuan H, He X, Coates M. A framework for recommending accurate and diverse items using Bayesian graph convolutional neural networks. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2020, 2030−2039

[412] Zhao Z, Zhang X, Zhou H, Li C, Gong M, Wang Y . HetNERec: heterogeneous network embedding based recommendation. Knowledge-Based Systems, 2020, 204: 106218

[413] Wu J, Wang X, Feng F, He X, Chen L, Lian J, Xie X. Self-supervised graph learning for recommendation. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2021, 726−735

[414] Jiang W, Jiao Y, Wang Q, Liang C, Guo L, Zhang Y, Sun Z, Xiong Y, Zhu Y. Triangle graph interest network for click-through rate prediction. In: Proceedings of the 15th ACM International Conference on Web Search and Data Mining. 2022, 401−409

[415] Jiang W, Gao X, Xu G, Chen T, Yin H. Challenging low homophily in social recommendation. In: Proceedings of the ACM Web Conference 2024. 2024, 3476−3484

[416] Gholinejad N, Chehreghani M H. Heterophily-aware fair recommendation using graph convolutional networks. 2024, arXiv preprint arXiv: 2402.03365

[417] Zoidi O, Fotiadou E, Nikolaidis N, Pitas I . Graph-based label propagation in digital media: a review. ACM Computing Surveys (CSUR), 2015, 47( 3): 48

[418] Taelman C, Chlaily S, Khachatrian E, van der Sommen F, Marinoni A. On the exploitation of heterophily in graph-based multimodal remote sensing data analysis. In: Proceedings of the 29th CIKM 2021 Workshops Co-Located with 30th ACM International Conference on Information and Knowledge Management. 2021

[419] Eswaran D, Günnemann S, Faloutsos C, Makhija D, Kumar M . ZooBP: belief propagation for heterogeneous networks. Proceedings of the VLDB Endowment, 2017, 10( 5): 625–636

[420] Han K, Wang Y, Guo J, Tang Y, Wu E. Vision GNN: an image is worth graph of nodes. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 603

[421] Peng W, Hong X, Chen H, Zhao G. Learning graph convolutional network for skeleton-based human action recognition by neural searching. In: Proceedings of the 34th AAAI Conference on Artificial Intelligence. 2020, 2669−2676

[422] Chen Y, Rohrbach M, Yan Z, Shuicheng Y, Feng J, Kalantidis Y. Graph-based global reasoning networks. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, 433−442

[423] Yang J, Lu J, Lee S, Batra D, Parikh D. Graph R-CNN for scene graph generation. In: Proceedings of the 15th European Conference on Computer Vision (ECCV). 2018, 690−706

[424] Li H, Zhu G, Zhang L, Jiang Y, Dang Y, Hou H, Shen P, Zhao X, Shah S A A, Bennamoun M . Scene graph generation: a comprehensive survey. Neurocomputing, 2024, 566: 127052

[425] Chang X, Ren P, Xu P, Li Z, Chen X, Hauptmann A . A comprehensive survey of scene graphs: Generation and application. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45( 1): 1–26

[426] Lin X, Ding C, Zhan Y, Li Z, Tao D. HL-Net: heterophily learning network for scene graph generation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022, 19454−19463

[427] Shuman D I, Narang S K, Frossard P, Ortega A, Vandergheynst P . The emerging field of signal processing on graphs: extending high-dimensional data analysis to networks and other irregular domains. IEEE Signal Processing Magazine, 2013, 30( 3): 83–98

[428] Chen L, Song Y, Lin S, Wang C, He G. Kumaraswamy wavelet for heterophilic scene graph generation. In: Proceedings of the 38th AAAI Conference on Artificial Intelligence. 2024, 1138−1146

[429] Kumaraswamy P . A generalized probability density function for double-bounded random processes. Journal of Hydrology, 1980, 46( 1-2): 79–88

[430] Nguyen A, Le B. 3D point cloud segmentation: a survey. In: Proceedings of the 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM). 2013, 225−230

[431] Wang L, Huang Y, Hou Y, Zhang S, Shan J. Graph attention convolution for point cloud semantic segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, 10288−10297

[432] Lei H, Akhtar N, Mian A . Spherical kernel for efficient graph convolution on 3D point clouds. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43( 10): 3664–3680

[433] Pan X, Xia Z, Song S, Li L E, Huang G. 3D object detection with pointformer. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021, 7459−7468

[434] Chen S, Wei L, Liang L, Lang C. Joint homophily and heterophily relational knowledge distillation for efficient and compact 3D object detection. In: Proceedings of the 32nd ACM International Conference on Multimedia. 2024, 2127−2135

[435] Wang Y, Wang J, Cao Z, Barati Farimani A . Molecular contrastive learning of representations via graph neural networks. Nature Machine Intelligence, 2022, 4( 3): 279–287

[436] Merchant A, Batzner S, Schoenholz S S, Aykol M, Cheon G, Cubuk E D . Scaling deep learning for materials discovery. Nature, 2023, 624( 7990): 80–85

[437] Fang X, Liu L, Lei J, He D, Zhang S, Zhou J, Wang F, Wu H, Wang H . Geometry-enhanced molecular representation learning for property prediction. Nature Machine Intelligence, 2022, 4( 2): 127–134

[438] Li H, Han Z, Sun Y, Wang F, Hu P, Gao Y, Bai X, Peng S, Ren C, Xu X, Liu Z, Chen H, Yang Y, Bo X . CGMega: explainable graph neural network framework with attention mechanisms for cancer gene module dissection. Nature Communications, 2024, 15( 1): 5997

[439] Wu L, Wen Y, Leng D, Zhang Q, Dai C, Wang Z, Liu Z, Yan B, Zhang Y, Wang J, He S, Bo X . Machine learning methods, databases and tools for drug combination prediction. Briefings in Bioinformatics, 2022, 23( 1): bbab355

[440] Cheng F, Kovács I A, Barabási A L . Network-based prediction of drug combinations. Nature Communications, 2019, 10( 1): 1197

[441] Jia Y, Yun C H, Park E, Ercan D, Manuia M, Juarez J, Xu C, Rhee K, Chen T, Zhang H, Palakurthi S, Jang J, Lelais G, Didonato M, Bursulaya B, Michellys P Y, Epple R, Marsilje T H, Mcneill M, Lu W, Harris J, Bender S, Wong K K, Jänne P A, Eck M J . Overcoming EGFR (T790M) and EGFR (C797S) resistance with mutant-selective allosteric inhibitors. Nature, 2016, 534( 7605): 129–132

[442] Chen H, Lu Y, Yang Y, Rao Y . A drug combination prediction framework based on graph convolutional network and heterogeneous information. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 2023, 20( 3): 1917–1925

[443] Liu B M, Gao Y L, Li F, Zheng C H, Liu J X . SLGCN: structure-enhanced line graph convolutional network for predicting drug−disease associations. Knowledge-Based Systems, 2024, 283: 111187

[444] Xue H, Li J, Xie H, Wang Y . Review of drug repositioning approaches and resources. International Journal of Biological Sciences, 2018, 14( 10): 1232–1244

[445] Jarada T N, Rokne J G, Alhajj R . A review of computational drug repositioning: strategies, approaches, opportunities, challenges, and directions. Journal of Cheminformatics, 2020, 12( 1): 46

[446] Lotfi Shahreza M, Ghadiri N, Mousavi S R, Varshosaz J, Green J R . A review of network-based approaches to drug repositioning. Briefings in Bioinformatics, 2018, 19( 5): 878–892

[447] Kang S, Cho K . Conditional molecular design with deep generative models. Journal of Chemical Information and Modeling, 2019, 59( 1): 43–52

[448] Yang M, Sun H, Liu X, Xue X, Deng Y, Wang X . CMGN: a conditional molecular generation net to design target-specific molecules with desired properties. Briefings in Bioinformatics, 2023, 24( 4): bbad185

[449] Rigoni D, Navarin N, Sperduti A. Conditional constrained graph variational autoencoders for molecule design. In: Proceedings of 2020 IEEE Symposium Series on Computational Intelligence (SSCI). 2020, 729−736

[450] Wang H, Solin A, Garg V. Molecule generation by heterophilious triple flows. In: Proceedings of the Twelfth International Conference on Learning Representations. 2024

[451] Wang Z, Zhu X, Adeli E, Zhu Y, Nie F, Munsell B, Wu G . Multi-modal classification of neurodegenerative disease by progressive graph-based transductive learning. Medical Image Analysis, 2017, 39: 218–230

[452] Zhu Y, Zhu X, Kim M, Yan J, Kaufer D, Wu G . Dynamic hyper-graph inference framework for computer-assisted diagnosis of neurodegenerative diseases. IEEE Transactions on Medical Imaging, 2019, 38( 2): 608–616

[453] Wang M, Shao W, Huang S, Zhang D . Hypergraph-regularized multimodal learning by graph diffusion for imaging genetics based Alzheimer’s disease diagnosis. Medical Image Analysis, 2023, 89: 102883

[454] Qu Z, Yao T, Liu X, Wang G . A graph convolutional network based on univariate neurodegeneration biomarker for Alzheimer’s disease diagnosis. IEEE Journal of Translational Engineering in Health and Medicine, 2023, 11: 405–416

[455] Xu J, Yang Y, Huang D, Gururajapathy S S, Ke Y, Qiao M, Wang A, Kumar H, McGeown J, Kwon E. Data-driven network neuroscience: on data collection and benchmark. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 955

[456] Hammond D K, Vandergheynst P, Gribonval R . Wavelets on graphs via spectral graph theory. Applied and Computational Harmonic Analysis, 2011, 30( 2): 129–150

[457] Xu B, Shen H, Cao Q, Qiu Y, Cheng X. Graph wavelet neural network. 2019, arXiv preprint arXiv: 1904.07785

[458] Nair A, Roy A, Meinke K. funcGNN: a graph neural network approach to program similarity. In: Proceedings of the 14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). 2020, 10

[459] Xu S, Shen J, Li Y, Yao Y, Yu P, Xu F, Ma X. On the heterophily of program graphs: a case study of graph-based type inference. In: Proceedings of the 15th Asia-Pacific Symposium on Internetware. 2024, 1−10

[460] Yan M, Xia X, Fan Y, Hassan A E, Lo D, Li S . Just-in-time defect identification and localization: a two-phase framework. IEEE Transactions on Software Engineering, 2022, 48( 1): 82–101

[461] Qiu F, Yan M, Xia X, Wang X, Fan Y, Hassan A E, Lo D. JITO: a tool for just-in-time defect identification and localization. In: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 2020, 1586−1590

[462] Qiu F, Gao Z, Xia X, Lo D, Grundy J, Wang X . Deep just-in-time defect localization. IEEE Transactions on Software Engineering, 2021, 48( 12): 5068–5086

[463] Zhang H, Min W, Wei Z, Kuang L, Gao H, Miao H. A just-in-time software defect localization method based on code graph representation. In: Proceedings of the 32nd IEEE/ACM International Conference on Program Comprehension. 2024, 293−303

[464] Shi C, Li Y, Zhang J, Sun Y, Yu P S . A survey of heterogeneous information network analysis. IEEE Transactions on Knowledge and Data Engineering, 2017, 29( 1): 17–37

[465] Wang X, Ji H, Shi C, Wang B, Ye Y, Cui P, Yu P S. Heterogeneous graph attention network. In: Proceedings of the World Wide Web Conference. 2019, 2022−2032

[466] Li X, Wu Y, Ester M, Kao B, Wang X, Zheng Y. Semi-supervised clustering in attributed heterogeneous information networks. In: Proceedings of the 26th International Conference on World Wide Web. 2017, 1621−1629

[467] Li X, Ding D, Kao B, Sun Y, Mamoulis N. Leveraging meta-path contexts for classification in heterogeneous information networks. In: Proceedings of 2021 IEEE 37th International Conference on Data Engineering (ICDE). 2021, 912−923

[468] Li X, Kao B, Zheng Y, Huang Z. On transductive classification in heterogeneous information networks. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. 2016, 811−820

[469] Zhao J, Wang X, Shi C, Hu B, Song G, Ye Y. Heterogeneous graph structure learning for graph neural networks. In: Proceedings of the 35th AAAI Conference on Artificial Intelligence. 2021, 4697−4705

[470] Hu B, Fang Y, Shi C. Adversarial learning on heterogeneous information networks. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2019, 120−129

[471] Ji H, Wang X, Shi C, Wang B, Yu P S . Heterogeneous graph propagation network. IEEE Transactions on Knowledge and Data Engineering, 2023, 35( 1): 521–532

[472] Guo J, Du L, Bi W, Fu Q, Ma X, Chen X, Han S, Zhang D, Zhang Y. Homophily-oriented heterogeneous graph rewiring. In: Proceedings of the ACM Web Conference 2023. 2023, 511−522

[473] Li J, Wei Z, Dan J, Zhou J, Zhu Y, Wu R, Wang B, Zhen Z, Meng C, Jin H, Zheng Z, Chen L. Hetero²Net: heterophily-aware representation learning on heterogenerous graphs. 2023, arXiv preprint arXiv: 2310.11664

[474] Shen Z, Kang Z. When heterophily meets heterogeneous graphs: latent graphs guided unsupervised representation learning. IEEE Transactions on Neural Networks and Learning Systems, 2025

[475] Lin J, Guo X, Zhang S, Zhou D, Zhu Y, Shun J. When heterophily meets heterogeneity: new graph benchmarks and effective methods. 2024, arXiv preprint arXiv: 2407.10916

[476] Longa A, Lachi V, Santin G, Bianchini M, Lepri B, Liò P, Scarselli F, Passerini A. Graph neural networks for temporal graphs: state of the art, open challenges, and opportunities. 2023, arXiv preprint arXiv: 2302.01018

[477] Al Sahili Z, Awad M. Spatio-temporal graph neural networks: a survey. 2023, arXiv preprint arXiv: 2301.10569

[478] Zhou Z, Huang Q, Lin G, Yang K, Bai L, Wang Y. GReTo: remedying dynamic graph topology-task discordance via target homophily. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[479] Antelmi A, Cordasco G, Polato M, Scarano V, Spagnuolo C, Yang D . A survey on hypergraph representation learning. ACM Computing Surveys, 2024, 56( 1): 24

[480] Veldt N, Benson A R, Kleinberg J . Combinatorial characterizations and impossibilities for higher-order homophily. Science Advances, 2023, 9( 1): eabq3200

[481] Wang P, Yang S, Liu Y, Wang Z, Li P. Equivariant hypergraph diffusion neural operators. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[482] Nguyen B, Sani L, Qiu X, Liò P, Lane N D. Sheaf hypernetworks for personalized federated learning. 2024, arXiv preprint arXiv: 2405.20882

[483] Zou M, Gan Z, Wang Y, Zhang J, Sui D, Guan C, Leng S . UniG-Encoder: a universal feature encoder for graph and hypergraph node classification. Pattern Recognition, 2024, 147: 110115

[484] Wang J, Guo Y, Yang L, Wang Y. Understanding heterophily for graph neural networks. In: Proceedings of the 41st International Conference on Machine Learning. 2024, 2067

[485] Zhu Q, Jiao Y, Ponomareva N, Han J, Perozzi B. Explaining and adapting graph conditional shift. 2023, arXiv preprint arXiv: 2306.03256

[486] Mao H, Chen Z, Jin W, Han H, Ma Y, Zhao T, Shah N, Tang J. Demystifying structural disparity in graph neural networks: can one size fit all? In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 1610

[487] Yang J, Chen Z, Xiao T, Zhang W, Lin Y, Kuang K. Leveraging invariant principle for heterophilic graph structure distribution shifts. 2024, arXiv preprint arXiv: 2408.09490

[488] Loveland D, Zhu J, Heimann M, Fish B, Schaub M T, Koutra D. On performance discrepancies across local homophily levels in graph neural networks. In: Proceedings of the 2nd Learning on Graphs Conference. 2023, 6

[489] Chen J, Chen S, Gao J, Huang Z, Zhang J, Pu J . Exploiting neighbor effect: conv-agnostic GNN framework for graphs with heterophily. IEEE Transactions on Neural Networks and Learning Systems, 2024, 35( 10): 13383–13396

[490] Oono K, Suzuki T. Graph neural networks exponentially lose expressive power for node classification. In: Proceedings of the 8th International Conference on Learning Representations. 2020

[491] Liu M, Gao H, Ji S. Towards deeper graph neural networks. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2020, 338−348

[492] Rusch T K, Bronstein M M, Mishra S. A survey on oversmoothing in graph neural networks. 2023, arXiv preprint arXiv: 2303.10993

[493] Guo K, Cao X, Liu Z, Chang Y . Taming over-smoothing representation on heterophilic graphs. Information Sciences, 2023, 647: 119463

[494] Topping J, Di Giovanni F, Chamberlain B P, Dong X, Bronstein M M. Understanding over-squashing and bottlenecks on graphs via curvature. In: Proceedings of the 10th International Conference on Learning Representations. 2022

[495] Rubin J, Loomba S, Jones N S. Geodesic distributions reveal how heterophily and bottlenecks limit the expressive power of message passing neural networks. In: Proceedings of the 2nd Learning on Graphs Conference. 2023

[496] Pei H, Li Y, Deng H, Hai J, Wang P, Ma J, Tao J, Xiong Y, Guan X. Multi-track message passing: tackling oversmoothing and oversquashing in graph learning via preventing heterophily mixing. In: Proceedings of 41st International Conference on Machine Learning. 2024

[497] Yang C, Wu Q, Wipf D, Sun R, Yan J. How graph neural networks learn: lessons from training dynamics in function space. 2023, arXiv preprint arXiv: 2310.05105

[498] Cui G, Wei Z. MGNN: graph neural networks inspired by distance geometry problem. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 335−347

[499] Shi C, Pan L, Hu H, Dokmanić I . Homophily modulates double descent generalization in graph convolution networks. Proceedings of the National Academy of Sciences of the United States of America, 2024, 121( 8): e2309504121

[500] Zhu Y, Du Y, Wang Y, Xu Y, Zhang J, Liu Q, Wu S. A survey on deep graph generation: methods and applications. In: Proceedings of the 1st Learning on Graphs Conference. 2022, 47

[501] Chanpuriya S, Rossi R A, Rao A, Mai T, Lipka N, Song Z, Musco C. An interpretable graph generative model with heterophily. 2021, arXiv preprint arXiv: 2111.03030

[502] Jin W, Zhao L, Zhang S, Liu Y, Tang J, Shah N. Graph condensation for graph neural networks. In: Proceedings of the 10th International Conference on Learning Representations. 2022

[503] Gao X, Yu J, Jiang W, Chen T, Ye G, Zhang W, Yin H . Graph condensation: a survey. IEEE Transactions on Knowledge and Data Engineering, 2025, 37( 4): 1819–1837

[504] Zheng X, Zhang M, Chen C, Nguyen Q V H, Zhu X, Pan S. Structure-free graph condensation: from large-scale graphs to condensed graph-free data. In: Proceedings of the 37th International Conference on Neural Information Processing Systems. 2023, 264

[505] Munikoti S, Das L, Natarajan B . Scalable graph neural network-based framework for identifying critical nodes and links in complex networks. Neurocomputing, 2022, 468: 211–221

[506] Ling C, Jiang J, Wang J, Thai M T, Xue L, Song J, Qiu M, Zhao L. Deep graph representation learning and optimization for influence maximization. In: Proceedings of the 40th International Conference on Machine Learning. 2023, 880

[507] Panagopoulos G, Tziortziotis N, Vazirgiannis M, Malliaros F. Maximizing influence with graph neural networks. In: Proceedings of the International Conference on Advances in Social Networks Analysis and Mining. 2023, 237−244

[508] Feng Y, Tan V Y F, Cautis B. Influence maximization via graph neural bandits. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 771−781

[509] Zhou F, Cao C, Zhang K, Trajcevski G, Zhong T, Geng J. Meta-GNN: on few-shot node classification in graph meta-learning. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 2357−2360

[510] Wang S, Dong Y, Ding K, Chen C, Li J. Few-shot node classification with extremely weak supervision. In: Proceedings of the 16th ACM International Conference on Web Search and Data Mining. 2023, 276−284

[511] Wan S, Zhan Y, Liu L, Yu B, Pan S, Gong C. Contrastive graph Poisson networks: semi-supervised learning with extremely limited labels. In: Proceedings of the 35th International Conference on Neural Information Processing Systems. 2021, 483

[512] Zhao T, Zhang X, Wang S. GraphSMOTE: imbalanced node classification on graphs with graph neural networks. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 2021, 833−841

[513] Yu C, Zhu J, Li X. GraphCBAL: class-balanced active learning for graph neural networks via reinforcement learning. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, 3022−3031

[514] Yun S, Kim K, Yoon K, Park C. LTE4G: long-tail experts for graph neural networks. In: Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 2022, 2434−2443

[515] Wu X, Wu H, Wang R, Li D, Zhou X, Lu K. Leveraging free labels to power up heterophilic graph learning in weakly-supervised settings: an empirical study. In: Proceedings of European Conference on Machine Learning and Knowledge Discovery in Databases. 2023, 140−156

[516] Liu Y, Ding K, Wang J, Lee V, Liu H, Pan S. Learning strong graph neural networks with weak information. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2023, 1559−1571

[517] Peng T, Wu W, Yuan H, Bao Z, Zhao P, Yu X, Lin X, Liang Y, Pu Y. GraphRARE: reinforcement learning enhanced graph neural network with relative entropy. In: Proceedings of the 40th IEEE International Conference on Data Engineering (ICDE). 2024, 2489−2502

[518] Chen J, Chen S, Bai M, Gao J, Zhang J, Pu J. SA-MLP: distilling graph knowledge from GNNs into structure-aware MLP. 2022, arXiv preprint arXiv: 2210.09609

[519] Wu L, Lin H, Huang Y, Li S Z. Knowledge distillation improves graph structure augmentation for graph neural networks. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 858

[520] Wang F, Zhao T, Xu J, Wang S. HC-GST: heterophily-aware distribution consistency based graph self-training. In: Proceedings of the 33rd ACM International Conference on Information and Knowledge Management. 2024, 2326−2335

[521] Wei L, He Z, Zhao H, Yao Q. Searching heterophily-agnostic graph neural networks. SSRN 4825405, 2024

[522] Wei L, He Z, Zhao H, Yao Q. Enhancing intra-class information extraction for heterophilous graphs: one neural architecture search approach. 2022, arXiv preprint arXiv: 2211.10990

[523] Wei L, Zhao H, He Z. Designing the topology of graph neural networks: a novel feature fusion perspective. In: Proceedings of the ACM Web Conference 2022. 2022, 1381−1391

[524] Zheng X, Zhang M, Chen C, Zhang Q, Zhou C, Pan S. Auto-HeG: automated graph neural network on heterophilic graphs. In: Proceedings of the ACM Web Conference 2023. 2023, 611−620

[525] Liu Y, Li M, Li X, Giunchiglia F, Feng X, Guan R. Few-shot node classification on attributed networks with graph meta-learning. In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2022, 471−481

[526] Zhang Y, Yang Q . A survey on multi-task learning. IEEE Transactions on Knowledge and Data Engineering, 2022, 34( 12): 5586–5609

[527] Wu Y, Yao J, Han B, Yao L, Liu T. Unraveling the impact of heterophilic structures on graph positive-unlabeled learning. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[528] Xi Z, Chen W, Guo X, He W, Ding Y, Hong B, Zhang M, Wang J, Jin S, Zhou E, Zheng R, Fan X, Wang X, Xiong L, Zhou Y, Wang W, Jiang C, Zou Y, Liu X, Yin Z, Dou S, Weng R, Qin W, Zheng Y, Qiu X, Huang X, Zhan Q . The rise and potential of large language model based agents: a survey. Science China Information Sciences, 2025, 68( 2): 121101

[529] Gong C, Li X . Agents with foundation models: advance and vision. Frontiers of Computer Science, 2025, 19( 4): 194330

[530] Lee J, Stevens N, Han S C, Song M. A survey of large language models in finance (FinLLMs). 2024, arXiv preprint arXiv: 2402.02315

[531] Zhang X, Wang L, Helwig J, Luo Y, Fu C, , . Artificial intelligence for science in quantum, atomistic, and continuum systems. 2023, arXiv preprint arXiv: 2307.08423

[532] Wu X, Shen Y, Shan C, Song K, Wang S, Zhang B, Feng J, Cheng H, Chen W, Xiong Y, Li D. Can graph learning improve task planning? 2024, arXiv preprint arXiv: 2405.19119

[533] Yang S, Nachum O, Du Y, Wei J, Abbeel P, Schuurmans D. Foundation models for decision making: problems, methods, and opportunities. 2023, arXiv preprint arXiv: 2303.04129

[534] Soleymani F, Paquet E . Deep graph convolutional reinforcement learning for financial portfolio management−DeepPocket. Expert Systems with Applications, 2021, 182: 115127

[535] Bayraktar Z, Molla S, Mahavadi S. Graph neural network generated metal-organic frameworks for carbon capture. In: Proceedings of the 11th International Conference on Learning Representations. 2023

[536] Wang M, Wang E, Liu X, Wang C . Topological graph representation of stratigraphic properties of spatial-geological characteristics and compression modulus prediction by mechanism-driven learning. Computers and Geotechnics, 2023, 153: 105112

[537] Yang Q, Wang X, Zhang X, Zheng J, Ke Y, Wang L, Guo H . A novel deep learning method for automatic recognition of coseismic landslides. Remote Sensing, 2023, 15( 4): 977

[538] Liu Z, Wan G, Prakash B A, Lau M S, Jin W. A review of graph neural networks in epidemic modeling. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 6577−6587

[539] Hamilton J D . State-space models. Handbook of Econometrics, 1994, 4: 3041–3080

[540] Gu A, Dao T. Mamba: linear-time sequence modeling with selective state spaces. 2023, arXiv preprint arXiv: 2312.00752

[541] Behrouz A, Hashemi F. Graph mamba: towards learning on graphs with state space models. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 119−130

[542] Liu Z, Wang Y, Vaidya S, Ruehle F, Halverson J, Soljačić M, Hou T Y, Tegmark M. KAN: Kolmogorov-Arnold networks. 2024, arXiv preprint arXiv: 2404.19756

[543] Ahmed T, Sifat M H R. GraphKAN: graph Kolmogorov Arnold network for small molecule-protein interaction predictions. In: Proceedings of the 1st Machine Learning for Life and Material Sciences Workshop. 2024

[544] Zhang F, Zhang X. GraphKAN: enhancing feature ex- traction with graph Kolmogorov Arnold networks. 2024, arXiv preprint arXiv: 2406.13597

[545] Yu J, Ren Y, Gong C, Tan J, Li X, Zhang X. Empower text-attributed graphs learning with large language models (LLMs). 2023, arXiv preprint arXiv: 2310.09872

[546] He X, Bresson X, Laurent T, Perold A, LeCun Y, Hooi B. Harnessing explanations: LLM-to-LM interpreter for enhanced text-attributed graph representation learning. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[547] Wang Y, Zhu Y, Zhang W, Zhuang Y, Li Y, Tang S. Bridging local details and global context in text-attributed graphs. In: Proceedings of 2024 Conference on Empirical Methods in Natural Language Processing. 2024, 14830−14841

[548] Huang X, Han K, Yang Y, Bao D, Tao Q, Chai Z, Zhu Q. GNNs as adapters for LLMs on text-attributed graphs. In: Proceedings of the Web Conference 2024. 2024

[549] Chen Z, Mao H, Li H, Jin W, Wen H, Wei X, Wang S, Yin D, Fan W, Liu H, Tang J . Exploring the potential of large language models (LLMs) in learning on graphs. ACM SIGKDD Explorations Newsletter, 2024, 25( 2): 42–61

[550] Mao Q, Liu Z, Liu C, Li Z, Sun J. Advancing graph representation learning with large language models: a comprehensive survey of techniques. 2024, arXiv preprint arXiv: 2402.05952

[551] Wu Y, Li S, Fang Y, Shi C. Exploring the potential of large language models for heterophilic graphs. 2024, arXiv preprint arXiv: 2408.14134

[552] Ren X, Tang J, Yin D, Chawla N, Huang C. A survey of large language models for graphs. In: Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2024, 6616−6626

[553] Liu J, Yang C, Lu Z, Chen J, Li Y, Zhang M, Bai T, Fang Y, Sun L, Yu P S, Shi C. Graph foundation models: concepts, opportunities and challenges. 2023, arXiv preprint arXiv: 2310.11829

[554] Galkin M, Yuan X, Mostafa H, Tang J, Zhu Z. Towards foundation models for knowledge graph reasoning. In: Proceedings of the 12th International Conference on Learning Representations. 2024

[555] Mao H, Chen Z, Tang W, Zhao J, Ma Y, Zhao T, Shah N, Galkin M, Tang J. Position: graph foundation models are already here. In: Proceedings of the 41st International Conference on Machine Learning. 2024

[556] Tang J, Yang Y, Wei W, Shi L, Su L, Cheng S, Yin D, Huang C. GraphGPT: graph instruction tuning for large language models. In: Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2024, 491−500

[557] Xia L, Kao B, Huang C. OpenGraph: towards open graph foundation models. In: Proceedings of the Association for Computational Linguistics. 2024, 2365−2379

[558] Xia L, Huang C. AnyGraph: graph foundation model in the wild. 2024, arXiv preprint arXiv: 2408.10700

[559] Alabdulmohsin I, Neyshabur B, Zhai X. Revisiting neural scaling laws in language and vision. In: Proceedings of the 36th International Conference on Neural Information Processing Systems. 2022, 1620

RIGHTS & PERMISSIONS

The Author(s) 2025. This article is published with open access at link.springer.com and journal.hep.com.cn