Few-shot node classification via local adaptive discriminant structure learning

Abstract

Node classification has a wide range of application scenarios such as citation analysis and social network analysis. In many real-world attributed networks, a large portion of classes only contain limited labeled nodes. Most of the existing node classification methods cannot be used for few-shot node classification. To train the model effectively and improve the robustness and reliability of the model with scarce labeled samples, in this paper, we propose a local adaptive discriminant structure learning (LADSL) method for few-shot node classification. LADSL aims to properly represent the nodes in the attributed graphs and learn a metric space with a strong discriminating power by reducing the intra-class variations and enlarging inter-class differences. Extensive experiments conducted on various attributed networks datasets demonstrate that LADSL is superior to the other methods on few-shot node classification task.

Graphical abstract

Keywords

few-shot learning / node classification / graph neural network / adaptive structure learning / attention strategy

References

[1] Tang J, Zhang J, Yao L, Li J, Zhang L, Su Z. ArnetMiner: extraction and mining of academic social networks. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2008, 990– 998

[2] Ding K, Li J, Agarwal N, Liu H. Inductive anomaly detection on attributed networks. In: Proceedings of the 29th International Joint Conference on Artificial Intelligence, IJCAI 2020. 2020, 1288– 1294

[3] Liao L, He X, Zhang H, Chua T S . Attributed social network embedding. IEEE Transactions on Knowledge and Data Engineering, 2018, 30( 12): 2257– 2270

[4] Tabassum S, Pereira F S F, Fernandes S, Gama J . Social network analysis: an overview. WIREs Data Mining and Knowledge Discovery, 2018, 8( 5): e1256

[5] Yao L, Mao C, Luo Y. Graph convolutional networks for text classification. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence. 2019, 905

[6] Abu-El-Haija S, Kapoor A, Perozzi B, Lee J. N-GCN: multi-scale graph convolution for semi-supervised node classification. In: Proceedings of the 35th Uncertainty in Artificial Intelligence Conference. 2020, 841– 851

[7] Gidaris S, Komodakis N. Generating classification weights with GNN denoising autoencoders for few-shot learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2019, 21– 30

[8] Bhagat S, Cormode G, Muthukrishnan S. Node classification in social networks. In: Aggarwal C C, ed. Social Network Data Analytics. Boston: Springer, 2011, 115− 148

[9] Zhou Z, Gu Y, Yu G . Adversarial network embedding using structural similarity. Frontiers of Computer Science, 2021, 15( 1): 151603

[10] Xue Z, Du J, Zheng C, Song J, Ren W, Liang M. Clustering-induced adaptive structure enhancing network for incomplete multi-view data. In: Proceedings of the 30th International Joint Conference on Artificial Intelligence, IJCAI-21. 2021, 3235– 3241

[11] Snell J, Swersky K, Zemel R S. Prototypical networks for few-shot learning. In: Proceedings of the 31st Conference on Neural Information Processing Systems. 2017, 4077– 4087

[12] Hu W, Gao J, Li B, Wu O, Du J, Maybank S . Anomaly detection using local kernel density estimation and context-based regression. IEEE Transactions on Knowledge and Data Engineering, 2020, 32( 2): 218– 233

[13] Zhang R, Che T, Ghahramani Z, Bengio Y, Song Y. MetaGAN: an adversarial approach to few-shot learning. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. 2018, 2371– 2380

[14] Koch G, Zemel R, Salakhutdinov R. Siamese neural networks for one-shot image recognition. In: Proceedings of the 32nd International Conference on Machine Learning. 2015

[15] Xu L, Du J, Li Q . Image fusion based on nonsubsampled contourlet transform and saliency-motivated pulse coupled neural networks. Mathematical Problems in Engineering, 2013, 2013: 135182

[16] Finn C, Abbeel P, Levine S. Model-agnostic meta-learning for fast adaptation of deep networks. In: Proceedings of the 34th International Conference on Machine Learning. 2017, 1126– 1135

[17] Sung F, Yang Y, Zhang L, Xiang T, Torr P H S, Hospedales T M. Learning to compare: relation network for few-shot learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2018, 1199– 1208

[18] Xue Z, Du J, Du D, Ren W, Lyu S. Deep correlated predictive subspace learning for incomplete multi-view semi-supervised classification. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI). 2019, 4026– 4032

[19] Yang X, Nan X, Song B . D2N4: a discriminative deep nearest neighbor neural network for few-shot space target recognition. IEEE Transactions on Geoscience and Remote Sensing, 2020, 58( 5): 3667– 3676

[20] Fang Y, Deng W, Du J, Hu J . Identity-aware CycleGAN for face photo-sketch synthesis and recognition. Pattern Recognition, 2020, 102: 107249

[21] Kim J, Kim T, Kim S, Yoo C D. Edge-labeling graph neural network for few-shot learning. In: Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2019, 11– 20

[22] Liu Y, Lee J, Park M, Kim S, Yang E, Hwang S J, Yang Y. Learning to propagate labels: transductive propagation network for few-shot learning. In: Proceedings of the 7th International Conference on Learning Representations. 2019

[23] Scarselli F, Gori M, Tsoi A C, Hagenbuchner M, Monfardini G . The graph neural network model. IEEE Transactions on Neural Networks, 2009, 20( 1): 61– 80

[24] Bruna J, Zaremba W, Szlam A, LeCun Y. Spectral networks and locally connected networks on graphs. In: Proceedings of the 2nd International Conference on Learning Representations. 2014

[25] Defferrard M, Bresson X, Vandergheynst P. Convolutional neural networks on graphs with fast localized spectral filtering. In: Proceedings of the 30th International Conference on Neural Information Processing Systems. 2016, 3844– 3852

[26] Kipf T N, Welling M. Semi-supervised classification with graph convolutional networks. In: Proceedings of the 5th International Conference on Learning Representations. 2017

[27] Yu K X, Qiao Z J, Song W L, Bi S . DNA nanotechnology for multimodal synergistic theranostics. Journal of Analysis and Testing, 2021, 5( 2): 112– 129

[28] Hamilton W L, Ying R, Leskovec J. Inductive representation learning on large graphs. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. 2017, 1025– 1035

[29] Veličković P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y. Graph attention networks. In: Proceedings of the 6th International Conference on Learning Representations. 2018, 1– 12

[30] Xu K, Hu W, Leskovec J, Jegelka S. How powerful are graph neural networks? In: Proceedings of the 7th International Conference on Learning Representations (ICLR). 2019

[31] Mishra N, Rohaninejad M, Chen X, Abbeel P. A simple neural attentive meta-learner. In: Proceedings of the 6th International Conference on Learning Representations. 2018

[32] Xue Z, Du J, Du D, Lyu S . Deep low-rank subspace ensemble for multi-view clustering. Information Sciences, 2019, 482: 210– 227

[33] Ravi S, Larochelle H. Optimization as a model for few-shot learning. In: Proceedings of the 5th International Conference on Learning Representations. 2017

[34] Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D. Matching networks for one shot learning. In: Proceedings of the 30th International Conference on Neural Information Processing Systems. 2016, 3637– 3645

[35] Ren M, Triantafillou E, Ravi S, Snell J, Swersky K, Tenenbaum J B, Larochelle H, Zemel R S. Meta-learning for semi-supervised few-shot classification. In: Proceedings of the 6th International Conference on Learning Representations. 2018

[36] Liu L, Zhou T, Long G, Jiang J, Zhang C. Learning to propagate for graph meta-learning. In: Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS). 2019, 1037– 1048

[37] Fereja T H, Du F, Wang C, Snizhko D, Guan Y, Xu G . Electrochemiluminescence imaging techniques for analysis and visualizing. Journal of Analysis and Testing, 2020, 4( 2): 76– 91

[38] Zhou F, Cao C, Zhang K, Trajcevski G, Zhong T, Geng J. Meta-GNN: on few-shot node classification in graph meta-learning. In: Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 2019, 2357– 2360

[39] Ding K, Wang J, Li J, Shu K, Liu C, Liu H. Graph prototypical networks for few-shot learning on attributed networks. In: Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2020, 295– 304

[40] Wen Y, Zhang K, Li Z, Qiao Y. A discriminative feature learning approach for deep face recognition. In: Proceedings of the 14th European Conference on Computer Vision. 2016, 499– 515

[41] McAuley J, Pandey R, Leskovec J. Inferring networks of substitutable and complementary products. In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2015, 785– 794

[42] Perozzi B, Al-Rfou R, Skiena S. DeepWalk: online learning of social representations. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 701– 710

[43] Grover A, Leskovec J. node2vec: scalable feature learning for networks. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2016, 855– 864

[44] Wu F, Zhang T, de Souza A H Jr, Fifty C, Yu T, Weinberger K Q. Simplifying graph convolutional networks. In: Proceedings of the 36th International Conference on Machine Learning. 2019, 6861– 6871

[45] MindSpore. mindspore website, 2021

[46] van der Maaten L, Hinton G . Visualizing data using t-SNE. Journal of Machine Learning Research, 2008, 9( 86): 2579– 2605

RIGHTS & PERMISSIONS

Higher Education Press