Integrating Hierarchical Dependencies and Correlation for Multi-Label Text Classification
Jiaxin ZHU , Guohua LIU
Journal of Donghua University(English Edition) ›› 2026, Vol. 43 ›› Issue (5) : 121 -130.
This study addresses the challenges in scientific paper classification caused by the exponential growth of scientific papers, which intensifies demands for efficient manuscript categorization and cross-disciplinary knowledge retrieval. To overcome limitations of conventional methods in handling multi-label scenarios and domain-specific nuances, a novel multi-label text classification model is proposed, integrating semantic-aware label correlation modeling with advanced text representation learning. This model constructs a discipline-aware label graph through a graph attention network, incorporating hierarchical information and co-occurrence patterns from domain knowledge, while employing DeBERTaV3 to capture deep contextual semantics through its enhanced Transformer architecture. Text embeddings and label representations undergo systematic fusion, with hybrid sampling strategies and text augmentation techniques mitigating data imbalance issues. Experimental results demonstrate that the proposed model achieves higher performance in cross-disciplinary text classification compared to existing state-of-the-art methods.
multi-label text classification / graph attention network / DeBERTaV3 / label representation learning
| [1] |
|
| [2] |
|
| [3] |
|
| [4] |
Joachims T. Making large-scale support vector machine learning practical[M]// Advances in Kernel Methods. Cambridge: The MIT Press, 1998. |
| [5] |
|
| [6] |
|
| [7] |
|
| [8] |
|
| [9] |
|
| [10] |
|
| [11] |
|
| [12] |
|
| [13] |
|
| [14] |
|
| [15] |
|
| [16] |
|
| [17] |
|
| [18] |
|
| [19] |
Scarselli F, Gori M, |
| [20] |
Kim Y. Convolutional neural networks for sentence classification[PP/OL]. V2. arXiv (2014-09-03)[2025-05-02]. https://arxiv.org/pdf/1408.5882. |
| [21] |
|
| [22] |
|
| [23] |
|
| [24] |
|
| [25] |
|
| [26] |
Clark K, |
| [27] |
Hadsell R, Rao D, Rusu A A, |
| [28] |
|
| [29] |
|
| [30] |
|
| [31] |
You R, Zhang Z, Wang Z, |
| [32] |
|
| [33] |
|
/
| 〈 |
|
〉 |