Zou, X., Li, K., Chen, C., Yang, X., Wei, W., & Li, K. (2023). DGSLN: Differentiable graph structure learning neural network for robust graph representations. Information Sciences, 626, 94–113. https://doi.org/10.1016/j.ins.2023.01.059
Abstract:
Recently, graph neural networks (GNNs) have been widely used for graph representation learning, where the central idea is to recursively aggregate neighborhood information to update the node feature based on the graph topology. Therefore, an appropriate graph topology is crucial for effective graph representation learning in GNNs. However, most existing GNNs assume that the initial graph is complete and accurate, and utilize the fixed initial graph structure in the entire network, which may limit the learning representation capability of the model. In this work, we propose a novel differentiable graph structure learning neural network (DGSLN), which learns suitable graph structures for GNNs. Specifically, our DGSLN presents a general graph generation scheme that integrates various useful graph prior messages to generate normal structures. We describe the generation process with homophily, node degree, and sparsity as examples. Moreover, we develop a hybrid loss function to ensure the quality of learned graphs, which combines task-specific loss and graph regularization loss to optimize graph structures from both structural adaptive and task-driven aspects. Extensive experiments on graph classification and node classification have shown that our approach significantly improves performance on different benchmark datasets compared to state-of-the-art GNNs methods.
License type:
Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Funding Info:
This work is supported by the National Key Research and Development Program of China under Grant 2019YFB2103004, the National Natural Science Foundation of China under Grant 61902120, and the Natural Science Foundation of Hunan Province under Grant 2020JJ5083, and the Postgraduate Scientific Research Innovation Project of Hunan Province under Grant CX20210407.