Enhanced Variational Graph Convolutional Networks with Multi-Scale Convolutions and Attention Mechanisms for Dynamic Network Analysis

Authors

  • Aabid Ahmad Mir Malaysian Institute of Information Technology, Universiti Kuala Lumpur, Malaysia
  • Megat F. Zuhairi Malaysian Institute of Information Technology, Universiti Kuala Lumpur, Malaysia
  • Shahrulniza Musa Malaysian Institute of Information Technology, Universiti Kuala Lumpur, Malaysia
  • Fuhid Alanazi Faculty of Computer and Information Systems, Islamic University of Madinah, Saudi Arabia
  • Abdallah Namoun AI Centre, Faculty of Computer and Information Systems, Islamic University of Madinah, Saudi Arabia
  • Ahmed Alrehaili Faculty of Computer and Information Systems, Islamic University of Madinah, Saudi Arabia
Volume: 15 | Issue: 1 | Pages: 19838-19847 | February 2025 | https://doi.org/10.48084/etasr.9443

Abstract

The dynamic and constantly evolving landscape of cyber threats demands innovative methods capable of adapting to the complex relationships and structures inherent in network data. Traditional methods often struggle to adequately capture the intricacies of dynamic networks, especially in terms of evolving temporal dynamics and multiscale dependencies. The proposed solution, Enhanced V-GCN, combines the structural insights of Graph Convolutional Networks (GCNs) with the temporal modeling capabilities of Variational Autoencoders (VAEs), further augmented by multiscale convolutions and attention mechanisms. Multiscale convolutions enable the model to aggregate information across broader neighborhood ranges, while attention mechanisms prioritize the most critical nodes and edges, dynamically adapting to changes within the network. This enhanced approach allows V-GCN to effectively capture both nodal and structural patterns, significantly improving performance in node classification tasks. The Enhanced V-GCN model has demonstrated superior performance in node classification, outperforming baseline models with an accuracy of 98.00%, precision of 97.93%, recall of 98%, and an F1-score of 97.92%, indicating robust classification capabilities and exceptional generalization across diverse network structures.

Keywords:

anomaly detection, dynamic networks, deep learning, graph neural networks, node classification

Downloads

Download data is not yet available.

References

S. Ji, S. Pan, E. Cambria, P. Marttinen, and P. S. Yu, "A Survey on Knowledge Graphs: Representation, Acquisition, and Applications," IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 2, pp. 494–514, Oct. 2022.

F. Xia et al., "Graph Learning: A Survey," IEEE Transactions on Artificial Intelligence, vol. 2, no. 2, pp. 109–127, Apr. 2021.

Y. Liu et al., "Graph Self-Supervised Learning: A Survey," IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 6, pp. 5879–5900, Jun. 2023.

P. Jiao et al., "Temporal Network Embedding for Link Prediction via VAE Joint Attention Mechanism," IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 12, pp. 7400–7413, Sep. 2022.

S. Pan, R. Hu, S. F. Fung, G. Long, J. Jiang, and C. Zhang, "Learning Graph Embedding With Adversarial Training Methods," IEEE Transactions on Cybernetics, vol. 50, no. 6, pp. 2475–2487, Jun. 2020.

M. Wu, S. Pan, L. Du, and X. Zhu, "Learning Graph Neural Networks with Positive and Unlabeled Nodes," ACM Transactions on Knowledge Discovery from Data, vol. 15, no. 6, pp. 1–25, Jun. 2021.

Y. Liu, Z. Li, S. Pan, C. Gong, C. Zhou, and G. Karypis, "Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning," IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 6, pp. 2378–2392, Jun. 2022.

Y. Liu et al., "Anomaly Detection in Dynamic Graphs via Transformer," IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 12, pp. 12081–12094, Sep. 2023.

D. Jin et al., "A Survey of Community Detection Approaches: From Statistical Modeling to Deep Learning," IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 2, pp. 1149–1170, Oct. 2023.

A. A. Mir, M. F. Zuhairi, S. Musa, M. H. Alanazi, and A. Namoun, "Variational Graph Convolutional Networks for Dynamic Graph Representation Learning," IEEE Access, vol. 12, pp. 161697–161717, 2024.

J. Ren, F. Xia, I. Lee, A. Noori Hoshyar, and C. Aggarwal, "Graph Learning for Anomaly Analytics: Algorithms, Applications, and Challenges," ACM Transactions on Intelligent Systems and Technology, vol. 14, no. 2, pp. 1–29, Apr. 2023.

C. Zhang, D. Song, C. Huang, A. Swami, and N. V. Chawla, "Heterogeneous Graph Neural Network," in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA, Jul. 2019, pp. 793–803.

J. Zhao, X. Wang, C. Shi, B. Hu, G. Song, and Y. Ye, "Heterogeneous Graph Structure Learning for Graph Neural Networks," Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 5, pp. 4697–4705, May 2021.

H. Huang, R. Shi, W. Zhou, X. Wang, H. Jin, and X. Fu, "Temporal Heterogeneous Information Network Embedding," in Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, Montreal, Canada, Aug. 2021, pp. 1470–1476.

J. Wang, Y. Zhang, Y. Wei, Y. Hu, X. Piao, and B. Yin, "Metro Passenger Flow Prediction via Dynamic Hypergraph Convolution Networks," IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 12, pp. 7891–7903, Sep. 2021.

Q. Ding and J. Li, "AnoGLA: An efficient scheme to improve network anomaly detection," Journal of Information Security and Applications, vol. 66, May 2022, Art. no. 103149.

B. Chen et al., "GCCAD: Graph Contrastive Coding for Anomaly Detection," IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 8, pp. 8037–8051, Dec. 2023.

H. Chen, X. Mei, Z. Ma, X. Wu, and Y. Wei, "Spatial–temporal graph attention network for video anomaly detection," Image and Vision Computing, vol. 131, Mar. 2023, Art. no. 104629.

X. Wang et al., "Heterogeneous Graph Attention Network," in The World Wide Web Conference, San Francisco, CA, USA, May 2019, pp. 2022–2032.

P. Malhotra, Y. Singh, P. Anand, D. K. Bangotra, P. K. Singh, and W.-C. Hong, "Internet of Things: Evolution, Concerns and Security Challenges," Sensors, vol. 21, no. 5, Jan. 2021, Art. no. 1809.

A. A. Mir, M. F. Zuhairi, and S. M. Musa, "Graph Anomaly Detection with Graph Convolutional Networks.," International Journal of Advanced Computer Science & Applications, vol. 14, no. 11, 2023.

T. N. Kipf and M. Welling, "Semi-Supervised Classification with Graph Convolutional Networks." arXiv, Feb. 22, 2017.

A. A. Mir, M. F. Zuhairi, S. Musa, and A. Namoun, "Adaptive Anomaly Detection in Dynamic Graph Networks," in 2024 International Visualization, Informatics and Technology Conference (IVIT), Kuala Lumpur, Malaysia, Aug. 2024, pp. 200–206.

D. P. Kingma and M. Welling, "Auto-Encoding Variational Bayes." arXiv, Dec. 10, 2022.

V. Cerqueira, L. Torgo, M. Oliveira, and B. Pfahringer, "Dynamic and Heterogeneous Ensembles for Time Series Forecasting," in 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA), Tokyo, Japan, Oct. 2017, pp. 242–251.

I. Sánchez, "Adaptive combination of forecasts with application to wind energy," International Journal of Forecasting, vol. 24, no. 4, pp. 679–693, Oct. 2008.

F. Collopy and J. S. Armstrong, "Rule-Based Forecasting: Development and Validation of an Expert Systems Approach to Combining Time Series Extrapolations," Management Science, vol. 38, no. 10, pp. 1394–1414, Oct. 1992.

J. S. Armstrong, M. Adya, and F. Collopy, "Rule-Based Forecasting: Using Judgment in Time-Series Extrapolation," in Principles of Forecasting: A Handbook for Researchers and Practitioners, J. S. Armstrong, Ed. Boston, MA, USA: Springer US, 2001, pp. 259–282.

J. Durbin and S. J. Koopman, Time Series Analysis by State Space Methods. Oxford University Press, 2012.

J. D. Hamilton, Time Series Analysis. Princeton University Press, 2020.

Y. Fu, D. Wu, and B. Boulet, "Reinforcement Learning Based Dynamic Model Combination for Time Series Forecasting," Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 6, pp. 6639–6647, Jun. 2022.

A. Alrehaili, A. Mir, and M. Junaid, "A retrospect of prominent cloud security algorithms," International Journal of Innovative Technology and Exploring Engineering (IJITEE), vol. 9, no. 3, pp. 749–755, 2020.

A. Mir, M. F. Zuhairi, S. Musa, T. A. Syed, and A. Alrehaili, "POSTER: A Survey of Security Challenges with 5G-IoT," in 2020 First International Conference of Smart Systems and Emerging Technologies (SMARTTECH), Riyadh, Saudi Arabia, Nov. 2020, pp. 249–250.

F. Scarselli, M. Gori, A. C. Tsoi, M. Hagenbuchner, and G. Monfardini, "The Graph Neural Network Model," IEEE Transactions on Neural Networks, vol. 20, no. 1, pp. 61–80, Jan. 2009.

S. K. Maurya, X. Liu, and T. Murata, "Simplifying approach to node classification in Graph Neural Networks," Journal of Computational Science, vol. 62, Jul. 2022, Art. no. 101695.

M. H. Alanazi, "G-GANS for Adaptive Learning in Dynamic Network Slices," Engineering, Technology & Applied Science Research, vol. 14, no. 3, pp. 14327–14341, Jun. 2024.

T. N. Kipf and M. Welling, "Variational Graph Auto-Encoders." arXiv, Nov. 21, 2016.

S. Tian, S. Zhang, H. Mao, R. Liu, and X. Xiong, "Temporal Network Link Prediction Based on the Optimized Exponential Smoothing Model and Node Interaction Entropy," Symmetry, vol. 15, no. 6, p. 1182, Jun. 2023.

D. Ghosh et al., "The synchronized dynamics of time-varying networks," Physics Reports, vol. 949, pp. 1–63, Feb. 2022.

O. Ryan, J. Haslbeck, and L. Waldorp, "Non-Stationarity in Time-Series Analysis: Modeling Stochastic and Deterministic Trends." OSF, Jul. 13, 2023.

P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio, "Graph Attention Networks." arXiv, Feb. 04, 2018.

W. Hamilton, Z. Ying, and J. Leskovec, "Inductive Representation Learning on Large Graphs," in Advances in Neural Information Processing Systems, 2017, vol. 30.

Downloads

How to Cite

[1]
Mir, A.A., Zuhairi, M.F., Musa, S., Alanazi, F., Namoun, A. and Alrehaili, A. 2025. Enhanced Variational Graph Convolutional Networks with Multi-Scale Convolutions and Attention Mechanisms for Dynamic Network Analysis. Engineering, Technology & Applied Science Research. 15, 1 (Feb. 2025), 19838–19847. DOI:https://doi.org/10.48084/etasr.9443.

Metrics

Abstract Views: 47
PDF Downloads: 24

Metrics Information

Most read articles by the same author(s)