Maximizing DRL-based Energy Efficiency in IRS-NOMA using a DDPG Algorithm for the Next Generation of Wireless Communications

Authors

  • Kamil Audah Department of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia, Malaysia | Department of Electronics Technologies, Southern Technical University, Iraq | Department of Computer Technology Engineering, Faculty of Engineering, Iraq University College, Iraq
  • Nor K. Noordin Department of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia, Malaysia | Wireless and Photonics Networks Research Center of Excellence (WiPNET), Faculty of Engineering, Universiti Putra Malaysia, Malaysia
  • Wala'a Hussein Department of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia, Malaysia | Department of Chemical Engineering and Petroleum Refining, Basrah University for Oil and Gas, Iraq | Department of Computer Technology Engineering, Faculty of Engineering, Iraq University College, Iraq
  • Mod Fadlee B. A. Rasid Department of Computer and Communication Systems Engineering, Faculty of Engineering, Universiti Putra Malaysia, Malaysia | Wireless and Photonics Networks Research Center of Excellence (WiPNET), Faculty of Engineering, Universiti Putra Malaysia, Malaysia
  • Aduwati Sali
  • Aymen Flah National Engineering School of Gabes, University of Gabes, Tunisia | University of Business and Technology (UBT), College of Engineering, Jeddah, 21448, Saudi Arabia | MEU Research Unit, Middle East University, Amman, 11831, Jordan | Applied Science Research Center, Applied Science Private University, Amman, Jordan | The Private Higher School of Applied Sciences and Technologies of Gabes (ESSAT), University of Gabes, Gabes, Tunisia
Volume: 14 | Issue: 4 | Pages: 14801-14810 | August 2024 | https://doi.org/10.48084/etasr.7536

Received: 18 April 2024 | Revised: 5 May 2024 | Accepted: 7 May 2024 | Online: 13 May 2024


Corresponding author: Kamil Audah

Abstract

Combining Intelligent Reflecting Surfaces (IRSs) with Non-Orthogonal Multiple Access (NOMA) effectively enhances communication. This study introduces a NOMA-assisted Downlink Transmission (DT) system, emphasizing Energy Efficiency (EE) optimization. EE, crucial in Wireless Communications (WCs), measures data transmission relative to energy consumption. This study focuses on a Deep Deterministic Policy Gradient (DDPG) algorithm that intelligently adjusts IRS phase-shift matrices and access point beamforming in NOMA DT. Beamforming directs signals to users for optimal strength and quality, while phase shift control enhances signal coverage and quality. Strategic IRS placement improves user signal transmissions. The simulation results demonstrate significantly improved EE compared to other algorithms, such as Deep Q Network (DQN) and Proximal Policy Optimization (PPO), showcasing the effectiveness of the combined IRS and NOMA approach in enhancing communication systems' EE.

Keywords:

5G, deep deterministic policy gradient, DRL, energy efficiency, IRS-NOMA, optimization

Downloads

Download data is not yet available.

References

R. Alghamdi et al., "Intelligent Surfaces for 6G Wireless Networks: A Survey of Optimization and Performance Analysis Techniques," IEEE Access, vol. 8, pp. 202795–202818, 2020.

Q. Wu and R. Zhang, "Towards Smart and Reconfigurable Environment: Intelligent Reflecting Surface Aided Wireless Network," IEEE Communications Magazine, vol. 58, no. 1, pp. 106–112, Jan. 2020.

C. Huang et al., "Holographic MIMO Surfaces for 6G Wireless Networks: Opportunities, Challenges, and Trends," IEEE Wireless Communications, vol. 27, no. 5, pp. 118–125, Oct. 2020.

D. Xu, X. Yu, Y. Sun, D. W. K. Ng, and R. Schober, "Resource Allocation for IRS-Assisted Full-Duplex Cognitive Radio Systems," IEEE Transactions on Communications, vol. 68, no. 12, pp. 7376–7394, Sep. 2020.

X. Yu, D. Xu, Y. Sun, D. W. K. Ng, and R. Schober, "Robust and Secure Wireless Communications via Intelligent Reflecting Surfaces," IEEE Journal on Selected Areas in Communications, vol. 38, no. 11, pp. 2637–2652, Aug. 2020.

Y. Liu et al., "Evolution of NOMA Toward Next Generation Multiple Access (NGMA) for 6G," IEEE Journal on Selected Areas in Communications, vol. 40, no. 4, pp. 1037–1071, Apr. 2022.

A. Ihsan, W. Chen, S. Zhang, and S. Xu, "Energy-Efficient NOMA Multicasting System for Beyond 5G Cellular V2X Communications With Imperfect CSI," IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 8, pp. 10721–10735, Dec. 2022.

Z. Ding and H. V. Poor, "A Simple Design of IRS-NOMA Transmission," IEEE Communications Letters, vol. 24, no. 5, pp. 1119–1123, Feb. 2020.

G. Zhou, C. Pan, H. Ren, K. Wang, and A. Nallanathan, "Intelligent Reflecting Surface Aided Multigroup Multicast MISO Communication Systems," IEEE Transactions on Signal Processing, vol. 68, pp. 3236–3251, 2020.

C. Pan et al., "Multicell MIMO Communications Relying on Intelligent Reflecting Surfaces," IEEE Transactions on Wireless Communications, vol. 19, no. 8, pp. 5218–5233, Dec. 2020.

Y. Wang, H. Lu, D. Zhao, and H. Sun, "Energy Efficiency Optimization in IRS-Enhanced mmWave Systems with Lens Antenna Array," in GLOBECOM 2020 - 2020 IEEE Global Communications Conference, Taipei, Taiwan, Dec. 2020, pp. 1–6.

L. You, J. Xiong, D. W. K. Ng, C. Yuen, W. Wang, and X. Gao, "Energy Efficiency and Spectral Efficiency Tradeoff in RIS-Aided Multiuser MIMO Uplink Transmission," IEEE Transactions on Signal Processing, vol. 69, pp. 1407–1421, 2021.

L. Du, C. Huang, W. Guo, J. Ma, X. Ma, and Y. Tang, "Reconfigurable Intelligent Surfaces Assisted Secure Multicast Communications," IEEE Wireless Communications Letters, vol. 9, no. 10, pp. 1673–1676, Jul. 2020.

C. Huang, R. Mo, and C. Yuen, "Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning," IEEE Journal on Selected Areas in Communications, vol. 38, no. 8, pp. 1839–1850, Dec. 2020.

Q. Wu and R. Zhang, "Beamforming Optimization for Wireless Network Aided by Intelligent Reflecting Surface With Discrete Phase Shifts," IEEE Transactions on Communications, vol. 68, no. 3, pp. 1838–1851, Mar. 2020.

H. Ghavami and B. Akhbari, "Secrecy performance analysis of IRS-NOMA systems," EURASIP Journal on Wireless Communications and Networking, vol. 2023, no. 1, Jul. 2023, Art. no. 57.

S. P. Le, H. N. Nguyen, N. T. Nguyen, C. H. Van, A. T. Le, and M. Voznak, "Physical layer security analysis of IRS-based downlink and uplink NOMA networks," EURASIP Journal on Wireless Communications and Networking, vol. 2023, no. 1, Oct. 2023, Art. no. 105.

B. C. Nguyen, T. Manh Hoang, A. T. Le, V. D. Nguyen, and P. T. Tran, "Performance analysis of intelligent reflecting surface aided full-duplex amplify-and-forward relay networks," International Journal of Communication Systems, vol. 35, no. 10, 2022, Art. no. e5172.

N. D. Nguyen, A. T. Le, M. Munochiveyi, F. Afghah, and E. Pallis, "Intelligent Reflecting Surface Aided Wireless Systems with Imperfect Hardware," Electronics, vol. 11, no. 6, Jan. 2022, Art. no. 900.

F. Fang, Y. Xu, Q. V. Pham, and Z. Ding, "Energy-Efficient Design of IRS-NOMA Networks," IEEE Transactions on Vehicular Technology, vol. 69, no. 11, pp. 14088–14092, Aug. 2020.

G. Li, M. Zeng, D. Mishra, L. Hao, Z. Ma, and O. A. Dobre, "Energy-Efficient Design for IRS-Empowered Uplink MIMO-NOMA Systems," IEEE Transactions on Vehicular Technology, vol. 71, no. 9, pp. 9490–9500, Sep. 2022.

W. Du et al., "Weighted Sum-Rate and Energy Efficiency Maximization for Joint ITS and IRS Assisted Multiuser MIMO Networks," IEEE Transactions on Communications, vol. 70, no. 11, pp. 7351–7364, Aug. 2022.

Y. Qi and M. Vaezi, "IRS-Assisted Physical Layer Security in MIMO-NOMA Networks," IEEE Communications Letters, vol. 27, no. 3, pp. 792–796, Mar. 2023.

T. Zhang and S. Mao, "Energy-Efficient Federated Learning With Intelligent Reflecting Surface," IEEE Transactions on Green Communications and Networking, vol. 6, no. 2, pp. 845–858, Jun. 2022.

A. Ihsan, W. Chen, M. Asif, W. U. Khan, Q. Wu, and J. Li, "Energy-Efficient IRS-Aided NOMA Beamforming for 6G Wireless Communications," IEEE Transactions on Green Communications and Networking, vol. 6, no. 4, pp. 1945–1956, Sep. 2022.

S. H. Hong, J. Park, S. J. Kim, and J. Choi, "Hybrid Beamforming for Intelligent Reflecting Surface Aided Millimeter Wave MIMO Systems," IEEE Transactions on Wireless Communications, vol. 21, no. 9, pp. 7343–7357, Sep. 2022.

Y. Wu, F. Zhou, W. Wu, Q. Wu, R. Q. Hu, and K. K. Wong, "Spectrum and Energy Efficiency Tradeoff in IRS-Assisted CRNs with NOMA: A Multi-Objective Optimization Framework," in ICC 2022 - IEEE International Conference on Communications, Seoul, Korea (South), Feb. 2022, pp. 3930–3935.

L. Du, W. Zhang, J. Ma, and Y. Tang, "Reconfigurable Intelligent Surfaces for Energy Efficiency in Multicast Transmissions," IEEE Transactions on Vehicular Technology, vol. 70, no. 6, pp. 6266–6271, Jun. 2021.

L. Li, D. Ma, H. Ren, P. Wang, W. Lin, and Z. Han, "Toward Energy-Efficient Multiple IRSs: Federated Learning-Based Configuration Optimization," IEEE Transactions on Green Communications and Networking, vol. 6, no. 2, pp. 755–765, Jun. 2022.

Q. Liu, J. Wu, L. Hu, S. Bi, W. Ji, and R. Yang, "Optimal Energy Efficiency Used DDPG in IRS-NOMA Wireless Communications," Symmetry, vol. 14, no. 5, May 2022, Art. no. 1018.

K. Li, C. Huang, Y. Gong, and G. Chen, "Double Deep Learning for Joint Phase-Shift and Beamforming Based on Cascaded Channels in RIS-Assisted MIMO Networks," IEEE Wireless Communications Letters, vol. 12, no. 4, pp. 659–663, Apr. 2023.

P. Saikia, S. Pala, K. Singh, S. K. Singh, and W. J. Huang, "Proximal Policy Optimization for RIS-assisted Full Duplex 6G-V2X Communications," IEEE Transactions on Intelligent Vehicles, pp. 1–16, 2023.

H. B. Mahesh, G. F. A. Ahammed, and S. M. Usha, "Design and Performance Analysis of Massive MIMO Modeling with Reflected Intelligent Surface to Enhance the Capacity of 6G Networks," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12068–12073, Dec. 2023.

Downloads

How to Cite

[1]
Audah, K., Noordin, N.K., Hussein, W., Rasid, M.F.B.A., Sali, A. and Flah, A. 2024. Maximizing DRL-based Energy Efficiency in IRS-NOMA using a DDPG Algorithm for the Next Generation of Wireless Communications. Engineering, Technology & Applied Science Research. 14, 4 (Aug. 2024), 14801–14810. DOI:https://doi.org/10.48084/etasr.7536.

Metrics

Abstract Views: 557
PDF Downloads: 520

Metrics Information

License

Copyright (c) 2024 Kamil Audah, Nor K. Noordin, Wala'a Hussein, Mod Fadlee B. A. Rasid, Aduwati Sali , Aymen Flah

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.

Crossref
Scopus
Google Scholar
Europe PMC

Most read articles by the same author(s)