A BiLSTM-CF and BiGRU-based Deep Sentiment Analysis Model to Explore Customer Reviews for Effective Recommendations


  • Muhammad Rizwan Rashid Rana University Institute of Information Technology, PMAS Arid Agriculture University, Pakistan
  • Asif Nawaz University Institute of Information Technology, PMAS Arid Agriculture University, Pakistan
  • Tariq Ali University Institute of Information Technology, PMAS Arid Agriculture University, Pakistan
  • Ahmed M. El-Sherbeeny Industrial Engineering Department, College of Engineering, King Saud University, Saudi Arabia
  • Waqar Ali Department of Environmental Sciences, Informatics and Statistics, Ca' Foscari university of Venice, Italy
Volume: 13 | Issue: 5 | Pages: 11739-11746 | October 2023 | https://doi.org/10.48084/etasr.6278


The advancement of technology has led to the rise of social media forums and e-commerce platforms, which have become popular means of communication, and people can express their opinions through comments and reviews. Increased accessibility to online feedback helps individuals make informed decisions about product purchases, services, and other decisions. This study used a sentiment analysis-based approach to improve the functionality of the recommendations from user reviews and consider the features (aspects and opinions) of products and services to understand the characteristics and attributes that influence the performance of classification algorithms. The proposed model consists of data preprocessing, word embedding, character representation creation, feature extraction using BiLSTM-CF, and classification using BiGRU. The proposed model was evaluated on different multidomain benchmark datasets demonstrating impressive performance. The proposed model outperformed existing models, offering more promising performance results in recommendations.


sentiment analysis, reviews, classification, deep learning, recommendations


Download data is not yet available.


M. A. Kausar, S. O. Fageeri, and A. Soosaimanickam, "Sentiment Classification based on Machine Learning Approaches in Amazon Product Reviews," Engineering, Technology & Applied Science Research, vol. 13, no. 3, pp. 10849–10855, Jun. 2023.

M. R. R. Rana, S. U. Rehman, A. Nawaz, T. Ali, and M. Ahmed, "A conceptual model for decision support systems using aspect based sentiment analysis," Proceedings of the Romanian Academy, vol. 22, no. 4, pp. 371–380, Apr. 2021.

D. Elangovan and V. Subedha, "Adaptive Particle Grey Wolf Optimizer with Deep Learning-based Sentiment Analysis on Online Product Reviews," Engineering, Technology & Applied Science Research, vol. 13, no. 3, pp. 10989–10993, Jun. 2023.

P. Resnick and H. R. Varian, "Recommender systems," Communications of the ACM, vol. 40, no. 3, pp. 56–59, Mar. 1997.

D. Jannach, A. Manzoor, W. Cai, and L. Chen, "A Survey on Conversational Recommender Systems," ACM Computing Surveys, vol. 54, no. 5, Feb. 2021, Art. no. 105.

A. Nawaz, T. Ali, Y. Hafeez, S. ur Rehman, and M. R. Rashid, "Mining public opinion: a sentiment based forecasting for democratic elections of Pakistan," Spatial Information Research, vol. 30, no. 1, pp. 169–181, Feb. 2022.

M. Mahyoob, J. Algaraady, M. Alrahiali, and A. Alblwi, "Sentiment Analysis of Public Tweets Towards the Emergence of SARS-CoV-2 Omicron Variant: A Social Media Analytics Framework," Engineering, Technology & Applied Science Research, vol. 12, no. 3, pp. 8525–8531, Jun. 2022.

W. M. S. Yafooz, E. A. Hizam, and W. A. Alromema, "Arabic Sentiment Analysis on Chewing Khat Leaves using Machine Learning and Ensemble Methods," Engineering, Technology & Applied Science Research, vol. 11, no. 2, pp. 6845–6848, Apr. 2021.

H. Wu, Z. Zhang, S. Shi, Q. Wu, and H. Song, "Phrase dependency relational graph attention network for Aspect-based Sentiment Analysis," Knowledge-Based Systems, vol. 236, Jan. 2022, Art. no. 107736.

A. I. Saad, "Opinion Mining on US Airline Twitter Data Using Machine Learning Techniques," in 2020 16th International Computer Engineering Conference (ICENCO), Cairo, Egypt, Sep. 2020, pp. 59–63.

M. A. Ullah, S. M. Marium, S. A. Begum, and N. S. Dipa, "An algorithm and method for sentiment analysis using the text and emoticon," ICT Express, vol. 6, no. 4, pp. 357–360, Dec. 2020.

N. K. Gondhi, U. Chaahat, E. Sharma, A. H. Alharbi, R. Verma, and M. A. Shah, "Efficient Long Short-Term Memory-Based Sentiment Analysis of E-Commerce Reviews," Computational Intelligence and Neuroscience, vol. 2022, Jun. 2022, Art. no. e3464524.

J. S. Vimali and S. Murugan, "A Text Based Sentiment Analysis Model using Bi-directional LSTM Networks," in 2021 6th International Conference on Communication and Electronics Systems (ICCES), Coimbatre, India, Jul. 2021, pp. 1652–1658.

R. Hegde and S. Seema, "Nearest neighbour-based feature selection and classification approach for analysing sentiments," International Journal of Bioinformatics Research and Applications, vol. 18, no. 1–2, pp. 16–29, Jan. 2022.

K. Dhola and M. Saradva, "A Comparative Evaluation of Traditional Machine Learning and Deep Learning Classification Techniques for Sentiment Analysis," in 2021 11th International Conference on Cloud Computing, Data Science & Engineering (Confluence), Jan. 2021, pp. 932–936.

R. Vatambeti, S. V. Mantena, K. V. D. Kiran, M. Manohar, and C. Manjunath, "Twitter sentiment analysis on online food services based on elephant herd optimization with hybrid deep learning technique," Cluster Computing, Feb. 2023.

L. Wang, W. Guo, X. Yao, Y. Zhang, and J. Yang, "Multimodal Event-Aware Network for Sentiment Analysis in Tourism," IEEE MultiMedia, vol. 28, no. 2, pp. 49–58, Apr. 2021.

F. Huang, X. Zhang, Z. Zhao, J. Xu, and Z. Li, "Image–text sentiment analysis via deep multimodal attentive fusion," Knowledge-Based Systems, vol. 167, pp. 26–37, Mar. 2019.

J. Xu, Z. Li, F. Huang, C. Li, and P. S. Yu, "Social Image Sentiment Analysis by Exploiting Multimodal Content and Heterogeneous Relations," IEEE Transactions on Industrial Informatics, vol. 17, no. 4, pp. 2974–2982, Apr. 2021.

A. Banjar, Z. Ahmed, A. Daud, R. Abbasi, and H. Dawood, "Aspect-Based Sentiment Analysis for Polarity Estimation of Customer Reviews on Twitter," Computers, Materials & Continua, vol. 67, no. 2, pp. 2203–2225, 2021.

W. Li, S. Yin, and T. Pu, "Lexical attention and aspect-oriented graph convolutional networks for aspect-based sentiment analysis," Journal of Intelligent & Fuzzy Systems, vol. 42, no. 3, pp. 1643–1654, Jan. 2022.

R. Kora and A. Mohammed, "An enhanced approach for sentiment analysis based on meta-ensemble deep learning," Social Network Analysis and Mining, vol. 13, no. 1, Mar. 2023, Art. no. 38.

A. Nawaz, A. A. Awan, T. Ali, and M. R. R. Rana, "Product’s behaviour recommendations using free text: an aspect based sentiment analysis approach," Cluster Computing, vol. 23, no. 2, pp. 1267–1279, Jun. 2020.

R. Catelli, S. Pelosi, and M. Esposito, "Lexicon-Based vs. Bert-Based Sentiment Analysis: A Comparative Study in Italian," Electronics, vol. 11, no. 3, Jan. 2022, Art. no. 374.

C. D. Santos and B. Zadrozny, "Learning Character-level Representations for Part-of-Speech Tagging," in Proceedings of the 31st International Conference on Machine Learning, Beijing, China, Jun. 2014, pp. 1818–1826.

X. Wu, "A Dropout Optimization Algorithm to Prevent Overfitting in Machine Learning," Machine Learning Theory and Practice, vol. 4, no. 1, Mar. 2023.

H. Xia, Y. Yang, X. Pan, Z. Zhang, and W. An, "Sentiment analysis for online reviews using conditional random fields and support vector machines," Electronic Commerce Research, vol. 20, no. 2, pp. 343–360, Jun. 2020.

Z. Gao, Z. Li, J. Luo, and X. Li, "Short Text Aspect-Based Sentiment Analysis Based on CNN + BiGRU," Applied Sciences, vol. 12, no. 5, Jan. 2022, Art. no. 2707.

M. Hu and B. Liu, "Mining and summarizing customer reviews," in Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, Seattle, WA, USA, May 2004, pp. 168–177.

Md. H. Alam, W.-J. Ryu, and S. Lee, "Joint multi-grain topic sentiment: modeling semantic aspects for online reviews," Information Sciences, vol. 339, pp. 206–223, Apr. 2016.

A. L. Maas, R. E. Daly, P. T. Pham, D. Huang, A. Y. Ng, and C. Potts, "Learning word vectors for sentiment analysis," in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1, Portland, OR, USA, Mar. 2011, pp. 142–150.

Y. Sharma, G. Agrawal, P. Jain, and T. Kumar, "Vector representation of words for sentiment analysis using GloVe," in 2017 International Conference on Intelligent Communication and Computational Techniques (ICCT), Jaipur, India, Sep. 2017, pp. 279–284.

P. F. Muhammad, R. Kusumaningrum, and A. Wibowo, "Sentiment Analysis Using Word2vec And Long Short-Term Memory (LSTM) For Indonesian Hotel Reviews," Procedia Computer Science, vol. 179, pp. 728–735, Jan. 2021.

A. Zhao and Y. Yu, "Knowledge-enabled BERT for aspect-based sentiment analysis," Knowledge-Based Systems, vol. 227, Sep. 2021, Art. no. 107220.

H. Zhao, Z. Liu, X. Yao, and Q. Yang, "A machine learning-based sentiment analysis of online product reviews with a novel term weighting and feature selection approach," Information Processing & Management, vol. 58, no. 5, Sep. 2021, Art. no. 102656.

M. Rizwan et al., "Aspect-Based Sentiment Analysis for Social Multimedia: A Hybrid Computational Framework," Computer Systems Science and Engineering, vol. 46, no. 2, pp. 2415–2428, 2023.

J. Mutinda, W. Mwangi, and G. Okeyo, "Sentiment Analysis of Text Reviews Using Lexicon-Enhanced Bert Embedding (LeBERT) Model with Convolutional Neural Network," Applied Sciences, vol. 13, no. 3, Jan. 2023, Art. no. 1445.


How to Cite

M. R. R. Rana, A. Nawaz, T. Ali, A. M. El-Sherbeeny, and W. Ali, “A BiLSTM-CF and BiGRU-based Deep Sentiment Analysis Model to Explore Customer Reviews for Effective Recommendations”, Eng. Technol. Appl. Sci. Res., vol. 13, no. 5, pp. 11739–11746, Oct. 2023.


Abstract Views: 309
PDF Downloads: 224

Metrics Information

Most read articles by the same author(s)