A BiLSTM-CF and BiGRU-based Deep Sentiment Analysis Model to Explore Customer Reviews for Effective Recommendations
Received: 13 August 2023 | Revised: 24 August 2023 | Accepted: 26 August 2023 | Online: 4 September 2023
Corresponding author: Asif Nawaz
Abstract
The advancement of technology has led to the rise of social media forums and e-commerce platforms, which have become popular means of communication, and people can express their opinions through comments and reviews. Increased accessibility to online feedback helps individuals make informed decisions about product purchases, services, and other decisions. This study used a sentiment analysis-based approach to improve the functionality of the recommendations from user reviews and consider the features (aspects and opinions) of products and services to understand the characteristics and attributes that influence the performance of classification algorithms. The proposed model consists of data preprocessing, word embedding, character representation creation, feature extraction using BiLSTM-CF, and classification using BiGRU. The proposed model was evaluated on different multidomain benchmark datasets demonstrating impressive performance. The proposed model outperformed existing models, offering more promising performance results in recommendations.
Keywords:
sentiment analysis, reviews, classification, deep learning, recommendationsDownloads
References
M. A. Kausar, S. O. Fageeri, and A. Soosaimanickam, "Sentiment Classification based on Machine Learning Approaches in Amazon Product Reviews," Engineering, Technology & Applied Science Research, vol. 13, no. 3, pp. 10849–10855, Jun. 2023.
M. R. R. Rana, S. U. Rehman, A. Nawaz, T. Ali, and M. Ahmed, "A conceptual model for decision support systems using aspect based sentiment analysis," Proceedings of the Romanian Academy, vol. 22, no. 4, pp. 371–380, Apr. 2021.
D. Elangovan and V. Subedha, "Adaptive Particle Grey Wolf Optimizer with Deep Learning-based Sentiment Analysis on Online Product Reviews," Engineering, Technology & Applied Science Research, vol. 13, no. 3, pp. 10989–10993, Jun. 2023.
P. Resnick and H. R. Varian, "Recommender systems," Communications of the ACM, vol. 40, no. 3, pp. 56–59, Mar. 1997.
D. Jannach, A. Manzoor, W. Cai, and L. Chen, "A Survey on Conversational Recommender Systems," ACM Computing Surveys, vol. 54, no. 5, Feb. 2021, Art. no. 105.
A. Nawaz, T. Ali, Y. Hafeez, S. ur Rehman, and M. R. Rashid, "Mining public opinion: a sentiment based forecasting for democratic elections of Pakistan," Spatial Information Research, vol. 30, no. 1, pp. 169–181, Feb. 2022.
M. Mahyoob, J. Algaraady, M. Alrahiali, and A. Alblwi, "Sentiment Analysis of Public Tweets Towards the Emergence of SARS-CoV-2 Omicron Variant: A Social Media Analytics Framework," Engineering, Technology & Applied Science Research, vol. 12, no. 3, pp. 8525–8531, Jun. 2022.
W. M. S. Yafooz, E. A. Hizam, and W. A. Alromema, "Arabic Sentiment Analysis on Chewing Khat Leaves using Machine Learning and Ensemble Methods," Engineering, Technology & Applied Science Research, vol. 11, no. 2, pp. 6845–6848, Apr. 2021.
H. Wu, Z. Zhang, S. Shi, Q. Wu, and H. Song, "Phrase dependency relational graph attention network for Aspect-based Sentiment Analysis," Knowledge-Based Systems, vol. 236, Jan. 2022, Art. no. 107736.
A. I. Saad, "Opinion Mining on US Airline Twitter Data Using Machine Learning Techniques," in 2020 16th International Computer Engineering Conference (ICENCO), Cairo, Egypt, Sep. 2020, pp. 59–63.
M. A. Ullah, S. M. Marium, S. A. Begum, and N. S. Dipa, "An algorithm and method for sentiment analysis using the text and emoticon," ICT Express, vol. 6, no. 4, pp. 357–360, Dec. 2020.
N. K. Gondhi, U. Chaahat, E. Sharma, A. H. Alharbi, R. Verma, and M. A. Shah, "Efficient Long Short-Term Memory-Based Sentiment Analysis of E-Commerce Reviews," Computational Intelligence and Neuroscience, vol. 2022, Jun. 2022, Art. no. e3464524.
J. S. Vimali and S. Murugan, "A Text Based Sentiment Analysis Model using Bi-directional LSTM Networks," in 2021 6th International Conference on Communication and Electronics Systems (ICCES), Coimbatre, India, Jul. 2021, pp. 1652–1658.
R. Hegde and S. Seema, "Nearest neighbour-based feature selection and classification approach for analysing sentiments," International Journal of Bioinformatics Research and Applications, vol. 18, no. 1–2, pp. 16–29, Jan. 2022.
K. Dhola and M. Saradva, "A Comparative Evaluation of Traditional Machine Learning and Deep Learning Classification Techniques for Sentiment Analysis," in 2021 11th International Conference on Cloud Computing, Data Science & Engineering (Confluence), Jan. 2021, pp. 932–936.
R. Vatambeti, S. V. Mantena, K. V. D. Kiran, M. Manohar, and C. Manjunath, "Twitter sentiment analysis on online food services based on elephant herd optimization with hybrid deep learning technique," Cluster Computing, Feb. 2023.
L. Wang, W. Guo, X. Yao, Y. Zhang, and J. Yang, "Multimodal Event-Aware Network for Sentiment Analysis in Tourism," IEEE MultiMedia, vol. 28, no. 2, pp. 49–58, Apr. 2021.
F. Huang, X. Zhang, Z. Zhao, J. Xu, and Z. Li, "Image–text sentiment analysis via deep multimodal attentive fusion," Knowledge-Based Systems, vol. 167, pp. 26–37, Mar. 2019.
J. Xu, Z. Li, F. Huang, C. Li, and P. S. Yu, "Social Image Sentiment Analysis by Exploiting Multimodal Content and Heterogeneous Relations," IEEE Transactions on Industrial Informatics, vol. 17, no. 4, pp. 2974–2982, Apr. 2021.
A. Banjar, Z. Ahmed, A. Daud, R. Abbasi, and H. Dawood, "Aspect-Based Sentiment Analysis for Polarity Estimation of Customer Reviews on Twitter," Computers, Materials & Continua, vol. 67, no. 2, pp. 2203–2225, 2021.
W. Li, S. Yin, and T. Pu, "Lexical attention and aspect-oriented graph convolutional networks for aspect-based sentiment analysis," Journal of Intelligent & Fuzzy Systems, vol. 42, no. 3, pp. 1643–1654, Jan. 2022.
R. Kora and A. Mohammed, "An enhanced approach for sentiment analysis based on meta-ensemble deep learning," Social Network Analysis and Mining, vol. 13, no. 1, Mar. 2023, Art. no. 38.
A. Nawaz, A. A. Awan, T. Ali, and M. R. R. Rana, "Product’s behaviour recommendations using free text: an aspect based sentiment analysis approach," Cluster Computing, vol. 23, no. 2, pp. 1267–1279, Jun. 2020.
R. Catelli, S. Pelosi, and M. Esposito, "Lexicon-Based vs. Bert-Based Sentiment Analysis: A Comparative Study in Italian," Electronics, vol. 11, no. 3, Jan. 2022, Art. no. 374.
C. D. Santos and B. Zadrozny, "Learning Character-level Representations for Part-of-Speech Tagging," in Proceedings of the 31st International Conference on Machine Learning, Beijing, China, Jun. 2014, pp. 1818–1826.
X. Wu, "A Dropout Optimization Algorithm to Prevent Overfitting in Machine Learning," Machine Learning Theory and Practice, vol. 4, no. 1, Mar. 2023.
H. Xia, Y. Yang, X. Pan, Z. Zhang, and W. An, "Sentiment analysis for online reviews using conditional random fields and support vector machines," Electronic Commerce Research, vol. 20, no. 2, pp. 343–360, Jun. 2020.
Z. Gao, Z. Li, J. Luo, and X. Li, "Short Text Aspect-Based Sentiment Analysis Based on CNN + BiGRU," Applied Sciences, vol. 12, no. 5, Jan. 2022, Art. no. 2707.
M. Hu and B. Liu, "Mining and summarizing customer reviews," in Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, Seattle, WA, USA, May 2004, pp. 168–177.
Md. H. Alam, W.-J. Ryu, and S. Lee, "Joint multi-grain topic sentiment: modeling semantic aspects for online reviews," Information Sciences, vol. 339, pp. 206–223, Apr. 2016.
A. L. Maas, R. E. Daly, P. T. Pham, D. Huang, A. Y. Ng, and C. Potts, "Learning word vectors for sentiment analysis," in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1, Portland, OR, USA, Mar. 2011, pp. 142–150.
Y. Sharma, G. Agrawal, P. Jain, and T. Kumar, "Vector representation of words for sentiment analysis using GloVe," in 2017 International Conference on Intelligent Communication and Computational Techniques (ICCT), Jaipur, India, Sep. 2017, pp. 279–284.
P. F. Muhammad, R. Kusumaningrum, and A. Wibowo, "Sentiment Analysis Using Word2vec And Long Short-Term Memory (LSTM) For Indonesian Hotel Reviews," Procedia Computer Science, vol. 179, pp. 728–735, Jan. 2021.
A. Zhao and Y. Yu, "Knowledge-enabled BERT for aspect-based sentiment analysis," Knowledge-Based Systems, vol. 227, Sep. 2021, Art. no. 107220.
H. Zhao, Z. Liu, X. Yao, and Q. Yang, "A machine learning-based sentiment analysis of online product reviews with a novel term weighting and feature selection approach," Information Processing & Management, vol. 58, no. 5, Sep. 2021, Art. no. 102656.
M. Rizwan et al., "Aspect-Based Sentiment Analysis for Social Multimedia: A Hybrid Computational Framework," Computer Systems Science and Engineering, vol. 46, no. 2, pp. 2415–2428, 2023.
J. Mutinda, W. Mwangi, and G. Okeyo, "Sentiment Analysis of Text Reviews Using Lexicon-Enhanced Bert Embedding (LeBERT) Model with Convolutional Neural Network," Applied Sciences, vol. 13, no. 3, Jan. 2023, Art. no. 1445.
Downloads
How to Cite
License
Copyright (c) 2023 Muhammad Rizwan Rashid Rana, Asif Nawaz, Tariq Ali, Ahmed M. El-Sherbeeny, Waqar Ali
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
