Hyper-tuned Swarm Intelligence Machine Learning-based Sentiment Analysis of Social Media
Received: 13 May 2024 | Revised: 25 May 2024 | Accepted: 29 May 2024 | Online: 8 June 2024
Corresponding author: Nitesh Sureja
Abstract
Natural Language Processing (NLP) uses Sentiment Analysis (SA) to determine text sentiment. SA is often used on text datasets to assess consumer demands, the sentiment of the customer for a product, and brand monitoring. Deep Learning (DL) is a subset of Machine Learning (ML) that mimics how humans learn. In this work, the Deep Learning Reptile Search Algorithm (SA-DLRSA) model is introduced for accurate automatic SA. The SA-DLRSA model utilizes Word2Vec word embedding to reduce language processing that is dependent on data pre-processing. The SA-DLRSA model utilizes SVM, CNN, RNN, BiLSTM, and BERT models for sentiment classification. Choosing the optimal hyperparameters is crucial for determining the model's architecture, functionality, performance, and accuracy. The Reptile Search Algorithm (RSA) is employed to find the best optimal hyperparameters to improve classification. A derived balanced dataset based on the tweets related to bitcoins was employed as a training dataset, which contains three sentiments, namely "neutral", "positive", and negative". The collection has 7 columns and 50058 rows, consisting of 21938 neutral, 22937 positive, and 5183 negative tweets. Precision, accuracy, recall, and F1 Score metrics were used to evaluate the effectiveness of the proposed approach. The results showed that the BERT and BiLSTM classifiers achieved superior performance in classifying sentiments in the tweets achieving accuracies of 99% and 98%, respectively. Due to the promising results of the proposed approach, it is anticipated to be used in solutions to social media problems, such as hate speech detection and emotion detection.
Keywords:
machine learning, natural language processing, sentiment analysis, reptile search algorithmDownloads
References
C. A. Iglesias and A. Moreno, "Sentiment Analysis for Social Media," Applied Sciences, vol. 9, no. 23, Jan. 2019, Art. no. 5037.
Q. Tul et al., "Sentiment Analysis Using Deep Learning Techniques: A Review," International Journal of Advanced Computer Science and Applications, vol. 8, no. 6, pp. 424–433, 2017.
D. Li, R. Rzepka, M. Ptaszynski, and K. Araki, "HEMOS: A novel deep learning-based fine-grained humor detecting method for sentiment analysis of social media," Information Processing & Management, vol. 57, no. 6, Nov. 2020, Art. no. 102290.
M. Sinan et al., "Analysis of the mathematical model of cutaneous Leishmaniasis disease," Alexandria Engineering Journal, vol. 72, pp. 117–134, Jun. 2023.
P. Savci and B. Das, "Prediction of the customers’ interests using sentiment analysis in e-commerce data for comparison of Arabic, English, and Turkish languages," Journal of King Saud University - Computer and Information Sciences, vol. 35, no. 3, pp. 227–237, Mar. 2023.
M. Rodriguez-Ibanez, A. Casanez-Ventura, F. Castejon-Mateos, and P.-M. Cuenca-Jimenez, "A review on sentiment analysis from social media platforms," Expert Systems with Applications, vol. 223, Aug. 2023, Art. no. 119862.
L. Bryan-Smith, J. Godsall, F. George, K. Egode, N. Dethlefs, and D. Parsons, "Real-time social media sentiment analysis for rapid impact assessment of floods," Computers & Geosciences, vol. 178, Sep. 2023, Art. no. 105405.
M. Alam, F. Abid, C. Guangpei, and L. V. Yunrong, "Social media sentiment analysis through parallel dilated convolutional neural network for smart city applications," Computer Communications, vol. 154, pp. 129–137, Mar. 2020.
I. Priyadarshini and C. Cotton, "A novel LSTM–CNN–grid search-based deep neural network for sentiment analysis," The Journal of Supercomputing, vol. 77, no. 12, pp. 13911–13932, Dec. 2021.
A. R. Pathak, M. Pandey, and S. Rautaray, "Topic-level sentiment analysis of social media data using deep learning," Applied Soft Computing, vol. 108, Sep. 2021, Art. no. 107440.
Y.-Y. Cheng, Y.-M. Chen, W.-C. Yeh, and Y.-C. Chang, "Valence and Arousal-Infused Bi-Directional LSTM for Sentiment Analysis of Government Social Media Management," Applied Sciences, vol. 11, no. 2, Jan. 2021, Art. no. 880.
A. Alsayat, "Improving Sentiment Analysis for Social Media Applications Using an Ensemble Deep Learning Language Model," Arabian Journal for Science and Engineering, vol. 47, no. 2, pp. 2499–2511, Feb. 2022.
P. K. Jain, W. Quamer, V. Saravanan, and R. Pamula, "Employing BERT-DCNN with sentic knowledge base for social media sentiment analysis," Journal of Ambient Intelligence and Humanized Computing, vol. 14, no. 8, pp. 10417–10429, Aug. 2023.
Z. Jin, X. Zhao, and Y. Liu, "Heterogeneous Graph Network Embedding for Sentiment Analysis on Social Media," Cognitive Computation, vol. 13, no. 1, pp. 81–95, Jan. 2021.
A. H. Ombabi, W. Ouarda, and A. M. Alimi, "Deep learning CNN–LSTM framework for Arabic sentiment analysis using textual information shared in social networks," Social Network Analysis and Mining, vol. 10, no. 1, Jul. 2020, Art. no. 53.
M. M. Abdelgwad, T. H. A. Soliman, and A. I. Taloba, "Arabic aspect sentiment polarity classification using BERT," Journal of Big Data, vol. 9, no. 1, Dec. 2022, Art. no. 115.
M. M.Abdelgwad, T. H. A Soliman, A. I.Taloba, and M. F. Farghaly, "Arabic aspect based sentiment analysis using bidirectional GRU based models," Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 9, pp. 6652–6662, Oct. 2022.
W. Alkaberi and F. Assiri, "Predicting the Number of Software Faults using Deep Learning," Engineering, Technology & Applied Science Research, vol. 14, no. 2, pp. 13222–13231, Apr. 2024.
M. Alruily, "Sentiment analysis for predicting stress among workers and classification utilizing CNN: Unveiling the mechanism," Alexandria Engineering Journal, vol. 81, pp. 360–370, Oct. 2023.
J. Sangeetha and U. Kumaran, "Sentiment analysis of amazon user reviews using a hybrid approach," Measurement: Sensors, vol. 27, Jun. 2023, Art. no. 100790.
U. B. Mahadevaswamy and P. Swathi, "Sentiment Analysis using Bidirectional LSTM Network," Procedia Computer Science, vol. 218, pp. 45–56, Jan. 2023.
M. Ahmad, S. Aftab, M. Salman, and N. Hameed, "Sentiment Analysis using SVM: A Systematic Literature Review," International Journal of Advanced Computer Science and Applications, vol. 9, no. 2, pp. 182–188, Jan. 2018.
H. Batra, N. S. Punn, S. K. Sonbhadra, and S. Agarwal, "BERT-Based Sentiment Analysis: A Software Engineering Perspective," in 32nd International Conference on Database and Expert Systems Applications, Sep. 2021, pp. 138–148.
S. Bano and S. Khalid, "BERT-based Extractive Text Summarization of Scholarly Articles: A Novel Architecture," in International Conference on Artificial Intelligence of Things, Istanbul, Turkey, Dec. 2022, pp. 1–5.
S. Bano, S. Khalid, N. M. Tairan, H. Shah, and H. A. Khattak, "Summarization of scholarly articles using BERT and BiGRU: Deep learning-based extractive approach," Journal of King Saud University - Computer and Information Sciences, vol. 35, no. 9, Oct. 2023, Art. no. 101739.
L. Abualigah, M. A. Elaziz, P. Sumari, Z. W. Geem, and A. H. Gandomi, "Reptile Search Algorithm (RSA): A nature-inspired meta-heuristic optimizer," Expert Systems with Applications, vol. 191, Apr. 2022, Art. no. 116158.
S. Khalid and S. Wu, "Supporting Scholarly Search by Query Expansion and Citation Analysis," Engineering, Technology & Applied Science Research, vol. 10, no. 4, pp. 6102–6108, Aug. 2020.
S. Khalid, S. Khusro, I. Ullah, and G. Dawson-Amoah, "On The Current State of Scholarly Retrieval Systems," Engineering, Technology & Applied Science Research, vol. 9, no. 1, pp. 3863–3870, Feb. 2019.
M. K. Khan, M. H. Zafar, S. Rashid, M. Mansoor, S. K. R. Moosavi, and F. Sanfilippo, "Improved Reptile Search Optimization Algorithm: Application on Regression and Classification Problems," Applied Sciences, vol. 13, no. 2, Jan. 2023, Art. no. 945.
H. Alsolai, L. Alsolai, F. N. Al-Wesabi, M. Othman, M. Rizwanullah, and A. A. Abdelmageed, "Automated sign language detection and classification using reptile search algorithm with hybrid deep learning," Heliyon, vol. 10, no. 1, Jan. 2024, Art. no. e23252.
M. Maashi et al., "Modeling of Reptile Search Algorithm With Deep Learning Approach for Copy Move Image Forgery Detection," IEEE Access, vol. 11, pp. 87297–87304, 2023.
Z. Elgamal, A. Q. M. Sabri, M. Tubishat, D. Tbaishat, S. N. Makhadmeh, and O. A. Alomari, "Improved Reptile Search Optimization Algorithm using Chaotic map and Simulated Annealing for Feature Selection in Medical Filed," IEEE Access, vol. 10, pp. 51428–51446, Jan. 2022.
S. Khalid, S. Wu, and F. Zhang, "A multi-objective approach to determining the usefulness of papers in academic search," Data Technologies and Applications, vol. 55, no. 5, pp. 734–748, Jan. 2021.
Suran, "Bitcoin Tweets." kaggle, [Online]. Available: https://www.kaggle.com/datasets/skularat/bitcoin-tweets.
F. Gulsen, "Bitcoin Sentiment Analysis." kaggle, [Online]. Available: https://kaggle.com/code/codeblogger/bitcoin-sentiment-analysis.
Downloads
How to Cite
License
Copyright (c) 2024 Nitesh Sureja, Nandini Chaudhari, Priyanka Patel, Jalpa Bhatt, Tushar Desai, Vruti Parikh
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
