Authorship Attribution for English Short Texts
Received: 4 July 2024 | Revised: 23 July 2024 | Accepted: 26 July 2024 | Online: 7 August 2024
Corresponding author: Tawfeeq Alsanoosy
Abstract
Internet and social media explosive growth has led to the rapid and widespread dissemination of information, which often takes place anonymously. This anonymity has fostered the rise of uncredited copying, posing a significant threat of copyright infringement and raising serious concerns in fields where verifying information's authenticity is paramount. Authorship Attribution (AA), a critical classification task within Natural Language Processing (NLP), aims to mitigate these concerns by identifying the original source of content. Although extensive research exists for longer texts, AA for short texts, namely informal texts like tweets, remains challenging due to the latter’s brevity and stylistic variation. Thus, this study aims to investigate and measure the performance of various Machine Learning (ML) and Deep Learning (DL) methods deployed for feature extraction from short text data, using tweets. The employed feature extraction methods were: Bag-of-Words (BoW), TF-IDF, n-grams, word-level, and character-level features. These methods were evaluated in conjunction with six ML classifiers, i.e. Naive Bayes (NB), Support Vector Machine (SVM), Decision Tree (DT), Logistic Regression (LR), K-Nearest Neighbors (KNN), and Random Forest (RF) along with two DL architectures, i.e. Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs). The highest accuracy achieved with an ML model was 92.34%, using an SVM with TF-IDF features. Even though the basic CNN DL model reached 88% accuracy, this outcome still surpassed the previously established baseline for this task. The findings of this research not only advance the technical capabilities of AA, but also extend its practical applications, providing tools that can be adapted across various domains to ensure proper attribution and expose copyright infringement.
Keywords:
natural language processing, authorship attribution, machine learning, deep learning, authorship identificationDownloads
References
S. Shao, C. Tunc, A. Al-Shawi, and S. Hariri, "An Ensemble of Ensembles Approach to Author Attribution for Internet Relay Chat Forensics," ACM Transactions on Management Information Systems, vol. 11, no. 4, Jul. 2020, Art. no. 24.
L. Chen, E. Gonzalez, and C. Nantermoz, "Authorship Attribution with Limited Text on Twitter," 2017, [Online]. Available: https://cs229.stanford.edu/proj2017/final-reports/5241953.pdf.
C. Grier, K. Thomas, V. Paxson, and M. Zhang, "@spam: the underground on 140 characters or less," in 17th ACM Conference on Computer and Communications Security, Chicago, IL, USA, Oct. 2010, pp. 27–37.
K. Lagutina and N. Lagutina, "A Survey of Models for Constructing Text Features to Classify Texts in Natural Language," in 29th Conference of Open Innovations Association, Tampere, Finland, Dec. 2021, pp. 222–233.
E. Aydogan and S. Sen, "Android Authorship Attribution Using Source Code-Based Features," IEEE Access, vol. 12, pp. 6569–6589, Jan. 2024.
A. Fedotova, A. Kurtukova, A. Romanov, and A. Shelupanov, "Semantic Clustering and Transfer Learning in Social Media Texts Authorship Attribution," IEEE Access, vol. 12, pp. 39783–39803, Jan. 2024.
W. Zheng and M. Jin, "A review on authorship attribution in text mining," WIREs Computational Statistics, vol. 15, no. 2, 2023, Art. no. e1584.
R. Azimov, "Analysis of the Use of Methods and Feature Groups for Author Recognition on the Example of Texts in the Azerbaijani Language," in 5th International Conference on Problems of Cybernetics and Informatics, Baku, Azerbaijan, Aug. 2023, pp. 1–4.
E. Ferracane, S. Wang, and R. Mooney, "Leveraging Discourse Information Effectively for Authorship Attribution," in Eighth International Joint Conference on Natural Language Processing, Taipei, Taiwan, Dec. 2017, pp. 584–593.
R. Hou and C.-R. Huang, "Robust stylometric analysis and author attribution based on tones and rimes," Natural Language Engineering, vol. 26, no. 1, pp. 49–71, Jan. 2020.
M. Kestemont et al., "Overview of the author identification task at PAN-2018: Cross-domain authorship attribution and style change detection," in Conference and Labs of the Evaluation Forum, Avignon, France, Sep. 2018, pp. 1–25.
M. Llorens and S. J. Delany, "Deep Level Lexical Features for Cross-lingual Authorship Attribution," in First Workshop on Modeling, Learning and Mining for Cross/Multilinguality, Padova, Italy, Mar. 2016.
S. Ruder, P. Ghaffari, and J. G. Breslin, "Character-level and Multi-channel Convolutional Neural Networks for Large-scale Authorship Attribution." arXiv, Sep. 21, 2016.
Y. Sari, A. Vlachos, and M. Stevenson, "Continuous N-gram Representations for Authorship Attribution," in 15th Conference of the European Chapter of the Association for Computational Linguistics, Valencia, Spain, Apr. 2017, pp. 267–273.
A. Sharma, A. Nandan, and R. Ralhan, "An Investigation of Supervised Learning Methods for Authorship Attribution in Short Hinglish Texts using Char & Word N-grams." arXiv, Dec. 26, 2018.
K. Y. Tai, J. Dhaliwal, and S. M. Shariff, "Online Social Networks and Writing Styles-A Review of the Multidisciplinary Literature," IEEE Access, vol. 8, pp. 67024–67046, Jan. 2020.
A. Pandey and A. Jain, "Detection of Compromised Accounts using Machine Learning Based Boosting Algorithms- AdaBoost, XGBoost, and CatBoost," in 14th International Conference on Computing Communication and Networking Technologies, Delhi, India, Jul. 2023, pp. 1–6.
C. Suman, A. Raj, S. Saha, and P. Bhattacharyya, "Authorship Attribution of Microtext Using Capsule Networks," IEEE Transactions on Computational Social Systems, vol. 9, no. 4, pp. 1038–1047, Dec. 2022.
M. Hajja, A. Yahya, and A. Yahya, "Authorship Attribution of Arabic Articles," in International Conference on Arabic Language Processing, Nancy, France, Oct. 2019, pp. 194–208.
S. H. H. Ding, B. C. M. Fung, F. Iqbal, and W. K. Cheung, "Learning Stylometric Representations for Authorship Analysis," IEEE Transactions on Cybernetics, vol. 49, no. 1, pp. 107–121, Jan. 2019.
O. Aborisade and M. Anwar, "Classification for Authorship of Tweets by Comparing Logistic Regression and Naive Bayes Classifiers," in International Conference on Information Reuse and Integration, Salt Lake City, UT, USA, Jul. 2018, pp. 269–276.
E. Dauber, R. Overdorf, and R. Greenstadt, "Stylometric Authorship Attribution of Collaborative Documents," in International Symposium on Cyber Security, Cryptology, and Machine Learning, Beer-Sheva, Israel, Jun. 2017, pp. 115–135.
M. Eder, "Short Samples in Authorship Attribution: A New Approach," in ADHO 2017, Montreal, Canada, 2017.
S. Minaee, N. Kalchbrenner, E. Cambria, N. Nikzad, M. Chenaghlu, and J. Gao, "Deep Learning--based Text Classification: A Comprehensive Review," ACM Computing Surveys, vol. 54, no. 3, Dec. 2021, Art. no. 62.
M. Sage, P. Cruciata, R. Abdo, J. C. K. Cheung, and Y. F. Zhao, "Investigating the influence of selected linguistic features on authorship attribution using German news articles," in 5th Swiss Text Analytics Conference (SwissText) & 16th Conference on Natural Language Processing (KONVENS), Zurich, Switzerland, Jun. 2020, pp. 1–6.
B. Alsulami, E. Dauber, R. Harang, S. Mancoridis, and R. Greenstadt, "Source Code Authorship Attribution Using Long Short-Term Memory Based Networks," in European Symposium on Research in Computer Security, Oslo, Norway, Sep. 2017, pp. 65–82.
N. Saha, P. Das, and H. N. Saha, "Authorship attribution of short texts using multi-layer perceptron," International Journal of Applied Pattern Recognition, vol. 5, no. 3, pp. 251–259, Jan. 2018.
Z. Hu, R. K.-W. Lee, L. Wang, E. Lim, and B. Dai, "DeepStyle: User Style Embedding for Authorship Attribution of Short Texts," in Asia-Pacific Web (APWeb) and Web-Age Information Management (WAIM) Joint International Conference on Web and Big Data, Tianjin, China, Aug. 2020, pp. 221–229.
R. Schwartz, O. Tsur, A. Rappoport, and M. Koppel, "Authorship attribution of micro-messages: 2013 Conference on Empirical Methods in Natural Language Processing, EMNLP 2013," in Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA, Oct. 2013, pp. 1880–1891.
A. Modupe, T. Celik, V. Marivate, and O. O. Olugbara, "Post-Authorship Attribution Using Regularized Deep Neural Network," Applied Sciences, vol. 12, no. 15, Jan. 2022, Art. no. 7518.
M. Joshi and N. Zincir-Heywood, "Classification of Micro-Texts Using Sub-Word Embeddings," in International Conference on Recent Advances in Natural Language Processing, Varna, Bulgaria, Sep. 2019, pp. 526–533.
X. Tang, S. Liang, and Z. Liu, "Authorship Attribution of The Golden Lotus Based on Text Classification Methods," in 3rd International Conference on Innovation in Artificial Intelligence, Suzhou, China, Mar. 2019, pp. 69–72.
W. Huang, R. Su, and M. Iwaihara, "Contribution of Improved Character Embedding and Latent Posting Styles to Authorship Attribution of Short Texts," in Asia-Pacific Web (APWeb) and Web-Age Information Management (WAIM) Joint International Conference on Web and Big Data, Tianjin, China, Aug. 2020, pp. 261–269.
S. Aykent and G. Dozier, "Author Identification of Micro-Messages via Multi-Channel Convolutional Neural Networks," in IEEE International Conference on Systems, Man, and Cybernetics, Toronto, ON, Canada, Oct. 2020, pp. 675–681.
P. Shrestha, S. Sierra, F. González, M. Montes, P. Rosso, and T. Solorio, "Convolutional Neural Networks for Authorship Attribution of Short Texts," in 15th Conference of the European Chapter of the Association for Computational Linguistics, Valencia, Spain, Apr. 2017, pp. 669–674.
F. Ullah, J. Wang, S. Jabbar, F. Al-Turjman, and M. Alazab, "Source Code Authorship Attribution Using Hybrid Approach of Program Dependence Graph and Deep Learning Model," IEEE Access, vol. 7, pp. 141987–141999, 2019.
A. Alqurafi and T. Alsanoosy, "Measuring Customers’ Satisfaction Using Sentiment Analysis: Model and Tool," Journal of Computer Science, vol. 20, no. 4, pp. 419–430, Feb. 2024.
A. Rabab’ah, M. Al-Ayyoub, Y. Jararweh, and M. Aldwairi, "Authorship attribution of Arabic tweets," in 13th International Conference of Computer Systems and Applications, Agadir, Morocco, Dec. 2016, pp. 1–6.
A. S. Hossain, N. Akter, and Md. S. Islam, "A Stylometric Approach for Author Attribution System Using Neural Network and Machine Learning Classifiers," in International Conference on Computing Advancements, Dhaka, Bangladesh, Jan. 2020, pp. 1–7.
H. A. Chowdhury, M. A. H. Imon, S. M. Hasnayeen, and M. S. Islam, "Authorship Attribution in Bengali Literature using Convolutional Neural Networks with fastText’s word embedding model," in 1st International Conference on Advances in Science, Engineering and Robotics Technology, Dhaka, Bangladesh, Dec. 2019, pp. 1–5.
M. Madhukar and S. Verma, "Hybrid Semantic Analysis of Tweets: A Case Study of Tweets on Girl-Child in India," Engineering, Technology & Applied Science Research, vol. 7, no. 5, pp. 2014–2016, Oct. 2017.
SaraML00, "Authorship-Attribution." [Online]. Available: https://github.com/SaraML00/authorship-attribution.git.
Downloads
How to Cite
License
Copyright (c) 2024 Tawfeeq Alsanoosy, Bodor Shalbi, Ayman Noor
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.