A Children's Psychological and Mental Health Detection Model by Drawing Analysis based on Computer Vision and Deep Learning
Received: 12 May 2024 | Revised: 31 May 2024 | Accepted: 4 June 2024 | Online: 12 June 2024
Corresponding author: Amal Alshahrani
Abstract
Nowadays, children face different changes and challenges from an early age, which can have long-lasting impacts on them. Many children struggle to express or explain their feelings and thoughts properly. Due to that fact, psychological and mental health specialists found a way to detect mental issues by observing and analyzing different signs in children’s drawings. Yet, this process remains complex and time-consuming. This study proposes a solution by employing artificial intelligence to analyze children’s drawings and provide diagnosis rates with high accuracy. While prior research has focused on detecting psychological and mental issues through questionnaires, only one study has explored analyzing emotions in children's drawings by detecting positive and negative feelings. A notable gap is the limited diagnosis of specific mental issues, along with the promising accuracy of the detection results. In this study, different versions of YOLO were trained on a dataset of 500 drawings, split into 80% for training, 10% for validation, and 10% for testing. Each drawing was annotated with one or more emotional labels: happy, sad, anxiety, anger, and aggression. YOLOv8-cls, YOLOv9, and ResNet50 were used for object detection and classification, achieving accuracies of 94%, 95.1%, and 70.3%, respectively. YOLOv9 and ResNet50 results were obtained at high epoch numbers with large model sizes of 5.26 MB and 94.3 MB. YOLOv8-cls achieved the most satisfying result, reaching a high accuracy of 94% after 10 epochs with a compact model size of 2.83 MB, effectively meeting the study's goals.
Keywords:
Psychology, Mental health, Drawings, CNN, Artificial Intelligence, YOLO, Deep Learning, Computer VisionDownloads
References
M. Lee, Y. Kim, and Y.-K. Kim, "Generating psychological analysis tables for children’s drawings using deep learning," Data & Knowledge Engineering, vol. 149, Jan. 2024, Art. no. 102266.
N. Ali, A. Abd-Alrazaq, Z. Shah, M. Alajlani, T. Alam, and M. Househ, "Artificial Intelligence-Based Mobile Application for Sensing Children Emotion Through Drawings," in Advances in Informatics, Management and Technology in Healthcare, IOS Press, 2022, pp. 118–121.
Y. Yuan, J. Huang, X. Ma, and K. Yan, "Children’s Drawing Psychological Analysis using Shallow Convolutional Neural Network," in 2020 International Conferences on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics (Cybermatics), Rhodes, Greece, Nov. 2020, pp. 692–698.
M. O. Zeeshan, I. Siddiqi, and M. Moetesum, "Two-Step Fine-Tuned Convolutional Neural Networks for Multi-label Classification of Children’s Drawings," in Document Analysis and Recognition – ICDAR 2021, 2021, pp. 321–334.
S. Tutun et al., "An AI-based Decision Support System for Predicting Mental Health Disorders," Information Systems Frontiers, vol. 25, no. 3, pp. 1261–1276, Jun. 2023.
M. Srividya, S. Mohanavalli, and N. Bhalaji, "Behavioral Modeling for Mental Health using Machine Learning Algorithms, " Journal of Medical Systems, vol. 42, no. 5, Apr, 2018.
H. Lin and J. Yang, "Ensemble cross-stage partial attention network for image classification, " IET Image Processing, vol. 16, Jan, 2022.
R. Taleti, "YOLO: You Only Look Once," Towards Data Science, Aug. 02, 2020. https://towardsdatascience.com/yolo-you-only-look-once-f05c054a06b4.
P. Jiang, D. Ergu, F. Liu, Y. Cai, and B. Ma, "A Review of Yolo Algorithm Developments," Procedia Computer Science, vol. 199, pp. 1066-1073, 2022.
R. Rajamohanan and B. C. Latha, "An Optimized YOLO v5 Model for Tomato Leaf Disease Classification with Field Dataset," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12033–12038, Dec. 2023.
B. Xiao, M. Nguyen, W. Qi Yan, "Fruit ripeness identification using YOLOv8 model," Multimedia Tools and Applications, vol. 83, no. 9, pp. 28039–28056, Feb. 2023.
F. Shamrulismawi, "Sketch Recognition based on Deep Learning for Children’s Psychological Development Monitoring," B.Sc. thesis, Universiti Teknologi PETRONAS, Seri Iskandar, Malaysia, 2021.
M. Almatrafi, "anamelClassification Image Dataset." [Online]. Available: https://universe.roboflow.com/anamel/anamelclassification/dataset/1.
A. T. Dang, "Accuracy and Loss: Things to Know about The Top 1 and Top 5 Accuracy," Medium, Jan. 07, 2021. https://towardsdatascience.com/accuracy-and-loss-things-to-know-about-the-top-1-and-top-5-accuracy-1d6beb8f6df3.
T. Saidani, R. Ghodhbani, A. Alhomoud, A. Alshammari, H. Zayani, and M. B. Ammar, "Hardware Acceleration for Object Detection using YOLOv5 Deep Learning Algorithm on Xilinx Zynq FPGA Platform," Engineering, Technology & Applied Science Research, vol. 14, no. 1, pp. 13066–13071, Feb. 2024.
E. K. Ronoh, S. Mirau, and M. A. Dida, "Human-Wildlife Conflict Early Warning System Using the Internet of Things and Short Message Service," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8273–8277, Apr. 2022.
Downloads
How to Cite
License
Copyright (c) 2024 Amal Alshahrani, Manar Mohammed Almatrafi, Jenan Ibrahim Mustafa, Layan Saad Albaqami, Raneem Abdulrahman Aljabri
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
