A Children's Psychological and Mental Health Detection Model by Drawing Analysis based on Computer Vision and Deep Learning

Authors

  • Amal Alshahrani College of Computing, Umm Al-Qura University, Saudi Arabia
  • Manar Mohammed Almatrafi College of Computing, Umm Al-Qura University, Saudi Arabia
  • Jenan Ibrahim Mustafa College of Computing, Umm Al-Qura University, Saudi Arabia
  • Layan Saad Albaqami College of Computing, Umm Al-Qura University, Saudi Arabia
  • Raneem Abdulrahman Aljabri College of Computing, Umm Al-Qura University, Saudi Arabia
Volume: 14 | Issue: 4 | Pages: 15533-15540 | August 2024 | https://doi.org/10.48084/etasr.7812

Abstract

Nowadays, children face different changes and challenges from an early age, which can have long-lasting impacts on them. Many children struggle to express or explain their feelings and thoughts properly. Due to that fact, psychological and mental health specialists found a way to detect mental issues by observing and analyzing different signs in children’s drawings. Yet, this process remains complex and time-consuming. This study proposes a solution by employing artificial intelligence to analyze children’s drawings and provide diagnosis rates with high accuracy. While prior research has focused on detecting psychological and mental issues through questionnaires, only one study has explored analyzing emotions in children's drawings by detecting positive and negative feelings. A notable gap is the limited diagnosis of specific mental issues, along with the promising accuracy of the detection results. In this study, different versions of YOLO were trained on a dataset of 500 drawings, split into 80% for training, 10% for validation, and 10% for testing. Each drawing was annotated with one or more emotional labels: happy, sad, anxiety, anger, and aggression. YOLOv8-cls, YOLOv9, and ResNet50 were used for object detection and classification, achieving accuracies of 94%, 95.1%, and 70.3%, respectively. YOLOv9 and ResNet50 results were obtained at high epoch numbers with large model sizes of 5.26 MB and 94.3 MB. YOLOv8-cls achieved the most satisfying result, reaching a high accuracy of 94% after 10 epochs with a compact model size of 2.83 MB, effectively meeting the study's goals.

Keywords:

Psychology, Mental health, Drawings, CNN, Artificial Intelligence, YOLO, Deep Learning, Computer Vision

Downloads

Download data is not yet available.

References

M. Lee, Y. Kim, and Y.-K. Kim, "Generating psychological analysis tables for children’s drawings using deep learning," Data & Knowledge Engineering, vol. 149, Jan. 2024, Art. no. 102266.

N. Ali, A. Abd-Alrazaq, Z. Shah, M. Alajlani, T. Alam, and M. Househ, "Artificial Intelligence-Based Mobile Application for Sensing Children Emotion Through Drawings," in Advances in Informatics, Management and Technology in Healthcare, IOS Press, 2022, pp. 118–121.

Y. Yuan, J. Huang, X. Ma, and K. Yan, "Children’s Drawing Psychological Analysis using Shallow Convolutional Neural Network," in 2020 International Conferences on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics (Cybermatics), Rhodes, Greece, Nov. 2020, pp. 692–698.

M. O. Zeeshan, I. Siddiqi, and M. Moetesum, "Two-Step Fine-Tuned Convolutional Neural Networks for Multi-label Classification of Children’s Drawings," in Document Analysis and Recognition – ICDAR 2021, 2021, pp. 321–334.

S. Tutun et al., "An AI-based Decision Support System for Predicting Mental Health Disorders," Information Systems Frontiers, vol. 25, no. 3, pp. 1261–1276, Jun. 2023.

M. Srividya, S. Mohanavalli, and N. Bhalaji, "Behavioral Modeling for Mental Health using Machine Learning Algorithms, " Journal of Medical Systems, vol. 42, no. 5, Apr, 2018.

H. Lin and J. Yang, "Ensemble cross-stage partial attention network for image classification, " IET Image Processing, vol. 16, Jan, 2022.

R. Taleti, "YOLO: You Only Look Once," Towards Data Science, Aug. 02, 2020. https://towardsdatascience.com/yolo-you-only-look-once-f05c054a06b4.

P. Jiang, D. Ergu, F. Liu, Y. Cai, and B. Ma, "A Review of Yolo Algorithm Developments," Procedia Computer Science, vol. 199, pp. 1066-1073, 2022.

R. Rajamohanan and B. C. Latha, "An Optimized YOLO v5 Model for Tomato Leaf Disease Classification with Field Dataset," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12033–12038, Dec. 2023.

B. Xiao, M. Nguyen, W. Qi Yan, "Fruit ripeness identification using YOLOv8 model," Multimedia Tools and Applications, vol. 83, no. 9, pp. 28039–28056, Feb. 2023.

F. Shamrulismawi, "Sketch Recognition based on Deep Learning for Children’s Psychological Development Monitoring," B.Sc. thesis, Universiti Teknologi PETRONAS, Seri Iskandar, Malaysia, 2021.

M. Almatrafi, "anamelClassification Image Dataset." [Online]. Available: https://universe.roboflow.com/anamel/anamelclassification/dataset/1.

A. T. Dang, "Accuracy and Loss: Things to Know about The Top 1 and Top 5 Accuracy," Medium, Jan. 07, 2021. https://towardsdatascience.com/accuracy-and-loss-things-to-know-about-the-top-1-and-top-5-accuracy-1d6beb8f6df3.

T. Saidani, R. Ghodhbani, A. Alhomoud, A. Alshammari, H. Zayani, and M. B. Ammar, "Hardware Acceleration for Object Detection using YOLOv5 Deep Learning Algorithm on Xilinx Zynq FPGA Platform," Engineering, Technology & Applied Science Research, vol. 14, no. 1, pp. 13066–13071, Feb. 2024.

E. K. Ronoh, S. Mirau, and M. A. Dida, "Human-Wildlife Conflict Early Warning System Using the Internet of Things and Short Message Service," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8273–8277, Apr. 2022.

Downloads

How to Cite

[1]
Alshahrani, A., Almatrafi, M.M., Mustafa, J.I., Albaqami, L.S. and Aljabri, R. A. 2024. A Children’s Psychological and Mental Health Detection Model by Drawing Analysis based on Computer Vision and Deep Learning. Engineering, Technology & Applied Science Research. 14, 4 (Aug. 2024), 15533–15540. DOI:https://doi.org/10.48084/etasr.7812.

Metrics

Abstract Views: 561
PDF Downloads: 661

Metrics Information

Most read articles by the same author(s)