This is a preview and has not been published. View submission

A Skeleton-Based Movement Dataset for Autism Spectrum Disorder (ASD) Collected via an Augmented Reality Game

Authors

  • Iyas Qaddara Department of Computer Science, Faculty of Information Technology, Al-Ahliyya Amman University, Jordan | Department of Computer Science, King Abdullah II School of Information Technology, University of Jordan, Jordan
  • Mohammad O. Hiari Department of Networks and Cybersecurity, Faculty of Information Technology, Al-Ahliyya Amman University, Jordan
  • Talal. S. M. Haimur Department of Allied Science, Faculty of Arts and Science, Al-Ahliyya Amman University, Jordan
Volume: 16 | Issue: 3 | Pages: 35500-35508 | June 2026 | https://doi.org/10.48084/etasr.17815

Abstract

This study recorded movement data for children with Autism Spectrum Disorder (ASD) and Typically Developing (TD) children on a skeleton-based serious game based on Augmented Reality (AR). The dataset contains full-body skeletal motions in interactive and task-oriented activities, unlike current datasets that use passive observation or detection of a part of the body. The AR environment was characterized as arousing clinically relevant movements of the upper limbs, lower limbs, balance, and body rotation. A Microsoft Kinect v2 sensor was used to capture data, and a series of steps were taken to process them, namely cleaning, segmentation, spatial normalization, and temporal normalization to create fixed-length sequences. The data consist of equal recordings of the ASD and TD groups and can be used in Machine Learning (ML) studies. Random Forest and CNN-LSTM baseline experiments show that the dataset can be used to learn discriminative movement patterns. This dataset can lead to the evolution of movement-based autism analysis and AR-based behavioral data collection.

Keywords:

Autism Spectrum Disorder (ASD), skeleton-based movement analysis, augmented reality serious games, Machine Learning (ML)

References

M. Kangarani-Farahani, M. A. Malik, and J. G. Zwicker, "Motor Impairments in Children with Autism Spectrum Disorder: A Systematic Review and Meta-analysis," Journal of Autism and Developmental Disorders, vol. 54, no. 5, pp. 1977–1997, May 2024.

R. A. J. De Belen, T. Bednarz, A. Sowmya, and D. Del Favero, "Computer vision in autism spectrum disorder research: a systematic review of published studies from 2009 to 2019," Translational Psychiatry, vol. 10, no. 1, Sept. 2020, Art. no. 333.

B. Ren, M. Liu, R. Ding, and H. Liu, "A Survey on 3D Skeleton-Based Action Recognition Using Learning Method." arXiv, 2020.

M. V. Toma, C. E. Turcu, C. O. Turcu, S. Vlad, D. E. Tiliute, and P. Pascu, "Extended Reality–Based Mobile App Solutions for the Therapy of Children With Autism Spectrum Disorders: Systematic Literature Review," JMIR Serious Games, vol. 12, Feb. 2024, Art. no. e49906.

T. Barami et al., "Automated Analysis of Stereotypical Movements in Videos of Children With Autism Spectrum Disorder," JAMA Network Open, vol. 7, no. 9, Sept. 2024, Art. no. e2432851.

E. Billing et al., "The DREAM Dataset: Supporting a data-driven study of autism spectrum disorder and robot enhanced therapy," PLOS ONE, vol. 15, no. 8, Aug. 2020, Art. no. e0236939.

J. Li et al., "MMASD: A Multimodal Dataset for Autism Intervention Analysis." arXiv, 2023.

A. A. ِAl-Jubouri, I. Hadi, and Y. Rajihy, "Three dimensional dataset combining gait and full body movement of children with autism spectrum disorders collected by Kinect v2 camera." Dryad, Sept. 11, 2020.

A. A. Al-Jubouri, I. H. Ali, and Y. Rajihy, "Gait and Full Body Movement Dataset of Autistic Children Classified by Rough Set Classifier," Journal of Physics: Conference Series, vol. 1818, no. 1, Mar. 2021, Art. no. 012201.

N. K. Zakaria, N. M. Tahir, and R. Jailani, "A Markerless-based Gait Analysis and Visualization Approach for ASD Children," International Journal of Advanced Computer Science and Applications, vol. 12, no. 5, 2021.

M. Alanazi, R. S. Aldahr, and M. Ilyas, "Human Activity Recognition through Smartphone Inertial Sensors with ML Approach," Engineering, Technology & Applied Science Research, vol. 14, no. 1, pp. 12780–12787, Feb. 2024.

M. Hiari, Y. Alraba’nah, and I. Qaddara, "A Deep Learning-Based Intrusion Detection System using Refined LSTM for DoS Attack Detection," Engineering, Technology & Applied Science Research, vol. 15, no. 4, pp. 25627–25633, Aug. 2025.

H. A. Hatim, Z. A. A. Alyasseri, and N. Jamil, "A recent advances on autism spectrum disorders in diagnosing based on machine learning and deep learning," Artificial Intelligence Review, vol. 58, no. 10, July 2025, Art. no. 313.

I. Qaddara and Y. Alraba’nah, "Enhancing Requirements Classification Using Machine Learning Techniques," SN Computer Science, vol. 6, no. 6, July 2025, Art. no. 649.

Downloads

How to Cite

[1]
I. Qaddara, M. O. Hiari, and T. S. M. Haimur, “A Skeleton-Based Movement Dataset for Autism Spectrum Disorder (ASD) Collected via an Augmented Reality Game”, Eng. Technol. Appl. Sci. Res., vol. 16, no. 3, pp. 35500–35508, Jun. 2026.

Metrics

Abstract Views: 8
PDF Downloads: 3

Metrics Information