Human Activity Recognition through Smartphone Inertial Sensors with ML Approach
Received: 2 November 2023 | Revised: 27 November 2023 | Accepted: 29 November 2023 | Online: 8 February 2024
Corresponding author: Munid Alanazi
Abstract
Human Activity Recognition (HAR) has several applications in healthcare, security, and assisted living systems used in smart homes. The main aim of these applications or systems is to classify body movement read from the built in sensors such as accelerometers and gyroscopes. Some actions could be performed in response to the output of these HAR systems. The number of smartphone users increases, whereas the sensors are widely available in different sizes and shapes (internal or external sensors). Recent advances in sensor technology and machine learning have led researchers to conduct studies on sensor technology such as HAR. HAR systems typically use a combination of sensors, such as accelerometers, gyroscopes, and cameras, to collect images or signal data that can be classified by machine learning algorithms. HAR research has focused on several key challenges including dealing with variability in sensor data, handling missing data or noise, and dealing with large amounts of sensor-generated data. In this work, several machine learning algorithms were tested in predefined settings using the KU-HAR dataset in a series of experiments. Subsequently, various performance metrics were calculated to assess the chosen algorithms’ performance. The experimental findings showed that the LightGBM classifier surpassed the other machine learning algorithms in performance metrics, such as accuracy, F1 score, precision, and recall. Although Gradient Boosting has lengthy training time, the other classifiers complete their training in an acceptable time period.
Keywords:
accelerometer, gyroscope, machine learning, sensors, Human Activity Recognition (HAR)Downloads
References
"Smartphone users in the US 2009-2040," Statista. https://www.statista.com/statistics/201182/forecast-of-smartphone-users-in-the-us/.
N. Gupta and B. B. Agarwal, "Recognition of Suspicious Human Activity in Video Surveillance: A Review," Engineering, Technology & Applied Science Research, vol. 13, no. 2, pp. 10529–10534, Apr. 2023.
M. T. Jan et al., "Methods and Tools for Monitoring Driver’s Behavior," in International Conference on Computational Science and Computational Intelligence, Las Vegas, NV, USA, Dec. 2022, pp. 1269–1273.
C. Collette et al., "Review: Inertial Sensors for Low‐Frequency Seismic Vibration Measurement," Bulletin of the Seismological Society of America, vol. 102, no. 4, pp. 1289–1300, Aug. 2012.
A. Bayat, M. Pomplun, and D. A. Tran, "A Study on Human Activity Recognition Using Accelerometer Data from Smartphones," Procedia Computer Science, vol. 34, pp. 450–457, Jan. 2014.
M. M. Hassan, Md. Z. Uddin, A. Mohamed, and A. Almogren, "A robust human activity recognition system using smartphone sensors and deep learning," Future Generation Computer Systems, vol. 81, pp. 307–313, Apr. 2018.
N. Sikder and A.-A. Nahid, "KU-HAR: An open dataset for heterogeneous human activity recognition," Pattern Recognition Letters, vol. 146, pp. 46–54, Jun. 2021.
J. Reyes-Ortiz, D. Anguita, A. Ghio, L. Oneto, and X. Parra, "Human Activity Recognition Using Smartphones." UCI Machine Learning Repository, 2012.
D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-Ortiz, "A Public Domain Dataset for Human Activity Recognition Using Smartphones," in European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Brussels, Belgium, Apr. 2013, pp. 437–442.
J. R. Kwapisz, G. M. Weiss, and S. A. Moore, "Activity recognition using cell phone accelerometers," ACM SIGKDD Explorations Newsletter, vol. 12, no. 2, pp. 74–82, Nov. 2011.
K. Walse, R. Dharaskar, and V. M. Thakare, "A study of human activity recognition using adaboost classifiers on WISDM dataset," The Institute of Integrative Omics and Applied Biotechnology Journal, vol. 7, no. 2, pp. 68–76, Jan. 2016.
M. Zhang and A. A. Sawchuk, "USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors," in ACM Conference on Ubiquitous Computing, Pittsburgh, PA, USA, Sep. 2012, pp. 1036–1043.
W. Jiang and Z. Yin, "Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks," in 23rd ACM international conference on Multimedia, Brisbane, QLD, Australia, Oct. 2015, pp. 1307–1310.
E. Casilari, J. A. Santoyo-Ramon, and J. M. Cano-Garcia, "UMAFall: A Multisensor Dataset for the Research on Automatic Fall Detection," Procedia Computer Science, vol. 110, pp. 32–39, Jan. 2017.
M. Saleh, M. Abbas, and R. B. Le Jeannès, "FallAllD: An Open Dataset of Human Falls and Activities of Daily Living for Classical and Deep Learning Applications," IEEE Sensors Journal, vol. 21, no. 2, pp. 1849–1858, Jan. 2021.
L. Xu, W. Yang, Y. Cao, and Q. Li, "Human activity recognition based on random forests," in 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, Guilin, China, Jul. 2017, pp. 548–553.
D. Adeboye, "Human Activity Recognition in Wearables Using Random Forest Feature Selection to Improve Model Performance." Rochester, NY, USA, Oct. 25, 2022.
F. Hartwig and B. E. Dearing, Exploratory Data Analysis. Newcastle, UK: SAGE, 1979.
A. O. Ige and M. H. Mohd Noor, "A survey on unsupervised learning for wearable sensor-based activity recognition," Applied Soft Computing, vol. 127, Sep. 2022, Art. no. 109363.
E. Alalwany and I. Mahgoub, "Classification of Normal and Malicious Traffic Based on an Ensemble of Machine Learning for a Vehicle CAN-Network," Sensors, vol. 22, no. 23, Jan. 2022, Art. no. 9195.
J.-Y. Yang, J.-S. Wang, and Y.-P. Chen, "Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers," Pattern Recognition Letters, vol. 29, no. 16, pp. 2213–2220, Dec. 2008.
V. Miskovic and D. Babic, "Implementation of a Flexible Bayesian Classifier for the Assessment of Patient’s Activities within a Real-time Personalized Mobile Application," Engineering, Technology & Applied Science Research, vol. 7, no. 1, pp. 1405–1412, Feb. 2017.
A. S. Altaher et al., "Detection and localization of Goliath grouper using their low-frequency pulse sounds," The Journal of the Acoustical Society of America, vol. 153, no. 4, Apr. 2023, Art. no. 2190.
A. J. Abidalkareem, M. A. Abd, A. K. Ibrahim, H. Zhuang, A. S. Altaher, and A. Muhamed Ali, "Diabetic Retinopathy (DR) Severity Level Classification Using Multimodel Convolutional Neural Networks," in 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society, Montreal, QC, Canada, Jul. 2020, pp. 1404–1407.
S. O. Slim, A. Atia, M. M. A. Elfattah, and M.-S. M. Mostafa, "Survey on Human Activity Recognition based on Acceleration Data," International Journal of Advanced Computer Science and Applications, vol. 10, no. 3, pp. 84–98, Jan. 2019.
F. Pedregosa et al., "Scikit-learn: Machine Learning in Python," Journal of Machine Learning Research, vol. 12, pp. 2825–2830, Oct. 2011.
C. R. Harris et al., "Array programming with NumPy," Nature, vol. 585, no. 7825, pp. 357–362, Sep. 2020.
P. Virtanen et al., "SciPy 1.0: fundamental algorithms for scientific computing in Python," Nature Methods, vol. 17, no. 3, pp. 261–272, Mar. 2020.
W. McKinney, "Data Structures for Statistical Computing in Python," Proceedings of the 9th Python in Science Conference, pp. 56–61, 2010.
L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, "CatBoost: unbiased boosting with categorical features," in 32nd International Conference on Neural Information Processing Systems, Montreal, QC, Canada, Dec. 2018, pp. 6639–6649.
G. Ke et al., "LightGBM: A Highly Efficient Gradient Boosting Decision Tree," in 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA, Dec. 2017.
T. Chen and C. Guestrin, "XGBoost: A Scalable Tree Boosting System," in 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, Aug. 2016, pp. 785–794.
H. Cho and S. M. Yoon, "Divide and Conquer-Based 1D CNN Human Activity Recognition Using Test Data Sharpening," Sensors, vol. 18, no. 4, Apr. 2018, Art. no. 1055.
A. Altaher, Z. Salekshahrezaee, A. Abdollah Zadeh, H. Rafieipour, and A. Altaher, "Using Multi-inception CNN for Face Emotion Recognition," Journal of Bioengineering Research, vol. 3, no. 1, pp. 1–12, May 2021.
G. Biau and E. Scornet, "A random forest guided tour," TEST, vol. 25, no. 2, pp. 197–227, Jun. 2016.
Y. L. Ng, X. Jiang, Y. Zhang, S. B. Shin, and R. Ning, "Automated Activity Recognition with Gait Positions Using Machine Learning Algorithms," Engineering, Technology & Applied Science Research, vol. 9, no. 4, pp. 4554–4560, Aug. 2019.
P. Paul and T. George, "An effective approach for human activity recognition on smartphone," in International Conference on Engineering and Technology, Coimbatore, India, Mar. 2015, pp. 1–3.
M. Alsaidi, M. T. Jan, A. Altaher, H. Zhuang, and X. Zhu, "Tackling the class imbalanced dermoscopic image classification using data augmentation and GAN," Multimedia Tools and Applications, Oct. 2023.
E. Bisong, Building machine learning and deep learning models on Google Cloud Platform. New York, NY, USA: Springer, 2019.
L. Mason, J. Baxter, P. Bartlett, and M. Frean, "Boosting algorithms as gradient descent," in 12th International Conference on Neural Information Processing Systems, Cambridge, MA, USA, Dec. 1999, pp. 512–518.
R. Mitchell and E. Frank, "Accelerating the XGBoost algorithm using GPU computing," PeerJ Computer Science, vol. 3, Jul. 2017, Art. no. e127.
D. Wang, L. Li, and D. Zhao, "Corporate finance risk prediction based on LightGBM," Information Sciences, vol. 602, pp. 259–268, Jul. 2022.
Downloads
How to Cite
License
Copyright (c) 2023 Munid Alanazi, Raghdah Saem Aldahr, Mohammad Ilyas
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
