Human Activity Recognition through Smartphone Inertial Sensors with ML Approach

Authors

  • Munid Alanazi Department of Electrical Engineering and Computer Science, Florida Atlantic University, USA | Department of Business Informatics, College of Business, King Khalid University, Saudi Arabia
  • Raghdah Saem Aldahr Department of Electrical Engineering and Computer Science, Florida Atlantic University, USA | Department of Computer Science, Taibah University, Saudi Arabia
  • Mohammad Ilyas Department of Electrical Engineering and Computer Science, Florida Atlantic University, USA
Volume: 14 | Issue: 1 | Pages: 12780-12787 | February 2024 | https://doi.org/10.48084/etasr.6586

Abstract

Human Activity Recognition (HAR) has several applications in healthcare, security, and assisted living systems used in smart homes. The main aim of these applications or systems is to classify body movement read from the built in sensors such as accelerometers and gyroscopes. Some actions could be performed in response to the output of these HAR systems. The number of smartphone users increases, whereas the sensors are widely available in different sizes and shapes (internal or external sensors). Recent advances in sensor technology and machine learning have led researchers to conduct studies on sensor technology such as HAR. HAR systems typically use a combination of sensors, such as accelerometers, gyroscopes, and cameras, to collect images or signal data that can be classified by machine learning algorithms. HAR research has focused on several key challenges including dealing with variability in sensor data, handling missing data or noise, and dealing with large amounts of sensor-generated data. In this work, several machine learning algorithms were tested in predefined settings using the KU-HAR dataset in a series of experiments. Subsequently, various performance metrics were calculated to assess the chosen algorithms’ performance. The experimental findings showed that the LightGBM classifier surpassed the other machine learning algorithms in performance metrics, such as accuracy, F1 score, precision, and recall. Although Gradient Boosting has lengthy training time, the other classifiers complete their training in an acceptable time period.

Keywords:

accelerometer, gyroscope, machine learning, sensors, Human Activity Recognition (HAR)

Downloads

Download data is not yet available.

References

"Smartphone users in the US 2009-2040," Statista. https://www.statista.com/statistics/201182/forecast-of-smartphone-users-in-the-us/.

N. Gupta and B. B. Agarwal, "Recognition of Suspicious Human Activity in Video Surveillance: A Review," Engineering, Technology & Applied Science Research, vol. 13, no. 2, pp. 10529–10534, Apr. 2023.

M. T. Jan et al., "Methods and Tools for Monitoring Driver’s Behavior," in International Conference on Computational Science and Computational Intelligence, Las Vegas, NV, USA, Dec. 2022, pp. 1269–1273.

C. Collette et al., "Review: Inertial Sensors for Low‐Frequency Seismic Vibration Measurement," Bulletin of the Seismological Society of America, vol. 102, no. 4, pp. 1289–1300, Aug. 2012.

A. Bayat, M. Pomplun, and D. A. Tran, "A Study on Human Activity Recognition Using Accelerometer Data from Smartphones," Procedia Computer Science, vol. 34, pp. 450–457, Jan. 2014.

M. M. Hassan, Md. Z. Uddin, A. Mohamed, and A. Almogren, "A robust human activity recognition system using smartphone sensors and deep learning," Future Generation Computer Systems, vol. 81, pp. 307–313, Apr. 2018.

N. Sikder and A.-A. Nahid, "KU-HAR: An open dataset for heterogeneous human activity recognition," Pattern Recognition Letters, vol. 146, pp. 46–54, Jun. 2021.

J. Reyes-Ortiz, D. Anguita, A. Ghio, L. Oneto, and X. Parra, "Human Activity Recognition Using Smartphones." UCI Machine Learning Repository, 2012.

D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-Ortiz, "A Public Domain Dataset for Human Activity Recognition Using Smartphones," in European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Brussels, Belgium, Apr. 2013, pp. 437–442.

J. R. Kwapisz, G. M. Weiss, and S. A. Moore, "Activity recognition using cell phone accelerometers," ACM SIGKDD Explorations Newsletter, vol. 12, no. 2, pp. 74–82, Nov. 2011.

K. Walse, R. Dharaskar, and V. M. Thakare, "A study of human activity recognition using adaboost classifiers on WISDM dataset," The Institute of Integrative Omics and Applied Biotechnology Journal, vol. 7, no. 2, pp. 68–76, Jan. 2016.

M. Zhang and A. A. Sawchuk, "USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors," in ACM Conference on Ubiquitous Computing, Pittsburgh, PA, USA, Sep. 2012, pp. 1036–1043.

W. Jiang and Z. Yin, "Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks," in 23rd ACM international conference on Multimedia, Brisbane, QLD, Australia, Oct. 2015, pp. 1307–1310.

E. Casilari, J. A. Santoyo-Ramon, and J. M. Cano-Garcia, "UMAFall: A Multisensor Dataset for the Research on Automatic Fall Detection," Procedia Computer Science, vol. 110, pp. 32–39, Jan. 2017.

M. Saleh, M. Abbas, and R. B. Le Jeannès, "FallAllD: An Open Dataset of Human Falls and Activities of Daily Living for Classical and Deep Learning Applications," IEEE Sensors Journal, vol. 21, no. 2, pp. 1849–1858, Jan. 2021.

L. Xu, W. Yang, Y. Cao, and Q. Li, "Human activity recognition based on random forests," in 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, Guilin, China, Jul. 2017, pp. 548–553.

D. Adeboye, "Human Activity Recognition in Wearables Using Random Forest Feature Selection to Improve Model Performance." Rochester, NY, USA, Oct. 25, 2022.

F. Hartwig and B. E. Dearing, Exploratory Data Analysis. Newcastle, UK: SAGE, 1979.

A. O. Ige and M. H. Mohd Noor, "A survey on unsupervised learning for wearable sensor-based activity recognition," Applied Soft Computing, vol. 127, Sep. 2022, Art. no. 109363.

E. Alalwany and I. Mahgoub, "Classification of Normal and Malicious Traffic Based on an Ensemble of Machine Learning for a Vehicle CAN-Network," Sensors, vol. 22, no. 23, Jan. 2022, Art. no. 9195.

J.-Y. Yang, J.-S. Wang, and Y.-P. Chen, "Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers," Pattern Recognition Letters, vol. 29, no. 16, pp. 2213–2220, Dec. 2008.

V. Miskovic and D. Babic, "Implementation of a Flexible Bayesian Classifier for the Assessment of Patient’s Activities within a Real-time Personalized Mobile Application," Engineering, Technology & Applied Science Research, vol. 7, no. 1, pp. 1405–1412, Feb. 2017.

A. S. Altaher et al., "Detection and localization of Goliath grouper using their low-frequency pulse sounds," The Journal of the Acoustical Society of America, vol. 153, no. 4, Apr. 2023, Art. no. 2190.

A. J. Abidalkareem, M. A. Abd, A. K. Ibrahim, H. Zhuang, A. S. Altaher, and A. Muhamed Ali, "Diabetic Retinopathy (DR) Severity Level Classification Using Multimodel Convolutional Neural Networks," in 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society, Montreal, QC, Canada, Jul. 2020, pp. 1404–1407.

S. O. Slim, A. Atia, M. M. A. Elfattah, and M.-S. M. Mostafa, "Survey on Human Activity Recognition based on Acceleration Data," International Journal of Advanced Computer Science and Applications, vol. 10, no. 3, pp. 84–98, Jan. 2019.

F. Pedregosa et al., "Scikit-learn: Machine Learning in Python," Journal of Machine Learning Research, vol. 12, pp. 2825–2830, Oct. 2011.

C. R. Harris et al., "Array programming with NumPy," Nature, vol. 585, no. 7825, pp. 357–362, Sep. 2020.

P. Virtanen et al., "SciPy 1.0: fundamental algorithms for scientific computing in Python," Nature Methods, vol. 17, no. 3, pp. 261–272, Mar. 2020.

W. McKinney, "Data Structures for Statistical Computing in Python," Proceedings of the 9th Python in Science Conference, pp. 56–61, 2010.

L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, "CatBoost: unbiased boosting with categorical features," in 32nd International Conference on Neural Information Processing Systems, Montreal, QC, Canada, Dec. 2018, pp. 6639–6649.

G. Ke et al., "LightGBM: A Highly Efficient Gradient Boosting Decision Tree," in 31st Conference on Neural Information Processing Systems, Long Beach, CA, USA, Dec. 2017.

T. Chen and C. Guestrin, "XGBoost: A Scalable Tree Boosting System," in 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, Aug. 2016, pp. 785–794.

H. Cho and S. M. Yoon, "Divide and Conquer-Based 1D CNN Human Activity Recognition Using Test Data Sharpening," Sensors, vol. 18, no. 4, Apr. 2018, Art. no. 1055.

A. Altaher, Z. Salekshahrezaee, A. Abdollah Zadeh, H. Rafieipour, and A. Altaher, "Using Multi-inception CNN for Face Emotion Recognition," Journal of Bioengineering Research, vol. 3, no. 1, pp. 1–12, May 2021.

G. Biau and E. Scornet, "A random forest guided tour," TEST, vol. 25, no. 2, pp. 197–227, Jun. 2016.

Y. L. Ng, X. Jiang, Y. Zhang, S. B. Shin, and R. Ning, "Automated Activity Recognition with Gait Positions Using Machine Learning Algorithms," Engineering, Technology & Applied Science Research, vol. 9, no. 4, pp. 4554–4560, Aug. 2019.

P. Paul and T. George, "An effective approach for human activity recognition on smartphone," in International Conference on Engineering and Technology, Coimbatore, India, Mar. 2015, pp. 1–3.

M. Alsaidi, M. T. Jan, A. Altaher, H. Zhuang, and X. Zhu, "Tackling the class imbalanced dermoscopic image classification using data augmentation and GAN," Multimedia Tools and Applications, Oct. 2023.

E. Bisong, Building machine learning and deep learning models on Google Cloud Platform. New York, NY, USA: Springer, 2019.

L. Mason, J. Baxter, P. Bartlett, and M. Frean, "Boosting algorithms as gradient descent," in 12th International Conference on Neural Information Processing Systems, Cambridge, MA, USA, Dec. 1999, pp. 512–518.

R. Mitchell and E. Frank, "Accelerating the XGBoost algorithm using GPU computing," PeerJ Computer Science, vol. 3, Jul. 2017, Art. no. e127.

D. Wang, L. Li, and D. Zhao, "Corporate finance risk prediction based on LightGBM," Information Sciences, vol. 602, pp. 259–268, Jul. 2022.

Downloads

How to Cite

[1]
M. Alanazi, R. S. Aldahr, and M. Ilyas, “Human Activity Recognition through Smartphone Inertial Sensors with ML Approach”, Eng. Technol. Appl. Sci. Res., vol. 14, no. 1, pp. 12780–12787, Feb. 2024.

Metrics

Abstract Views: 55
PDF Downloads: 48

Metrics Information