Transactions on Data Analysis in Social Science

Transactions on Data Analysis in Social Science

Human Activity Recognition Based on Deep Learning Using Sensor Data

Document Type : Original Article

Authors
1 Department of Education, District 2, Sari, Iran
2 Department of Electrical Engineering, Hadaf Higher Education Institute, Sari, Iran
Abstract
Human Activity Recognition (HAR) refers to the process of detecting, identifying, and classifying human activities from sensor data through the application of artificial intelligence techniques. Over the past few decades, HAR has emerged as a rapidly evolving research domain with significant implications in various fields, including video surveillance, identity authentication, smart home automation, healthcare monitoring, and human–computer interaction. In particular, within surveillance systems, timely and accurate recognition of human activities can serve as a preventive measure against incidents such as theft, vandalism, or other suspicious behaviors, thereby enhancing public safety. Among various AI-based approaches, deep learning models especially Convolutional Neural Networks (CNNs) have shown remarkable capabilities in automatically extracting high-level spatiotemporal features and achieving robust classification performance. However, CNN architectures often require extensive hyperparameter tuning to maximize their accuracy and efficiency. To address this challenge, the present study proposes an enhanced CNN model whose parameters are optimized using the Particle Swarm Optimization (PSO) algorithm. The PSO-driven optimization process aims to improve feature extraction quality, reduce overfitting, and enhance generalization capabilities. The proposed framework is implemented and experimentally evaluated on the Wiezmann dataset. Comparative analysis demonstrates that our approach achieves superior recognition accuracy and computational efficiency compared to several existing state-of-the-art methods.
Keywords

  • Shajari, S., Kuruvinashetti, K., Komeili, A., & Sundararaj, U. (2023). The emergence of AI-based wearable sensors for digital health technology: a review. Sensors, 23(23), 9498.https://doi.org/10.3390/s23239498
  • Alzubaidi, L., Zhang, J., Humaidi, A., Al-Dujaili, A., Duan, Y., Al-Shamma, O., … Farhan, L. (2021). Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions. Journal of Big Data, 8, Article 53. https://doi.org/10.1186/s40537-021-00444-8
  • Bulling, A., Blanke, U., & Schiele, B. (2014). A tutorial on human activity recognition using body-worn inertial sensors. ACM Computing Surveys, 46(3), Article 33, 33:1–33:33. https://doi.org/10.1145/2499621
  • Schuldt, C., Laptev, I., & Caputo, B. (2004). Recognizing human actions: A local SVM approach. In Proceedings of the 17th International Conference on Pattern Recognition (ICPR) (pp. 32–36). IEEE. https://doi.org/10.1109/ICPR.2004.1334462
  • Bott, O. J., Ammenwerth, E., Brigl, B., Knaup, P., Lang, E., Pilgram, R., & Kulikowski, C. (2005). The challenge of ubiquitous computing in health care: Technology, concepts and solutions. Methods of Information in Medicine, 44(3), 473–479. https://doi.org/10.1055/s-0038-1633996
  • Kumar, P., Chauhan, S., & Awasthi, L. (2023). Human activity recognition (HAR) using deep learning: Review, methodologies, progress and future research directions. Archives of Computational Methods in Engineering, 31, 179–219. https://doi.org/10.1007/s11831-023-09986-x
  • Ronao, C. A., & Cho, S.-B. (2016). Human activity recognition with smartphone sensors using deep learning neural networks. Expert Systems with Applications, 59, 235–244. https://doi.org/10.1016/j.eswa.2016.04.032
  • Ordóñez, F. J., & Roggen, D. (2016). Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors, 16(1), Article 115. https://doi.org/10.3390/s16010115
  • Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019). Deep learning for sensor-based activity recognition: A survey. Pattern Recognition Letters, 119, 3–11. https://doi.org/10.1016/j.patrec.2018.02.010
  • Shoaib, M., Bosch, S., Incel, O. D., Scholten, H., & Havinga, P. J. M. (2016). Complex human activity recognition using smartphone and wrist-worn motion sensors. Sensors, 16(4), Article 426. https://doi.org/10.3390/s16040426
  • Hassan, M. M., Uddin, M. Z., Mohamed, A., & Almogren, A. (2018). A robust human activity recognition system using smartphone sensors and deep learning. Future Generation Computer Systems, 81, 307–313. https://doi.org/10.1016/j.future.2017.11.029
  • Chen, C., Jafari, R., & Kehtarnavaz, N. (2017). A survey of depth and inertial sensor fusion for human action recognition. Multimedia Tools and Applications, 76(3), 4405–4425. https://doi.org/10.1007/s11042-015-3177-1
  • Ray, A., Kolekar, M. H., Balasubramanian, R., & Hafiane, A. (2023). Transfer learning enhanced vision-based human activity recognition: A decade-long analysis. International Journal of Information Management Data Insights, 3(1), Article 100142. https://doi.org/10.1016/j.jjimei.2022.100142
  • Dawar, N., & Kehtarnavaz, N. (2018, June). A convolutional neural network-based sensor fusion system for monitoring transition movements in healthcare applications. In 2018 IEEE 14th International Conference on Control and Automation (ICCA) (pp. 482–485). IEEE. https://doi.org/10.1109/ICCA.2018.8444326
  • Wang, H., Zhao, J., Li, J., Tian, L., Tu, P., Cao, T., … & Li, S. (2020). Wearable sensor-based human activity recognition using hybrid deep learning techniques. Security and Communication Networks, 2020, Article 2132138. https://doi.org/10.1155/2020/2132138
  • Lara, O. D., & Labrador, M. A. (2013). A survey on human activity recognition using wearable sensors. IEEE Communications Surveys & Tutorials, 15(3), 1192–1209. https://doi.org/10.1109/SURV.2012.110112.00192 TandfonlineSpace Frontiers
  • Xie, X.-F., Zhang, W.-J., & Yang, Z.-L. (2003). Overview of particle swarm optimization. Control and Decision, 18(2), 129–134.
  • Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., ... & Zheng, X. (2016). {TensorFlow}: a system for {Large-Scale} machine learning. In 12th USENIX symposium on operating systems design and implementation (OSDI 16), 265-283.
Volume 6, Issue 4
Autumn 2024
Pages 222-230

  • Receive Date 03 July 2024
  • Revise Date 20 September 2024
  • Accept Date 28 November 2024