Generic placeholder image

Current Medical Imaging


ISSN (Print): 1573-4056
ISSN (Online): 1875-6603

Research Article

Machine Learning Applied to Datasets of Human Activity Recognition: Data Analysis in Health Care

Author(s): Ariza-Colpas Paola Patricia*, Vicario Enrico, Butt Aziz Shariq, Emiro De la Hoz Franco, Piñeres-Melo Marlon Alberto, Oviedo-Carrascal Ana Isabel, Muhammad Imran Tariq, Johanna Karina García Restrepo and Patara Fulvio

Volume 19, Issue 1, 2023

Published on: 20 May, 2022

Page: [46 - 64] Pages: 19

DOI: 10.2174/1573405618666220104114814


Background: In order to remain active and productive, older adults with poor health require a combination of advanced methods of visual monitoring, optimization, pattern recognition, and learning, which provide safe and comfortable environments and serve as a tool to facilitate the work of family members and workers, both at home and in geriatric homes. Therefore, there is a need to develop technologies to provide these adults autonomy in indoor environments.

Objective: This study aimed to generate a prediction model of daily living activities through classification techniques and selection of characteristics in order to contribute to the development in this area of knowledge, especially in the field of health. Moreover, the study aimed to accurately monitor the activities of the elderly or people with disabilities. Technological developments allow predictive analysis of daily life activities, contributing to the identification of patterns in advance in order to improve the quality of life of the elderly.

Methods: The vanKasteren, CASAS Kyoto, and CASAS Aruba datasets were used to validate a predictive model capable of supporting the identification of activities in indoor environments. These datasets have some variation in terms of occupation and the number of daily living activities to be identified.

Results: Twelve classifiers were implemented, among which the following stand out: Classification via Regression, OneR, Attribute Selected, J48, Random SubSpace, RandomForest, RandomCommittee, Bagging, Random Tree, JRip, LMT, and REP Tree. The classifiers that show better results when identifying daily life activities are analyzed in the light of precision and recall quality metrics. For this specific experimentation, the Classification via Regression and OneR classifiers obtain the best results.

Conclusion: The efficiency of the predictive model based on classification is concluded, showing the results of the two classifiers, i.e., Classification via Regression and OneR, with quality metrics higher than 90% even when the datasets vary in occupation and number of activities.

Keywords: HAR, smart environment, classification techniques, vanKasteren dataset, CASAS Kyoto, CASAS Aruba.

Graphical Abstract
Amiribesheli M, Benmansour A, Bouchachia A. A review of smart homes in healthcare. J Ambient Intell Humaniz Comput 2015; 6(4): 495-517.
Ding D, Sallis JF, Kerr J, Lee S, Rosenberg DE. Neighborhood environment and physical activity among youth a review. Am J Prev Med 2011; 41(4): 442-55.
[] [PMID: 21961474]
Hassan M, Hu W, Lan G, Seneviratne A, Khalifa S, Das S. Kinetic-powered health wearables: Challenges and opportunities. Computer 2018; 51(9): 64-74.
Cardoso H, Moreira J. Human activity recognition by means of online semi-supervised learning. Proceedings of the 17th IEEE International Conference on Mobile Data Management (MDM). 2016 Jun 13-16; Porto, Portugal.
Wang Z, Wu D, Gravina R, Fortino G, Jiang Y, Tang K. Kernel fusion based extreme learning machine for cross-location activity recognition. Inf Fusion 2017; 37(3): 1-9.
Islam A. Android application based smart home automation system using internet of things. In: Proceedings of the 3rd International Conference for Convergence in Technology (I2CT); 2018 Apr 6-8; Pune, India.
Jalal A, Kim Y, Kim Y, Kamal S, Kim D. Robust human activity recognition from depth video using spatiotemporal multi-fused features. Pattern Recognit 2017; 61(2): 295-308.
He H, Tan Y, Zhang W. A wavelet tensor fuzzy clustering scheme for multi-sensor human activity recognition. Eng Appl Artif Intell 2018; 70(1): 109-22.
Zhang J, Liu X, Wang LA, et al. Au-functionalized hematite hybrid nanospindles: General synthesis, gas sensing and catalytic properties. J Phys Chem C 2011; 115(13): 5352-7.
Cook DJ, Crandall AS, Thomas BL, Krishnan NC. CASAS: A smart home in a box. Computer 2013; 46(7): 62-9.
[] [PMID: 24415794]
Cook D. Learning setting-generalized activity models for smart spaces. IEEE Intell Syst 2012; 27(1): 32-8.
[] [PMID: 21461133]
Singla G, Cook DJ, Schmitter-Edgecombe M. Recognizing independent and joint activities among multiple residents in smart environments. J Ambient Intell Humaniz Comput 2010; 1(1): 57-63.
[] [PMID: 20975986]
Yang ZR. Machine learning approaches to bioinformatics. Singapore: World Scientific 2010.
Yuan G, Wang Z, Meng F, Yan Q, Xia S. An overview of human activity recognition based on smartphone. Sens Rev 2019; 39(2): 288-306.
Eskaf K, Aly W, Aly A. Aggregated activity recognition using smart devices. Proceedings of the 3rd International Conference on Soft Computing & Machine Intelligence (ISCMI). 2016 Nov 23-25; Dubai, United Arab Emirates.
Mongia A, Gunturi V, Naik V. Detecting activities at metro stations using smartphone sensors. Proceedings of the 10th International Conference on Communication Systems & Networks (COMSNETS). 2018 Jan 3-7; Bengaluru, India.
Raeiszadeh M, Tahayori H. A novel method for detecting and predicting resident’s behavior in smart home. Proceedings of the 6th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS). 2018 Feb 26 - 28; Kerman, Iran.
Schels M, Glodek M, Meudt SA, et al. Multi-modal classifier-fusion for the recognition of emotions.In: Rojc M, Campbell N, Eds Coverbal Synchrony in Human-Machine Interaction. Boca Raton: CRC Press 2013; pp. 73-98.
Groves P, Martin H, Voutsis K, Walter D, Wang L. Context detection, categorization, and connectivity for advanced adaptive integrated navigation. In: Proceedings of the 26th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2013); 2013 Sep 16-20; Tennessee, USA.
Sivalingam R, Cherian A, Fasching JA, et al. A multi-sensor visual tracking system for behavior monitoring of at-risk children. Proceedings of the 2012 IEEE International Conference on Robotics and Automation. 2012 May 14-18; Minnesota, USA.
Wang L, Xiong Y, Wang ZA, et al. Temporal segment networks: Towards good practices for deep action recognition. Proceedings of the European conference on computer vision. 2016 Oct 8-16; Amsterdam, Netherlands.
Ordóñez FJ, Roggen D. Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition. Sensors (Basel) 2016; 16(1): 115.
[] [PMID: 26797612]
Almaslukh B, AlMuhtadi J, Artoli A. An efective deep autoencoder approach for online smartphone-based human activity recognition. Int J Comput Sci Netw Secur 2017; 17(1): 160-5.
Hu D, Yang Q. CIGAR: Concurrent and Interleaving Goal and Activity Recognition. Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence. 2008 Jul 13-17; Chicago, USA.
Gallissot M, Caelen J, Bonnefond N, Meillon B, Pons S. Using the Multicom Domus Data 2011. Available from: (access August 30 2021).
Ha S, Choi S. Convolutional neural networks for human activity recognition using multiple accelerometer and gyroscope sensors. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN). 2016 Jul 24–29; Vancouver, Canada.
Alsheikh M, Selim A, Niyato D, Doyle L, Lin S, Tan H. Deep activity recognition models with triaxial accelerometers. Proceedings of the Workshops at the Thirtieth AAAI Conference on Artificial Intelligence. 2016 Feb 12-13; Phoenix, USA.
Zhang L, Wu X, Luo D. Recognizing human activities from raw accelerometer data using deep neural networks. Proceedings of the 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA). 2015 Dec 9–11; Miami, USA.
Zhang S, McCullagh P, Nugent C, Zheng H. Activity monitoring using a smart phone’s accelerometer with hierarchical classification. Proceedings of the 2010 Sixth International Conference on Intelligent Environments. 2010 Jul 19–21; Kuala Malaysia.
Jiang W, Yin Z. Human activity recognition using wearable sensors by deep convolutional neural networks. Proceedings of the 23rd ACM International Conference on Multimedia. 2015 Oct 26–30; Brisbane, Australia.
Frigui H, Krishnakumar R. A robust competitive clustering algorithm with applications in computer vision. IEEE Trans Pattern Anal Mach Intell 1999; 21(1): 450-65.
Ariza Colpas P, Vicario E, De-La-Hoz-Franco E, Pineres-Melo M, Oviedo-Carrascal A, Patara F. Unsupervised human activity recognition using the clustering approach: A review. Sensors (Basel) 2020; 20(9): 2702.
[] [PMID: 32397446]
Espinilla M, Martínez L, Medina J, Nugent C. The experience of developing theUJAmI Smart labIEEE Access 2018; 6(1): 34631-42.
Philipose M, Fishkin K, Perkowitz MA, et al. Inferring activities from interactions with objects. IEEE Pervasive Comput 2004; 3(1): 50-7.
Singla G, Cook D, Schmitter-Edgecombe M. Incorporating temporal reasoning into activity recognition for smart home residents. Proceedings of the AAAI Workshop on Spatial and Temporal Reasoning. 2008 Jul 13-14; Chicago, USA.
Mathie MJ, Coster AC, Lovell NH, Celler BG. Detection of daily physical activities using a triaxial accelerometer. Med Biol Eng Comput 2003; 41(3): 296-301.
[] [PMID: 12803294]
Bao L, Intille S. Activity recognition from user-annotated acceleration data. Proceedings of the International Conference on Pervasive Computing. 2004 Apr 21-23; Linz/Vienna, Austria.
Chambers G, Venkatesh S, West G, Bui H. Hierarchical recognition of intentional human gestures for sports video annotation. Proceedings of the Object Recognition Supported by User Interaction for Service Robots. 2002 Jun 26-29; Quebec, Canada.
Lester J, Choudhury T, Borriello G. A practical approach to recognizing physical activities. Proceedings of the 4th International Conference on Pervasive Computing. 2006 May 7-10; Dublin, Ireland.
Mantyjarvi J, Himberg J, Seppanen T. Recognizing human motion with multiple acceleration sensors. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. 2001 Oct 7–10; Tucson, USA.
Al-Ani T, Le Q, Monacelli E. On-line automatic detection of human activity in home using wavelet and hidden Markov models Scilab toolkits. Proceedings of the 2007 IEEE International Conference on Control Applications. 2007 Oct 1-3; Singapore.
Singla G, Cook DJ, Schmitter-Edgecombe M. Tracking activities in complex settings using smart environment technologies. Int J Biosci Psychiatr Technol IJBSPT 2009; 1(1): 25-35.
[PMID: 20019890]
Dernbach S, Das B, Krishnan N, Thomas B, Cook D. Simple and complex activity recognition through smart phones. Proceedings of the 2012 Eighth International Conference on Intelligent Environments. 2012 Jun 26-29; Guanajuato, Mexico.
Sahaf Y. Comparing Sensor Modalities for Activity Recognition 2011.
Cook D, Youngblood M, Das S. A multi-agent approach to controlling a smart environment. Designing Smart Homes 2006; 1(1): 165-82.
Fleury A, Noury N, Vacher M. Introducing knowledge in the process of supervised classification of activities of Daily Living in Health Smart Homes. In: Proceedings of the 12th IEEE International Conference on e-Health Networking, Applications and Services; Lyon, France.
McCallum A. A Comparison of Event Models for Naive Bayes Text Classification. Proceedings of the AAAI-98 Workshop on Learning for Text Categorization. 1998 Jul 26-27; Madinson, USA.
Domingos P, Pazzani M. On the optimality of the simple Bayesian classifier under zero-one loss. Mach Learn 1997; 29(2): 103-30.
Eddy S. Profile hidden Markov models. Academic Oup Com 1998; 144(9): 755-63.
Murata N, Yoshizawa S, Amari S. Network information criterion-determining the number of hidden units for an artificial neural network model. IEEE Trans Neural Netw 1994; 5(6): 865-72.
[] [PMID: 18267861]
Du W, Hu B. Approximate distribution reducts in inconsistent interval-valued ordered decision tables. Inf Sci 2014; 271(1): 93-114.
Chen W, Xie X, Wang JA, et al. A comparative study of logistic model tree, random forest, and classification and regression tree models for spatial prediction of landslide susceptibility. Catena 2017; 151(1): 147-60.
Quinlan R. C45: Programs for Machine Learning. Burlington: Morgan Kaufmann Publishers, Inc. 1993.
Landwehr N, Hall M, Frank E. Logistic model trees. Mach Learn 2005; 59(1): 161-205.
Breiman L. Prediction games and arcing algorithms. Neural Comput 1999; 11(7): 1493-517.
[] [PMID: 10490934]
Shah C. Supervised LearningA Hands-On Introduction to Data Science. (1st ed.), Cambridge, UK: Cambridge University Press 2020.
Nettleton D, Orriols A, Fornells A. A study of the effect of different types of noise on the precision of supervised learning techniques. Artif Intell Rev 2010; 33(4): 275-306.
Caruana R, Niculescu A. An empirical comparison of supervised learning algorithms. Proceedings of the 23rd International Conference on Machine Learning. 2006 Jun 25-29; Pittsburgh, USA.
Thakur D, Biswas S. Smartphone based human activity monitoring and recognition using ML and DL: A comprehensive survey. J Ambient Intell Humaniz Comput 2020; 1(1): 1-12.
Cook CA. Behaviometrics for identifying smart home residents. Atlantis Ambient and Pervasive Intelligence 2013; 8(1): 55-71.
Crandall A. Behaviometrics for multiple residents in a smart environment 2011.
Cook DJ, Crandall A, Singla G, Thomas B. Detection of social interaction in smart spaces. Cybern Syst 2010; 41(2): 90-104.
[] [PMID: 20953347]
Cook D. Health monitoring and assistance to support aging in place. J Univers Comput Sci 2006; 12(1): 15-29.
Seelye AM, Schmitter-Edgecombe M, Cook DJ, Crandall A. Naturalistic assessment of everyday activities and prompting technologies in mild cognitive impairment. J Int Neuropsychol Soc 2013; 19(4): 442-52.
[] [PMID: 23351284]
Wolden SL, Chen L, Kelly KM, et al. Long-term results of CCG 5942: A randomized comparison of chemotherapy with and without radiotherapy for children with Hodgkin’s lymphoma-a report from the children’s oncology group. J Clin Oncol 2012; 30(26): 3174-80.
[] [PMID: 22649136]
Hoey J, Pltz T, Jackson D, Monk A, Pham C, Olivier P. Rapid specification and automated generation of prompting systems to assist people with dementia. Pervasive Mobile Comput 2011; 7(3): 299-318.
Fahad L, Tahir S, Rajarajan M. Feature selection and data balancing for activity recognition in smart homes. Proceedings of the IEEE International Conference on Communications Workshops. 2015 Jun 8-12; London.
Fahad L, Tahir S, Rajarajan M. Activity recognition in smarthomes using clustering-based classification. Proceedings of the 22nd International Conference of Pattern Recognition. 2014 Aug 24-28; Stockholm, Sweden.
Arifoglu D, Bouchachia A. Activity recognition and abnormal behaviour detection with recurrent neural networks. Procedia Comput Sci 2017; 110(1): 86-93.
Chen G, Wang A, Zhao S, Liu L, Chang C. Latent feature learning for activity recognition using simple sensors in smart homes. Multimedia Tools Appl 2018; 77(1): 15201-19.
Van Kasteren T, Englebienne G, Kröse B. Activity recognition using semi-Markov models on real world smart home datasets. J Ambient Intell Smart Environ 2010; 2(3): 311-25.
Kabir M, Hoque M, Thapa K, Yang S. Two-layer hidden Markov model for human activity recognition in home environments. Int J Distrib Sens Netw 2016; 12(1): 4560365.
Fatima I, Fahim M, Lee Y, Lee S. Effects of smart home dataset characteristics on classifiers performance for human activity recognition. Computer Science and Its Applications 2012; 203(1): 271-81.
Ortega J, Han L, Whittacker N, Bowring N. A machinelearning based approach to model user occupancy and activity patterns for energy saving in buildings. Proceedings of the 2015 Science and Information Conference (SAI). 2015, Jul 28-30; London, United Kingdom.
Ghasemi V, Pouyan A. Activity recognition in smart homes using absolute temporal information in dynamic graphical models. Proceedings of the IEEE 2015 10th Asian Control Conference (ASCC); 2015 Jun 1-6; Kota Kinabalu, Malaysia.
Abidine M, Fergani B, Clavier L. Importance-weighted the imbalanced data for C-SVM classifier to human activity recognition. Proceedings of the 8th International Workshop System (WoSSPA). 2013 May 12-15; Zeralda, Algeria.
Abidine M, Fergani B. Evaluating a new classification method using PCA to human activity recognition. Proceedings of the 2013 International Conference on Computer Medical Applications (ICCMA). 2013 Jan 20-23; Sousse, Tunisia.
Ghasemi A, Pouyan A, Sharifi M. Human activity recognition in smart homes based on a difference of convex programming problem. KSII Trans Internet Inf Syst 2017; 11(1): 321-44.
Akter S, Holder L. Activity recognition using graphical features. Proceedings of the 13th International Conference on Machine Learning and Applications. 2014 Dec 3-6; Detroit, USA.
Shahi A, Woodford B, Lin H. Dynamic real-time segmentation and recognition of activities using a multi-feature windowing approach. Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining. 2017 May 23-26; Jeju, South Korea.
De Paola A, Ferraro P, Gaglio SA, et al. An ambient intelligence system for assisted living. Proceedings of the International Annual Conference of AEIT. 2017 Sep 20-22; Cagliari, Italy, USA.
Yala N, Fergani B, Fleury A. Feature extractionand incremental learning to improve activity recognition on streaming data. Proceedings of the 2015 IEEE Conference on Evolving and Adaptive Intelligent Systems (EAIS). 2015 Dec 1-3; Douai, France, USA.
Van Kasteren T, Noulas A, Englebienne G, Kröse B. Accurate activity recognition in a home setting. Proceedings of the 10th International Conference on Ubiquitous computing. 2008 Sep 21-24; Seoul, South Korea, USA. 1-9.
Cook DJ, Schmitter-Edgecombe M. Assessing the quality of activities in a smart environment. Methods Inf Med 2009; 48(5): 480-5.
[] [PMID: 19448886]
Fayyad U, Piatetsky-Shapiro G, Smyth P. From data mining to knowledge discovery in databases. AI Mag 1996; 17(3): 37-53.
Azevedo A. Data mining and knowledge discovery in databases.In: Khosrow-Pour M, Ed advanced methodologies and technologies in network architecture, mobile computing, and data analytics. Pennsylvania, USA 2019; pp. 502-14.
Catley C, Smith K, McGregor C, Tracy M. Extending CRISP-DM to incorporate temporal data mining of multidimensional medical data streams: A neonatal intensive care unit case study. Proceedings of the IEEE Symposium on Computer-Based Medical Systems. 2009 August 2-5; Albuquerque, USA.
Spruit M, Vroon R, Batenburg R. Towards healthcare business intelligence in long-term care: An explorative case study in the Netherlands. Comput Human Behav 2014; 30(1): 698-707.
Nuraeni F, Febriani N, Listiani L, Rahmawati E. Implementation of K-means algorithm with distance of euclidean proximity in clustering cases of violence against women and children. Proceedings of the 2019 1st international conference on cybernetics and intelligent system ICORIS. 2019 August 22 - 23; Denpasar, Indonesia, USA. 2019.

© 2023 Bentham Science Publishers | Privacy Policy