Supervised Classification of Motor-Rehabilitation Body Movements with RGB Cameras and Pose Tracking Data

The technological evolution allowed the use of a single camera for precise and effective body tracking, reducing the cost and increasing the accessibility of applications in places where depth cameras and wearable sensors are not available. This paper describes and implements a supervised machine le...

ver descrição completa

Detalhes bibliográficos
Autores: Rodrigues, Luis Guilherme Silva, Dias, Diego Roberto Colombo, de Paiva Guimarães, Marcelo, Brandão, Alexandre Fonseca, Rocha, Leonardo C., Iope, Rogério Luiz, Brega, José Remo Ferreira
Formato: artículo
Estado:Versión publicada
Fecha de publicación:2022
País:Brasil
Recursos:Sociedade Brasileira de Computação (SBC)
Repositorio:Journal on Interactive Systems
Idioma:inglés
OAI Identifier:oai:journals-sol.sbc.org.br:article/2409
Acesso em linha:https://journals-sol.sbc.org.br/index.php/jis/article/view/2409
Access Level:acceso abierto
Palavra-chave:Classification
Computer Vision
Machine Learning
Pose Tracking
Supervised Learning
Motor-rehabilitation
Descrição
Resumo:The technological evolution allowed the use of a single camera for precise and effective body tracking, reducing the cost and increasing the accessibility of applications in places where depth cameras and wearable sensors are not available. This paper describes and implements a supervised machine learning process consisting of a mobile application used as a motion capture device which also transforms the data into an input for a machine learning model that classifies upper and lower limbs movements (24 types of human movements). The user performs movements in front of the camera, and the trained model classifies them. We designed the system to work in a motor-rehabilitation context to assist the professional while the patient does physical exercises. The implementation can summarize the movements made during the rehabilitation sessions by counting the repetitions and classifying them when done completely or reached a specific range of motion.