On the use of natural user interfaces in physical rehabilitation: a web-based application for patients with hip prosthesis
Main Article Content
Abstract
This study aims to develop a telemedicine platform for self-motor rehabilitation and remote monitoring by health professionals, in order to enhance recovery in patients after hip replacement. The implementation of such a technology is justified by medical (improvement of the recovery process by the possibility to perform rehabilitation exercises more frequently), economic (reduction of the number of medical appointments and the time patients spend at the hospital), mobility (diminution of the transportation to and from the hospital) and ethics (healthcare democratization and increased empowerment of the patient) purposes. The Kinect camera is used as a Natural User Interface to capture the physical exercises performed at home by the patients. The quality of the movement is evaluated in real-time by an assessment module implemented according to a Hidden-Markov Model approach. The results show a high accuracy in the evaluation of the movements (92% of correct classification). Finally, the usability of the platform is tested through the System Usability Scale (SUS). The overall SUS score is 81 out of 100, which suggests a good usability of the Web application. Further work will focus on the development of additional functionalities and an evaluation of the impact of the platform on the recovery process.
Downloads
References
Antón, D., Go-i, A., & Illarramendi, A. (2015). Exercise recognition for Kinect-based telerehabilitation. Methods of Information in Medicine, (54), 145-155.
Brook, G., Barry, G., Jackson, D., Mhiripiri, D., Olivier, P., & Rochester, L. (2014). Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. Gait & Posture, (39), 1062-1068.
Brooke, J. (1996). SUS – A quick and dirty usability scale. Usability Evaluation in Industry. London: Taylor & Francis, pp. 189-194.
Carrasco, G., Rybarczyk, Y., Cardoso, T., & Martins, I.P. (2013). A serious game for multimodal training of physician novices. Proceedings of the 6th International Conference of Education, Research and Innovation. Seville, Spain.
Coelho, T., De Oliveira, R., Cardoso, T., Rosas, J., & Rybarczyk, Y. (2014). Body ownership of virtual avatars: an affordance approach of telepresence. Innovative and Creative Development in Multimodal Interaction Systems. Heidelberg: Springer, pp. 3-19. https://doi.org/10.1007/978-3-642-55143-7_1
Gameiro, J., Cardoso, T., & Rybarczyk, Y. (2014). Kinect-Sign: teaching sign language to listeners through a game. Innovative and Creative Development in Multimodal Interaction Systems. Heidelberg: Springer, pp. 141-159. https://doi.org/10.1007/978-3-642-55143-7_6
Heiberg, K., & Figved, W. (2016). Physical functioning and prediction of physical activity after total hip arthroplasty: Five-year follow up of a randomized controlled trial. Arthritis Care & Research, (68), 454-462. https://doi.org/10.1002/acr.22679
Holden, M.K., Dyar, T.A., & Dayan-Cimadoro, L. (2007). Telerehabilitation using a virtual environment improves upper extremity function in patients with stroke. IEEE Transactions on Neural Systems and Rehabilitation Engineering, (15), 36-42. https://doi.org/10.1109/TNSRE.2007.891388
Jäppinen, A.M., Hämäläinen, H., Kettunen, T., & Piirainen, A. (2016). Postoperative patient education in physiotherapy after hip arthroplasty: Patients' perspective. Musculoskeletal Care. https://doi.org/10.1002/msc.1153
Jogi, P., Zecevic, A., Overend, T., Spaulding, S., & Kramer, J. (2016). Force-plate analyses of balance following a balance exercise program during acute post-operative phase in individuals with total hip and knee arthroplasty: a randomized clinical trial. SAGE Open Medicine, (4), 1-9. https://doi.org/10.1177/2050312116675097
Kleine Deters, J., & Rybarczyk, Y. (2018). Hidden Markov Model approach for the assessment of tele-rehabilitation exercises. International Journal of Artificial Intelligence, (16), 1-19.
Mahapatra, A., Tusar, K.M., Pankaj, K.S., & Banshidhar, M. (2014). Human recognition system for outdoor videos using Hidden Markov Model. International Journal of Electronics and Communications, (68), 227-236. https://doi.org/10.1016/j.aeue.2013.08.011
Ni, S., Jiang, W., Guo, L., Jin, Y., Jiang, T., Zhao, Y., & Zhao, J. (2015). Cryotherapy on postoperative rehabilitation of joint arthroplasty. Knee Surgery, Sports Traumatology, Arthroscopy, (23), 3354-3361. https://doi.org/10.1007/s00167-014-3135-x
Papadopoulos, G.T., Axenopoulos, A., & Daras, P. (2014). Real-time skeleton-tracking-based human action recognition using Kinect data. Lecture Notes in Computer Science: MultiMedia Modeling, (8325). Heidelberg: Springer. https://doi.org/10.1007/978-3-319-04114-8_40
Peter, W., Nelissen, R., & Vlieland, T. (2014). Guideline recommendations for post-acute postoperative physiotherapy in total hip and knee arthroplasty: are they used in daily clinical practice? Musculoskeletal Care, (12), 125-131. https://doi.org/10.1002/msc.1067
Plantard, P., Shum, H., Le Pierres, A.S., & Multon, F. (2016). Validation of an ergonomic assessment method using Kinect data in real workplace conditions. Applied Ergonomics, (65), 562-569.
Rybarczyk, Y., Kleine Deters, J., Cointe, C., & Esparza, D. (2018). Smart Web-based platform to support physical rehabilitation. Sensors, (18), 1344. https://doi.org/10.3390/s18051344
Rybarczyk, Y., & Gonçalves, M.J. (2016). WebLisling: a web-based therapeutic platform for the rehabilitation of aphasic patients. IEEE Latin America Transactions, (14), 3921-3927. https://doi.org/10.1109/TLA.2016.7786381
Rybarczyk, Y., & Vernay, D. (2016). Educative therapeutic tool to promote the empowerment of disabled people. IEEE Latin America Transactions, (14), 3410-3417. https://doi.org/10.1109/TLA.2016.7587649
Sauro, J. (2011). A Practical Guide to the System Usability Scale: Background, Benchmarks and Practices. Denver: CreateSpace.
Schega, L., Bertram, D., Fölsch, C., Hamacher, D., & Hamacher, D. (2014). The influence of visual feedback on the mental representation of gait in patients with THR: a new approach for an experimental rehabilitation strategy. Applied Psychophysiology and Biofeedback, (39), 37-43. https://doi.org/10.1007/s10484-014-9239-8
Tsukagoshi, R., Tateuchi, H., Fukumoto, Y., Ibuki, S., Akiyama, H., So, K., Kuroda, Y., Okumura, H., & Ichihashi, N. (2014). Functional performance of female patients more than 6 months after total hip arthroplasty shows greater improvement with weight-bearing exercise than with non-weight-bearing exercise. Randomized controlled trial. European Journal of Physical and Rehabilitation Medicine, (50), 665-675.