JBiSE  Vol.14 No.4 , April 2021
Design and Evaluation of a Vision-Based UI for People with Large Cognitive-Motor Disabilities
Recovering from multiple traumatic brain injury (TBI) is a very difficult task, depending on the severity of the lesions, the affected parts of the brain and the level of damage (locomotor, cognitive or sensory). Although there are some software platforms to help these patients to recover part of the lost capacity, the variety of existing lesions and the different degree to which they affect the patient, do not allow the generalization of the appropriate treatments and tools in each case. The aim of this work is to design and evaluate a machine vision-based UI (User Interface) allowing patients with a high level of injury to interact with a computer. This UI will be a tool for the therapy they follow and a way to communicate with their environment. The interface provides a set of specific activities, developed in collaboration with the multidisciplinary team that is currently evaluating each patient, to be used as a part of the therapy they receive. The system has been successfully tested with two patients whose degree of disability prevents them from using other types of platforms.
Cite this paper: Martínez, S. , Peñalver, A. and Sáez, J. (2021) Design and Evaluation of a Vision-Based UI for People with Large Cognitive-Motor Disabilities. Journal of Biomedical Science and Engineering, 14, 185-201. doi: 10.4236/jbise.2021.144016.

[1]   Castao, J. (2002) Plasticidad neuronal y las bases científicas de la neurohabilitación. Revista de Neurología, 34, 130-135.

[2]   Christensen, A.L. and Uzell, B.P. (1999) International Handbook of Neuropsychological Rehabilitation. Springer Science + Business Media, New York.

[3]   Sitplus Project.

[4]   Navarro, F.J., Navarro, E. and Montero, F. (2012) HABITAT: Una herramienta para el soporte de actividades interactivas tiles en el tratamiento del daño cerebral. Proceedings of XIII Interacción 2012, Elche, 3-5 October 2012, 139-146. .

[5]   Instituto Guttmann (2011) Universidad Autónoma de Barcelona. PREVIRNEC.

[6]   Rehacom Project.

[7]   Neuron. Up 2012.

[8]   Computer Science Canada University of Victoria (2001).

[9]   Bonneville, E., Muzio, J.C. and Serra, M. (2000) Usability Issues in Software to Assist People with Brain Injuries. 6th ERCIM Workshop “User Interfaces for All”, Florence, 25-26 October 2000.

[10]   Zhou, H. and Hu, H. (2007) Human Motion Tracking for Rehabilitation: A Survey. Biomedical Signal Processing and Control, 3, 1-18.

[11]   Zhou, H., Hu, H. and Harris, N. (2005) Application of Wearable Inertial Sensors in Stroke Rehabilitation. Engineering in Medicine and Biology Society, EMBS, 27th Annual International Conference, Shanghai, 1-4 September 2005, 6825-6828.

[12]   Zhou, H., Hu, H., Stone, T. and Harris, N. (2007) Use of Multiple Wearable Inertial Sensors in Upper Limb Motion Tracking. Medical Engineering & Physics, 30, 123-133.

[13]   Ayoade, M., Morton, L. and Baillie, L. (2011) Investigating the Feasibility of a Wireless Motion Capture System to Aid in the Rehabilitation of Total Knee Replacement Patients. Pervasive Computing Technologies for Healthcare (PervasiveHealth), 5th International Conference, Dublin, 23-26 May 2011, 404-407.

[14]   Gay, V., Leijdekkers, P. and Barin, E. (2009) A Mobile Rehabilitation Application for the Remote Monitoring of Cardiac Patients after a Heart Attack or a Coronary Bypass Surgery. Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments, Corfu, 9-13 June 2009, 2-4.

[15]   Salminen, J., Koskinen, E., Kirkeby, O. and Korhonen, I. (2009) A Home-Based Care Model for Outpatient Cardiac Rehabilitation Based on Mobile Technologies. 3rd International Conference on Pervasive Computing Technologies for Healthcare, PervasiveHealth 2009, London, 1-3 April 2009, 1-8.

[16]   Ruiz-Zafra, A., Noguera, M., Benghazi, K., Garrido, J.L. and Cuberos, G. (2013) CloudRehab: Plataforma para la TeleRehabilitación de Pacientes con Daño Cerebral. Proceedings of XIV Interacción 2013, Madrid, 17-20 September 2013. 35-38.

[17]   Okuyama, K., Kawasaki, T. and Kroumov, V.I. (2011) Localization and Position Correction for Mobile Robot Using Artificial Visual Landmarks. Advanced Mechatronic Systems (ICAMechS), 2011 International Conference, Zhengzhou, 11-13 August 2011, 455-461.

[18]   Guo, Y. and Xu, X. (2006) Color Landmark Design for Mobile Robot Localization. IMACS Multiconference on Computational Engineering in Systems Applications, Beijing, 4-6 October 2006, 1868-1874.

[19]   Zhang, X., Fronz, S. and Navab, N. (2002) Visual Marker Detection and Decoding in AR Systems: A Comparative Study. International Symposium on Mixed and Augmented Reality, Darmstadt, 30 September-1 October 2002, 97-106.

[20]   Wang, T., Liu, Y. and Wang, Y. (2008) Infrared Marker Based Augmented Reality System for Equipment Maintenance. 2008 International Conference on Computer Science and Software Engineering, Volume 5, 816-819.

[21]   Lai, C.H. and Yu, C.C. (2010) An Efficient Real-Time Traffic Sign Recognition System for Intelligent Vehicles with Smart Phones. 2010 International Conference on Technologies and Applications of Artificial Intelligence (TAAI), Hsinchu, 18-20 November 2010, 195-202.

[22]   Coughlan, J., Manduchi, R. and Shen, H. (2006) Cell Phone-Based Wayfinding for the Visually Impaired. 1st International Workshop on Mobile Vision, Volume 1.

[23]   Comaniciu, D. and Meer, P. (2002) Mean Shift: A Robust Approach toward Feature Space Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 603-619.