ENG  Vol.12 No.2 , February 2020
Human Skeleton Detection, Modeling and Gesture Imitation Learning for a Social Purpose
Abstract: Gesture recognition is topical in computer science and aims at interpreting human gestures via mathematical algorithms. Among the numerous applications are physical rehabilitation and imitation games. In this work, we suggest performing human gesture recognition within the context of a serious imitation game, which would aim at improving social interactions with teenagers with autism spectrum disorders. We use an artificial intelligence algorithm to detect the skeleton of the participant, then model the human pose space and describe an imitation learning method using a Gaussian Mixture Model in the Riemannian manifold.
Cite this paper: Vallée, L. , Nguyen, S. , Lohr, C. , Kanellos, I. and Asseu, O. (2020) Human Skeleton Detection, Modeling and Gesture Imitation Learning for a Social Purpose. Engineering, 12, 90-98. doi: 10.4236/eng.2020.122009.

[1]   The National Autistic Society (2014) What Is Autism?

[2]   Baron-Cohen, S., Ashwin, E., Ashwin, C., Tavassoli, T. and Chakrabarti, B. (2009) Talent in Autism: Hyper-Systemizing, Hyper-Attention to Detail and Sensory Hypersensitivity. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 364, 1377-1383.

[3]   Hughes, J.E.A., Ward, J., Gruffydd, E., et al. (2018) Savant Syndrome Has a Distinct Psychological Profile in Autism. Molecular Autism, 9, 53.

[4]   WHO, World Health Organization (2013) Autism Spectrum Disorders & Other Developmental Disorders. From Raising Awareness to Building Capacity. Geneva, Switzerland.

[5]   Franz, L., Chambers, N., von Isenburg, M. and de Vries, P.J. (2017) Autism Spectrum Disorder in Sub-Saharan Africa: A Comprehensive Scoping Review. Autism Research, 10, 723-749.

[6]   Shaw, C.A., Sheth, S., Li, D. and Tomljenovic, L. (2014) Etiology of Autism Spectrum Disorders: Genes, Environment, or Both? OA Autism, 2, 11.

[7]   Nadel, J. (2005) L’autisme, chapter Imitation et austisme.

[8]   Bendiouis, S. (2015) Imitation et communication chez le jeune enfant avec autisme. Psychologie. Université Paul Valéry-Montpellier III, Français.

[9]   Attia, A. and Dayan, S. (2018) Global Overview of Imitation Learning. ArXiv, abs/1801.06503.

[10]   Zeestraten, M., Havoutis, I., Silv’erio, J., Calinon, S. and Caldwell, D.G. (2017) An Approach for Imitation Learning on Riemannian Manifolds. IEEE Robotics and Automation Letters, 2, 1240-1247.

[11]   Lin, J.F.-S. and Kulic, D. (2014) Online Segmentation of Human Motion for Automated Rehabilitation Exercise Analysis. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 22, 168-180.

[12]   Devanne, M. and Nguyen, S.M. (2017) Multi-Level Motion Analysis for Physical Exercises Assessment in Kinaesthetic Rehabilitation. 2017 IEEE-RAS 17th IEEE International Conference on Humanoid Robots (Humanoids), Birmingham, 15-17 November 2017, 529-534.

[13]   Sara, B., Kaska, P.-P. and Tim, S. (2014) ECHOES: An Intelligent Serious Game for Fostering Social Communication in Children with Autism. Information Sciences, 264, 41-60.

[14]   Mazon, C., Fage, C. and Sauzéon, H. (2019) Effectiveness and Usability of Technology-Based in-Terventions for Children and Adolescents with ASD: A Systematic Review of Reliability, Consistency, Generalization and Durability Related to the Effects of Intervention. Computers in Human Behavior, 93, 235-251.

[15]   Calinon, S., Guenter, F. and Billard, A. (2007) On Learning, Representing, and Generalizing a Task in a Humanoid Robot. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 37, 286-298.

[16]   Karcher, H. (1977) Riemannian Center of Mass and Mollifier Smoothing. Communications on Pure and Applied Mathematics, 30, 509-541.

[17]   Simo-Serra, E., Torras, C. and Moreno-Noguer, F. (2016) 3D Human Pose Tracking Priors Using Geodesic Mixture Models. International Journal of Computer Vision, 122, 1-21.