Raposo, Miguel, Raquel Barateiro, Susana Martins, Tiago Cardoso, Miguel Palha, and José Barata. "
Improving the Learning of Child Movements Through Games."
International Conference on Serious Games, Interaction and Simulation. Springer, Cham, 2016. 15-22.
AbstractA Developmental Coordination Disorder can be identified when children show motor skills either below the expected levels considered adequate to their physical age or the opportunities provided for their learning. This problem affects four to six percent of school-age children, meaning that, from a very early stage of their life, they have several difficulties to adapt to the daily needs. In order to reduce the impact caused by this disorder, a team of therapists from “ – collected a wide range of exercises that allow the stimulus of several motor areas, including both the Gross and Fine Motor Skills. However, the application of this therapeutics is restricted to regular appointments. Since the motor stimulus, in order to be effective, need continuous application, it was found to be necessary to have a tool that in a practical and affordable way, fulfill this need. Therefore, the proposal presented in this article describes the creation of a systematic collection of such exercises in a friendly user manner for the children to be able to exercise elsewhere.
Gameiro, João, Tiago Cardoso, and Yves Rybarczyk. "
Kinect-sign: teaching sign language to “listeners” through a game."
Conference on Electronics, Telecomunications and Computers - CETC . Lisbon, Portugal, 2013. 141-159.
AbstractThe sign language is widely used by deaf people around the globe. As the spoken languages, several sign languages do exist. The way sign language is learned by deaf people may have some details to be improved, but one can state that the existing learning mechanisms are effective when we talk about a deaf child, for example. The problem arises for the non-deaf persons that communicate with the deaf persons – the so-called listeners. If, for example, one couple has a new child that turns to be deaf, these two persons find a challenge to learn the sign language. In one hand, they cannot stop their working life, especially because of this sad news turns to be more costly, on the other hand, the existing mechanisms target the deaf-persons and are not prepared for the listeners. This paper proposes a new playful approach to help these listeners to learn the sign language. The proposal is a serious game composed of two modes: School-mode and Competition-mode. The first provides a school-like environment where the user learns the letter-signs and the second provides the user an environment used towards testing the learned skills. Behind the scenes, the proposal is based on two phases: 1 – the creation of a gestures library, relying on the Kinect depth camera; and 2 – the real-time recognition of gestures, by comparing what the depth camera information to the existing gestures previously stored in the library. A prototype system, supporting only the Portuguese sign language alphabet, was developed – the Kinect-Sign – and tested in a Portuguese Sign-Language school resulting in a joyful acceptance of the approach.
Rybarczyk, Y., G. Carrasco, T. Cardoso, and Pavão I. Martins. "
A serious game for multimodal training of physician novices."
ICER2013 - 6th International Conference of Education, Research and Innovation. Seville, Spain: IATED, 2013. 4944-4949.
AbstractSerious games are usually applied to cognitive learning. However, the development of recent Natural User Interfaces (NUI) enables us to use serious games for a more holistic training. This project proposes to implement an educative game that teaches medical students how to carry out a neurological examination. The purpose is to improve not only the cognitive knowledge of the young physicians but also their sensorimotor skills. The game takes place in a virtual doctor office, which is modelled in 3D. Many possible clinical cases related to different neurologic diseases are simulated. The users are tested at two skill levels. First of all, they have to choose the right exam according to the patient’s symptoms. This initial stage is used to assess the theoretical expertise of the students. If the choice is correct, the physical examination begins. In order to evaluate the motor performance, a Kinect NUI is used. Such a device allows for the natural and intuitive control of the doctor’s avatar because there is a direct link between the individual’s and the avatar’s joints. Due to the fact that the real movements of the student are recorded with some accuracy, it is possible to gauge whether or not the medical gesture is properly applied to the virtual patient. In particular, the force and the precision of the movements are measured and compared to reference values. After each examination immediate feedback is given, so that the learners may rectify their choices and improve the quality of their motor skills at the next training session. Overall, the objective of this software is to enable the future physicians to practice a basic medical exam on a wide scope of neurologic disorders, without any risk for the patients and through an enjoyable approach.
Simao, José, Luisa Cotrim, Teresa Condeco, Tiago Cardoso, Miguel Palha, Yves Rybarczyk, and José Barata. "
Using Games for the Phonetics Awareness of Children with Down Syndrome."
International Conference on Serious Games, Interaction and Simulation. Springer, Cham, 2016. 1-8.
AbstractComputers and technology can play a key role in supporting learning, namely for students with special educational needs. Nevertheless, despite the emphasis the society puts on the use of technology and its fast proliferation in the area of education, few initiatives focus on the specific needs of children with disabilities. Motivated by this gap, this research work proposes a computer assisted education application that targets to teach talking and reading through games. The work described herein was carried out in close cooperation with - , a child-care institution that works with children with distinct growth disorders, namely the Down syndrome.