Gameiro, João, Tiago Cardoso, and Yves Rybarczyk. "
Kinect-sign: teaching sign language to “listeners” through a game."
Conference on Electronics, Telecomunications and Computers - CETC . Lisbon, Portugal, 2013. 141-159.
AbstractThe sign language is widely used by deaf people around the globe. As the spoken languages, several sign languages do exist. The way sign language is learned by deaf people may have some details to be improved, but one can state that the existing learning mechanisms are effective when we talk about a deaf child, for example. The problem arises for the non-deaf persons that communicate with the deaf persons – the so-called listeners. If, for example, one couple has a new child that turns to be deaf, these two persons find a challenge to learn the sign language. In one hand, they cannot stop their working life, especially because of this sad news turns to be more costly, on the other hand, the existing mechanisms target the deaf-persons and are not prepared for the listeners. This paper proposes a new playful approach to help these listeners to learn the sign language. The proposal is a serious game composed of two modes: School-mode and Competition-mode. The first provides a school-like environment where the user learns the letter-signs and the second provides the user an environment used towards testing the learned skills. Behind the scenes, the proposal is based on two phases: 1 – the creation of a gestures library, relying on the Kinect depth camera; and 2 – the real-time recognition of gestures, by comparing what the depth camera information to the existing gestures previously stored in the library. A prototype system, supporting only the Portuguese sign language alphabet, was developed – the Kinect-Sign – and tested in a Portuguese Sign-Language school resulting in a joyful acceptance of the approach.
Rybarczyk, Y., G. Carrasco, T. Cardoso, and Pavão I. Martins. "
A serious game for multimodal training of physician novices."
ICER2013 - 6th International Conference of Education, Research and Innovation. Seville, Spain: IATED, 2013. 4944-4949.
AbstractSerious games are usually applied to cognitive learning. However, the development of recent Natural User Interfaces (NUI) enables us to use serious games for a more holistic training. This project proposes to implement an educative game that teaches medical students how to carry out a neurological examination. The purpose is to improve not only the cognitive knowledge of the young physicians but also their sensorimotor skills. The game takes place in a virtual doctor office, which is modelled in 3D. Many possible clinical cases related to different neurologic diseases are simulated. The users are tested at two skill levels. First of all, they have to choose the right exam according to the patient’s symptoms. This initial stage is used to assess the theoretical expertise of the students. If the choice is correct, the physical examination begins. In order to evaluate the motor performance, a Kinect NUI is used. Such a device allows for the natural and intuitive control of the doctor’s avatar because there is a direct link between the individual’s and the avatar’s joints. Due to the fact that the real movements of the student are recorded with some accuracy, it is possible to gauge whether or not the medical gesture is properly applied to the virtual patient. In particular, the force and the precision of the movements are measured and compared to reference values. After each examination immediate feedback is given, so that the learners may rectify their choices and improve the quality of their motor skills at the next training session. Overall, the objective of this software is to enable the future physicians to practice a basic medical exam on a wide scope of neurologic disorders, without any risk for the patients and through an enjoyable approach.
Macedo, Patricia, Tiago Cardoso, and Luis M. Camarinha-Matos. "
Value systems alignment in product servicing networks."
Working Conference on Virtual Enterprises. Springer, Berlin, Heidelberg, 2013. 71-80.
AbstractThe notion of service-enhanced product brings new perspectives for value creation and differentiation in manufacturing. The existence of complex and highly customized products, the inclusion of business services that add value to the product typically require the collaboration of multiple stakeholders. It is natural that each stakeholder has its own set of values and preferences and as a result, conflicts among them might emerge due to some values misalignment. Therefore, the Value System Alignment assessment should be included when selecting partner for the formation of long-term collaborative networks for the operation and management of the product life-cycle. This paper presents the implementation of a Value System alignment assessment model, as a component of the cloud-based collaborative environment designed to support a mix of collaborative enterprise networks involved in the solar energy sector.