el   en  

Exploiting sensing devices availability in AR/VR deployments to foster engagement

Currently, in all augmented reality (AR) or virtual reality (VR) educational experiences, the evolution of the experience
(game, exercise or other) and the assessment of the user’s performance are based on her/his (re)actions which are continuously
traced/sensed. In this paper, we propose the exploitation of the sensors available in the AR/VR systems to enhance the
current AR/VR experiences, taking into account the users’ affect state that changes in real time. Adapting the difficulty level
of the experience to the users’ affect state fosters their engagement which is a crucial issue in educational environments and
prevents boredom and anxiety. The users’ cues are processed enabling dynamic user profiling. The detection of the affect
state based on different sensing inputs, since diverse sensing devices exist in different AR/VR systems, is investigated, and
techniques that have been undergone validation using state-of-the-art sensors are presented.