Exploring Visuo-haptic Feedback Congruency in Virtual Reality

Williams, Benjamin, Garton, Alexandra and Headleand, Chris (2020) Exploring Visuo-haptic Feedback Congruency in Virtual Reality. In: International Conference on Cyberworlds, 29 Sept.-1 Oct. 2020.

Full content URL: https://doi.org/10.1109/CW49994.2020.00022

WarningThere is a more recent version of this item available.

Exploring Visuo-haptic Feedback Congruency in Virtual Reality
Accepted Manuscript
[img] PDF
CW2020_GSFP_paper__accepted_ (1).pdf - Whole Document
Restricted to Repository staff only until 30 October 2022.

Item Type:Conference or Workshop contribution (Paper)
Item Status:Live Archive


Visuo-haptic feedback is an important aspect of virtual reality experiences, with several previous works investigating its benefits and effects. A key aspect of this domain is congruency of crossmodal feedback and how it affects users.
However, an important sub-domain which has received surprisingly little focus is visuo-haptic congruency in an interactive multisensory setting. This is especially important given that multisensory integration is crucial to player immersion in the context of virtual reality video games. In this paper, we attempt to address this lack of research. To achieve this, a total of 50 participants played a virtual reality racing game with either congruent or incongruent visuo-haptic feedback. Specifically, these users engaged in a driving simulator with physical gear shift interfaces, with one treatment group using a stick-shift gearbox, and the other using a paddle-shift setup. The virtual car they drove (A Formula Rookie race car) was only visually congruent with the stick-shift setup. A motion simulator was also used to provide synchronous vestibular cues and diversify the range of modalities in multisensory integration. The racing simulator used was Project CARS 2, one of the world’s most popular commercial racing simulators. Our findings showed
no significant differences between the groups in measures of user presence or in-game performance, counter to previous work regarding visuo-haptic congruency. However, the Selfevaluation of Performance PQ subscale was notably close to significance. Our results can be used to better inform games and simulation developers, especially those targeting virtual reality.

Keywords:virtual reality, video games, visuo-haptic feedback, multisensory integration, sensory perception
Subjects:G Mathematical and Computer Sciences > G440 Human-computer Interaction
G Mathematical and Computer Sciences > G400 Computer Science
G Mathematical and Computer Sciences > G450 Multi-media Computing Science
Divisions:College of Science > School of Computer Science
ID Code:42575
Deposited On:17 Dec 2020 18:59

Available Versions of this Item

Repository Staff Only: item control page