Game controller modification for fMRI hyperscanning experiments in a cooperative virtual reality environment

Jason Trees,Joseph Snider,Maryam Falahpour,Nick Guo,Kun Lu,Douglas C Johnson,Howard Poizner,Thomas T Liu

doi:10.1016/j.mex.2014.10.009

Jason Trees, Joseph Snider + Show 6 more

Open Access

PDF Available

https://doi.org/10.1016/j.mex.2014.10.009

Copy DOI

Export

Save

Cite

Journal: MethodsX	Publication Date: Jan 1, 2014
Citations: 6	License type: cc-by

Affiliation: University of California, San Diego

Abstract
Highlights/Summary
Full-Text PDF
Similar Papers

Abstract

Listen

Hyperscanning, an emerging technique in which data from multiple interacting subjects’ brains are simultaneously recorded, has become an increasingly popular way to address complex topics, such as “theory of mind.” However, most previous fMRI hyperscanning experiments have been limited to abstract social interactions (e.g. phone conversations). Our new method utilizes a virtual reality (VR) environment used for military training, Virtual Battlespace 2 (VBS2), to create realistic avatar-avatar interactions and cooperative tasks. To control the virtual avatar, subjects use a MRI compatible Playstation 3 game controller, modified by removing all extraneous metal components and replacing any necessary ones with 3D printed plastic models. Control of both scanners’ operation is initiated by a VBS2 plugin to sync scanner time to the known time within the VR environment. Our modifications include:•Modification of game controller to be MRI compatible.•Design of VBS2 virtual environment for cooperative interactions.•Syncing two MRI machines for simultaneous recording.

Highlights

Hyperscanning, an emerging technique in which data from multiple interacting subjects’ brains are simultaneously recorded, has become an increasingly popular way to address complex topics, such as ‘‘theory of mind.’’ most previous fMRI hyperscanning experiments have been limited to abstract social interactions
A modified game controller has been used within an Magnetic Resonance Imaging (MRI) to control action of a single agent within a complex virtual representation, but details on the necessary modifications have not been previously published
The following is a detailed procedure for modifying a game controller to be MRI compatible, along with steps for creating hyperscanning virtual environments

Summary

Introduction

The following is a detailed procedure for modifying a game controller to be MRI compatible, along with steps for creating hyperscanning virtual environments. As MRI-compatible controllers with the functionality required for hyperscanning in a virtual environment are not currently available on a commercial basis, the procedures described should prove to be useful for the development of experimental protocols in this area of research. Remove the circuit board from the controller housing.

Results

Conclusion