Local and remote cooperation with virtual and robotic agents: A P300 BCI study in healthy and people living with spinal cord injury

Tidoni, E., Abu-Alqumsan, M., Leonardis, D., Kapeller, C., Fusco, G., Guger, C., Hintermüller, C., Peer, A., Frisoli, A., Tecchia, F., Bergamasco, M. and Aglioti, S. M. (2017) Local and remote cooperation with virtual and robotic agents: A P300 BCI study in healthy and people living with spinal cord injury. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 25 (9). pp. 1622-1632. ISSN 1558-0210 Available from: http://eprints.uwe.ac.uk/30884

PDF - Accepted Version
Available under License All Rights Reserved.


Publisher's URL: http://dx.doi.org/10.1109/TNSRE.2016.2626391


The development of technological applications that allow people to control and embody external devices within social interaction settings represents a major goal for current and future brain-computer interface (BCI) systems. Prior research has suggested that embodied systems may ameliorate BCI end-user’s experience and accuracy in controlling external devices. Along these lines, we developed an immersive P300-based BCI application with a head-mounted display for virtual-local and robotic-remote social interactions and explored in a group of healthy participants the role of proprioceptive feedback in the control of a virtual surrogate (Study 1). Moreover, we compared the performance of a small group of people with spinal cord injury (SCI) to a control group of healthy subjects during virtual and robotic social interactions (Study 2), where both groups received a proprioceptive stimulation. Our attempt to combine immersive environments, BCI technologies and neuroscience of body ownership suggests that providing realistic multisensory feedback still represents a challenge. Results have shown that healthy and people living with SCI used the BCI within the immersive scenarios with good levels of performance (as indexed by task accuracy, optimizations calls and Information Transfer Rate) and perceived control of the surrogates. Proprioceptive feedback did not contribute to alter performance measures and body ownership sensations. Further studies are necessary to test whether sensorimotor experience represents an opportunity to improve the use of future embodied BCI applications.

Item Type:Article
Uncontrolled Keywords:BCI P300, spinal cord injury, virtual reality, teleoperation, body illusions, tendon Vibration
Faculty/Department:Faculty of Environment and Technology > Department of Engineering Design and Mathematics
ID Code:30884
Deposited By: Professor A. Peer
Deposited On:03 Feb 2017 16:02
Last Modified:12 Nov 2017 08:09

Request a change to this item

Total Document Downloads in Past 12 Months

Document Downloads

Total Document Downloads

More statistics for this item...