Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges

José Del R Millán

doi:10.3389/fnins.2010.00161

Abstract

In recent years, new research has brought the field of electroencephalogram (EEG)-based brain–computer interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely, “Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user–machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human–computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices.

Highlights

Imagine being able to control a robot or other machine using only your thoughts – this fanciful notion has long since captured the imagination of humankind, and, within the past decade, the ability to bypass conventional channels of communication between a user’s brain and a computer has become a demonstrated reality
In pursuit of more practical brain–computer interfaces (BCIs) for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely, “Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”
In summary, time is ripe to develop a new generation of hybrid BCI assistive technology for people with physical disabilities that will advance the state of the art in a number of ways:

Summary

Introduction

Imagine being able to control a robot or other machine using only your thoughts – this fanciful notion has long since captured the imagination of humankind, and, within the past decade, the ability to bypass conventional channels of communication (i.e., muscles or speech) between a user’s brain and a computer has become a demonstrated reality. BCI as a proof-of-concept has already been demonstrated in several contexts; driving a robot or wheelchair (Millán et al, 2004a,b, 2009), operating prosthetic devices (Müller-Putz et al, 2005, 2006; Pfurtscheller et al, 2000, 2003), selecting letters from a virtual keyboard (Birbaumer et al, 1999; Donchin et al, 2000; Millán, 2003; Obermaier et al, 2003; Millán et al, 2004a; Scherer et al, 2004; Müller and Blankertz, 2006; Sellers et al, 2006; Williamson et al, 2009), internet browsing (Karim et al, 2006; Bensch et al, 2007; Mugler et al, 2008), navigating in virtual realities (Bayliss, 2003; Leeb et al, 2007a,b), and playing games (Millán, 2003; Krepki et al, 2007; Nijholt et al, 2008b; Tangermann et al, 2008). User training is complemented with machine learning techniques to discover the individual brain patterns characterizing the mental tasks executed by the user

Objectives

Findings

Discussion

Conclusion