Hybrid Brain–Computer Interface System Using Auditory Stimulation and Speech Imagination Paradigms for Assistive Technology

Abstract

In the case of paralysis with visual and tactile impairments, brain–computer interfaces (BCIs) based on auditory and mental imagery paradigms are alternative methods for controlling external devices. This study demonstrates the use of a hybrid BCI via auditory stimulation and speech imagination for assistive technology. The proposed auditory BCI using Thai vowel and numeral stimulus patterns as well as multi-loudspeaker position settings for multi-command BCI are investigated. To avoid auditory stimulation during resting periods, a speech imagery method is used to enable an audio stimulator. We observe the classification efficiency of speech imagery and auditory BCIs from selected electroencephalogram channels using the proposed algorithms. We examine the efficiency of using the proposed BCI in the presence of background noise (speech). One command is created using the proposed speech-imagination paradigm. Four commands are created using the proposed auditory stimulation paradigm. We design an experiment to verify the proposed BCI paradigm and classification algorithms for real-time processing. The results show that the average classification accuracy of the proposed auditory BCI using numeral stimuli and scatter patterns without speech noise is 72.2% to 83.3%, respectively. The efficiency under background noise is approximately two times lower than that without background noise.