Real-time Magnetoencephalography Research Articles

MEG Source Localization via Deep Learning.

We present a deep learning solution to the problem of localization of magnetoencephalography (MEG) brain signals. The proposed deep model architectures are tuned to single and multiple time point MEG data, and can estimate varying numbers of dipole sources. Results from simulated MEG data on the cortical surface of a real human subject demonstrated improvements against the popular RAP-MUSIC localization algorithm in specific scenarios with varying SNR levels, inter-source correlation values, and number of sources. Importantly, the deep learning models had robust performance to forward model errors resulting from head translation and rotation and a significant reduction in computation time, to a fraction of 1 ms, paving the way to real-time MEG source localization.

Seizure detection and epileptogenic zone localisation on heavily skewed MEG data using RUSBoost machine learning technique

Background: Epilepsy is a neurological disorder which is characterised by recurrent and involuntary seizures. Magnetoencephalography (MEG) is clinically used as a presurgical tool in locating the epileptogenic zone by localising either interictal epileptic discharges (IEDs) or ictal activities. The localisation of ictal onset provides reliable and more accurate seizure onset zones rather than localising the IEDs. Ictals or seizures are presently detected during MEG analysis by manually inspecting the recorded data. This is laborious when the duration of recordings is longer. Methods: We propose a novel method which uses statistical features such as short-time permutation entropy (STPE), gradient of STPE (GSTPE), short-time energy (STE) and short-time mean (STM) extracted from the ictal and interictal MEG data of drug resistant epilepsy patients group. Since the data is heavily skewed, the RUSBoost algorithm with k-fold cross-validation is used to classify the data into ictal and interictal by using the four feature vectors. This method is further used for localising the epileptogenic region using region-specific classifications by means of the RUSBoost algorithm. Results: The accuracy obtained for seizure detection is 93.4%. The specificity and sensitivity for the same are 93%. The localisation accuracies for each lobe are in the range of 88.1–99.1%. Discussion: Through this ictus detection method, the current scenario of laborious inspection of the ictal MEG can be reduced. The proposed system, thus, can be implemented in real-time as a better and more efficient method for seizure detection and further it can prove to be highly beneficial for patients and health-care professionals during real-time MEG recording. Furthermore, the identification of the epileptogenic lobe can provide clinicians with useful insights, and a pre-cursor for source localisation.

A computational paradigm for real-time MEG neurofeedback for dynamic allocation of spatial attention

BackgroundNeurofeedback aids volitional control of one’s own brain activity using non-invasive recordings of brain activity. The applications of neurofeedback include improvement of cognitive performance and treatment of various psychiatric and neurological disorders. During real-time magnetoencephalography (rt-MEG), sensor-level or source-localized brain activity is measured and transformed into a visual feedback cue to the subject. Recent real-time fMRI (rt-fMRI) neurofeedback studies have used pattern recognition techniques to decode and train a brain state to link brain activities and cognitive behaviors. Here, we utilize the real-time decoding technique similar to ones employed in rt-fMRI to analyze time-varying rt-MEG signals.ResultsWe developed a novel rt-MEG method, state-based neurofeedback (sb-NFB), to decode a time-varying brain state, a state signal, from which timings are extracted for neurofeedback training. The approach is entirely data-driven: it uses sensor-level oscillatory activity to find relevant features that best separate the targeted brain states. In a psychophysical task of spatial attention switching, we trained five young, healthy subjects using the sb-NFB method to decrease the time necessary for switch spatial attention from one visual hemifield to the other (referred to as switch time). Training resulted in a decrease in switch time with training. We saw that the activity targeted by the training involved proportional changes in alpha and beta-band oscillations, in sensors at the occipital and parietal regions. We also found that the state signal that encodes whether subjects attend to the left or right visual field effectively switches consistently with the task.ConclusionWe demonstrated the use of the sb-NFB method when the subject learns to increase the speed of shifting covert spatial attention from one visual field to the other. The sb-NFB method can target timing features that would otherwise also include extraneous features such as visual detection and motor response in a simple reaction time task.

Requirement-driven model-based development methodology applied to the design of a real-time MEG data processing unit

The paper describes a multidisciplinary work that uses a model-based systems engineering method for developing real-time magnetoencephalography (MEG) signal processing. We introduce a requirement-driven, model-based development methodology (RDD and MBD) to provide a high-level environment and efficiently handle the complexity of computation and control systems. The proposed development methodology focuses on the use of System Modeling Language to define high-level model-based design descriptions for later implementation in heterogeneous hardware/software systems. The proposed approach was applied to the implementation of a real-time artifact rejection unit in MEG signal processing and demonstrated high efficiency in designing complex high-performance embedded systems. In MEG signal processing, biological artifacts in particular have a signal strength that overtop the signal of interest by orders of magnitude and must be removed from the measurement to achieve high-quality source reconstructions with minimal error contributions. However, many existing brain–computer interface studies overlook real-time artifact removal because of the demanding computational process. In this work, an automated real-time artifact rejection method is introduced, which is based on the recently presented method “ocular and cardiac artifact rejection for real-time analysis in MEG” (OCARTA). The method has been implemented using the RDD and MBD approach and successfully verified on a Virtex-6 field-programmable gate array.

An inversion method based on random sampling for real-time MEG neuroimaging

Abstract The MagnetoEncephaloGraphy (MEG) has gained great interest in neurorehabilitation training due to its high temporal resolution. The challenge is to localize the active regions of the brain in a fast and accurate way. In this paper we use an inversion method based on random spatial sampling to solve the real-time MEG inverse problem. Several numerical tests on synthetic but realistic data show that the method takes just a few hundredths of a second on a laptop to produce an accurate map of the electric activity inside the brain. Moreover, it requires very little memory storage. For these reasons the random sampling method is particularly attractive in real-time MEG applications.

Training in Use of Brain-Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements.

Objective: Brain-machine interfaces (BMIs) are useful for inducing plastic changes in cortical representation. A BMI first decodes hand movements using cortical signals and then converts the decoded information into movements of a robotic hand. By using the BMI robotic hand, the cortical representation decoded by the BMI is modulated to improve decoding accuracy. We developed a BMI based on real-time magnetoencephalography (MEG) signals to control a robotic hand using decoded hand movements. Subjects were trained to use the BMI robotic hand freely for 10 min to evaluate plastic changes in the cortical representation due to the training.Method: We trained nine young healthy subjects with normal motor function. In open-loop conditions, they were instructed to grasp or open their right hands during MEG recording. Time-averaged MEG signals were then used to train a real decoder to control the robotic arm in real time. Then, subjects were instructed to control the BMI-controlled robotic hand by moving their right hands for 10 min while watching the robot's movement. During this closed-loop session, subjects tried to improve their ability to control the robot. Finally, subjects performed the same offline task to compare cortical activities related to the hand movements. As a control, we used a random decoder trained by the MEG signals with shuffled movement labels. We performed the same experiments with the random decoder as a crossover trial. To evaluate the cortical representation, cortical currents were estimated using a source localization technique. Hand movements were also decoded by a support vector machine using the MEG signals during the offline task. The classification accuracy of the movements was compared among offline tasks.Results: During the BMI training with the real decoder, the subjects succeeded in improving their accuracy in controlling the BMI robotic hand with correct rates of 0.28 ± 0.13 to 0.50 ± 0.11 (p = 0.017, n = 8, paired Student's t-test). Moreover, the classification accuracy of hand movements during the offline task was significantly increased after BMI training with the real decoder from 62.7 ± 6.5 to 70.0 ± 11.1% (p = 0.022, n = 8, t(7) = 2.93, paired Student's t-test), whereas accuracy did not significantly change after BMI training with the random decoder from 63.0 ± 8.8 to 66.4 ± 9.0% (p = 0.225, n = 8, t(7) = 1.33).Conclusion: BMI training is a useful tool to train the cortical activity necessary for BMI control and to induce some plastic changes in the activity.

Learned control of inter-hemispheric connectivity: Effects on bimanual motor performance

Bimanual movements involve the interactions between both primary motor cortices. These interactions are assumed to involve phase-locked oscillatory brain activity referred to as inter-hemispheric functional coupling. So far, inter-hemispheric functional coupling has been investigated as a function of motor performance. These studies report mostly a negative correlation between the performance in motor tasks and the strength of functional coupling. However, correlation might not reflect a causal relationship. To overcome this limitation, we opted for an alternative approach by manipulating the strength of inter-hemispheric functional coupling and assessing bimanual motor performance as a dependent variable. We hypothesize that an increase/decrease of functional coupling deteriorates/facilitates motor performance in an out-of-phase bimanual finger-tapping task. Healthy individuals were trained to volitionally regulate functional coupling in an operant conditioning paradigm using real-time magnetoencephalography neurofeedback. During operant conditioning, two discriminative stimuli were associated with upregulation and downregulation of functional coupling. Effects of training were assessed by comparing motor performance prior to (pre-test) and after the training (post-test). Participants receiving contingent feedback learned to upregulate and downregulate functional coupling. Comparing motor performance, as indexed by the ratio of tapping speed for upregulation versus downregulation trials, no change was found in the control group between pre- and post-test. In contrast, the group receiving contingent feedback evidenced a significant decrease of the ratio implicating lower tapping speed with stronger functional coupling. Results point toward a causal role of inter-hemispheric functional coupling for the performance in bimanual tasks. Hum Brain Mapp 38:4353-4369, 2017. © 2017 Wiley Periodicals, Inc.

Versatile synchronized real-time MEG hardware controller for large-scale fast data acquisition.

Versatile controllers for accurate, fast, and real-time synchronized acquisition of large-scale data are useful in many areas of science, engineering, and technology. Here, we describe the development of a controller software based on a technique called queued state machine for controlling the data acquisition (DAQ) hardware, continuously acquiring a large amount of data synchronized across a large number of channels (>400) at a fast rate (up to 20 kHz/channel) in real time, and interfacing with applications for real-time data analysis and display of electrophysiological data. This DAQ controller was developed specifically for a 384-channel pediatric whole-head magnetoencephalography (MEG) system, but its architecture is useful for wide applications. This controller running in a LabVIEW environment interfaces with microprocessors in the MEG sensor electronics to control their real-time operation. It also interfaces with a real-time MEG analysis software via transmission control protocol/internet protocol, to control the synchronous acquisition and transfer of the data in real time from >400 channels to acquisition and analysis workstations. The successful implementation of this controller for an MEG system with a large number of channels demonstrates the feasibility of employing the present architecture in several other applications.

A decoded neurofeedback method for MEG/SSVEF

Event Abstract Back to Event A decoded neurofeedback method for MEG/SSVEF Hiroki Ora1, 2 and Kenji Kansaku1, 2* 1 Research Institute of National Rehabilitation Center for Persons with Disabilities, Department of Rehabilitation for Brain Function, Japan 2 The University of Electro-Communications, Brain Science Inspired Life Support Research Center, Japan Decoded neurofeedback method was recently proposed to lead brain activity to a target state (Shibata, et al., 2011). While researchers utilized functional magnetic resonance imaging in the former studies, little is focused on magnetoencephalography (MEG). Real-time magnetoencephalography (rtMEG) is an emerging neurofeedback technology that could potentially benefit multiple areas of basic and clinical neuroscience, and in this study, we used an rtMEG system to perform decoded neurofeedback training for MEG/steady-state visual evoked field (SSVEF). Five able-bodied participants (age 33.2 years old, 5 females) participated in this study. The visual stimuli were displayed on a screen in front of the participant, and consisted of a circular checkerboard patch on the left and a circular checkerboard patch on the right. The checkerboard patches flickered at 5 (left) or 6 (right) Hz. They were asked to attend to the left, right, or middle of the screen in a SSVEF task. The used MEG scanner was a 306-channel Elekta Neuromag system (Elekta Oy, Helsinki, Finland). We constructed a sparse multinomial logistic regression (SMLR) decoder from MEG signals during the SSVEF task in each participant. We then conducted 3-day MEG neurofeedback training. In a trial, a white fixation cross was turned green for 5 second, then a green solid circle, whose radius indicated a score of the SMLR decoder, was presented. Participants were asked to “somehow regulate your brain activity to make the green solid circle bigger while the fixation cross is green.” During the trainings, no flickering visual stimuli were presented. After the trainings, the SSVEF task was used again to evaluate the training effects. Furthermore, we analyzed weights of the SMLR decoders to determine a subset of MEG sensors that contributed to decode the attended orientation. The SMLR decoder was able to classify the MEG signals into 3 attentional directions (left, right or middle) (88.2 %). The participants were able to increase decoder scores through the trainings (p<0.05). In the post-training SSVEF tasks, accuracy for the target orientation was higher than that for the non-target orientation (p<0.05). Analysis of weights of the decoders demonstrated that sensors on the occipital region contributed to decode the attended orientation (p<0.05, Bonferroni corrected). The results suggest that the decoded neurofeedback training was effective for MEG/SSVEF, and the method may enhance robustness of steady-state visual evoked potential (SSVEP)-based Brain-Computer Interface (BCI). Keywords: Magnetic Resonance Imaging, decoded neurofeedback, Magnetoencephalography (MEG), Real-time magnetoencephalography, Steady-state visual evoked field Conference: 2015 International Workshop on Clinical Brain-Machine Interfaces (CBMI2015), Tokyo, Japan, 13 Mar - 15 Mar, 2015. Presentation Type: Poster 1-6 Topic: Clinical Brain-Machine Interfaces Citation: Ora H and Kansaku K (2015). A decoded neurofeedback method for MEG/SSVEF. Conference Abstract: 2015 International Workshop on Clinical Brain-Machine Interfaces (CBMI2015). doi: 10.3389/conf.fnhum.2015.218.00007 Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters. The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated. Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed. For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions. Received: 23 Apr 2015; Published Online: 29 Apr 2015. * Correspondence: Dr. Kenji Kansaku, Research Institute of National Rehabilitation Center for Persons with Disabilities, Department of Rehabilitation for Brain Function, Tokorozawa, Saitama, Japan, kansakuk@dokkyomed.ac.jp Login Required This action requires you to be registered with Frontiers and logged in. To register or login click here. Abstract Info Abstract The Authors in Frontiers Hiroki Ora Kenji Kansaku Google Hiroki Ora Kenji Kansaku Google Scholar Hiroki Ora Kenji Kansaku PubMed Hiroki Ora Kenji Kansaku Related Article in Frontiers Google Scholar PubMed Abstract Close Back to top Javascript is disabled. Please enable Javascript in your browser settings in order to see all the content on this page.

Real-time MEG neurofeedback training of posterior alpha activity modulates subsequent visual detection performance

It has been demonstrated that alpha activity is lateralized when attention is directed to the left or right visual hemifield. We investigated whether real-time neurofeedback training of the alpha lateralization enhances participants' ability to modulate posterior alpha lateralization and causes subsequent short-term changes in visual detection performance. The experiment consisted of three phases: (i) pre-training assessment, (ii) neurofeedback phase and (iii) post-training assessment. In the pre- and post-training phases we measured the threshold to covertly detect a cued faint Gabor stimulus presented in the left or right hemifield. During magnetoencephalography (MEG) neurofeedback, two face stimuli superimposed with noise were presented bilaterally. Participants were cued to attend to one of the hemifields. The transparency of the superimposed noise and thus the visibility of the stimuli were varied according to the momentary degree of hemispheric alpha lateralization. In a double-blind procedure half of the participants were provided with sham feedback. We found that hemispheric alpha lateralization increased with the neurofeedback training; this was mainly driven by an ipsilateral alpha increase. Surprisingly, comparing pre- to post-training, detection performance decreased for a Gabor stimulus presented in the hemifield that was un-attended during neurofeedback. This effect was not observed in the sham group. Thus, neurofeedback training alters alpha lateralization, which in turn decreases performances in the untrained hemifield. Our findings suggest that alpha oscillations play a causal role for the allocation of attention. Furthermore, our neurofeedback protocol serves to reduce the detection of unattended visual information and could therefore be of potential use for training to reduce distractibility in attention deficit patients, but also highlights that neurofeedback paradigms can have negative impact on behavioral performance and should be applied with caution.

Targeted reinforcement of neural oscillatory activity with real-time neuroimaging feedback

Biofeedback and brain-computer interfacing using EEG has been receiving continuous and increasing interest. However, the limited spatial resolution of low-density scalp recordings is a roadblock to the unequivocal monitoring and targeting of neuroanatomical regions and physiological signaling. This latter aspect is pivotal to the actual efficiency of neurofeedback procedures, which are expected to engage the modulation of well-identified components of neural activity within and between predetermined brain regions. Our group has previously contributed to demonstrate the principles of real-time magnetoencephalography (MEG) source imaging. Here we show how the technique was further developed to provide healthy subjects with region-specific neurofeedback to modulate successfully predetermined components of their brain activity in targeted brain regions. Overall, our results positively indicate that neurofeedback based on time-resolved MEG imaging has the potential to become an innovative therapeutic approach in neurology and neuropsychiatry.

Implementation of a beam forming technique in real-time magnetoencephalography

Real-time magnetoencephalography (rtMEG) is an emerging neurofeedback technology that could potentially benefit multiple areas of basic and clinical neuroscience. In the present study, we implemented voxel-based real-time coherence measurements in a rtMEG system in which we employed a beamformer to localize signal sources in the anatomical space prior to computing imaginary coherence. Our rtMEG experiment showed that a healthy subject could increase coherence between the parietal cortex and visual cortex when attending to a flickering visual stimulus. This finding suggests that our system is suitable for neurofeedback training and can be useful for practical brain-machine interface applications or neurofeedback rehabilitation.

RtMEG: A Real-Time Software Interface for Magnetoencephalography

To date, the majority of studies using magnetoencephalography (MEG) rely on off-line analysis of the spatiotemporal properties of brain activity. Real-time MEG feedback could potentially benefit multiple areas of basic and clinical research: brain-machine interfaces, neurofeedback rehabilitation of stroke and spinal cord injury, and new adaptive paradigm designs, among others. We have developed a software interface to stream MEG signals in real time from the 306-channel Elekta Neuromag MEG system to an external workstation. The signals can be accessed with a minimal delay (≤45 ms) when data are sampled at 1000 Hz, which is sufficient for most real-time studies. We also show here that real-time source imaging is possible by demonstrating real-time monitoring and feedback of alpha-band power fluctuations over parieto-occipital and frontal areas. The interface is made available to the academic community as an open-source resource.

Real-Time Robust Signal Space Separation for Magnetoencephalography

In this paper, we develop a robust signal space separation (rSSS) algorithm for real-time magnetoencephalography (MEG) data processing. rSSS is based on the spatial signal space separation (SSS) method and it applies robust regression to automatically detect and remove bad MEG channels so that the results of SSS are not distorted. We extend the existing robust regression algorithm via three important new contributions: 1) a low-rank solver that efficiently performs matrix operations; 2) a subspace iteration scheme that selects bad MEG channels using low-order spherical harmonic functions; and 3) a parallel computing implementation that simultaneously runs multiple tasks to further speed up numerical computation. Our experimental results based on both simulation and measurement data demonstrate that rSSS offers superior accuracy over the traditional SSS algorithm, if the MEG data contain significant outliers. Taking advantage of the proposed fast algorithm, rSSS achieves more than 75 x runtime speedup compared to a direct solver of robust regression. Even though rSSS is currently implemented with MATLAB, it already provides sufficient throughput for real-time applications.

Magnetoencephalographic signals predict movement trajectory in space

Brain-machine interface (BMI) efforts have been focused on using either invasive implanted electrodes or training-extensive conscious manipulation of brain rhythms to control prosthetic devices. Here we demonstrate an excellent prediction of movement trajectory by real-time magnetoencephalography (MEG). Ten human subjects copied a pentagon for 45 s using an X-Y joystick while MEG signals were being recorded from 248 sensors. A linear summation of weighted contributions of the MEG signals yielded a predicted movement trajectory of high congruence to the actual trajectory (median correlation coefficient: r=0.91 and 0.97 for unsmoothed and smoothed predictions, respectively). This congruence was robust since it remained high in cross-validation analyses (based on the first half of data to predict the second half; median correlation coefficient: r=0.76 and 0.85 for unsmoothed and smoothed predictions, respectively).