Mobile Brain Imaging Research Articles

Coupling Mobile Brain Imaging and Virtual Reality Omnidirectional Treadmill to Explore Attenuated Situational Awareness During Distracted Walking

Coupling Mobile Brain Imaging and Virtual Reality Omnidirectional Treadmill to Explore Attenuated Situational Awareness During Distracted Walking

Electrocortical activity correlated with locomotor adaptation during split-belt treadmill walking.

Locomotor adaptation is crucial for daily gait adjustments to changing environmental demands and obstacle avoidance. Mobile brain imaging with high-density electroencephalography (EEG) now permits quantification of electrocortical dynamics during human locomotion. To determine the brain areas involved in human locomotor adaptation, we recorded high-density EEG from healthy, young adults during split-belt treadmill walking. We incorporated a dual-electrode EEG system and neck electromyography to decrease motion and muscle artefacts. Voluntary movement preparation and execution have been linked to alpha (8-13Hz) and beta band (13-30Hz) desynchronizations in the sensorimotor and posterior parietal cortices, whereas theta band (4-7Hz) modulations in the anterior cingulate have been correlated with movement error monitoring. We hypothesized that relative to normal walking, split-belt walking would elicit: (1) decreases in alpha and beta band power in sensorimotor and posterior parietal cortices, reflecting enhanced motor flexibility; and (2) increases in theta band power in anterior cingulate cortex, reflecting instability and balance errors that will diminish with practice. We found electrocortical activity in multiple regions that was associated with stages of gait adaptation. Data indicated that sensorimotor and posterior parietal cortices had decreased alpha and beta band spectral power during early adaptation to split-belt treadmill walking that gradually returned to pre-adaptation levels by the end of the adaptation period. Our findings emphasize that multiple brain areas are involved in adjusting gait under changing environmental demands during human walking. Future studies could use these findings on healthy, young participants to identify dysfunctional supraspinal mechanisms that may be impairing gait adaptation. KEY POINTS: Identifying the location and time course of electrical changes in the brain correlating with gait adaptation increases our understanding of brain function and provides targets for brain stimulation interventions. Using high-density EEG in combination with 3D biomechanics, we found changes in neural oscillations localized near the sensorimotor, posterior parietal and cingulate cortices during split-belt treadmill adaptation. These findings suggest that multiple cortical mechanisms may be associated with locomotor adaptation, and their temporal dynamics can be quantified using mobile EEG. Results from this study can serve as a reference model to examine brain dynamics in individuals with movement disorders that cause gait asymmetry and reduced gait adaptation.

Moving beyond the lab: investigating empathy through the Empirical 5E approach.

Empathy is a complex and multifaceted phenomenon that plays a crucial role in human social interactions. Recent developments in social neuroscience have provided valuable insights into the neural underpinnings and bodily mechanisms underlying empathy. This methodology often prioritizes precision, replicability, internal validity, and confound control. However, fully understanding the complexity of empathy seems unattainable by solely relying on artificial and controlled laboratory settings, while overlooking a comprehensive view of empathy through an ecological experimental approach. In this article, we propose articulating an integrative theoretical and methodological framework based on the 5E approach (the "E"s stand for embodied, embedded, enacted, emotional, and extended perspectives of empathy), highlighting the relevance of studying empathy as an active interaction between embodied agents, embedded in a shared real-world environment. In addition, we illustrate how a novel multimodal approach including mobile brain and body imaging (MoBi) combined with phenomenological methods, and the implementation of interactive paradigms in a natural context, are adequate procedures to study empathy from the 5E approach. In doing so, we present the Empirical 5E approach (E5E) as an integrative scientific framework to bridge brain/body and phenomenological attributes in an interbody interactive setting. Progressing toward an E5E approach can be crucial to understanding empathy in accordance with the complexity of how it is experienced in the real world.

ICanClean Improves Independent Component Analysis of Mobile Brain Imaging with EEG.

Motion artifacts hinder source-level analysis of mobile electroencephalography (EEG) data using independent component analysis (ICA). iCanClean is a novel cleaning algorithm that uses reference noise recordings to remove noisy EEG subspaces, but it has not been formally tested in a parameter sweep. The goal of this study was to test iCanClean’s ability to improve the ICA decomposition of EEG data corrupted by walking motion artifacts. Our primary objective was to determine optimal settings and performance in a parameter sweep (varying the window length and r2 cleaning aggressiveness). High-density EEG was recorded with 120 + 120 (dual-layer) EEG electrodes in young adults, high-functioning older adults, and low-functioning older adults. EEG data were decomposed by ICA after basic preprocessing and iCanClean. Components well-localized as dipoles (residual variance < 15%) and with high brain probability (ICLabel > 50%) were marked as ‘good’. We determined iCanClean’s optimal window length and cleaning aggressiveness to be 4-s and r2 = 0.65 for our data. At these settings, iCanClean improved the average number of good components from 8.4 to 13.2 (+57%). Good performance could be maintained with reduced sets of noise channels (12.7, 12.2, and 12.0 good components for 64, 32, and 16 noise channels, respectively). Overall, iCanClean shows promise as an effective method to clean mobile EEG data.

Embodiment for Robotic Lower-Limb Exoskeletons: A Narrative Review.

Research on embodiment of objects external to the human body has revealed important information about how the human nervous system interacts with robotic lower limb exoskeletons. Typical robotic exoskeleton control approaches view the controllers as an external agent intending to move in coordination with the human. However, principles of embodiment suggest that the exoskeleton controller should ideally coordinate with the human such that the nervous system can adequately model the input-output dynamics of the exoskeleton controller. Measuring embodiment of exoskeletons should be a necessary step in the exoskeleton development and prototyping process. Researchers need to establish high fidelity quantitative measures of embodiment, rather than relying on current qualitative survey measures. Mobile brain imaging techniques, such as high-density electroencephalography, is likely to provide a deeper understanding of embodiment during human-machine interactions and advance exoskeleton research and development. In this review we show why future exoskeleton research should include quantitative measures of embodiment as a metric of success.

Mobile Brain Imaging to Examine Task-Related Cortical Correlates of Reactive Balance: A Systematic Review.

This systematic review examined available findings on spatial and temporal characteristics of cortical activity in response to unpredicted mechanical perturbations. Secondly, this review investigated associations between cortical activity and behavioral/biomechanical measures. Databases were searched from 1980-2021 and a total of 35 cross-sectional studies (31 EEG and 4 fNIRS) were included. Majority of EEG studies assessed perturbation-evoked potentials (PEPs), whereas other studies assessed changes in cortical frequencies. Further, fNIRS studies assessed hemodynamic changes. The PEP-N1, commonly identified at sensorimotor areas, was most examined and was influenced by context prediction, perturbation magnitude, motor adaptation and age. Other PEPs were identified at frontal, parietal and sensorimotor areas and were influenced by task position. Further, changes in cortical frequencies were observed at prefrontal, sensorimotor and parietal areas and were influenced by task difficulty. Lastly, hemodynamic changes were observed at prefrontal and frontal areas and were influenced by task prediction. Limited studies reported associations between cortical and behavioral outcomes. This review provided evidence regarding the involvement of cerebral cortex for sensory processing of unpredicted perturbations, error-detection of expected versus actual postural state, and planning and execution of compensatory stepping responses. There is still limited evidence examining cortical activity during reactive balance tasks in populations with high fall-risk.

The Time for Translation of Mobile Brain and Body Imaging to People With Stroke Is Now

The Time for Translation of Mobile Brain and Body Imaging to People With Stroke Is Now

Neurobehavioural signatures in race car driving: a case study

Recent technological developments in mobile brain and body imaging are enabling new frontiers of real-world neuroscience. Simultaneous recordings of body movement and brain activity from highly skilled individuals as they demonstrate their exceptional skills in real-world settings, can shed new light on the neurobehavioural structure of human expertise. Driving is a real-world skill which many of us acquire to different levels of expertise. Here we ran a case-study on a subject with the highest level of driving expertise—a Formula E Champion. We studied the driver’s neural and motor patterns while he drove a sports car on the “Top Gear” race track under extreme conditions (high speed, low visibility, low temperature, wet track). His brain activity, eye movements and hand/foot movements were recorded. Brain activity in the delta, alpha, and beta frequency bands showed causal relation to hand movements. We herein demonstrate the feasibility of using mobile brain and body imaging even in very extreme conditions (race car driving) to study the sensory inputs, motor outputs, and brain states which characterise complex human skills.

Navigation in Real-World Environments: New Opportunities Afforded by Advances in Mobile Brain Imaging.

A central question in neuroscience and psychology is how the mammalian brain represents the outside world and enables interaction with it. Significant progress on this question has been made in the domain of spatial cognition, where a consistent network of brain regions that represent external space has been identified in both humans and rodents. In rodents, much of the work to date has been done in situations where the animal is free to move about naturally. By contrast, the majority of work carried out to date in humans is static, due to limitations imposed by traditional laboratory based imaging techniques. In recent years, significant progress has been made in bridging the gap between animal and human work by employing virtual reality (VR) technology to simulate aspects of real-world navigation. Despite this progress, the VR studies often fail to fully simulate important aspects of real-world navigation, where information derived from self-motion is integrated with representations of environmental features and task goals. In the current review article, we provide a brief overview of animal and human imaging work to date, focusing on commonalties and differences in findings across species. Following on from this we discuss VR studies of spatial cognition, outlining limitations and developments, before introducing mobile brain imaging techniques and describe technical challenges and solutions for real-world recording. Finally, we discuss how these advances in mobile brain imaging technology, provide an unprecedented opportunity to illuminate how the brain represents complex multifaceted information during naturalistic navigation.

Effects of Cable Sway, Electrode Surface Area, and Electrode Mass on Electroencephalography Signal Quality during Motion.

More neuroscience researchers are using scalp electroencephalography (EEG) to measure electrocortical dynamics during human locomotion and other types of movement. Motion artifacts corrupt the EEG and mask underlying neural signals of interest. The cause of motion artifacts in EEG is often attributed to electrode motion relative to the skin, but few studies have examined EEG signals under head motion. In the current study, we tested how motion artifacts are affected by the overall mass and surface area of commercially available electrodes, as well as how cable sway contributes to motion artifacts. To provide a ground-truth signal, we used a gelatin head phantom with embedded antennas broadcasting electrical signals, and recorded EEG with a commercially available electrode system. A robotic platform moved the phantom head through sinusoidal displacements at different frequencies (0–2 Hz). Results showed that a larger electrode surface area can have a small but significant effect on improving EEG signal quality during motion and that cable sway is a major contributor to motion artifacts. These results have implications in the development of future hardware for mobile brain imaging with EEG.

Independent Component Analysis of Gait-Related Movement Artifact Recorded using EEG Electrodes during Treadmill Walking.

There has been a recent surge in the use of electroencephalography (EEG) as a tool for mobile brain imaging due to its portability and fine time resolution. When EEG is combined with independent component analysis (ICA) and source localization techniques, it can model electrocortical activity as arising from temporally independent signals located in spatially distinct cortical areas. However, for mobile tasks, it is not clear how movement artifacts influence ICA and source localization. We devised a novel method to collect pure movement artifact data (devoid of any electrophysiological signals) with a 256-channel EEG system. We first blocked true electrocortical activity using a silicone swim cap. Over the silicone layer, we placed a simulated scalp with electrical properties similar to real human scalp. We collected EEG movement artifact signals from ten healthy, young subjects wearing this setup as they walked on a treadmill at speeds from 0.4–1.6 m/s. We performed ICA and dipole fitting on the EEG movement artifact data to quantify how accurately these methods would identify the artifact signals as non-neural. ICA and dipole fitting accurately localized 99% of the independent components in non-neural locations or lacked dipolar characteristics. The remaining 1% of sources had locations within the brain volume and low residual variances, but had topographical maps, power spectra, time courses, and event related spectral perturbations typical of non-neural sources. Caution should be exercised when interpreting ICA for data that includes semi-periodic artifacts including artifact arising from human walking. Alternative methods are needed for the identification and separation of movement artifact in mobile EEG signals, especially methods that can be performed in real time. Separating true brain signals from motion artifact could clear the way for EEG brain computer interfaces for assistance during mobile activities, such as walking.

Toward a new cognitive neuroscience: modeling natural brain dynamics.

Toward a new cognitive neuroscience: modeling natural brain dynamics.

The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System

Combining low-cost wireless EEG sensors with smartphones offers novel opportunities for mobile brain imaging in an everyday context. Here we present the technical details and validation of a framework for building multi-platform, portable EEG applications with real-time 3D source reconstruction. The system – Smartphone Brain Scanner – combines an off-the-shelf neuroheadset or EEG cap with a smartphone or tablet, and as such represents the first fully portable system for real-time 3D EEG imaging. We discuss the benefits and challenges, including technical limitations as well as details of real-time reconstruction of 3D images of brain activity. We present examples of brain activity captured in a simple experiment involving imagined finger tapping, which shows that the acquired signal in a relevant brain region is similar to that obtained with standard EEG lab equipment. Although the quality of the signal in a mobile solution using an off-the-shelf consumer neuroheadset is lower than the signal obtained using high-density standard EEG equipment, we propose mobile application development may offset the disadvantages and provide completely new opportunities for neuroimaging in natural settings.

Smartphones as pocketable labs: Visions for mobile brain imaging and neurofeedback

Mobile brain imaging solutions, such as the Smartphone Brain Scanner, which combines low cost wireless EEG sensors with open source software for real-time neuroimaging, may transform neuroscience experimental paradigms. Normally subject to the physical constraints in labs, neuroscience experimental paradigms can be transformed into dynamic environments allowing for the capturing of brain signals in everyday contexts. Using smartphones or tablets to access text or images may enable experimental design capable of tracing emotional responses when shopping or consuming media, incorporating sensorimotor responses reflecting our actions into brain machine interfaces, and facilitating neurofeedback training over extended periods. Even though the quality of consumer neuroheadsets is still lower than laboratory equipment and susceptible to environmental noise, we show that mobile neuroimaging solutions, like the Smartphone Brain Scanner, complemented by 3D reconstruction or source separation techniques may support a range of neuroimaging applications and thus become a valuable addition to high-end neuroimaging solutions.

Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development

Functional near infrared spectroscopy (fNIRS) is a non-invasive, safe, and portable optical neuroimaging method that can be used to assess brain dynamics during skill acquisition and performance of complex work and everyday tasks. In this paper we describe neuroergonomic studies that illustrate the use of fNIRS in the examination of training-related brain dynamics and human performance assessment. We describe results of studies investigating cognitive workload in air traffic controllers, acquisition of dual verbal-spatial working memory skill, and development of expertise in piloting unmanned vehicles. These studies used conventional fNIRS devices in which the participants were tethered to the device while seated at a workstation. Consistent with the aims of mobile brain imaging (MoBI), we also describe a compact and battery-operated wireless fNIRS system that performs with similar accuracy as other established fNIRS devices. Our results indicate that both wired and wireless fNIRS systems allow for the examination of brain function in naturalistic settings, and thus are suitable for reliable human performance monitoring and training assessment.

Biosensor Technologies for Augmented Brain–Computer Interfaces in the Next Decades

The study of brain-computer interfaces (BCIs) has undergone 30 years of intense development and has grown into a rich and diverse field. BCIs are technologies that enable direct communication between the human brain and external devices. Conventionally, wet electrodes have been employed to obtain unprecedented sensitivity to high-temporal-resolution brain activity; recently, the growing availability of various sensors that can be used to detect high-quality brain signals in a wide range of clinical and everyday environments is being exploited. This development of biosensing neurotechnologies and the desire to implement them in real-world applications have led to the opportunity to develop augmented BCIs (ABCIs) in the upcoming decades. An ABCI is similar to a BCI in that it relies on biosensors that record signals from the brain in everyday environments; the signals are then processed in real time to monitor the behavior of the human. To use an ABCI as a mobile brain imaging technique for everyday, real-life applications, the sensors and the corresponding device must be lightweight and the equipment response time must be short. This study presents an overview of the wide range of biosensor approaches currently being applied to ABCIs, from their use in the laboratory to their application in clinical and everyday use. The basic principles of each technique are described along with examples of current applications of cutting-edge neuroscience research. In summary, we show that ABCI techniques continue to grow and evolve, incorporating new technologies and advances to address ever more complex and important neuroscience issues, with advancements that are envisioned to lead to a wide range of real-life applications.

How Many Electrodes Are Really Needed for EEG-Based Mobile Brain Imaging?

A noninvasive method for imaging the human brain during mobile activities could have far reaching benefits for studies of human motor control, for research and treatment of neurological disabilities, and for brain-controlled powered prosthetic limbs or orthoses. Several recent studies have demonstrated that electroencephalography (EEG) can be used to image the brain during locomotion provided that signal processing techniques, such as independent Component Analysis (ICA), are used to parse electrocortical activity from artifact contaminated EEG. However, these studies used high-density 256-channel EEG sensor arrays, which are likely too time-consuming to setup in a clinical or field setting. Therefore, it is important to evaluate how reducing the number of EEG channel signals affects the electrocortical source signals that can be parsed from EEG recorded during standing and walking while concurrently performing a visual oddball discrimination task. Specifically, we computed temporal and spatial correlations between electrocortical sources parsed from high-density EEG and electrocortical sources parsed from reduced-channel subsets of the original high-density EEG. For this task, our results indicate that on average an EEG montage with as few as 35 channels may be sufficient to record the two most dominate electrocortical sources (temporal and spatial R2 > 0.9). Correlations for additional electrocortical sources decreased linearly such that the least dominant sources extracted from the 35 channel dataset had temporal and spatial correlations of approximately 0.7. This suggests that for certain applications the number of EEG sensors used for mobile brain imaging could be vastly reduced, but researchers and clinicians must consider the expected distribution of relevant electrocortical sources when determining the number of EEG sensors necessary for a particular application.

Cognition in action: imaging brain/body dynamics in mobile humans

We have recently developed a mobile brain imaging method (MoBI), that allows for simultaneous recording of brain and body dynamics of humans actively behaving in and interacting with their environment. A mobile imaging approach was needed to study cognitive processes that are inherently based on the use of human physical structure to obtain behavioral goals. This review gives examples of the tight coupling between human physical structure with cognitive processing and the role of supraspinal activity during control of human stance and locomotion. Existing brain imaging methods for actively behaving participants are described and new sensor technology allowing for mobile recordings of different behavioral states in humans is introduced. Finally, we review recent work demonstrating the feasibility of a MoBI system that was developed at the Swartz Center for Computational Neuroscience at the University of California, San Diego, demonstrating the range of behavior that can be investigated with this method.

Mobile Brain/Body Imaging (MoBI) of Active Cognition

Mobile Brain/Body Imaging (MoBI) of Active Cognition

The Principles of the Association and the Interrogatories of the Council

<h3>ABSTRACT</h3> Recent technological developments in mobile brain and body imaging are enabling new frontiers of real-world neuroscience. Simultaneous recordings of body movement and brain activity from highly skillful individuals as they demonstrate their exceptional skills in real-world settings, can shed new light on neurobehavioural structure of human expertise. Driving is a real-world skill which many of us acquire on different levels of expertise. Here we ran a case-study on a subject with the highest level of driving expertise - a Formula E Champion. We studied the expert driver’s neural and motor patterns while he drove a sports car in the “Top Gear” race track under extreme conditions (high speed, low visibility, low temperature, wet track). His brain activity, eye movements and hand/foot movements were recorded. Brain activity in the delta, alpha, and beta frequency bands showed causal relation to hand movements. We demonstrate, here in summary, that even in extreme situations (race track driving) a method for conducting human ethomic (Ethology + Omics) data that encompasses information on the sensory inputs and motor outputs outputs of the brain as well as brain state to characterise complex human skills.