Human Cognitive States Research Articles

Cognitive Computing Method Based on Decoding Psychological Emotional States

The current artificial intelligence is constrained to passively executing human command control. It cannot perceive, learn, and guide itself. Furthermore, the majority of these systems are unable to comprehend the human psychological cognitive state or emotional intention actively. To enhance the universality and generalization ability of existing emotion recognition methods, a psychological emotion state decoding method combining singular spectrum analysis and entropy measure is designed based on an electroencephalography signal. This method is developed to empower the cognitive computing system with the ability to perceive emotions. The entropy measure is accelerated by the vector dissimilarity criterion. Finally, dynamic sample entropy model learning is used to realize the cognitive calculation of psychological and emotional state recognition. The results demonstrated that the computational efficiency of the proposed decoding algorithm was significantly improved. The average recognition accuracy of positive and negative emotional states reached 82.78±16.22. The best recognition accuracy of the proposed electroencephalography emotion recognition method was 84.64%. The proposed electroencephalography emotion recognition method demonstrated an accuracy of 64.15% in recognizing cross-individual positive, neutral, and negative emotional states. The proposed emotion recognition method shows better universality and generalization performance, and can effectively identify people's psychological and emotional states.

Towards better video services: An EEG-based interpretable model for functional quality of experience evaluation

Since emerging video services can provide emotional and social value to users, the setting of their functional parameters directly affects human cognitive and affective states, further influencing video services’ quality of experience (QoE), which we call functional QoE (fQoE). FQoE is highly dependent on human subjective perceptions and the reasons for its generation are important for service providers to optimize video services. However, existing fQoE research methods are unable to perform quantitative assessment and lack interpretability. Electroencephalogram (EEG) signals have the advantage of being difficult to disguise, and contain rich brain activity information, gaining more attention from researchers nowadays. Based on EEG, we propose an interpretable model to evaluate fQoE, and the model is tested on a self-built dataset for bullet chatting video (BCV) service. Our model can effectively fuse single electrode and multi-electrode features from EEG, and introduces Graph-based Brain-area Perception Network (GBPN) for extracting fQoE sensitive brain areas, achieving satisfactory results. We find brain areas associated with fQoE caused by different functional parameters of BCV. To sum up, our fQoE model enables quantitative assessment with neurophysiological interpretability of fQoE, providing a scientific basis for the optimization and development of video services.

Pick the Right Co-Worker: Online Assessment of Cognitive Ergonomics in Human–Robot Collaborative Assembly

Human-robot collaborative assembly systems enhance the efficiency and productivity of the workplace but may increase the workers’ cognitive demand. This paper proposes an online and quantitative framework to assess the cognitive workload induced by the interaction with a co-worker, either a human operator or an industrial collaborative robot with different control strategies. The approach monitors the operator’s attention distribution and upper-body kinematics benefiting from the input images of a low-cost stereo camera and cutting-edge artificial intelligence algorithms (i.e. head pose estimation and skeleton tracking). Three experimental scenarios with variations in workstation features and interaction modalities were designed to test the performance of our online method against state-of-the-art offline measurements. Results proved that our vision-based cognitive load assessment has the potential to be integrated into the new generation of collaborative robotic technologies. The latter would enable human cognitive state monitoring and robot control strategy adaptation for improving human comfort, ergonomics, and trust in automation.

Structural properties of optimal fidelity selection policies for human-in-the-loop queues

We study optimal fidelity selection for a human operator servicing a queue of homogeneous tasks. The agent can service a task with a normal or high fidelity level, where fidelity refers to the degree of exactness and precision while servicing the task. Therefore, high-fidelity servicing results in higher-quality service but leads to larger service times and increased operator tiredness. We treat the human cognitive state as a lumped parameter that captures psychological factors such as workload and fatigue. The operator’s service time distribution depends on her cognitive dynamics and the fidelity level selected for servicing the task. Her cognitive dynamics evolve as a Markov chain in which the cognitive state increases with high probability whenever she is busy and decreases while resting. The tasks arrive according to a Poisson process and the operator is penalized at a fixed rate for each task waiting in the queue. We address the trade-off between high-quality service of the task and consequent penalty due to a subsequent increase in queue length using a discrete-time Semi-Markov Decision Process framework. We numerically determine an optimal policy and the corresponding optimal value function. Finally, we establish the structural properties of an optimal fidelity policy and provide conditions under which the optimal policy is a threshold-based policy.

On validating a generic camera‐based blink detection system for cognitive load assessment

AbstractDetecting the human operator's cognitive state is paramount in settings wherein maintaining optimal workload is necessary for task performance. Blink rate is an established metric of cognitive load, with a higher blink frequency being observed under conditions of greater workload. Measuring blink rate requires the use of eye‐trackers which limits the adoption of this metric in the real‐world. The authors aim to investigate the effectiveness of using a generic camera‐based system as a way to assess the user's cognitive load during a computer task. Participants completed a mental task while sitting in front of a computer. Blink rate was recorded via both the generic camera‐based system and a scientific‐grade eye‐tracker for validation purposes. Cognitive load was also assessed through the performance in a single stimulus detection task. The blink rate recorded via the generic camera‐based approach did not differ from the one obtained through the eye‐tracker. No meaningful changes in blink rate were however observed with increasing cognitive load. Results show the generic‐camera based system may represent a more affordable, ubiquitous means for assessing cognitive workload during computer task. Future work should further investigate ways to increase its accuracy during the completion of more realistic tasks.

Eye-Tracking in Physical Human-Robot Interaction: Mental Workload and Performance Prediction.

In Physical Human-Robot Interaction (pHRI), the need to learn the robot's motor-control dynamics is associated with increased cognitive load. Eye-tracking metrics can help understand the dynamics of fluctuating mental workload over the course of learning. The aim of this study was to test eye-tracking measures' sensitivity and reliability to variations in task difficulty, as well as their performance-prediction capability, in physical human-robot collaboration tasks involving an industrial robot for object comanipulation. Participants (9M, 9F) learned to coperform a virtual pick-and-place task with a bimanual robot over multiple trials. Joint stiffness of the robot was manipulated to increase motor-coordination demands. The psychometric properties of eye-tracking measures and their ability to predict performance was investigated. Stationary Gaze Entropy and pupil diameter were the most reliable and sensitive measures of workload associated with changes in task difficulty and learning. Increased task difficulty was more likely to result in a robot-monitoring strategy. Eye-tracking measures were able to predict the occurrence of success or failure in each trial with 70% sensitivity and 71% accuracy. The sensitivity and reliability of eye-tracking measures was acceptable, although values were lower than those observed in cognitive domains. Measures of gaze behaviors indicative of visual monitoring strategies were most sensitive to task difficulty manipulations, and should be explored further for the pHRI domain where motor-control and internal-model formation will likely be strong contributors to workload. Future collaborative robots can adapt to human cognitive state and skill-level measured using eye-tracking measures of workload and visual attention.

Multimodal Social Data Analytics on the Design and Implementation of an EEG-Mechatronic System Interface

The devices that can read Electroencephalography (EEG) signals have been widely used for Brain-Computer Interfaces (BCIs). Popularity in the field of BCIs has increased in recent years with the development of several consumer-grade EEG devices that can detect human cognitive states in real-time and deliver feedback to enhance human performance. Several previous studies have been conducted to understand the fundamentals and essential aspects of EEG in BCIs. However, the significant issue of how consumer-grade EEG devices can be used to control mechatronic systems effectively has been given less attention. In this article, we have designed and implemented an EEG BCI system using the OpenBCI Cyton headset and a user interface running a game to explore the concept of streamlining the interaction between humans and mechatronic systems with a BCI EEG-mechatronic system interface. Big Multimodal Social Data (BMSD) analytics can be applied to the high-frequency and high-volume EEG data, allowing us to explore aspects of data acquisition, data processing, and data validation and evaluate the Quality of Experience (QoE) of our system. We employ real-world participants to play a game to gather training data that was later put into multiple machine learning models, including a linear discriminant analysis (LDA), k-nearest neighbours (KNN), and a convolutional neural network (CNN). After training the machine learning models, a validation phase of the experiment took place where participants tried to play the same game but without direct control, utilising the outputs of the machine learning models to determine how the game moved. We find that a CNN trained to the specific user was able to control the game and performed with the highest activation accuracy from the machine learning models tested, along with the highest user-rated QoE, which gives us significant insight for future implementation with a mechatronic system.

A Novel Probabilistic Network Model for Estimating Cognitive-Gait Connection Using Multimodal Interface

Research in human gait analysis has captivated several computer vision researchers to solve human identification problems. The proposed work provides a novel approach for cognitive state estimation via multi-modal analysis. The advantage of multi-modal system is to provide adequate motion signatures with ensemble of multimodal gait data to ensure data reliability for classification. The relationship between human cognitive states and gait is predicted using both temporal and non-temporal probabilistic models. We estimate prior probability tables for non-temporal probabilistic model known as Simple Bayesian Model after analysing the data acquired from Inertial Measurement Unit (IMU), Electroencephalography (EEG) and multiple Kinect V2.0 sensors. A novel Dynamic Bayesian Network (DBN) is used as probabilistic temporal model for estimating most probable sequence of transitions among human cognitive states. We apply Gaussian Mixture Modelling with Expectation maximisation (GMM-EM) to tune transition and emission probabilities for maximizing the probability of the observed sequence. A promising estimation accuracy of 88.6% is obtained. Also, Principal Component Analysis (PCA) and k-nearest neighbour (kNN) algorithms are applied separately to calculate the input probabilities for DBN model. It is observed that both GMM-EM and k-NN based approaches outperform all the state-of-the-art techniques. Moreover, standard statistical tests are performed on acquired dataset to validate the experimental results.

Estimating Systemic Cognitive States from a Mixture of Physiological and Brain Signals.

As human-machine teams are being considered for a variety of mixed-initiative tasks, detecting and being responsive to human cognitive states, in particular systematic cognitive states, is among the most critical capabilities for artificial systems to ensure smooth interactions with humans and high overall team performance. Various human physiological parameters, such as heart rate, respiration rate, blood pressure, and skin conductance, as well as brain activity inferred from functional near-infrared spectroscopy or electroencephalogram, have been linked to different systemic cognitive states, such as workload, distraction, or mind-wandering among others. Whether these multimodal signals are indeed sufficient to isolate such cognitive states across individuals performing tasks or whether additional contextual information (e.g., about the task state or the task environment) is required for making appropriate inferences remains an important openproblem. In this paper, we introduce an experimental and machine learning framework for investigating these questions and focus specifically on using physiological and neurophysiological measurements to learn classifiers associated with systemic cognitive states like cognitive load, distraction, sense of urgency, mind wandering, and interference. Specifically, we describe a multitasking interactive experimental setting used to obtain a comprehensive multimodal data set which provided the foundation for a first evaluation of various standard state-of-the-art machine learning techniques with respect to their effectiveness in inferring systemic cognitive states. While the classification success of these standard methods based on just the physiological and neurophysiological signals across subjects was modest, which is to be expected given the complexity of the classification problem and the possibility that higher accuracy rates might not in general be achievable, the results nevertheless can serve as a baseline for evaluating future efforts to improve classification, especially methods that take contextual aspects such as task and environmental states into account.

A machine learning-based decision support system for temporal human cognitive state estimation during online education using wearable physiological monitoring devices

Over the last decade, there has been a considerable increase in the popularity of online education. As a result, the online learning or e-learning industry has flourished, providing benefits to students, learners, educators, and education experts. Despite the advantages of e-learning, it also has its drawbacks. While e-learning enables students to access the learning materials at their convenience from any location, one of the significant challenges is the lack of monitoring of their level of attention during e-learning sessions. It is challenging to ascertain whether a student is actively engaged in the learning process. To address this issue, we have proposed a decision support system (DSS) based on wearable physiological sensor signals (i.e., Electroencephalogram (EEG) signals) that can inform the instructor whether a student is attentive. For developing DSS, we recorded an EEG-based dataset using a neurosky device, and 100 individuals participated in the study. The learning state is divided into two categories: attentive and inattentive. In this paper, machine learning techniques are employed to integrate the proposed DSS, which can predict, analyse, and validate the student’s level of attention or inattention throughout the e-learning session. The findings show that the Support Vector Machine (SVM) approach is the most efficient method for attention prediction, achieving an accuracy of 91.68% compared to logistic regression and ridge regression. Additionally, we examined the frequency bands that were most significant in predicting the learning state, with beta and alpha waves being identified as the key contributors in predicting attention. To further evaluate the data, we use K-means and Hierarchical algorithms to cluster beta and alpha data points. K-means effectively identifies an ideal representative of an attentive or inattentive state. Thus, EEG waves can effectively reveal whether a student is attentive during real-time e-learning sessions, providing a promising approach for providing a valuable tool for decision support in the E-Learning Environment.

Modelling the Trust Value for Human Agents Based on Real-Time Human States in Human-Autonomous Teaming Systems

The modelling of trust values on agents is broadly considered fundamental for decision-making in human-autonomous teaming (HAT) systems. Compared to the evaluation of trust values for robotic agents, estimating human trust is more challenging due to trust miscalibration issues, including undertrust and overtrust problems. From a subjective perception, human trust could be altered along with dynamic human cognitive states, which makes trust values hard to calibrate properly. Thus, in an attempt to capture the dynamics of human trust, the present study evaluated the dynamic nature of trust for human agents through real-time multievidence measures, including human states of attention, stress and perception abilities. The proposed multievidence human trust model applied an adaptive fusion method based on fuzzy reinforcement learning to fuse multievidence from eye trackers, heart rate monitors and human awareness. In addition, fuzzy reinforcement learning was applied to generate rewards via a fuzzy logic inference process that has tolerance for uncertainty in human physiological signals. The results of robot simulation suggest that the proposed trust model can generate reliable human trust values based on real-time cognitive states in the process of ongoing tasks. Moreover, the human-autonomous team with the proposed trust model improved the system efficiency by over 50% compared to the team with only autonomous agents. These results may demonstrate that the proposed model could provide insight into the real-time adaptation of HAT systems based on human states and, thus, might help develop new ways to enhance future HAT systems better.

Estimation of Subjectively Reported Trust, Mental Workload, and Situation Awareness Using Unobtrusive Measures.

We use a set of unobtrusive measures to estimate subjectively reported trust, mental workload, and situation awareness (henceforth "TWSA"). Subjective questionnaires are commonly used to assess human cognitive states. However, they are obtrusive and usually impractical to administer during operations. Measures derived from actions operators take while working (which we call "embedded measures") have been proposed as an unobtrusive way to obtain TWSA estimates. Embedded measures have not been systematically investigated for each of TWSA, which prevents their operational utility. Fifteen participants completed twelve trials of spaceflight-relevant tasks while using a simulated autonomous system. Embedded measures of TWSA were obtained during each trial and participants completed TWSA questionnaires after each trial. Statistical models incorporating our embedded measures were fit with various formulations, interaction effects, and levels of personalization to understand their benefits and improve model accuracy. The stepwise algorithm for building statistical models usually included embedded measures, which frequently corresponded to an intuitive increase or decrease in reported TWSA. Embedded measures alone could not accurately capture an operator's cognitive state, but combining the measures with readily observable task information or information about participants' backgrounds enabled the models to achieve good descriptive fit and accurate prediction of TWSA. Statistical models leveraging embedded measures of TWSA can be used to accurately estimate responses on subjective questionnaires that measure TWSA. Our systematic approach to investigating embedded measures and fitting models allows for cognitive state estimation without disrupting tasks when administering questionnaires would be impractical.

Investigating Methods for Cognitive Workload Estimation for Assistive Robots.

Robots interacting with humans in assistive contexts have to be sensitive to human cognitive states to be able to provide help when it is needed and not overburden the human when the human is busy. Yet, it is currently still unclear which sensing modality might allow robots to derive the best evidence of human workload. In this work, we analyzed and modeled data from a multi-modal simulated driving study specifically designed to evaluate different levels of cognitive workload induced by various secondary tasks such as dialogue interactions and braking events in addition to the primary driving task. Specifically, we performed statistical analyses of various physiological signals including eye gaze, electroencephalography, and arterial blood pressure from the healthy volunteers and utilized several machine learning methodologies including k-nearest neighbor, naive Bayes, random forest, support-vector machines, and neural network-based models to infer human cognitive workload levels. Our analyses provide evidence for eye gaze being the best physiological indicator of human cognitive workload, even when multiple signals are combined. Specifically, the highest accuracy (in %) of binary workload classification based on eye gaze signals is 80.45 ∓ 3.15 achieved by using support-vector machines, while the highest accuracy combining eye gaze and electroencephalography is only 77.08 ∓ 3.22 achieved by a neural network-based model. Our findings are important for future efforts of real-time workload estimation in the multimodal human-robot interactive systems given that eye gaze is easy to collect and process and less susceptible to noise artifacts compared to other physiological signal modalities.

Multivariate computational linguistic analysis for early detection of cognitive impairment

AbstractBackgroundThe overarching goal of this study was to develop a novel computational linguistic algorithm that can be used to build a machine learning platform for recognizing changes in cognitive abilities during the progression of psychopathological disorders or predicting clinical prognosis following a brain injury or therapeutic interventions.MethodThe computational linguistic algorithm developed in this study evaluates lexical diversity, lexical complexity, and emotional tones in a quantitative manner. An existing algorithm that quantifies idea density was also included in this study. The initial proof‐of‐concept study was performed on various published books by well‐known authors, including Iris Murdoch who developed Alzheimer’s disease (AD) later in life. Ten interviews of patients with mild AD and ten interviews of healthy age‐matched individuals were evaluated. The transcript of each video was produced manually. Each transcript was analyzed using the computational linguistic algorithm for lexical diversity/complexity, emotional tones, and idea density. Quantitative linguistic values were compared between patients with mild AD and healthy age‐matched individuals.ResultA computational linguistic analysis of various books resulted in findings that were consistent with the nature and subject of each book. Among all the computational linguistic variables evaluated in this study, the book written by Irish Murdoch after the onset of AD showed a decrease in the level of lexical complexity by 17.5%. Interestingly, a 20% decrease in the level of lexical complexity was also noted when video interviews of patients with mild AD were compared to normal age‐matched individuals. The video transcripts of AD patients showed a statistically significant increase in the levels of anger, fear, and sadness. We are currently conducting a study to compare computational linguistic variables in response to writing prompts between patients with mild AD and healthy age‐matched individuals. Preliminary results indicate that patients with AD show a similar decrease in the level of lexical complexity as well as quantifiable changes in emotional tones.ConclusionThe computational linguistic algorithm developed in this study may lead to a machine learning approach or artificial intelligence platform to detect linguistic changes that may occur in the human cognitive state for both diagnosis and/or prognosis of mental health conditions.

Application of Eye Tracking Technology in Aviation, Maritime, and Construction Industries: A Systematic Review.

Most accidents in the aviation, maritime, and construction industries are caused by human error, which can be traced back to impaired mental performance and attention failure. In 1596, Du Laurens, a French anatomist and medical scientist, said that the eyes are the windows of the mind. Eye tracking research dates back almost 150 years and it has been widely used in different fields for several purposes. Overall, eye tracking technologies provide the means to capture in real time a variety of eye movements that reflect different human cognitive, emotional, and physiological states, which can be used to gain a wider understanding of the human mind in different scenarios. This systematic literature review explored the different applications of eye tracking research in three high-risk industries, namely aviation, maritime, and construction. The results of this research uncovered the demographic distribution and applications of eye tracking research, as well as the different technologies that have been integrated to study the visual, cognitive, and attentional aspects of human mental performance. Moreover, different research gaps and potential future research directions were highlighted in relation to the usage of additional technologies to support, validate, and enhance eye tracking research to better understand human mental performance.

On effective cognitive state classification using novel feature extraction strategies.

Investigating new features for human cognitive state classification is an intiguing area of research with Electroencephalography (EEG) based signal analysis. We plan to develop a cost-effective system for cognitive state classification using ambulatory EEG signals. A novel event driven environment is created using external stimuli for capturing EEG data using a 14-channel Emotiv neuro-headset. A new feature extraction method, Gammatone Cepstrum Coefficients (GTCC) is introduced for ambulatory EEG signal analysis. The efficacy of this technique is compared with other feature extraction methods such as Discrete Wavelet Transformation (DWT) and Mel-Frequency Cepstral Coefficients (MFCC) using statistical metrics such as Fisher Discriminant Ratio (FDR) and Logistic Regression (LR). We obtain higher values for GTCC features, demonstrating its discriminative power during classification. A superior performance is achieved for the EEG dataset with a novel ensemble feature space comprising of GTCC and MFCC. Furthermore, the ensemble feature sets are passed through a proposed 1D Convolution Neural Networks (CNN) model to extract novel features. Various classification models like Probabilistic neural network (P-NN), Linear Discriminant Analysis (LDA), Multi-Class Support Vector Machine (MCSVM), Decision Tree (DT), Random Forest (RF) and Deep Convolutional Generative Adversarial Network (DCGAN) are employed to observe best accuracy on extracted features. The proposed GTCC, (GTCC+MFCC) & (GTCC +MFCC +CNN) features outperform the state-of-the-art techniques for all cases in our work. With GTCC+MFCC feature space and GTCC+MFCC+CNN features, accuracies of 96.42% and 96.14% are attained with the DCGAN classifier. Higher classification accuracies of the proposed system makes it a cynosure in the field of cognitive science.

Moral Decision Making in Human-Agent Teams: Human Control and the Role of Explanations.

With the progress of Artificial Intelligence, intelligent agents are increasingly being deployed in tasks for which ethical guidelines and moral values apply. As artificial agents do not have a legal position, humans should be held accountable if actions do not comply, implying humans need to exercise control. This is often labeled as Meaningful Human Control (MHC). In this paper, achieving MHC is addressed as a design problem, defining the collaboration between humans and agents. We propose three possible team designs (Team Design Patterns), varying in the level of autonomy on the agent’s part. The team designs include explanations given by the agent to clarify its reasoning and decision-making. The designs were implemented in a simulation of a medical triage task, to be executed by a domain expert and an artificial agent. The triage task simulates making decisions under time pressure, with too few resources available to comply with all medical guidelines all the time, hence involving moral choices. Domain experts (i.e., health care professionals) participated in the present study. One goal was to assess the ecological relevance of the simulation. Secondly, to explore the control that the human has over the agent to warrant moral compliant behavior in each proposed team design. Thirdly, to evaluate the role of agent explanations on the human’s understanding in the agent’s reasoning. Results showed that the experts overall found the task a believable simulation of what might occur in reality. Domain experts experienced control over the team’s moral compliance when consequences were quickly noticeable. When instead the consequences emerged much later, the experts experienced less control and felt less responsible. Possibly due to the experienced time pressure implemented in the task or over trust in the agent, the experts did not use explanations much during the task; when asked afterwards they however considered these to be useful. It is concluded that a team design should emphasize and support the human to develop a sense of responsibility for the agent’s behavior and for the team’s decisions. The design should include explanations that fit with the assigned team roles as well as the human cognitive state.

Functional annotation of human cognitive states using deep graph convolution

A key goal in neuroscience is to understand brain mechanisms of cognitive functions. An emerging approach is “brain decoding”, which consists of inferring a set of experimental conditions performed by a participant, using pattern classification of brain activity. Few works so far have attempted to train a brain decoding model that would generalize across many different cognitive tasks drawn from multiple cognitive domains. To tackle this problem, we proposed a multidomain brain decoder that automatically learns the spatiotemporal dynamics of brain response within a short time window using a deep learning approach. We evaluated the decoding model on a large population of 1200 participants, under 21 different experimental conditions spanning six different cognitive domains, acquired from the Human Connectome Project task-fMRI database. Using a 10s window of fMRI response, the 21 cognitive states were identified with a test accuracy of 90% (chance level 4.8%). Performance remained good when using a 6s window (82%). It was even feasible to decode cognitive states from a single fMRI volume (720ms), with the performance following the shape of the hemodynamic response. Moreover, a saliency map analysis demonstrated that the high decoding performance was driven by the response of biologically meaningful brain regions. Together, we provide an automated tool to annotate human brain activity with fine temporal resolution and fine cognitive granularity. Our model shows potential applications as a reference model for domain adaptation, possibly making contributions in a variety of domains, including neurological and psychiatric disorders.

EEG-Based Brain-Computer Interfaces (BCIs): A Survey of Recent Studies on Signal Sensing Technologies and Computational Intelligence Approaches and Their Applications

Brain-Computer interfaces (BCIs) enhance the capability of human brain activities to interact with the environment. Recent advancements in technology and machine learning algorithms have increased interest in electroencephalographic (EEG)-based BCI applications. EEG-based intelligent BCI systems can facilitate continuous monitoring of fluctuations in human cognitive states under monotonous tasks, which is both beneficial for people in need of healthcare support and general researchers in different domain areas. In this review, we survey the recent literature on EEG signal sensing technologies and computational intelligence approaches in BCI applications, compensating for the gaps in the systematic summary of the past five years. Specifically, we first review the current status of BCI and signal sensing technologies for collecting reliable EEG signals. Then, we demonstrate state-of-the-art computational intelligence techniques, including fuzzy models and transfer learning in machine learning and deep learning algorithms, to detect, monitor, and maintain human cognitive states and task performance in prevalent applications. Finally, we present a couple of innovative BCI-inspired healthcare applications and discuss future research directions in EEG-based BCI research.

A review on psychophysiological measures of human cognitive states applied in human computer interaction

This article examines psychophysiological measurements used in Human Computer Interaction (HCI), with a particular emphasis on research involving human cognitive states. Psychophysiological measurements, despite their drawbacks, provide a potential method of user understanding in fields such as HCI that seek a “sixth sense” for user psychological shifts. First, we'll go through the relevant research and the most common cognitive state assessments. The basics of psychophysiological measurements are next examined in more depth. In the form of a table, we offer comprehensive information on their diagnostic ability and sensitivity to human cognitive processes. Finally, the article examines the most recent applications and suggests future possibilities.