Automatic Sleep Scoring Research Articles

A Comprehensive Study on a Deep-Learning-Based Electrocardiography Analysis for Estimating the Apnea-Hypopnea Index.

This study introduces a deep-learning-based automatic sleep scoring system to detect sleep apnea using a single-lead electrocardiography (ECG) signal, focusing on accurately estimating the apnea-hypopnea index (AHI). Unlike other research, this work emphasizes AHI estimation, crucial for the diagnosis and severity evaluation of sleep apnea. The suggested model, trained on 1465 ECG recordings, combines the deep-shallow fusion network for sleep apnea detection network (DSF-SANet) and gated recurrent units (GRUs) to analyze ECG signals at 1-min intervals, capturing sleep-related respiratory disturbances. Achieving a 0.87 correlation coefficient with actual AHI values, an accuracy of 0.82, an F1 score of 0.71, and an area under the receiver operating characteristic curve of 0.88 for per-segment classification, our model was effective in identifying sleep-breathing events and estimating the AHI, offering a promising tool for medical professionals.

Personalization of Automatic Sleep Scoring: How Best to Adapt Models to Personal Domains in Wearable EEG.

Wearable EEG enables us to capture large amounts of high-quality sleep data for diagnostic purposes. To make full use of this capacity we need high-performance automatic sleep scoring models. To this end, it has been noted that domain mismatch between recording equipment can be considerable, e.g. PSG to wearable EEG, but a previously observed benefit from personalizing models to individual subjects further indicates a personal domain in sleep EEG. In this work, we have investigated the extent of such a personal domain in wearable EEG, and review supervised and unsupervised approaches to personalization as found in the literature. We investigated the personalization effect of the unsupervised Adversarial Domain Adaptation and implemented an unsupervised method based on statistics alignment. No beneficial personalization effect was observed using these unsupervised methods. We find that supervised personalization leads to a substantial performance improvement on the target subject ranging from 15% Cohen's Kappa for subjects with poor performance ( ) to roughly 2% on subjects with high performance ( ). This improvement was present for models trained on both small and large data sets, indicating that even high-performance models benefit from supervised personalization. We found that this personalization can be beneficially regularized using Kullback-Leibler regularization, leading to lower variance with negligible cost to improvement. Based on the experiments, we recommend model personalization using Kullback-Leibler regularization.

From Scalp to Ear-EEG: A Generalizable Transfer Learning Model for Automatic Sleep Scoring in Older People.

Sleep monitoring has extensively utilized electroencephalogram (EEG) data collected from the scalp, yielding very large data repositories and well-trained analysis models. Yet, this wealth of data is lacking for emerging, less intrusive modalities, such as ear-EEG. The current study seeks to harness the abundance of open-source scalp EEG datasets by applying models pre-trained on data, either directly or with minimal fine-tuning; this is achieved in the context of effective sleep analysis from ear-EEG data that was recorded using a single in-ear electrode, referenced to the ipsilateral mastoid, and developed in-house as described in our previous work. Unlike previous studies, our research uniquely focuses on an older cohort (17 subjects aged 65-83, mean age 71.8 years, some with health conditions), and employs LightGBM for transfer learning, diverging from previous deep learning approaches. Results show that the initial accuracy of the pre-trained model on ear-EEG was 70.1%, but fine-tuning the model with ear-EEG data improved its classification accuracy to 73.7%. The fine-tuned model exhibited a statistically significant improvement (p < 0.05, dependent t-test) for 10 out of the 13 participants, as reflected by an enhanced average Cohen's kappa score (a statistical measure of inter-rater agreement for categorical items) of 0.639, indicating a stronger agreement between automated and expert classifications of sleep stages. Comparative SHAP value analysis revealed a shift in feature importance for the N3 sleep stage, underscoring the effectiveness of the fine-tuning process. Our findings underscore the potential of fine-tuning pre-trained scalp EEG models on ear-EEG data to enhance classification accuracy, particularly within an older population and using feature-based methods for transfer learning. This approach presents a promising avenue for ear-EEG analysis in sleep studies, offering new insights into the applicability of transfer learning across different populations and computational techniques. An enhanced ear-EEG method could be pivotal in remote monitoring settings, allowing for continuous, non-invasive sleep quality assessment in elderly patients with conditions like dementia or sleep apnea.

SleePyCo: Automatic sleep scoring with feature pyramid and contrastive learning

Automatic sleep scoring is essential for the diagnosis and treatment of sleep disorders and enables longitudinal sleep tracking in home environments. Conventionally, learning-based automatic sleep scoring on single-channel electroencephalogram (EEG) is actively studied because obtaining multi-channel signals during sleep is difficult. However, learning representation from raw EEG signals is challenging owing to the following issues: (1) sleep-related EEG patterns occur on different temporal and frequency scales and (2) sleep stages share similar EEG patterns. To address these issues, we propose an automatic Sleep scoring framework that incorporates (1) a feature Pyramid and (2) supervised Contrastive learning, named SleePyCo. For the feature pyramid, we propose a backbone network named SleePyCo-backbone to consider multiple feature sequences on different temporal and frequency scales. Supervised contrastive learning allows the network to extract class discriminative features by minimizing the distance between intra-class features and simultaneously maximizing that between inter-class features. Comparative analyses on four public datasets demonstrate that SleePyCo consistently outperforms existing frameworks based on single-channel EEG. Extensive ablation experiments show that SleePyCo exhibited an enhanced overall performance, with significant improvements in discrimination between sleep stages, especially for N1 and rapid eye movement (REM). Source code is available at https://github.com/gist-ailab/SleePyCo.

Decentralized data-privacy preserving deep-learning approaches for enhancing inter-database generalization in automatic sleep staging.

For a while ago, automatic sleep staging has been an active field of development. Despite multiple efforts, the area remains a focus of research interest. Indeed, while promising evaluation results have reported in some of the past literature, uptake of automatic sleep scoring in the clinical setting remains low. One of the current issues regards the difficulty to generalization performance results beyond the local testing scenario, i.e. across data from different clinics. Issues derived from data-privacy restrictions, that generally apply in the medical domain, pose additional difficulties in the successful development of these methods. In this work we propose the use of several decentralized deep-learning approaches, namely ensemble models and federated learning, for robust inter-database performance generalization and data-privacy preservation in the context of automatic sleep staging. More specifically, we explore four ensemble combination strategies (max-voting, output averaging, size-proportional weighting, and Nelder-Mead) and present a new federated learning algorithm, so-called sub-sampled federated stochastic gradient descent (ssFedSGD). To evaluate generalization capabilities of such approaches, experimental procedures are carried out using a leaving-one-database-out direct-transfer scenario on six independent and heterogeneous public sleep staging databases. The resulting performance is also compared with respect to two baseline approaches involving single-database and centralized multiple-database derived models. Our results show that proposed decentralized learning methods outperform baseline local approaches, and provide similar generalization results to centralized database-combined approaches. We therefore conclude that these methods are more preferable choices, as they come with additional advantages concerning improved scalability, flexible design, and data-privacy preservation.

The pros and cons of using automated sleep scoring in sleep research.

Sleep scoring plays a pivotal role both in sleep research and in clinical practice. Traditionally, this process has relied on manual scoring by human experts, but it is marred by time constraints, and inconsistencies between different scorers. Consequently, the quest for more efficient and reliable approaches has sparked a great interest in the realm of automatic sleep-scoring methods. In this article, we provide an exploration of the merits and drawbacks of automatic sleep scoring, alongside the pressing challenges and critical considerations that demand attention in this evolving field.

Automatic sleep-stage classification of heart rate and actigraphy data using deep and transfer learning approaches

Manual sleep-stage scoring based on full-night polysomnography data recorded in a sleep lab has been the gold standard of clinical sleep medicine. This costly and time-consuming approach is unfit for long-term studies as well as assessment of sleep on a population level. With the vast amount of physiological data becoming available from wrist-worn devices, deep learning techniques provide an opportunity for fast and reliable automatic sleep-stage classification tasks. However, training a deep neural network requires large annotated sleep databases, which are not available for long-term epidemiological studies. In this paper, we introduce an end-to-end temporal convolutional neural network able to automatically score sleep stages from raw heartbeat RR interval (RRI) and wrist actigraphy data. Moreover, a transfer learning approach enables the training of the network on a large public database (Sleep Heart Health Study, SHHS) and its subsequent application to a much smaller database recorded by a wristband device. The transfer learning significantly shortens training time and improves sleep-scoring accuracy from 68.9% to 73.8% and inter-rater reliability (Cohen’s kappa) from 0.51 to 0.59. We also found that for the SHHS database, automatic sleep-scoring accuracy using deep learning shows a logarithmic relationship with the training size. Although deep learning approaches for automatic sleep scoring are not yet comparable to the inter-rater reliability among sleep technicians, performance is expected to significantly improve in the near future when more large public databases become available. We anticipate those deep learning techniques, when combined with our transfer learning approach, will leverage automatic sleep scoring of physiological data from wearable devices and enable the investigation of sleep in large cohort studies.

Regional variability in intracerebral properties of NREM to REM sleep transitions in humans

Transitions between wake and sleep states show a progressive pattern underpinned by local sleep regulation. In contrast, little evidence is available on non-rapid eye movement (NREM) to rapid eye movement (REM) sleep boundaries, considered as mainly reflecting subcortical regulation. Using polysomnography (PSG) combined with stereoelectroencephalography (SEEG) in humans undergoing epilepsy presurgical evaluation, we explored the dynamics of NREM-to-REM transitions. PSG was used to visually score transitions and identify REM sleep features. SEEG-based local transitions were determined automatically with a machine learning algorithm using features validated for automatic intra-cranial sleep scoring (10.5281/zenodo.7410501). We analyzed 2988 channel-transitions from 29 patients. The average transition time from all intracerebral channels to the first visually marked REM sleep epoch was 8 s ± 1 min 58 s, with a great heterogeneity between brain areas. Transitions were observed first in the lateral occipital cortex, preceding scalp transition by 1 min 57 s ± 2 min 14 s (d = -0.83), and close to the first sawtooth wave marker. Regions with late transitions were the inferior frontal and orbital gyri (1 min 1 s ± 2 min 1 s, d = 0.43, and 1 min 1 s ± 2 min 5 s, d = 0.43, after scalp transition). Intracranial transitions were earlier than scalp transitions as the night advanced (last sleep cycle, d = -0.81). We show a reproducible gradual pattern of REM sleep initiation, suggesting the involvement of cortical mechanisms of regulation. This provides clues for understanding oneiric experiences occurring at the NREM/REM boundary.

Automatic Sleep Stage Classification for the Obstructive Sleep Apnea Patients with Feature Mining

Automatic sleep scoring systems have being much more attention in last decades. Whereas a wide variety of studies have been used in this subject area, the accuracies are still under acceptable limits to apply these methods in real life data. One can find many high accuracy studies in literature using standard database but when it comes to the using real data reaching such a high performances is not straightforward. In this study, five distinct datasets were prepared using 124 persons including 93 unhealthy and 31 healthy persons. These datasets consist of time-, nonlinear-, welch-, discrete wavelet transform-and Hilbert-Huang transform-features. By applying k-NN, Decision Trees, ANN, SVM and Bagged Tree classifiers to these feature sets in various manners by using feature-selection highest classification accuracy was searched. The maximum classification accuracy was detected in case of Bagged Tree classifier as 95.06% with the use of 14 features among a total of 136 features. This accuracy is relatively high compared with literature for a real-data application.

0945 A Robust Hybrid algorithm for automatic respiratory events scoring in adults

Abstract Introduction Even though Polysomnography has many advantages, manual scoring is a labor intensive and time consuming. Therefore, automatic scoring system using a deep learning algorithm has been developed and commercialized for clinical sites. However, it is challenging to explain the results of respiratory events and to measure a precise event’s duration. To overcome these challenges, a new hybrid algorithm was proposed to explain why this event was categorized and provided the accurate duration of respiratory events. Methods In order to classify respiratory events - OSA, MSA, CSA, O-hypopnea, and C-hypopnea, the proposed algorithm consists of two algorithms – deep learning and post processing algorithms. Deep learning algorithm was used to detect candidates of respiratory events and post processing algorithm was used to determine the final classification and to measure duration of events. Deep learning model consisted of five layers: a perceptron layer, three consecutive layers of long short-term memory (LSTM) cells, and two more perceptron layers. A total of 1,000 case PSG data were enrolled to develop this algorithm. To classify respiratory events from the results provided by the deep learning algorithm, auto-correlation, peak detection, de-noise filtering and transition detection were used to obtain respiratory rate and measure signal amplitude. Using these algorithm’s results, amplitude and time of baseline breathing and respiratory events were calculated and classified based on the AASM’s guidelines. Results To evaluate the performance of proposed algorithm, 30 PSG data were selected and compared with the results of deep learning algorithm. The test dataset consisted of thirty subjects with 15 OSA, 5 PLMS, 2 insomnia and 8 healthy. The kappa value of deep learning algorithms showed 0.77 (0.759, 0.78) and that of proposed algorithm was 0.838 (0.832, 0.843). They showed better agreement by 0.068 than that of deep learning algorithm. In addition, the proposed algorithm provided the classification results such as OSA, MSA, CSA, O-hypopnea and C-hypopnea and explanations of the reason of event detection. Conclusion The proposed algorithm showed better agreement and versatile classified results. This algorithm will be adopted for new automatic sleep scoring solution and this solution will be very helpful to use in real clinical sites. Support (if any)

Deep learning-based algorithm accurately classifies sleep stages in preadolescent children with sleep-disordered breathing symptoms and age-matched controls.

Visual sleep scoring has several shortcomings, including inter-scorer inconsistency, which may adversely affect diagnostic decision-making. Although automatic sleep staging in adults has been extensively studied, it is uncertain whether such sophisticated algorithms generalize well to different pediatric age groups due to distinctive EEG characteristics. The preadolescent age group (10-13-year-olds) is relatively understudied, and thus, we aimed to develop an automatic deep learning-based sleep stage classifier specifically targeting this cohort. A dataset (n = 115) containing polysomnographic recordings of Icelandic preadolescent children with sleep-disordered breathing (SDB) symptoms, and age and sex-matched controls was utilized. We developed a combined convolutional and long short-term memory neural network architecture relying on electroencephalography (F4-M1), electrooculography (E1-M2), and chin electromyography signals. Performance relative to human scoring was further evaluated by analyzing intra- and inter-rater agreements in a subset (n = 10) of data with repeat scoring from two manual scorers. The deep learning-based model achieved an overall cross-validated accuracy of 84.1% (Cohen's kappa κ = 0.78). There was no meaningful performance difference between SDB-symptomatic (n = 53) and control subgroups (n = 52) [83.9% (κ = 0.78) vs. 84.2% (κ = 0.78)]. The inter-rater reliability between manual scorers was 84.6% (κ = 0.78), and the automatic method reached similar agreements with scorers, 83.4% (κ = 0.76) and 82.7% (κ = 0.75). The developed algorithm achieved high classification accuracy and substantial agreements with two manual scorers; the performance metrics compared favorably with typical inter-rater reliability between manual scorers and performance reported in previous studies. These suggest that our algorithm may facilitate less labor-intensive and reliable automatic sleep scoring in preadolescent children.

Sleep Stage Classification using Deep Learning Techniques: A Review

Sleep is an essential time for body recovery and healthy living. Therefore, sleep monitoring for health management is important. The gold-standard method for evaluating sleep is polysomnography (PSG), and physicians score the sleep stages using night PSG recording data. However, scoring sleep stages requires considerable time and labor. Hence, more accessible and efficient sleep-scoring methods are required. Because sleep stage information provides significant information for healthcare, studies of automatic sleep scoring have been conducted to overcome the limitations of PSG. This study reviews the progress and challenges of single- and multi-biosignalbased deep learning approaches to classify the sleep stages. In addition, non-contact sensor-based methods are reviewed for long-term monitoring at home.

At-home sleep monitoring using generic ear-EEG.

A device comprising two generic earpieces with embedded dry electrodes for ear-centered electroencephalography (ear-EEG) was developed. The objective was to provide ear-EEG based sleep monitoring to a wide range of the population without tailoring the device to the individual. To validate the device ten healthy subjects were recruited for a 12-night sleep study. The study was divided into two parts; part A comprised two nights with both ear-EEG and polysomnography (PSG), and part B comprised 10 nights using only ear-EEG. In addition to the electrophysiological measurements, subjects filled out a questionnaire after each night of sleep. The subjects reported that the ear-EEG system was easy to use, and that the comfort was better in part B. The performance of the system was validated by comparing automatic sleep scoring based on ear-EEG with PSG-based sleep scoring performed by a professional trained sleep scorer. Cohen's kappa was used to assess the agreement between the manual and automatic sleep scorings, and the study showed an average kappa value of 0.71. The majority of the 20 recordings from part A yielded a kappa value above 0.7. The study was compared to a companioned study conducted with individualized earpieces. To compare the sleep across the two studies and two parts, 7 different sleeps metrics were calculated based on the automatic sleep scorings. The ear-EEG nights were validated through linear mixed model analysis in which the effects of equipment (individualized vs. generic earpieces), part (PSG and ear-EEG vs. only ear-EEG) and subject were investigated. We found that the subject effect was significant for all computed sleep metrics. Furthermore, the equipment did not show any statistical significant effect on any of the sleep metrics. These results corroborate that generic ear-EEG is a promising alternative to the gold standard PSG for sleep stage monitoring. This will allow sleep stage monitoring to be performed in a less obtrusive way and over longer periods of time, thereby enabling diagnosis and treatment of diseases with associated sleep disorders.

Sleep Staging Framework with Physiologically Harmonized Sub-Networks.

Sleep screening is an important tool for both healthcare and neuroscientific research. Automatic sleep scoring is an alternative to the time-consuming gold-standard manual scoring procedure. Recently there have seen promising results on automatic stage scoring by extracting spatio-temporal features via deep neural networks from electroencephalogram (EEG). However, such methods fail to consistently yield good performance due to a missing piece in data representation: the medical criterion of the sleep scoring task on top of EEG features. We argue that capturing stage-specific features that satisfy the criterion of sleep medicine is non-trivial for automatic sleep scoring. This paper considers two criteria: Transient stage marker and Overall profile of EEG features, then we propose a physiologically meaningful framework for sleep stage scoring via mixed deep neural networks. The framework consists of two sub-networks: feature extraction networks, constructed in consideration of the physiological characteristics of sleep, and an attention-based scoring decision network. Moreover, we quantize the framework for potential use under an IoT setting. For proof-of-concept, the performance of the proposed framework is demonstrated by introducing multiple sleep datasets with the largest comprising 42,560h recorded from 5,793 subjects. From the experiment results, the proposed method achieves a competitive stage scoring performance, especially for Wake, N2, and N3, with higher F1 scores of 0.92, 0.86, and 0.88, respectively. Moreover, the feasibility analysis of framework quantization provides a potential for future implementation in the edge computing field and clinical settings.

Channel Contribution In Deep Learning Based Automatic Sleep Scoring - How Many Channels Do We Need?

Machine learning based sleep scoring methods aim to automate the process of annotating polysomnograms with sleep stages. Although sleep signals of multiple modalities and channels should contain more information according to sleep guidelines, most multi-channel multi-modal models in the literature showed only a little performance improvement compared to single-channel EEG models and sometimes even failed to outperform them. In this paper, we investigate whether the high performance of single-channel EEG models can be attributed to specific model features in their deep learning architectures and to which extent multi-channel multi-modal models take the information from different channels of modalities into account. First, we transfer the model features from single-channel EEG models, such as combinations of small and large filters in CNNs, to multi-channel multi-modal models and measure their impacts. Second, we employ two explainability methods, the layer-wise relevance propagation as post-hoc and the embedded channel attention network as intrinsic interpretability methods, to measure the contribution of different channels on predictive performance. We find that i) single-channel model features can improve the performance of multi-channel multi-modal models and ii) multi-channel multi-modal models focus on one important channel per modality and use the remaining channels to complement the information of the focused channels. Our results suggest that more advanced methods for aggregating channel information using complementary information from other channels may improve sleep scoring performance for multi-channel multi-modal models.

Sleep scoring in rodents: Criteria, automatic approaches and outstanding issues.

There is nothing we spend as much time on in our lives as we do sleeping, which makes it even more surprising that we currently do not know why we need to sleep. Most of the research addressing this question is performed in rodents to allow for invasive, mechanistic approaches. However, in contrast to human sleep, we currently do not have shared and agreed upon standards on sleep states in rodents. In this article, we present an overview on sleep stages in humans and rodents and a historical perspective on the development of automatic sleep scoring systems in rodents. Further, we highlight specific issues in rodent sleep that also call into question some of the standards used in human sleep research.

Automatic sleep scoring using patient-specific ensemble models and knowledge distillation for ear-EEG data

Human sleep can be described as a series of transitions between distinct states. This makes automatic sleep analysis (scoring) suitable for an automatic implementation using machine learning. However, the task becomes harder when data is sampled using more light-weight or mobile equipment, often chosen due to greater comfort for the patient. In this study we investigate the improvement in sleep scoring when multiple state-of-the-art neural networks are joined into an ensemble, and subsequently distilled into a single model of identical network architecture, but with improved predictive performance. In this study we investigate ensembles of up to 10 networks, and show that, on the same data, ensembles of neural networks perform better than each single subject model (improvement: 2.4%) and that this improvement can be transferred back into a single network using a combination of patient specific data and knowledge distillation.The study demonstrates both a way to further improve automatic sleep scoring from mobile devices, which in itself is interesting, but also highlights the great potential of the vast amounts of unlabeled personal data which will become available from personal recording devices.

Do not sleep on traditional machine learning: Simple and interpretable techniques are competitive to deep learning for sleep scoring

Over the last few years, research in automatic sleep scoring has mainly focused on developing increasingly complex deep learning architectures. However, recently these approaches achieved only marginal improvements, often at the expense of requiring more data and more expensive training procedures. Despite all these efforts and their satisfactory performance, automatic sleep staging solutions are not widely adopted in a clinical context yet. We argue that most deep learning solutions for sleep scoring are limited in their real-world applicability as they are hard to train, deploy, and reproduce. Moreover, these solutions lack interpretability and transparency, which are often key to increase adoption rates. In this work, we revisit the problem of sleep stage classification using classical machine learning. Results show that competitive performance can be achieved with a conventional machine learning pipeline consisting of preprocessing, feature extraction, and a simple machine learning model. In particular, we analyze the performance of a linear model and a non-linear (gradient boosting) model. Our approach surpasses state-of-the-art (that uses the same data) on two public datasets: Sleep-EDF SC-20 (MF1 0.810) and Sleep-EDF ST (MF1 0.795), while achieving competitive results on Sleep-EDF SC-78 (MF1 0.775) and MASS SS3 (MF1 0.817). We show that, for the sleep stage scoring task, the expressiveness of an engineered feature vector is on par with the internally learned representations of deep learning models. This observation opens the door to clinical adoption, as a representative feature vector allows to leverage both the interpretability and successful track record of traditional machine learning models.

A novel approach to automatic sleep stage classification using forehead electrophysiological signals

BackgroundSleep stage scoring is very important for the effective diagnosis and intervention of sleep disorders. However, the current automatic sleep staging methods generally have the problems of poor model generalization ability and non-portable acquisition equipment. MethodIn this paper, we propose a novel automatic sleep scoring system based on forehead electrophysiological signals that is more effective and convenient than other systems. We extract 3 channel signals from the forehead, named forehead electroencephalogram 1 (Fh1), forehead electroencephalogram 2 (Fh2), and forehead center electrooculogram (Fhz). Spectral features, statistical features, and entropy features are extracted using the discrete wavelet transform (DWT) method. Light gradient boosting machine (LGB), random forest (RF), and support vector machine (SVM) are employed to classify four stages: awake, light sleep (LS), deep sleep (DS), and rapid eye movement (REM). ResultThe performance of the proposed method is validated using databases of the Sleep-EDFX and our Own-data, which include polysomnograms (PSGs) and forehead signals of 28 subjects. The overall classification accuracy of using the combination of Fh1, Fh2, and Fhz can reach up to 90.25% accuracy with a kappa coefficient of 0.857. ConclusionsThe proposed method could provide state-of-art multichannel sleep stage scoring performance with higher portability. This will facilitate the application of long-term monitoring of sleep quality in the future.

Repeated automatic sleep scoring based on ear-EEG is a valuable alternative to manually scored polysomnography.

While polysomnography (PSG) is the gold standard to quantify sleep, modern technology allows for new alternatives. PSG is obtrusive, affects the sleep it is set out to measure and requires technical assistance for mounting. A number of less obtrusive solutions based on alternative methods have been introduced, but few have been clinically validated. Here we validate one of these solutions, the ear-EEG method, against concurrently recorded PSG in twenty healthy subjects each measured for four nights. Two trained technicians scored the 80 nights of PSG independently, while an automatic algorithm scored the ear-EEG. The sleep stages and eight sleep metrics (Total Sleep Time (TST), Sleep Onset Latency, Sleep Efficiency, Wake After Sleep Onset, REM latency, REM fraction of TST, N2 fraction of TST, and N3 fraction of TST) were used in the further analysis. We found the sleep metrics: Total Sleep Time, Sleep Onset Latency, Sleep Efficiency, Wake After Sleep Onset were estimated with high accuracy and precision between automatic sleep scoring and manual sleep scoring. However, the REM latency and REM fraction of sleep showed high accuracy but low precision. Further, the automatic sleep scoring systematically overestimated the N2 fraction of sleep and slightly underestimated the N3 fraction of sleep. We demonstrate that sleep metrics estimated from automatic sleep scoring based on repeated ear-EEG in some cases are more reliably estimated with repeated nights of automatically scored ear-EEG than with a single night of manually scored PSG. Thus, given the obtrusiveness and cost of PSG, ear-EEG seems to be a useful alternative for sleep staging for the single night recording and an advantageous choice for several nights of sleep monitoring.