Symbolic Entropy Research Articles

Health condition identification of planetary gearboxes based on variational mode decomposition and generalized composite multi-scale symbolic dynamic entropy

This paper proposes a novel fault diagnosis method based on variational mode decomposition (VMD) and generalized composite multi-scale symbol dynamic entropy (GCMSDE) to identify the different health conditions of planetary gearboxes. First, VMD is adopted to remove the noises and highlight the fault symptoms. Second, GCMSDE is utilized to extract the fault features from the denoised vibration signals. Third, the Laplacian score (LS) approach is employed to refine the fault features. Finally, the new features are fed into Softmax regression to identify the health conditions of planetary gearboxes. The proposed method is numerically and experimentally demonstrated to be able to differentiate seven localized fault types on the sun gear, planet gear and ring gear of planetary gearboxes.

Studying the dynamics of interbeat interval time series of healthy and congestive heart failure subjects using scale based symbolic entropy analysis.

Considerable interest has been devoted for developing a deeper understanding of the dynamics of healthy biological systems and how these dynamics are affected due to aging and disease. Entropy based complexity measures have widely been used for quantifying the dynamics of physical and biological systems. These techniques have provided valuable information leading to a fuller understanding of the dynamics of these systems and underlying stimuli that are responsible for anomalous behavior. The single scale based traditional entropy measures yielded contradictory results about the dynamics of real world time series data of healthy and pathological subjects. Recently the multiscale entropy (MSE) algorithm was introduced for precise description of the complexity of biological signals, which was used in numerous fields since its inception. The original MSE quantified the complexity of coarse-grained time series using sample entropy. The original MSE may be unreliable for short signals because the length of the coarse-grained time series decreases with increasing scaling factor τ, however, MSE works well for long signals. To overcome the drawback of original MSE, various variants of this method have been proposed for evaluating complexity efficiently. In this study, we have proposed multiscale normalized corrected Shannon entropy (MNCSE), in which instead of using sample entropy, symbolic entropy measure NCSE has been used as an entropy estimate. The results of the study are compared with traditional MSE. The effectiveness of the proposed approach is demonstrated using noise signals as well as interbeat interval signals from healthy and pathological subjects. The preliminary results of the study indicate that MNCSE values are more stable and reliable than original MSE values. The results show that MNCSE based features lead to higher classification accuracies in comparison with the MSE based features.

Early fault diagnosis of rolling bearings based on hierarchical symbol dynamic entropy and binary tree support vector machine

Early fault diagnosis of rolling bearings is crucial to operating and maintenance cost reduction of the equipment with bearings. This paper aims to propose a novel early fault feature extraction method based on the proposed hierarchical symbol dynamic entropy (HSDE) and the binary tree support vector machine (BT-SVM). Multiscale symbolic dynamic entropy (MSDE) has been recently proposed to characterize the dynamical behavior of time series. MSDE has several merits comparing with multiscale sample entropy (MSE) and multiscale permutation entropy (MPE), such as high computational efficiency and robustness to noise. However, MSDE only utilizes the fault information in the low frequency components and consequently the fault information hidden in the high frequency components is discarded. To address this shortcoming, a new method, namely HSDE, is proposed to extract the fault information in the high frequency components. Then, the BT-SVM is utilized to automatically complete the fault type identification. The effectiveness of the proposed method is validated using simulated and experimental vibration signals. Meanwhile, a comparison is conducted between MPE, hierarchical permutation entropy (HPE), MSE, hierarchical sample entropy (HSE), MSDE and HSDE. Results show that the proposed method performs best to recognize the early fault types of rolling bearings.

Chaos and Symbol Complexity in a Conformable Fractional‐Order Memcapacitor System

Application of conformable fractional calculus in nonlinear dynamics is a new topic, and it has received increasing interests in recent years. In this paper, numerical solution of a conformable fractional nonlinear system is obtained based on the conformable differential transform method. Dynamics of a conformable fractional memcapacitor (CFM) system is analyzed by means of bifurcation diagram and Lyapunov characteristic exponents (LCEs). Rich dynamics is found, and coexisting attractors and transient state are observed. Symbol complexity of the CFM system is estimated by employing the symbolic entropy (SybEn) algorithm, symbolic spectral entropy (SybSEn) algorithm, and symbolic C0 (SybC0) algorithm. It shows that pseudorandom sequences generated by the system have high complexity and pass the rigorous NIST test. Results demonstrate that the conformable memcapacitor nonlinear system can also be a good model for real applications.

Multivariate Multiscale Symbolic Entropy Analysis of Human Gait Signals

The complexity quantification of human gait time series has received considerable interest for wearable healthcare. Symbolic entropy is one of the most prevalent algorithms used to measure the complexity of a time series, but it fails to account for the multiple time scales and multi-channel statistical dependence inherent in such time series. To overcome this problem, multivariate multiscale symbolic entropy is proposed in this paper to distinguish the complexity of human gait signals in health and disease. The embedding dimension, time delay and quantization levels are appropriately designed to construct similarity of signals for calculating complexity of human gait. The proposed method can accurately detect healthy and pathologic group from realistic multivariate human gait time series on multiple scales. It strongly supports wearable healthcare with simplicity, robustness, and fast computation.

Symbolic joint entropy reveals the coupling of various brain regions

The convergence and divergence of oscillatory behavior of different brain regions are very important for the procedure of information processing. Measurements of coupling or correlation are very useful to study the difference of brain activities. In this study, EEG signals were collected from ten subjects under two conditions, i.e. eyes closed state and idle with eyes open. We propose a nonlinear algorithm, symbolic joint entropy, to compare the coupling strength among the frontal, temporal, parietal and occipital lobes and between two different states. Instead of decomposing the EEG into different frequency bands (theta, alpha, beta, gamma etc.), the novel algorithm is to investigate the coupling from the entire spectrum of brain wave activities above 4Hz. The coupling coefficients in two states with different time delay steps are compared and the group statistics are presented as well. We find that the coupling coefficient of eyes open state with delay consistently lower than that of eyes close state across the group except for one subject, whereas the results without delay are not consistent. The differences between two brain states with non-zero delay can reveal the intrinsic inter-region coupling better. We also use the well-known Hénon map data to validate the algorithm proposed in this paper. The result shows that the method is robust and has a great potential for other physiologic time series.

Double symbolic joint entropy in nonlinear dynamic complexity analysis

Symbolizations, the base of symbolic dynamic analysis, are classified as global static and local dynamic approaches which are combined by joint entropy in our works for nonlinear dynamic complexity analysis. Two global static methods, symbolic transformations of Wessel N. symbolic entropy and base-scale entropy, and two local ones, namely symbolizations of permutation and differential entropy, constitute four double symbolic joint entropies that have accurate complexity detections in chaotic models, logistic and Henon map series. In nonlinear dynamical analysis of different kinds of heart rate variability, heartbeats of healthy young have higher complexity than those of the healthy elderly, and congestive heart failure (CHF) patients are lowest in heartbeats’ joint entropy values. Each individual symbolic entropy is improved by double symbolic joint entropy among which the combination of base-scale and differential symbolizations have best complexity analysis. Test results prove that double symbolic joint entropy is feasible in nonlinear dynamic complexity analysis.

Multiscale Symbolic Phase Transfer Entropy in Financial Time Series Classification

We address the challenge of classifying financial time series via a newly proposed multiscale symbolic phase transfer entropy (MSPTE). Using MSPTE method, we succeed to quantify the strength and direction of information flow between financial systems and classify financial time series, which are the stock indices from Europe, America and China during the period from 2006 to 2016 and the stocks of banking, aviation industry and pharmacy during the period from 2007 to 2016, simultaneously. The MSPTE analysis shows that the value of symbolic phase transfer entropy (SPTE) among stocks decreases with the increasing scale factor. It is demonstrated that MSPTE method can well divide stocks into groups by areas and industries. In addition, it can be concluded that the MSPTE analysis quantify the similarity among the stock markets. The symbolic phase transfer entropy (SPTE) between the two stocks from the same area is far less than the SPTE between stocks from different areas. The results also indicate that four stocks from America and Europe have relatively high degree of similarity and the stocks of banking and pharmaceutical industry have higher similarity for CA. It is worth mentioning that the pharmaceutical industry has weaker particular market mechanism than banking and aviation industry.

Symbolic time series analysis of electroencephalographic (EEG) epileptic seizure and brain dynamics with eye-open and eye-closed subjects during resting states

ObjectiveEpilepsy is a neuronal disorder for which the electrical discharge in the brain is synchronized, abnormal and excessive. To detect the epileptic seizures and to analyse brain activities during different mental states, various methods in non-linear dynamics have been proposed. This study is an attempt to quantify the complexity of control and epileptic subject with and without seizure as well as to distinguish eye-open (EO) and eye-closed (EC) conditions using threshold-based symbolic entropy.MethodsThe threshold-dependent symbolic entropy was applied to distinguish the healthy and epileptic subjects with seizure and seizure-free intervals (i.e. interictal and ictal) as well as to distinguish EO and EC conditions. The original time series data was converted into symbol sequences using quantization level, and word series of symbol sequences was generated using a word length of three or more. Then, normalized corrected Shannon entropy (NCSE) was computed to quantify the complexity. The NCSE values were not following the normal distribution, and the non-parametric Mann–Whitney–Wilcoxon (MWW) test was used to find significant differences among various groups at 0.05 significance level. The values of NCSE were presented in a form of topographic maps to show significant brain regions during EC and EO conditions. The results of the study were compared to those of the multiscale entropy (MSE).ResultsThe results indicated that the dynamics of healthy subjects are more complex compared to epileptic subjects (during seizure and seizure-free intervals) in both EO and EC conditions. The comparison of the dynamics of epileptic subjects revealed that seizure-free intervals are more complex than seizure intervals. The dynamics of healthy subjects during EO conditions are more complex compared to those during EC conditions. Further, the results clearly demonstrated that threshold-dependent symbolic entropy outperform MSE in distinguishing different physiological and pathological conditions.ConclusionThe threshold symbolic entropy has provided improved accuracy in quantifying the dynamics of healthy and epileptic subjects during EC an EO conditions for each electrode compared to the MSE.

Symbolic phase transfer entropy method and its application

In this paper, we introduce symbolic phase transfer entropy (SPTE) to infer the direction and strength of information flow among systems. The advantages of the proposed method are investigated by simulations on synthetic signals and real-world data. We demonstrate that symbolic phase transfer entropy is a robust and efficient tool to infer the information flow between complex systems. Based on the study of the synthetic data, we find a significant advantage of SPTE is its reduced sensitivity to noise. In addition, SPTE requires less amount of data than symbolic transfer entropy(STE). We analyze the direction and strength of information flow between six stock markets during the period from 2006 to 2016. The results indicate that the information flow among stocks varies over different periods. We also find that the interaction network pattern among stocks undergoes hierarchial reorganization with transition from one period to another. It is shown that the clusters are mainly classified according to period, and then by region. The stocks during the same time period are shown to drop into the same cluster.

A fault diagnosis scheme for planetary gearboxes using modified multi-scale symbolic dynamic entropy and mRMR feature selection

Health condition identification of planetary gearboxes is crucial to reduce the downtime and maximize productivity. This paper aims to develop a novel fault diagnosis method based on modified multi-scale symbolic dynamic entropy (MMSDE) and minimum redundancy maximum relevance (mRMR) to identify the different health conditions of planetary gearbox. MMSDE is proposed to quantify the regularity of time series, which can assess the dynamical characteristics over a range of scales. MMSDE has obvious advantages in the detection of dynamical changes and computation efficiency. Then, the mRMR approach is introduced to refine the fault features. Lastly, the obtained new features are fed into the least square support vector machine (LSSVM) to complete the fault pattern identification. The proposed method is numerically and experimentally demonstrated to be able to recognize the different fault types of planetary gearboxes.

Quantifying Effects of Pharmacological Blockers of Cardiac Autonomous Control Using Variability Parameters.

Objective: The aim of this study was to identify the most sensitive heart rate and blood pressure variability (HRV and BPV) parameters from a given set of well-known methods for the quantification of cardiovascular autonomic function after several autonomic blockades.Methods: Cardiovascular sympathetic and parasympathetic functions were studied in freely moving rats following peripheral muscarinic (methylatropine), β1-adrenergic (metoprolol), muscarinic + β1-adrenergic, α1-adrenergic (prazosin), and ganglionic (hexamethonium) blockades. Time domain, frequency domain and symbolic dynamics measures for each of HRV and BPV were classified through paired Wilcoxon test for all autonomic drugs separately. In order to select those variables that have a high relevance to, and stable influence on our target measurements (HRV, BPV) we used Fisher's Method to combine the p-value of multiple tests.Results: This analysis led to the following best set of cardiovascular variability parameters: The mean normal beat-to-beat-interval/value (HRV/BPV: meanNN), the coefficient of variation (cvNN = standard deviation over meanNN) and the root mean square differences of successive (RMSSD) of the time domain analysis. In frequency domain analysis the very-low-frequency (VLF) component was selected. From symbolic dynamics Shannon entropy of the word distribution (FWSHANNON) as well as POLVAR3, the non-linear parameter to detect intermittently decreased variability, showed the best ability to discriminate between the different autonomic blockades.Conclusion: Throughout a complex comparative analysis of HRV and BPV measures altered by a set of autonomic drugs, we identified the most sensitive set of informative cardiovascular variability indexes able to pick up the modifications imposed by the autonomic challenges. These indexes may help to increase our understanding of cardiovascular sympathetic and parasympathetic functions in translational studies of experimental diseases.

A Research on Maximum Symbolic Entropy from Intrinsic Mode Function and Its Application in Fault Diagnosis

Empirical mode decomposition (EMD) is a self-adaptive analysis method for nonlinear and nonstationary signals. It has been widely applied to machinery fault diagnosis and structural damage detection. A novel feature, maximum symbolic entropy of intrinsic mode function based on EMD, is proposed to enhance the ability of recognition of EMD in this paper. First, a signal is decomposed into a collection of intrinsic mode functions (IMFs) based on the local characteristic time scale of the signal, and then IMFs are transformed into a serious of symbolic sequence with different parameters. Second, it can be found that the entropies of symbolic IMFs are quite different. However, there is always a maximum value for a certain symbolic IMF. Third, take the maximum symbolic entropy as features to describe IMFs from a signal. Finally, the proposed features are applied to evaluate the effect of maximum symbolic entropy in fault diagnosis of rolling bearing, and then the maximum symbolic entropy is compared with other standard time analysis features in a contrast experiment. Although maximum symbolic entropy is only a time domain feature, it can reveal the signal characteristic information accurately. It can also be used in other fields related to EMD method.

EEG based topography analysis in string recognition task

Abstract Vision perception and recognition is a complex process, during which different parts of brain are involved depending on the specific modality of the vision target, e.g. face, character, or word. In this study, brain activities in string recognition task compared with idle control state are analyzed through topographies based on multiple measurements, i.e. sample entropy, symbolic sample entropy and normalized rhythm power, extracted from simultaneously collected scalp EEG. Our analyses show that, for most subjects, both symbolic sample entropy and normalized gamma power in string recognition task are significantly higher than those in idle state, especially at locations of P4, O2, T6 and C4. It implies that these regions are highly involved in string recognition task. Since symbolic sample entropy measures complexity, from the perspective of new information generation, and normalized rhythm power reveals the power distributions in frequency domain, complementary information about the underlying dynamics can be provided through the two types of indices.

The complexity of electrodermal activity is altered in mental cognitive stressors

The aim of this study was to evaluate potential changes in the electrodermal activity (EDA) to enable the detection of variations in the sympathetic nervous system during mental load and recovery period. Several EDA parameters were used: SCA (skin conductance amplitude), frequency of NS-EDR (nonspecific electrodermal responses), SIE (symbolic information entropy), and ApEn (approximate entropy). The cohort consisted of 50 healthy students (average age: 23.33±0.24yr., 25 women). The stress profile consisted of five phases: baseline (P1), Stroop test (P2), recovery (P3), mental arithmetic test (P4), and recovery (P5). All phases of the stress profile lasted six minutes.The results indicate that the three EDA indices have sufficient sensitivity to detect changes in the sympathetic nervous system. The SCA, SIE and ApEn were significantly increased during mental loads and decreased during recovery periods. However, SCA remained significantly elevated during recovery periods versus baseline, and SIE and ApEn decreased significantly during recovery versus baseline. The frequency of NS-EDR had no significant changes during stress.The EDA is a sensitive marker for evaluation of changes during the activation of sympathetic nervous system under the influence of a load. Detailed knowledge of EDA regulatory mechanisms associated with stress could provide important information associated with autonomic dysregulation.

Quantifying Structure Differences in Literature Using Symbolic Diversity and Entropy Criteria

We measured entropy and symbolic diversity of texts written in English and Spanish. We included texts by Literature Nobel laureates and other famous authors. We formed four groups of texts according to the combinations of language used and the author’s Literature Nobel Prize condition. Entropy, symbol diversity and symbol frequency profiles were compared for these four groups. We also built a scale sensitive to the quality of writing and evaluated its relationship with the Flesch’s readability index for English and the Szigriszt’s perspicuity index for Spanish. Results suggest a correlation between entropy and word diversity with quality of writing. Text genre also influences the resulting entropy and diversity of the text. Results suggest the plausibility of automated quality assessment of texts.

Symbolic Dynamics, Mixing and Entropy in the Three-Body Problem

Abstract We use symbolic dynamics in the classic equal-mass free-fall three-body problem. Different methods for constructing symbolic sequences (in the process of numerical integration of trajectories) allow one to demonstrate (and illustrate on the Agekian-Anosova map) sensitivity to initial conditions, estimate entropies (Shannon, Markov and others), plot binary collision curves, reveal systems with intensive triple interactions (interplay), etc.

Measuring signal fluctuations in gait rhythm time series of patients with Parkinson's disease using entropy parameters

Abstract Gait rhythm disturbances due to abnormal strides indicate the degenerative mobility regulation of motor neurons affected by Parkinson's disease (PD). The aim of this work is to compute the approximate entropy (ApEn), normalized symbolic entropy (NSE), and signal turns count (STC) parameters for the measurements of stride fluctuations in PD. Generalized linear regression analysis (GLRA) and support vector machine (SVM) techniques were employed to implement nonlinear gait pattern classifications. The classification performance was evaluated in terms of overall accuracy, sensitivity, specificity, precision, Matthews correlation coefficient (MCC), and area under the receiver operating characteristic (ROC) curve. Our experimental results indicated that the ApEn, NSE, and STC parameters computed from the stride series of PD patients were all significantly larger (Wilcoxon rank-sum test: p

Correlation between RR, inter-systolic and inter-diastolic intervals and their differences for the analysis of spontaneous heart rate variability

Analysis of heart rate variability (HRV) is performed through interbeat interval time series derived from either electrocardiographic or arterial pressure (AP) recordings. However, little attention has been given to the reliability of calculating the time series from different sources, i.e. electrocardiogram (ECG) or pulse intervals (PI). Therefore, the present study aimed to evaluate the correlation between interbeat interval time series obtained from RR, inter-systolic (SS) and inter-diastolic (DD) intervals, as well as their impact on indices of HRV calculated from series of RR or PI. Conscious rats previously instrumented with subcutaneous electrodes and a catheter into the femoral artery were subjected to simultaneous ECG and AP recording for 5 min. Correlation and Bland–Altman plots between RR and PI were evaluated. Moreover, HRV was analyzed in time (mean cardiac interval, SDNN and RMSSD) and frequency domain (power in LF and HF spectral bands) as well as by nonlinear approaches (symbolic dynamics and sample entropy). First, RR showed a stronger correlation with PI calculated by DD than SS. Second, most HRV indices showed similar results when calculated with RR or DD series, but not with SS series. Considering RR interval as the gold standard for the calculation of cardiac cycle, when using PI inter diastolic intervals are the better choice to study HRV. These findings are quite relevant, especially when AP recording is used for HRV analysis.

Correlated rigid modes in protein families

A great deal of evolutionarily conserved information is contained in genomes and proteins. Enormous effort has been put into understanding protein structure and developing computational tools for protein folding, and many sophisticated approaches take structure and sequence homology into account. Several groups have applied statistical physics approaches to extracting information about proteins from sequences alone. Here, we develop a new method for sequence analysis based on first principles, in information theory, in statistical physics and in Bayesian analysis. We provide a complete derivation of our approach and we apply it to a variety of systems, to demonstrate its utility and its limitations. We show in some examples that phylogenetic alignments of amino-acid sequences of families of proteins imply the existence of a small number of modes that appear to be associated with correlated global variation. These modes are uncovered efficiently in our approach by computing a non-perturbative effective potential directly from the alignment. We show that this effective potential approaches a limiting form inversely with the logarithm of the number of sequences. Mapping symbol entropy flows along modes to underlying physical structures shows that these modes arise due to correlated compensatory adjustments. In the protein examples, these occur around functional binding pockets.