Fuzzy C-means Research Articles

Revolutionary Data Deduplication with Fuzzy C-Means: Advancing Data Quality Management

Revolutionary Data Deduplication with Fuzzy C-Means: Advancing Data Quality Management

Motion Clutter Suppression for Non-Cooperative Target Identification Based on Frequency Correlation Dual-SVD Reconstruction.

Non-cooperative targets, such as birds and unmanned aerial vehicles (UAVs), are typical low-altitude, slow, and small (LSS) targets with low observability. Radar observations in such scenarios are often complicated by strong motion clutter originating from sources like airplanes and cars. Hence, distinguishing between birds and UAVs in environments with strong motion clutter is crucial for improving target monitoring performance and ensuring flight safety. To address the impact of strong motion clutter on discriminating between UAVs and birds, we propose a frequency correlation dual-SVD (singular value decomposition) reconstruction method. This method exploits the strong power and spectral correlation characteristics of motion clutter, contrasted with the weak scattering characteristics of bird and UAV targets, to effectively suppress clutter. Unlike traditional clutter suppression methods based on SVD, our method avoids residual clutter or target loss while preserving the micro-motion characteristics of the targets. Based on the distinct micro-motion characteristics of birds and UAVs, we extract two key features: the sum of normalized large eigenvalues of the target's micro-motion component and the energy entropy of the time-frequency spectrum of the radar echoes. Subsequently, the kernel fuzzy c-means algorithm is applied to classify bird and UAV targets. The effectiveness of our proposed method is validated through results using both simulation and experimental data.

Innovative trend analysis technique with fuzzy logic and K-means clustering approach for identification of homogenous rainfall region: A long-term rainfall data analysis over Bangladesh

Understanding regional climatic trends is crucial for taking appropriate actions to mitigate the impacts of climate change and managing water resources effectively. This study aims to investigate the dissimilarities and similarities among various climate stations in Bangladesh from 1981 to 2021. Fuzzy C-means (FCM) and K-means clustering techniques were employed to identify regions with comparable rainfall patterns. Moreover, the innovative trend analysis (ITA) and the Mann-Kendall (MK) test family were utilized to analyze rainfall trends. The results indicate that both K-means and FCM methods successfully detected two rainfall regions in Bangladesh with distinct patterns. The ITA curve analysis revealed that out of the 29 stations, 13 had a non-monotonic increasing trend having no monotonic increasing trend, 8 had a non-monotonic decreasing trend, and 8 exhibited a monotonic decreasing trend. Additionally, the MK tests employed in the study showed predominantly negative trends across Bangladesh. The majority of stations (65.51%) fell into Cluster 1, while the remaining 34.48% were in Cluster 2. In terms of ITA analysis, 17.24% of stations exhibited a monotonic decrease, while there were no stations with a monotonic increase. However, 37.93% of stations showed a non-monotonic increase, and 44.83% displayed a non-monotonic decrease. These identified regions can provide valuable insights for water resource management, disaster risk reduction, and agricultural planning. Moreover, detailed rainfall analysis can help policymakers and scientists develop sustainable and effective regional-scale policies for managing the country's flood and drought situations, ultimately supporting agricultural development and environmental planning.

Short-term load forecasting: cascade intuitionistic fuzzy time series—univariate and bivariate models

AbstractShort-term load forecasting (STLF) is essential for developing reliable and sustainable economic and operational strategies for power systems. This study presents a forecasting model combining cascade forward neural network (CFNN) and intuitionistic fuzzy time series (IFTS) models for STLF. The proposed cascading intuitionistic fuzzy time series forecasting model (C-IFTS-FM) offers the advantage of CFNN using the links of both linear and nonlinear to model fuzzy relations between inputs and outputs. Moreover, it offers a more reliable and realistic approach to uncertainty, taking notice of also the degree of hesitation. C-IFTS-FM works in univariate structure when it uses only hourly load data, and in bivariate structure when it uses hourly load data and hourly temperature time series together. The conversion of time series into IFTS is realized with intuitionistic fuzzy c-means (IFCM). Thus, the membership and non-membership values for each data point are produced. In modelling process, membership and non-membership values, in addition to actual lagged observations, are used as input of the CFNNs. The effectiveness of C-IFTS-FM on test sets for both structures was discussed comparatively via different error criteria, in addition, the convergence time was examined, and also the fit of forecasts and observations was presented with different illustrations. Among different combinations of hyperparameters, in the best case, approximately 86% better accuracy is achieved than the best of the others, while even in the case of the worst of hyperparameters combination, the accuracy was improved by over 20% for the PSJM data sets. For HEXING, CHENGNAN, and EUNITE data sets, these progress rates reached approximately 90% in the best case.

Nakagami-fuzzy imaging for grading brain tumors by analyzing fractal complexity

Gliomas are the brain tumors in glial cells, which are categorized into four numerical grades, I-II-III-IV, to quantize the aggressiveness and severity of the tumors; while divided into two major groups, high-grade (HG) and low-grade (LG), in general. Among many differences between these groups, one of the most distinct and characteristic features could be seen in the shape of the tumor boundaries by magnetic resonance imaging (MRI). Due to aggressive nature of the HG tumors in proliferation phase, the boundaries of HG tumors become more shape-wise complex compared to the LG tumors, which could be differentiated by analyzing the fractal complexity of the cell membranes. However, the complexity cannot be either manually calculated or estimated by eye inspection without a reference point with one single image or sometimes even with an image set. Therefore, we present an automated glioma grading framework to provide an insight on the grades with a novel contouring and fractal dimension analysis system. The primary component of the proposed system is an automated Nakagami imaging module with a specialized fuzzy c-means algorithm to contour the boundaries of the whole tumors. The contoured images, afterwards, are analyzed by the Minkowski–Bouligand and Hausdorff methods for two panning options to generate the fractal dimensions and to estimate the fractal complexities for classifying the gliomas The results are greatly encouraging that the overall classification accuracy is computed as 88.31 % using the basic support vector machines (SVM) classifier; while as 91.96 % with the arbitrary thresholding appended. The outcomes of this paper with implementable mathematical infrastructure would be very useful and beneficial as an expert system in intelligent and automatic glioma grading, for researchers and medical experts.

Optimized Deep LSTM-Based Multi-Object Tracking with Occlusion Handling Mechanism

The multi-object tracking is a basic computer vision process having a huge class of real-life tools that range from monitoring of medical video to surveillance. The goal of tracking numerous items is to place numerous objects in a scene, handle their identities throughout time, and construct trajectories for analysis. However, this is a complex task, because of certain issues like occlusions, complicated object dynamics, and variations in the appearance of objects. In this research, a new technique named TPRO-based Deep LSTM is developed for tracking multi-object with occlusion handling. Here, the videos are considered as input wherein the extraction of frames is done from each video. Each frame undergoes pre-processing with filtering to eliminate noise from frames. By using a sparse Fuzzy c-Means (FCM) and Local Optimal-Oriented Pattern (LOOP) features, the localization of objects is done. Moreover, the visual and spatial trackings are considered for hybrid tracking. The second derivative model and neighborhood search model are used to perform visual tracking. Then the occlusion handling is performed. Concurrently, with the use of Deep Long Short-Term Memory (Deep LSTM) the spatial tracking is performed and the Taylor Poor Rich Optimization (TPRO) algorithm assigns the weight and bias of the Deep LSTM. The TPRO is obtained by the unification of the Taylor series along with the Poor and Rich Optimization algorithm. By combining visual and spatial tracking, the final tracked output is generated. The devised method achieves a performance with the highest value of 88.9% for Multiple Object Tracking Precision (MOTP), smallest tracking distance (TD) of 4.185, average MOTP of 0.889, average TD of 4.201, and highest tracking number (TN) of 14.

ANALYSIS OF CLUSTERING METHODS ON THE CAUSAL FACTORS OF DIABETES MELLITUS WITH FUZZY C MEANS METHOD

This study focuses on the effectiveness of clustering algorithms, namely Fuzzy C-Means by using k-Means algorithm as a supporting method, in the factors that cause Diabetes Mellitus. Diabetes mellitus is a chronic disease characterized by high levels of sugar (glucose) in the blood. Indonesia ranks 5th with the highest diabetes Mellitus patients in the world. This study aims to understand the pattern of factors causing Diabetes Mellitus and test the effectiveness of the clustering algorithm used. The data analysis methods include data collection, data pre-processing, distribution of cluster numbers, algorithm implementation, model adjustment, model training, model evaluation, and analysis of results. The results showed that the Fuzzy C-Means algorithm gets a coefficient of Fuzzynes score of 0.23 with a validation score of 0.40, while for supporting methods used K-Means algorithm gets a validation score of 0.32. This result shows that Fuzzy C-Means algorithm is superior in clastering the factors that cause Diabetes mellitus. The results of what variables have the most effect on cluster values 0 and 1. Where cluster 0 is a cluster that shows which variables are more at risk of diabetes, while cluster 1 is a cluster whose value shows what variables are far from the risk of causing diabetes mellitus. Then based on the results of the cluster that has been done, random blood sugar variables become the most influential variable on the risk of developing diabetes mellitus, followed by blood sugar variables 2 hours PP, and fasting blood sugar

Revisiting Possibilistic Fuzzy C-Means Clustering Using the Majorization-Minimization Method.

Possibilistic fuzzy c-means (PFCM) clustering is a kind of hybrid clustering method based on fuzzy c-means (FCM) and possibilistic c-means (PCM), which not only has the stability of FCM but also partly inherits the robustness of PCM. However, as an extension of FCM on the objective function, PFCM tends to find a suboptimal local minimum, which affects its performance. In this paper, we rederive PFCM using the majorization-minimization (MM) method, which is a new derivation approach not seen in other studies. In addition, we propose an effective optimization method to solve the above problem, called MMPFCM. Firstly, by eliminating the variable V∈Rp×c, the original optimization problem is transformed into a simplified model with fewer variables but a proportional term. Therefore, we introduce a new intermediate variable s∈Rc to convert the model with the proportional term into an easily solvable equivalent form. Subsequently, we design an iterative sub-problem using the MM method. The complexity analysis indicates that MMPFCM and PFCM share the same computational complexity. However, MMPFCM requires less memory per iteration. Extensive experiments, including objective function value comparison and clustering performance comparison, demonstrate that MMPFCM converges to a better local minimum compared to PFCM.

AI-based automated segmentation for ovarian/adnexal masses and their internal components on ultrasound imaging.

Segmentation of ovarian/adnexal masses from surrounding tissue on ultrasound images is a challenging task. The separation of masses into different components may also be important for radiomic feature extraction. Our study aimed to develop an artificial intelligence-based automatic segmentation method for transvaginal ultrasound images that (1)outlines the exterior boundary of adnexal masses and (2)separates internal components. A retrospective ultrasound imaging database of adnexal masses was reviewed for exclusion criteria at the patient, mass, and image levels, with one image per mass. The resulting 54 adnexal masses (36 benign/18 malignant) from 53 patients were separated by patient into training (26 benign/12 malignant) and independent test (10 benign/6 malignant) sets. U-net segmentation performance on test images compared to expert detailed outlines was measured using the Dice similarity coefficient (DSC) and the ratio of the Hausdorff distance to the effective diameter of the outline ( ) for each mass. Subsequently, in discovery mode, a two-level fuzzy c-means (FCM) unsupervised clustering approach was used to separate the pixels within masses belonging to hypoechoic or hyperechoic components. The DSC (median [95% confidence interval]) was 0.91 [0.78, 0.96], and was 0.04 [0.01, 0.12], indicating strong agreement with expert outlines. Clinical review of the internal separation of masses into echogenic components demonstrated a strong association with mass characteristics. A combined U-net and FCM algorithm for automatic segmentation of adnexal masses and their internal components achieved excellent results compared with expert outlines and review, supporting future radiomic feature-based classification of the masses by components.

Short-Term Load Forecasting Method Based on Bidirectional Long Short-Term Memory Model with Stochastic Weight Averaging Algorithm

To accommodate the rapid development of the distribution network of China, it is essential to research load forecasting methods with higher accuracy and stronger generalization capabilities in order to optimize distribution system control strategies, ensure the efficient and reliable operation of the power system, and provide a stable power supply to users. In this paper, a short-term load forecasting method is proposed for low-voltage distribution substations based on the bidirectional long short-term memory (BiLSTM) model. First, principal component analysis (PCA) and the fuzzy C-means method based on a genetic algorithm (GA-FCM) are used to extract the main influencing factors and classify different types of user electricity consumption behaviors. Then, the BiLSTM forecasting model utilizing the stochastic weight averaging (SWA) algorithm to enhance generalization capability is constructed. Finally, the load data from a low-voltage distribution substation in China over recent years are selected as a case study. Compared with conventional LSTM and BiLSTM prediction models, the annual electricity load curves for various user types forecasted by the PCA-BiLSTM model are more closely aligned with actual data curves. The proposed BiLSTM forecasting model exhibits higher accuracy and can forecast user electricity consumption data that more accurately reflect real-life usage.

Adaptive feature selection and optimized multiple histogram construction for reversible data hiding

Reversible data hiding (RDH) algorithms have been extensively employed in the field of copyright protection and information dissemination. Among various RDH algorithms, the multiple histogram modification (MHM) algorithm has attracted significant attention because of its capability to generate high-quality marked images. In previous MHM methods, the prediction error histograms were mostly generated in a fixed way. Recently, clustering algorithms automatically classify prediction errors into multiple classes, which enhances the similarity among prediction errors within the same class. However, the design of features and the determination of clustering numbers are crucial in clustering algorithms. Traditional algorithms utilize the same features and fix the number of clusters (e.g., empirically generate 16 classes), which may limit the performance due to the lack of adaptivity. To address these limitations, an adaptive initial feature selection scheme and a clustering number optimization scheme based on the Fuzzy C-Means (FCM) clustering algorithm are proposed in this paper. The superiority of the proposed scheme over other state-of-the-art schemes is verified by experimental results.

Fuzzy Logic Prediction of Hypertensive Disorders in Pregnancy Using the Takagi–Sugeno and C-Means Algorithms

Hypertensive disorders in pregnancy, which include preeclampsia, eclampsia, and chronic hypertension, complicate approximately 10% of all pregnancies in the world, constituting one of the most serious causes of mortality and morbidity in gestation. To help predict the occurrence of hypertensive disorders, a study based on algorithms that help model this health problem using mathematical tools is proposed. This study proposes a fuzzy c-means (FCM) model based on the Takagi–Sugeno (T-S) type of fuzzy rule to predict hypertensive disorders in pregnancy. To test different modeling methodologies, cross-validation comparisons were made between random forest, decision tree, support vector machine, and T-S and FCM methods, which achieved 80.00%, 66.25%, 70.00%, and 90.00%, respectively. The evaluation consisted of calculating the true positive rate (TPR) over the true negative rate (TNR), with equal error rate (EER) curves achieving a percentage of 20%. The learning dataset consisted of a total of 371 pregnant women, of which 13.2% were diagnosed with a condition related to gestational hypertension. The dataset for this study was obtained from the Secretaría de Salud del Estado de Hidalgo (SSEH), México. A random sub-sampling technique was used to adjust the class distribution of the data set, and to eliminate the problem of unbalanced classes. The models were trained using a total of 98 samples. The modeling results indicate that the T-S and FCM method has a higher predictive ability than the other three models in this research.

Organic carbon estimation in a regional soil Vis-NIR database supported by unsupervised learning and chemometrics techniques

The main assumptions of this study were: (i) that spectrally similar soils are similar according to SOC content; and (ii) that using spectral-based clustering might enhance the quality of the prediction model. A total of 939 sample's soil spectral data and SOC content were selected from the regional soil Vis-NIR database of Dalmatia, Croatia. The spectral dataset was partitioned into distinct clusters using unsupervised learning (UL) techniques: Principal Component Analysis (PCA) and Fuzzy C-means (FCM) method. The ellipsoidal shape of the soil spectral data set was best separated into three clusters, indicating a reasonable quality of clustering as seen by the Silhouette score of 0.57. The most important wavelengths for clustering were at the following ranges: 1980–2025 nm, 1900, 735–775, 490–530, 1200, 2100, 2200, 2130, 2400 485, and 440 nm. The identified clusters had mean SOC content values of 22.25, 13.36, and 17.29 g C kg−1. At a significance level of 0.05, these values exhibit a statistically significant difference. The FCM clustering enhanced PLSR model's precision as measured by the Prediction Interval (PI). However, it had little impact on accuracy for SOC predictions as assessed using the Residual prediction deviation (RPD). Our models are suitable for performing approximate or preliminary screenings for the prediction of SOC content. Therefore, we recommend using UL techniques and chemometrics combined with Vis-NIR spectroscopy to supplement conventional SOC content laboratory analyses.

Empirical study of outlier impact in classification context

In the field of data mining, outlier detection is an important and challenging task. This paper focuses on studying the impacts of outliers on the performance of models learned from large-scale datasets while it is unknown whether a data point is outlier or not. In the proposed approach, a fuzzy c-means clustering algorithm is applied and outliers are defined as those that have greater membership values in the cluster and are located further away from the cluster centroid. Ideally, the sample with a higher membership value should be located closer to the cluster centroid. In this context, we calculate the weight of each sample using the AdaBoost algorithm, where a weight determines the representativeness of each sample within the data distribution. Additionally, in this study, the impact of weighted loss functions in different situations are discussed in detail. At last, our method is evaluated on 12 UCI datasets and the accuracy of our method is greater than 95% on some datasets, such as banknote 99.99%, biodeg 99.01%, optdigits 99.19%, and letters 97.37%. The experimental results show the efficiency and effectiveness of the proposed approach.

Method for constructing typical operation scenarios in power systems considering spatiotemporal correlation of renewable energy generation

Abstract The proposed article focuses on developing a methodology for constructing typical operational scenarios in power systems considering the spatiotemporal characteristics of new energy output. The integration of new energy sources on a large scale into power systems can lead to issues such as line congestion and supply-demand imbalances. To support the planning and scheduling of future high-capacity power systems, this paper introduces a method that accounts for the spatiotemporal characteristics of new energy outputs. The method begins by proposing a spatiotemporal fusion-based multi-head attention model for generating new energy output scenarios. This model employs multi-head attention mechanisms to extract the spatiotemporal characteristics of new energy outputs, eliminating redundancy in the feature data. The processed spatiotemporal feature information is then transferred to a gated feature fusion model for integration, using an encoder structure based on Long Short-Term Memory (LSTM) to generate new energy output scenarios. The paper, by means of an advanced Fuzzy C-Means (FCM) clustering algorithm, identifies typical scenarios of net energy output. Subsequently, the proposed method’s efficacy and precision are confirmed through simulation analysis with real data from a certain area.

A Fuzzy C-Means Clustering-Based Hybrid Multivariate Time Series Prediction Framework With Feature Selection

A Fuzzy C-Means Clustering-Based Hybrid Multivariate Time Series Prediction Framework With Feature Selection

A Resolution and Localization Algorithm for Closely-Spaced Objects Based on Improved YOLOv5 Joint Fuzzy C-Means Clustering

A Resolution and Localization Algorithm for Closely-Spaced Objects Based on Improved YOLOv5 Joint Fuzzy C-Means Clustering

Fuzzy C-Means Clustering and Improved Arithmetic Optimization Algorithm-Based Layering Cooperative Routing Protocol for UASNs

Fuzzy C-Means Clustering and Improved Arithmetic Optimization Algorithm-Based Layering Cooperative Routing Protocol for UASNs

Design of a model for multistage classification of diabetic retinopathy and glaucoma

This study addresses the escalating prevalence of diabetic retinopathy (DR) and glaucoma, major global causes of vision impairment. We propose an innovative iterative Q-learning model that integrates with fuzzy C-means clustering to improve diagnostic accuracy and classification speed. Traditional diagnostic frameworks often struggle with accuracy and delay in disease stage classification, particularly in discerning complex features like exudates and veins. Our model overcomes these challenges by combining fuzzy C means with Q learning, enhancing precision in identifying key retinal components. The core of our approach is a custom-designed 45-layer 2D convolutional neural network (CNN) optimized for nuanced detection of DR and glaucoma stages. Compared to previous approaches, the performance on the IDRID and SMDG-19 datasets and associated samples shows a 10.9% rise in precision, an 8.5% improvement in overall accuracy, an 8.3% enhancement in recall, a 10.4% larger area under the curve (AUC), a 5.9% boost in specificity, and a 2.9% decrease in latency. This methodology has the potential to bring about significant changes in the field of DR and glaucoma diagnosis, leading to prompt medical interventions and possibly decreasing vision loss. The use of sophisticated machine learning techniques in medical imaging establishes a model for future investigations in ophthalmology and other clinical situations.

IMPLEMENTATION OF FUZZY C-MEANS AND FUZZY POSSIBILISTIC C-MEANS ALGORITHMS ON POVERTY DATA IN INDONESIA

Cluster analysis involves the methodical categorization of data based on the degree of similarity within each group to group data with similar characteristics. This study focuses on classifying poverty data across Indonesian provinces. The methodologies employed include the Fuzzy C-Means (FCM) and Fuzzy Probabilistic C-Means (FPCM) algorithms. The FCM algorithm is a clustering approach where membership values determine the presence of each data point in a cluster. On the other hand, the FPCM algorithm builds upon FCM and Possibilistic C (PCM) algorithms by incorporating probabilistic considerations. This research compares the FCM and FPCM algorithms using local poverty data from Indonesia, specifically examining the Partition Entropy (PE) index value. It aims to identify the optimal number of clusters for provincial-level poverty data in Indonesia. The findings indicate that the FPCM algorithm outperforms the FCM algorithm in categorizing poverty in Indonesia, as evidenced by the PE validity index. Furthermore, the study identifies that the ideal number of clusters for the data is 2.