Unsupervised Learning Method Research Articles

GSLCDA: An Unsupervised Deep Graph Structure Learning Method for Predicting CircRNA-Disease Association.

Growing studies reveal that Circular RNAs (circRNAs) are broadly engaged in physiological processes of cell proliferation, differentiation, aging, apoptosis, and are closely associated with the pathogenesis of numerous diseases. Clarification of the correlation among diseases and circRNAs is of great clinical importance to provide new therapeutic strategies for complex diseases. However, previous circRNA-disease association prediction methods rely excessively on the graph network, and the model performance is dramatically reduced when noisy connections occur in the graph structure. To address this problem, this paper proposes an unsupervised deep graph structure learning method GSLCDA to predict potential CDAs. Concretely, we first integrate circRNA and disease multi-source data to constitute the CDA heterogeneous network. Then the network topology is learned using the graph structure, and the original graph is enhanced in an unsupervised manner by maximize the inter information of the learned and original graphs to uncover their essential features. Finally, graph space sensitive k-nearest neighbor (KNN) algorithm is employed to search for latent CDAs. In the benchmark dataset, GSLCDA obtained 92.67% accuracy with 0.9279 AUC. GSLCDA also exhibits exceptional performance on independent datasets. Furthermore, 14, 12 and 14 of the top 16 circRNAs with the most points GSLCDA prediction scores were confirmed in the relevant literature in the breast cancer, colorectal cancer and lung cancer case studies, respectively. Such results demonstrated that GSLCDA can validly reveal underlying CDA and offer new perspectives for the diagnosis and therapy of complex human diseases.

Deeply Unsupervised Patch Re-Identification for Pre-Training Object Detectors.

Unsupervised pre-training aims at learning transferable features that are beneficial for downstream tasks. However, most state-of-the-art unsupervised methods concentrate on learning global representations for image-level classification tasks instead of discriminative local region representations, which limits their transferability to region-level downstream tasks, such as object detection. To improve the transferability of pre-trained features to object detection, we present Deeply Unsupervised Patch Re-ID (DUPR), a simple yet effective method for unsupervised visual representation learning. The patch Re-ID task treats individual patch as a pseudo-identity and contrastively learns its correspondence in two views, enabling us to obtain discriminative local features for object detection. Then the proposed patch Re-ID is performed in a deeply unsupervised manner, appealing to object detection, which usually requires multi-level feature maps. Extensive experiments demonstrate that DUPR outperforms state-of-the-art unsupervised pre-trainings and even the ImageNet supervised pre-training on various downstream tasks related to object detection.

Robust and Sparse Principal Component Analysis With Adaptive Loss Minimization for Feature Selection.

Principal component analysis (PCA) is one of the most successful unsupervised subspace learning methods and has been used in many practical applications. To deal with the outliers in real-world data, robust principal analysis models based on various measure are proposed. However, conventional PCA models can only transform features to unknown subspace for dimensionality reduction and cannot perform features' selection task. In this article, we propose a novel robust PCA (RPCA) model to mitigate the impact of outliers and conduct feature selection, simultaneously. First, we adopt σ -norm as reconstruction error (RE), which plays an important role in robust reconstruction. Second, to conduct feature selection task, we apply l2,0 -norm constraint to subspace projection. Furthermore, an efficient iterative optimization algorithm is proposed to solve the objective function with nonconvex and nonsmooth constraint. Extensive experiments conducted on several real-world datasets demonstrate the effectiveness and superiority of the proposed feature selection model.

Multimodal subspace identification for modeling discrete-continuous spiking and field potential population activity

Objective. Learning dynamical latent state models for multimodal spiking and field potential activity can reveal their collective low-dimensional dynamics and enable better decoding of behavior through multimodal fusion. Toward this goal, developing unsupervised learning methods that are computationally efficient is important, especially for real-time learning applications such as brain–machine interfaces (BMIs). However, efficient learning remains elusive for multimodal spike-field data due to their heterogeneous discrete-continuous distributions and different timescales. Approach. Here, we develop a multiscale subspace identification (multiscale SID) algorithm that enables computationally efficient learning for modeling and dimensionality reduction for multimodal discrete-continuous spike-field data. We describe the spike-field activity as combined Poisson and Gaussian observations, for which we derive a new analytical SID method. Importantly, we also introduce a novel constrained optimization approach to learn valid noise statistics, which is critical for multimodal statistical inference of the latent state, neural activity, and behavior. We validate the method using numerical simulations and with spiking and local field potential population activity recorded during a naturalistic reach and grasp behavior. Main results. We find that multiscale SID accurately learned dynamical models of spike-field signals and extracted low-dimensional dynamics from these multimodal signals. Further, it fused multimodal information, thus better identifying the dynamical modes and predicting behavior compared to using a single modality. Finally, compared to existing multiscale expectation-maximization learning for Poisson–Gaussian observations, multiscale SID had a much lower training time while being better in identifying the dynamical modes and having a better or similar accuracy in predicting neural activity and behavior. Significance. Overall, multiscale SID is an accurate learning method that is particularly beneficial when efficient learning is of interest, such as for online adaptive BMIs to track non-stationary dynamics or for reducing offline training time in neuroscience investigations.

SOFTWARE MODULES CLUSTERING: A LITERATURE REVIEW

Maintenance takes the largest cost within software engineering processes. Because understanding the software code is complex and requires a deep understanding of the structure of building the code. To face Such a problem and other problems such as research purposes, or retrieval, restructuring, and understanding the behavior of software entities, today the software component, such as objects, classes, or files that have similarity in feature can be grouped together using unsupervised learning method called software module clustering. This method gives a clear picture of the components of the program and the details of the dependencies between these components, and thus it gives a structure that can be relied upon effectively. This research paper will present a compilation of studies published in this field over the past 23 years. We review 36 well-known research papers in the literature that examines software module clustering techniques and obtain useful results and data. Research containing duplicate ideas was excluded. We will attempt to answer the following questions: What are the modern methods used in the concept of clustering? What are the applications of clustering in software engineering? What are various clustering algorithms? What evaluation methods are available for assessing the quality of clustering techniques?

Prior knowledge-augmented unsupervised shapelet learning for unknown abnormal working condition discovery in industrial process

Unknown abnormal working condition discovery is the key of refinement industrial production. Clustering industrial time series is an effective way to discover unknown working condition types. However, it is challenge for existing time series cluster methods to discover unknown abnormal working condition from industrial time series. In this study, a novel prior knowledge-augmented unsupervised shapelet learning method is proposed to discover abnormal and meaningful working condition through interpretable subsequences. A prior feature extracting module is proposed to change prior knowledge into a recognizable form for the data model. The prior knowledge contains abnormal working condition information. The knowledge-augmented clustering module can learn informative shapelets which stand for abnormal working condition by combining prior features with data features. Furthermore, the preference of prior knowledge and data are self-adjusted in the learning phase. Numerical test results on the real-world aluminum electrolysis process, simulated Tennessee Eastman process, and continuous stirred tank heater process verify the superior performances of the proposed method. The proposed method provides a new perspective for the fusion of prior knowledge and data model. It also provides a new way to solve the problem of abnormal unknown working condition discovery in industrial process.

Machine learning identifies fatigue as a key symptom of fibromyalgia reflected in tyrosine, purine, pyrimidine, and glutaminergic metabolism.

Fibromyalgia patients vary in clinical phenotype and treatment can be challenging. The pathophysiology of fibromyalgia is incompletely understood but appears to involve metabolic changes at rest or in response to stress. We enrolled 54 fibromyalgia patients and 31 healthy controls to this prospective study. Symptoms were assessed using the Fibromyalgia Impact Questionnaire (FIQ) and blood samples were collected for metabolomics analysis at baseline and after an oral glucose tolerance test and a cardiopulmonary exercise test. We identified key symptoms of fibromyalgia and related them to changes in metabolic pathways with supervised and unsupervised machine learning methods. Algorithms trained with the FIQ information assigned the fibromyalgia diagnosis in new data with balanced accuracy of 88% while fatigue alone already provided the diagnosis with 86% accuracy. Supervised analyses reduced the metabolomic information from 77 to 13 key markers. With these metabolites, fibromyalgia could be identified in new cases with 79% accuracy. In addition, 5-hydroxyindole-3-acetic acid and glutamine levels correlated with the severity of fatigue. Patients differed from controls at baseline in tyrosine and purine pathways, and in the pyrimidine pathway after the stress challenges. Several key markers are involved in glutaminergic neurotransmission. This data-driven analysis highlights fatigue as a key symptom of fibromyalgia. Fibromyalgia is associated with metabolic changes which also reflect the degree of fatigue. Responses to metabolic and physical stresses result in a metabolic pattern that allows discrimination of fibromyalgia patients from controls and narrows the focus on key pathophysiological processes in fibromyalgia as treatment targets.

Dietary patterns associated with the incidence of hypertension among adult Japanese males: application of machine learning to a cohort study

PurposeThe previous studies that examined the effectiveness of unsupervised machine learning methods versus traditional methods in assessing dietary patterns and their association with incident hypertension showed contradictory results. Consequently, our aim is to explore the correlation between the incidence of hypertension and overall dietary patterns that were extracted using unsupervised machine learning techniques.MethodsData were obtained from Japanese male participants enrolled in a prospective cohort study between August 2008 and August 2010. A final dataset of 447 male participants was used for analysis. Dimension reduction using uniform manifold approximation and projection (UMAP) and subsequent K-means clustering was used to derive dietary patterns. In addition, multivariable logistic regression was used to evaluate the association between dietary patterns and the incidence of hypertension.ResultsWe identified four dietary patterns: ‘Low-protein/fiber High-sugar,’ ‘Dairy/vegetable-based,’ ‘Meat-based,’ and ‘Seafood and Alcohol.’ Compared with ‘Seafood and Alcohol’ as a reference, the protective dietary patterns for hypertension were ‘Dairy/vegetable-based’ (OR 0.39, 95% CI 0.19–0.80, P = 0.013) and the ‘Meat-based’ (OR 0.37, 95% CI 0.16–0.86, P = 0.022) after adjusting for potential confounding factors, including age, body mass index, smoking, education, physical activity, dyslipidemia, and diabetes. An age-matched sensitivity analysis confirmed this finding.ConclusionThis study finds that relative to the ‘Seafood and Alcohol’ pattern, the ‘Dairy/vegetable-based’ and ‘Meat-based’ dietary patterns are associated with a lower risk of hypertension among men.

Machine Learning-Derived Baseline Visual Field Patterns Predict Future Glaucoma Onset in the Ocular Hypertension Treatment Study.

The Ocular Hypertension Treatment Study (OHTS) identified risk factors for primary open-angle glaucoma (POAG) in patients with ocular hypertension, including pattern standard deviation (PSD). Archetypal analysis, an unsupervised machine learning method, may offer a more interpretable approach to risk stratification by identifying patterns in baseline visual fields (VFs). There were 3272 eyes available in the OHTS. Archetypal analysis was applied using 24-2 baseline VFs, and model selection was performed with cross-validation. Decomposition coefficients for archetypes (ATs) were calculated. A penalized Cox proportional hazards model was implemented to select discriminative ATs. The AT model was compared to the OHTS model. Associations were identified between ATs with both POAG onset and VF progression, defined by mean deviation change per year. We selected 8494 baseline VFs. Optimal AT count was 19. The highest prevalence ATs were AT9, AT11, and AT7. The AT-based prediction model had a C-index of 0.75 for POAG onset. Multivariable models demonstrated that a one-interquartile range increase in the AT5 (hazard ratio [HR] = 1.14; 95% confidence interval [CI], 1.04-1.25), AT8 (HR = 1.22; 95% CI, 1.09-1.37), AT15 (HR = 1.26; 95% CI, 1.12-1.41), and AT17 (HR = 1.17; 95% CI, 1.03-1.31) coefficients conferred increased risk of POAG onset. AT5, AT10, and AT14 were significantly associated with rapid VF progression. In a subgroup analysis by high-risk ATs (>95th percentile or <75th percentile coefficients), PSD lost significance as a predictor of POAG in the low-risk group. Baseline VFs, prior to detectable glaucomatous damage, contain occult patterns representing early changes that may increase the risk of POAG onset and VF progression in patients with ocular hypertension. The relationship between PSD and POAG is modified by the presence of high-risk patterns at baseline. An AT-based prediction model for POAG may provide more interpretable glaucoma-specific information in a clinical setting.

Computational Assessment of Spectral Heterogeneity within Fresh Glioblastoma Tissue Using Raman Spectroscopy and Machine Learning Algorithms.

Understanding and classifying inherent tumor heterogeneity is a multimodal approach, which can be undertaken at the genetic, biochemical, or morphological level, among others. Optical spectral methods such as Raman spectroscopy aim at rapid and non-destructive tissue analysis, where each spectrum generated reflects the individual molecular composition of an examined spot within a (heterogenous) tissue sample. Using a combination of supervised and unsupervised machine learning methods as well as a solid database of Raman spectra of native glioblastoma samples, we succeed not only in distinguishing explicit tumor areas-vital tumor tissue and necrotic tumor tissue can correctly be predicted with an accuracy of 76%-but also in determining and classifying different spectral entities within the histomorphologically distinct class of vital tumor tissue. Measurements of non-pathological, autoptic brain tissue hereby serve as a healthy control since their respective spectroscopic properties form an individual and reproducible cluster within the spectral heterogeneity of a vital tumor sample. The demonstrated decipherment of a spectral glioblastoma heterogeneity will be valuable, especially in the field of spectroscopically guided surgery to delineate tumor margins and to assist resection control.

RTHEN: Unsupervised deep homography estimation based on dynamic attention for repetitive texture image stitching

Homography estimation is regarded as one of the key challenges in image alignment, where the goal is to estimate the projective transformation between two images on the same plane. Unsupervised learning methods are gradually becoming popular due to their excellent performance and lack of need for labeled data. However, in regional scenes with repeated textures, there may be ambiguity in the correspondence between local features, affecting homography estimation accuracy. This paper proposes a new unsupervised deep homography method RTHEN to solve such problems. In order to effectively obtain repeated texture features, a multi-scale Feature pyramid Siamese network (FPSN) is designed. Specifically, we dynamically allocate the weights of recited texture features through a dynamic attention module and introduce a channel attention module to provide rich contextual information for repeated texture areas. We propose a hard triplet loss function based on overlap constraints to optimize the matching results. At the same time, we collected a repetitive texture image dataset (RTID) for homography estimation training and evaluation. Experimental results show that our method outperforms existing learning methods in repetitive texture scenes and offers competitive performance with state-of-the-art traditional methods.

An end-to-end machine learning approach with explanation for time series with varying lengths

AbstractAn accurate prediction of complex product quality parameters from process time series by an end-to-end learning approach remains a significant challenge in machine learning. A special difficulty is the application of industrial batch process data because many batch processes generate variable length time series. In the industrial application of such methods, explainability is often desired. In this study, a 1D convolutional neural network (CNN) algorithm with a masking layer is proposed to solve the problem for time series of variable length. In addition, a novel combination of 1D CNN and class activation mapping (CAM) technique is part of this study to better understand the model results and highlight some regions of interest in the time series. As a comparative state-of-the-art unsupervised machine learning method, the One-Nearest Neighbours (1NN) algorithm combined with dynamic time warping (DTW) was used. Both methods are investigated as end-to-end learning methods with balanced and unbalanced class distributions and with scaled and unscaled input data, respectively. The FastDTW and DTAIDistance algorithms were investigated for the DTW calculation. The data set is made up of sensor signals that was collected during the production of plastic parts. The objective was to predict a quality parameter of plastic parts during production. For this research, the quality parameter will be a difficult or only destructively measurable parameter and both methods will be investigated for their applicability to this prediction task. The application of the proposed approach to an industrial facility for producing plastic products shows a prediction accuracy of 83.7%. It can improve the reverence method by approximately 1.4%. In addition to the slight increase in accuracy, the CNN training time was significantly reduced compared to the DTW calculation.

Using data clustering to reveal trainees’ behavior in cybersecurity education

AbstractIn cyber security education, hands-on training is a common type of exercise to help raise awareness and competence, and improve students’ cybersecurity skills. To be able to measure the impact of the design of the particular courses, the designers need methods that can reveal hidden patterns in trainee behavior. However, the support of the designers in performing such analytic and evaluation tasks is ad-hoc and insufficient. With unsupervised machine learning methods, we designed a tool for clustering the trainee actions that can exhibit their strategies or help pinpoint flaws in the training design. By using a k-means++ algorithm, we explore clusters of trainees that unveil their specific behavior within the training sessions. The final visualization tool consists of views with scatter plots and radar charts. The former provides a two-dimensional correlation of selected trainee actions and displays their clusters. In contrast, the radar chart displays distinct clusters of trainees based on their more specific strategies or approaches when solving tasks. Through iterative training redesign, the tool can help designers identify improper training parameters and improve the quality of the courses accordingly. To evaluate the tool, we performed a qualitative evaluation of its outcomes with cybersecurity experts. The results confirm the usability of the selected methods in discovering significant trainee behavior. Our insights and recommendations can be beneficial for the design of tools for educators, even beyond cyber security.

Trans-scale analysis of 3D braided composites with voids based on micro-CT imaging and unsupervised machine learning

Voids are unavoidable during the manufacturing of 3D braided composites. This study proposes an unsupervised machine learning method combined with micro-computed tomography (micro-CT) scanning and a progressive damage analysis to analyze defects in these composites at a trans-scale level. The method enables the creation of real multiscale models and the determination of the porosity in both the intra-yarn (1.52 %) and inter-yarn (5.04 %) planes. Here, the unsupervised machine learning method is introduced in a trans-scale damage analysis to reduce calculation dimensions and to visualize the clustering data. A user-defined material subroutine (UMAT) is also developed to implement the trans-scale damage model. The experimental validation of the simulation results demonstrates the effective trans-scale damage analysis, showing the predominant pull-shear damage in the yarns, which is primarily located at the interfaces both between the yarns and between the yarns and the matrix. Finally, based on the scanned geometric data the degradation in modulus and strength of 3D braided composites with porosity is studied.

Genomic prediction using machine learning: a comparison of the performance of regularized regression, ensemble, instance-based and deep learning methods on synthetic and empirical data

BackgroundThe accurate prediction of genomic breeding values is central to genomic selection in both plant and animal breeding studies. Genomic prediction involves the use of thousands of molecular markers spanning the entire genome and therefore requires methods able to efficiently handle high dimensional data. Not surprisingly, machine learning methods are becoming widely advocated for and used in genomic prediction studies. These methods encompass different groups of supervised and unsupervised learning methods. Although several studies have compared the predictive performances of individual methods, studies comparing the predictive performance of different groups of methods are rare. However, such studies are crucial for identifying (i) groups of methods with superior genomic predictive performance and assessing (ii) the merits and demerits of such groups of methods relative to each other and to the established classical methods. Here, we comparatively evaluate the genomic predictive performance and informally assess the computational cost of several groups of supervised machine learning methods, specifically, regularized regression methods, deep, ensemble and instance-based learning algorithms, using one simulated animal breeding dataset and three empirical maize breeding datasets obtained from a commercial breeding program.ResultsOur results show that the relative predictive performance and computational expense of the groups of machine learning methods depend upon both the data and target traits and that for classical regularized methods, increasing model complexity can incur huge computational costs but does not necessarily always improve predictive accuracy. Thus, despite their greater complexity and computational burden, neither the adaptive nor the group regularized methods clearly improved upon the results of their simple regularized counterparts. This rules out selection of one procedure among machine learning methods for routine use in genomic prediction. The results also show that, because of their competitive predictive performance, computational efficiency, simplicity and therefore relatively few tuning parameters, the classical linear mixed model and regularized regression methods are likely to remain strong contenders for genomic prediction.ConclusionsThe dependence of predictive performance and computational burden on target datasets and traits call for increasing investments in enhancing the computational efficiency of machine learning algorithms and computing resources.

How Socio-economic Inequalities Cluster People with Diabetes in Malaysia: Geographic Evaluation of Area Disparities Using a Non-parameterized Unsupervised Learning Method

Accurate assessments of epidemiological associations between health outcomes and routinely observed proximal and distal determinants of health are fundamental for the execution of effective public health interventions and policies. Methods to couple big public health data with modern statistical techniques offer greater granularity for describing and understanding data quality, disease distributions, and potential predictive connections between population-level indicators with areal-based health outcomes. This study applied clustering techniques to explore patterns of diabetes burden correlated with local socio-economic inequalities in Malaysia, with a goal of better understanding the factors influencing the collation of these clusters. Through multi-modal secondary data sources, district-wise diabetes crude rates from 271,553 individuals with diabetes sampled from 914 primary care clinics throughout Malaysia were computed. Unsupervised machine learning methods using hierarchical clustering to a set of 144 administrative districts was applied. Differences in characteristics of the areas were evaluated using multivariate non-parametric test statistics. Five statistically significant clusters were identified, each reflecting different levels of diabetes burden at the local level, each with contrasting patterns observed under the influence of population-level characteristics. The hierarchical clustering analysis that grouped local diabetes areas with varying socio-economic, demographic, and geographic characteristics offer opportunities to local public health to implement targeted interventions in an attempt to control the local diabetes burden.

Self-Supervised Self-Organizing Clustering Network: A Novel Unsupervised Representation Learning Method.

Deep learning-based clustering methods usually regard feature extraction and feature clustering as two independent steps. In this way, the features of all images need to be extracted before feature clustering, which consumes a lot of calculation. Inspired by the self-organizing map network, a self-supervised self-organizing clustering network ( [Formula: see text]OCNet) is proposed to jointly learn feature extraction and feature clustering, thus realizing a single-stage clustering method. In order to achieve joint learning, we propose a self-organizing clustering header (SOCH), which takes the weight of the self-organizing layer as the cluster centers, and the output of the self-organizing layer as the similarities between the feature and the cluster centers. In order to optimize our network, we first convert the similarities into probabilities which represents a soft cluster assignment, and then we obtain a target for self-supervised learning by transforming the soft cluster assignment into a hard cluster assignment, and finally we jointly optimize backbone and SOCH. By setting different feature dimensions, a Multilayer SOCHs strategy is further proposed by cascading SOCHs. This strategy achieves clustering features in multiple clustering spaces. [Formula: see text]OCNet is evaluated on widely used image classification benchmarks such as Canadian Institute For Advanced Research (CIFAR)-10, CIFAR-100, Self-Taught Learning (STL)-10, and Tiny ImageNet. Experimental results show that our method significant improvement over other related methods. The visualization of features and images shows that our method can achieve good clustering results.

Open science perspectives on machine learning for the identification of careless responding: A new hope or phantom menace?

AbstractPowerful methods for identifying careless respondents in survey data are not just important to ensure the validity of subsequent data analyses, they are also instrumental for studying the psychological processes that drive humans to respond carelessly. Conversely, a deeper understanding of the phenomenon of careless responding enables the development of improved methods for the identification of careless respondents. While machine learning has gained substantial attention and popularity in many scientific fields, it is largely unexplored for the detection of careless responding. On the one hand, machine learning algorithms can be highly powerful tools due to their flexibility. On the other hand, science based on machine learning has been criticized in the literature for a lack of reproducibility. We assess the potential and the pitfalls of machine learning approaches for identifying careless respondents from an open science perspective. In particular, we discuss possible sources of reproducibility issues when applying machine learning in the context of careless responding, and we give practical guidelines on how to avoid them. Furthermore, we illustrate the high potential of an unsupervised machine learning method for the identification of careless respondents in a proof‐of‐concept simulation experiment. Finally, we stress the necessity of building an open data repository with labeled benchmark data sets, which would enable the evaluation of methods in a more realistic setting and make it possible to train supervised learning methods. Without such a data repository, the true potential of machine learning for the identification of careless responding may fail to be unlocked.

Deep sequential pattern mining for readability enhancement of Indonesian summarization

In text summarization research, readability is a great issue that must be addressed. Our hypothesis is readability can be accomplished by using text representations that keep the meaning of text documents intact. Therefore, this study aims to combine sequential pattern mining (SPM) in producing a sequence of a word as text representation with unsupervised deep learning to produce an Indonesian text summary called DeepSPM. This research uses PrefixSpan as an SPM algorithm and deep belief network (DBN) as an unsupervised deep learning method. This research uses 18,774 Indonesian news text from IndoSum. The readability aspect is evaluated by recall-oriented understudy for gisting evaluation (ROUGE) as a co-selection-based analysis; Dwiyanto Djoko Pranowo metrics, Gunning fog index (GFI), and Flesch-Kincaid grade level (FKGL) as content-based analysis; and human readability evaluation with two experts. The experiment result shows that DeepSPM yields better than DBN, with the F-measure value of ROUGE-1 enhanced to 0.462, ROUGE-2 is 0.37, and ROUGE-L is 0.41. The significance of ROUGE results also be tested using T-Test. The content-based analysis and human readability evaluation findings are conformable with the findings of co-selection-based analysis that generated summaries are only partially readable or have a medium level of readability aspect.

Rock typing and Prediction Permeability Using Machine Learning Techniques in Mishrif formation, southern Iraq

Mishrif Formation is one of the major carbonate reserves. Classifying rock types and Predicted Permeability in the Mishrif Formation in four wells (A, B, C, and D) is the primary goal of this research. Using Machine Learning Techniques, this research applies rock-typing techniques like the Flow Zone Indicator (FZI) method. In a core plug dataset, we can use unsupervised learning methods to automatically cluster hydraulic flow units (HFU) based on flow zone indicators (FZI), and we can use a supervised learning method by combining core and well log data to predict HFU (rock type) for the interval depths of the wells without core data. In this method, we were able to classify rocks into five distinct groups, or “rock types,” or “RT” for short. RT1 rocks are the highest quality reservoir rocks, RT2 rocks are of good quality, RT3 rocks are of intermediate quality, RT4 rocks are of poor quality, and RT5 rocks are of very poor quality. Accurately estimating permeability in each rock type, not only does this help reduce uncertainty that occurs in reservoirs, but it also drives improvements in project economics by optimizing resource allocation and lowering costs. This is all thanks to the use of machine learning algorithms, which have proven to be highly effective in significantly enhancing the accuracy and precision of permeability predictions.