K-nearest Neighbor Algorithm Research Articles

Prediction of metabolic syndrome and its associated risk factors in patients with chronic kidney disease using machine learning techniques.

Chronic kidney disease (CKD) and metabolic syndrome (MS) are recognized as public health problems which are related to overweight and cardiometabolic factors. The aim of this study was to develop a model to predict MS in people with CKD. This was a prospective cross-sectional study of patients from a reference center in São Luís, MA, Brazil. The sample included adult volunteers classified according to the presence of mild or severe CKD. For MS tracking, the k-nearest neighbors (KNN) classifier algorithm was used with the following inputs: gender, smoking, neck circumference, and waist-to-hip ratio. Results were considered significant at p < 0.05. A total of 196 adult patients were evaluated with a mean age of 44.73 years, 71.9% female, 69.4% overweight, and 12.24% with CKD. Of the latter, 45.8% had MS, the majority had up to 3 altered metabolic components, and the group with CKD showed statistical significance in: waist circumference, systolic blood pressure, diastolic blood pressure, and fasting blood glucose. The KNN algorithm proved to be a good predictor for MS screening with 79% accuracy and sensitivity and 80% specificity (area under the ROC curve - AUC = 0.79). The KNN algorithm can be used as a low-cost screening method to evaluate the presence of MS in people with CKD.

Machine learning-driven design and performance analysis of microstrip antennas for sub-6 GHz/mm Wave 5G networks

In the realm of modern communication systems, antennas are crucial components, with the microstrip patch antenna being particularly notable for its low profile and seamless integration. Despite its widespread use, designing this antenna involves complex simulations to optimize parameters, requiring significant expertise and consuming considerable time and energy. To streamline this process, machine learning (ML) algorithms are being utilized. This paper introduces an innovative approach that employs ML techniques to design a rectangular microstrip patch antenna operating within the sub-6 GHz frequency range (1-6 GHz) and the millimeter frequency range (28-40 GHz). The antenna design maintains consistent patch dimensions positioned strategically at the center, with a thorough examination of patch length and width to enhance performance. Datasets are meticulously prepared, covering output parameters such as beam area, directivity, gain, and radiation efficiency across the specified frequency ranges. By employing various ML algorithms, this study conducts a comprehensive analysis to identify the most effective algorithm for accurately predicting antenna characteristics. The K-nearest neighbor (KNN) algorithm achieved high accuracy across all parameters: gain at 94.23% under sub-6 GHz and 95.93% under millimeter frequency range, directivity at 99.02% and 98.59%, radiation efficiency at 93.94% and 94.28%, and beam area at 99.07% and 98.59% respectively. These results optimize microstrip antenna designs and enhance understanding of the relationship between design parameters and performance outcomes with ML.

Predictive Modelling of Liver Disease Using Biochemical Markers and K-Nearest Neighbors Algorithm

The incidence of liver cirrhosis-related deaths is on the rise due to increased alcohol consumption, chronic hepatitis infections, and obesity-related liver conditions. Early detection is critical for improving patient outcomes; however, female patients often experience delayed diagnosis. This study aims to develop a predictive model for liver disease using biochemical markers and to investigate gender disparities in diagnostic accuracy. A dataset of 584 patient records from NorthEast Andhra Pradesh, India, was utilized, comprising ten variables per patient, including age, gender, total bilirubin, direct bilirubin, alkaline phosphatase, SGPT, SGOT, total proteins, albumin, and the albumin/globulin ratio. The data were pre-processed by encoding categorical variables and scaling numerical features. The K-Nearest Neighbors (K-NN) algorithm was employed for classification, and performance was evaluated using cross-validation. The model demonstrated variable accuracy across different folds, with accuracy ranging from 57.76% to 73.28%, precision from 58.14% to 70.56%, recall from 57.76% to 73.28%, and F1-score from 57.95% to 70.45%. These results indicate the potential of biochemical markers in predicting liver disease and highlight significant gender disparities in diagnostic accuracy. The study's contributions include the development of a practical predictive tool and the identification of gender-specific diagnostic challenges. Future research should focus on larger, more diverse datasets and explore additional machine learning algorithms to enhance predictive accuracy and address gender disparities in liver disease diagnosis.

Comparative Analysis of ML Models with Selection Methods for Early Predictive Analytics of Sepsis in ICU

Objectives: This study aims to make early prediction of Sepsis using ML algorithms and provide comparative analysis of different feature selection techniques. Methods: In this study, the Physionet website dataset has been used. Sepsis categorization is done on the basis of Sepsis-3 criteria. The dataset used is highly imbalanced, with only 2% of the data belonging to Sepsis. The SmoteTomek technique is used to handle an imbalanced dataset. Various filter, embedded, and wrapper feature selection techniques, like tree-based feature selection technique, recursive feature elimination (RFE), information gain, Bhattacharya distance, lasso, etc., have been applied for the top-performing classification ML models. These selection techniques were applied to RandomForest, K Nearest Neighbors (KNN), and Decision Tree models. We compared the impact of these selection techniques on the aforesaid machine learning models. Findings: After applying the RFE technique, the Area Under the Receiver Operating Characteristic curve (AUROC) score of the RandomForest model has slightly increased from 0.996 to 0.9974. KNN model with a tree-based feature selection technique showed the highest sensitivity of 0.934. which is slightly higher than the sensitivity of 0.922, which was without applying any feature selection technique. Along with the AUROC score, the highest performance, in terms of specificity (0.9976), accuracy (0.9959), and f-measure score (0.9062), is achieved when RFE is applied to the RandomForest model. The best selection algorithm for decision trees and KNN is the tree-based selection technique. RFE is the best selection technique for RandomForest. Novelty: In this research, the AUROC score is slightly increased to 0.9974, which has not been achieved yet. Instead of 40, the number of features chosen is 20. This research also provides a comparison of different feature selection techniques like tree-based feature selection, information gain, Bhattacharya, and RFE. It also analyses their impact on the performance of models, which has not been done yet with the same set of selection techniques. Keywords: Sepsis, Machine Learning, Feature selection, Early prediction, Predictive Analytics

Distinguishing lymphoma from benign lymph node diseases in fever of unknown origin using PET/CT radiomics.

A considerable portion of patients with fever of unknown origin (FUO) present concomitant lymphadenopathy. Diseases within the spectrum of FUO accompanied by lymphadenopathy include lymphoma, infections, and rheumatic diseases. Particularly, lymphoma has emerged as the most prevalent etiology of FUO with associated lymphadenopathy. Distinguishing between benign and malignant lymph node lesions is a major challenge for physicians and an urgent clinical concern for patients. However, conventional imaging techniques, including PET/CT, often have difficulty accurately distinguishing between malignant and benign lymph node lesions. This study utilizes PET/CT radiomics to differentiate between lymphoma and benign lymph node lesions in patients with FUO, aiming to improve diagnostic accuracy. Data were collected from 204 patients who underwent 18F-FDG PET/CT examinations for FUO, including 114 lymphoma patients and 90 patients with benign lymph node lesions. Patients were randomly divided into training and testing groups at a ratio of 7:3. A total of 15 effective features were obtained by the least absolute shrinkage and selection operator (LASSO) algorithm. Machine learning models were constructed using logistic regression (LR), support vector machine (SVM), random forest (RF), and k-nearest neighbors (KNN) algorithms. In the training group, the area under the curve (AUC) values for predicting lymphoma and benign cases by LR, SVM, RF, and KNN models were 0.936, 0.930, 0.998, and 0.938, respectively. There were statistically significant differences in AUC between the RF and other models (all P < 0.001). In the testing group, the AUC values for the four models were 0.860, 0.866, 0.915, and 0.891, respectively, with no statistically significant differences observed among them (all P > 0.05). The decision curve analysis (DCA) curves of the RF model outperformed those of the other three models in both the training and testing groups. PET/CT radiomics demonstrated promising performance in discriminating lymphoma from benign lymph node lesions in patients with FUO, with the RF model showing the best performance.

Using advanced machine learning algorithms to predict academic major completion: A cross-sectional study

BackgroundExisting prediction methods for academic majors based on personality traits have notable gaps, including limited model complexity and generalizability.The current study aimed to utilize advanced Machine Learning (ML) algorithms with smoothing functions to predict academic majors completed based on personality subscales. MethodsWe used reports from 59,413 individuals to perform the current study. All advanced algorithms implemented in this article were based on R software (version 4.1.3, R Core Team, 2021). All model parameters were optimized based on resampling and cross-validation (CV). In addition, pseudo-R2 as a robust metric has been used to compare the performance of models, which, unlike most studies, considers the quality of model-predicted probabilities. ResultThe results indicated that advanced ML models' performance on training and test data was superior to logistic regression. Pseudo-R2 and AUC results showed that advanced models such as kNN, GBE, and RF had the highest scores based on test data compared to other models. The pseudo-R2 values for the models used in this study varied across the test dataset; the lowest value belonged to the logistic regression algorithm at .022, and the highest value was recorded for the kNN algorithm at .099. The agreeableness subscale is the most influential component in predicting the completion of university education, followed by conscientiousness and emotional stability. ConclusionThe potential of advanced methods to enhance the accuracy and validity of predictions is a promising development in our field. Their performance, particularly in handling large data sets with complex patterns, is a reason for optimism about the future of research in this area.

A Novel Method for Anomaly Detection and Correction of GNSS Time Series

Abstract Global Navigation Satellite Systems (GNSS) provides a novel means for deformation monitoring, which is an important guarantee for structures. Accurately separating its linear and nonlinear signals, and noise in GNSS time series is the foundation for analyzing deformation mechanisms and the prerequisite for assessing the status. However, extracting deformation signals is a challenging obstacle to applying GNSS for deformation monitoring. Aimed at that, a new method is proposed in this study. Fine-tuning the window size and threshold of the Hampel filter through grid search allows for initial anomaly detection and correction. Optimizing the K parameter of the K-Nearest Neighbors (KNN) algorithm via rigorous K-Fold Cross-Validation ensures further smoothing of the filtered data, which overcomes the limitations of the Hampel filter in handling continuous anomalies. Experimental results demonstrate that the proposed method improves performance by approximately 62% compared to traditional methods and by around 40% relative to IQR and other methods. This study presents an effective approach for detecting and eliminating outliers in GNSS deformation monitoring, offering noteworthy theoretical and practical implications.&amp;#xD;

SOCIAL MEDIA FAKE ACCOUNT IDENTIFICATION USING ML

The proliferation of social media platforms has led to an increase in the creation of fake accounts. These accounts are used for various malicious activities, such as spreading false information, phishing, and identity theft. As a result, there is a growing need for effective methods to identify and eliminate fake accounts. This paper proposes a machine learning-based approach for social media fake account identification. This paper proposes a machine learning-based approach to identify fake accounts on social media platforms. Our method leverages a combination of feature extraction techniques and supervised learning algorithms to classify accounts as genuine or fake. We collect a large dataset of labeled social media accounts, including both genuine and fake profiles, and extract features from various sources such as profile information, network behavior, and content analysis. We experiment with multiple machine learning models, including Support vector machines(SVM),K-Nearest Neighbors Algorithm(KNN),Random forest, Logistic Regression &amp; Artificial Neural Network(ANN) to evaluate their performance in identifying fake accounts. Our proposed method has significant implications for social media platform operators, policymakers, and researchers seeking to combat fake accounts and maintain online trust. The approach can be integrated with existing social media moderation tools to enhance the accuracy and efficiency of fake account identification. Key Words: Support vector machines(SVM),K-Nearest Neighbors Algorithm(KNN),Random forest, Logistic Regression &amp; Artificial Neural Network(ANN),Python.

Iris Recognition System Using Advanced Segmentation Techniques and Fuzzy Clustering Methods for Robotic Control

The idea of developing a robot controlled by iris movement to assist physically disabled individuals is, indeed, innovative and has the potential to significantly improve their quality of life. This technology can empower individuals with limited mobility and enhance their ability to interact with their environment. Disability of movement has a huge impact on the lives of physically disabled people. Therefore, there is need to develop a robot that can be controlled using iris movement. The main idea of this work revolves around iris recognition from an eye image, specifically identifying the centroid of the iris. The centroid’s position is then utilized to issue commands to control the robot. This innovative approach leverages iris movement as a means of communication and control, offering a potential breakthrough in assisting individuals with physical disabilities. The proposed method aims to improve the precision and effectiveness of iris recognition by incorporating advanced segmentation techniques and fuzzy clustering methods. Fast gradient filters using a fuzzy inference system (FIS) are employed to separate the iris from its surroundings. Then, the bald eagle search (BES) algorithm is employed to locate and isolate the iris region. Subsequently, the fuzzy KNN algorithm is applied for the matching process. This combined methodology aims to improve the overall performance of iris recognition systems by leveraging advanced segmentation, search, and classification techniques. The results of the proposed model are validated using the true success rate (TSR) and compared to those of other existing models. These results highlight the effectiveness of the proposed method for the 400 tested images representing 40 people.

Analysis of K-NN with the Integration of Bag of Words, TF-IDF, and N-Grams for Hate Speech Classification on Twitter

Social media has emerged as one of the primary communication channels in the modern world, but it has simultaneously become a platform where hate speech can spread easily. This study attempts to evaluate the performance of a hate speech classification model using the K-Nearest Neighbors (K-NN) algorithm along with various feature extraction techniques, specifically Bag of Words (BoW), Term Frequency-Inverse Document Frequency (TF-IDF), and N-Grams. The dataset used in this study consists of 13169 entries, which represent a diverse range of hate speech examples commonly encountered on social media platforms. In this experimental investigation, we assess the efficacy of the model using each feature extraction technique. The findings reveal that the K-NN model exhibits optimal performance when the k parameter is set to 3 (k=3). Under this configuration, the model achieves an accuracy of 86.88%, with a precision of 88.27%, a recall of 86.88%, and an F1-Score of 86.50%. These results show that the integration of TF-IDF feature extraction technique with K-NN algorithm produces superior performance in hate speech classification.

High-throughput phenotypic traits estimation of faba bean based on machine learning and drone-based multimodal data

Faba bean is a global food legume crop, and it is essential to accurately and timely determine its plant height, above-ground biomass (fresh and dry weight) and yield for enhancing cultivation practices and planning the next planting season. Traditional ground sampling is a time-consuming and labor-intensive approach. However, the utilization of an unmanned aerial vehicle (UAV) as a high-throughput technique offers a promising alternative strategy for estimating crop phenotypic traits. In this study, a two-year experiment was conducted from 2020 to 2022, where UAV-based multimodal data were collected using red–green–blue, multispectral and thermal infrared sensors. The variables derived from these three sensors and their combinations were used to estimate the fresh weight, dry weight and yield of faba bean based on extreme gradient boosting (XGBoost), random forest, multiple linear regression and k-nearest neighbor algorithms. The following findings were obtained: (1) The use of the maximum percentile crop surface model resulted in the highest estimation accuracy for faba bean plant height. (2) Fusion data from multiple sensors increased the estimation accuracy of faba bean fresh weight, dry weight and yield, the coefficient of determination (R2) improved by 14.22%, 1.45%, and 18.76%, respectively, compared with the best estimation accuracy of a single sensor. (3) The XGBoost algorithm outperformed the other algorithms in estimating fresh weight, dry weight and yield of faba bean. These results demonstrate that multiple sensors and appropriate algorithms can be used to effectively estimate faba bean phenotypic traits and provide valuable insights for agricultural remote sensing research.

Application of K-Nearest Neighbor Algorithm for Consumer Behaviour Identification and Product Personalisation Based on Big Data Analysis

The rapid digital transformation has fundamentally altered the retail industry, presenting challenges such as shifting consumer behavior and intensified market competition. This research explores the application of the K-Nearest Neighbor (KNN) algorithm for identifying consumer behavior and developing product personalization systems based on big data insights. Utilizing a dataset comprising 10,000 transaction records from January to December 2023 and 5,302 product types, we implemented the KNN algorithm to predict consumer purchases. The data was processed into 89,908 distinct transaction records. Our evaluation, using 5-fold cross-validation, demonstrated that the optimal performance of the KNN model was achieved with 𝑘=10, yielding a precision of 0.8319, recall of 0.8311, and an F1-score of 0.8312. These findings highlight the effectiveness of KNN in enhancing consumer satisfaction through precise product recommendations. This study provides strategic insights for modern retailers aiming to leverage AI and big data to remain competitive and meet evolving consumer expectations.

A new binary classifier robust on noisy domains based on kNN algorithm

Classification is an effective technique commonly used in data analysis by systematically arranging groups or categories according to established criteria. The classifier's success relies on the classifier itself and the quality of the data. However, in real-world applications, it is inevitable for datasets to contain mislabeled instances, which may cause misclassification challenges that classifiers have to handle. This study aims for a quantitative assessment of the classification of noisy data through a new kNN-based classification algorithm and to increase the performance of classical kNN by efficiently classifying the data. We perform various numerical experiments on real-world data sets to prove our new algorithm's performance. We obtain high standards of accuracy levels on various noisy datasets. We propose that this new technique can provide high standard accuracy levels in binary classification problems. We compared the new kNN and classical kNN algorithms in various noise levels (10%, 20%, 30%, and 40%) on distinct datasets by measuring in terms of test accuracy. Also, we compared our new algorithm with popular classification algorithms and in the vast majority, we obtained better test accuracy results.

Application of machine learning in predicting health perception through military personnel's sense of empowerment.

The promotion of health and provision of care services for new recruits are issues of constant concern for military leaders and healthcare providers, as they are crucial to maintaining and operating military forces. The enhancement of military personnel's empowerment has been recognized as a core value in promoting health perception. However, the pathways between military personnel's sense of empowerment and health perception have not been thoroughly explored. The primary aim of this study is to examine the predictive power of different dimensions of empowerment (personal, interpersonal, and socio-political) on new recruits' health perception, and to further observe differences among subgroups, which will help us grasp the nuances of future health intervention measures. The research data were extracted from the "Military Career Development Study," analyzing personal empowerment data from Wave 1 (W1) and perceived health data from Wave 2 (W2) (N = 2,232). In terms of analytical methods, five ML classifiers, including Decision Tree, Random Forest, Support Vector Machine, AdaBoost, and k-Nearest Neighbors (KNN) algorithms, were used for prediction in both the full sample and subsamples (gender and socioeconomic status). Results show that among the five ML classifiers, the Decision Tree performed best overall, achieving a prediction accuracy of 95.4%. The results by gender show that the ML models perform best for both males and females with the Decision Tree and Random Forest methods. For the Decision Tree, the accuracy rates were 94.9% for males and 95.1% for females; the F1 scores were 92.9% for males and 93.2% for females. For the Random Forest, the accuracy rates were 94.9% for males and 95.4% for females; the F1 scores were 92.7% for males and 93.2% for females. Regarding SES, the Decision Tree and Random Forest methods performed best. In the SES Low group, both methods achieved a prediction accuracy of 95.6% and an F1 score of 93.7%; in the SES high group, they achieved a prediction accuracy of 95.4% and an F1 score of 93.3%. However, the contribution of different dimensions of empowerment features varied significantly among subgroups. These findings can provide important information on the differences in health perception among military personnel.

A Multi-Spatial Scale Ocean Sound Speed Prediction Method Based on Deep Learning

As sound speed is a fundamental parameter of ocean acoustic characteristics, its prediction is a central focus of underwater acoustics research. Traditional numerical and statistical forecasting methods often exhibit suboptimal performance under complex conditions, whereas deep learning approaches demonstrate promising results. However, these methodologies fall short in adequately addressing multi-spatial coupling effects and spatiotemporal weighting, particularly in scenarios characterized by limited data availability. To investigate the interactions across multiple spatial scales and to achieve accurate predictions, we propose the STA-ConvLSTM framework that integrates spatiotemporal attention mechanisms with convolutional long short-term memory neural networks (ConvLSTM). The core concept involves accounting for the coupling effects among various spatial scales while extracting temporal and spatial information from the data and assigning appropriate weights to different spatiotemporal entities. Furthermore, we introduce an interpolation method for ocean temperature and salinity data based on the KNN algorithm to enhance dataset resolution. Experimental results indicate that STA-ConvLSTM provides precise predictions of sound speed. Specifically, relative to the measured data, it achieved a root mean square error (RMSE) of approximately 0.57 m/s and a mean absolute error (MAE) of about 0.29 m/s. Additionally, when compared to single-dimensional spatial analysis, incorporating multi-spatial scale considerations yielded superior predictive performance.

Sentiment Analysis of Hate Speech against DPR-RI on Twitter Using Naive Bayes and KNN Algorithms

According to surveys, the rise in social media users has resulted in an increase of hate speech, and Twitter is one of the most popular platforms for this type of speech. The tweet feature on Twitter enables users to make repeated instances of hate speech, making Twitter data very intriguing to analyze. This study aims to investigate whether a tweet contains hate speech towards the Indonesian House of Representatives (DPR-RI). The research employed crawling techniques to gather data from Twitter using the Twitter API feature. The Naïve Bayes algorithm was applied, and the results were compared with the accuracy of the K-Nearest Neighbor. After preprocessing, the total data obtained was 1,494, with 956 test data and 538 training data. The study revealed that Twitter users' sentiment towards DPR-RI was 49.2% positive and 50.8% negative sentiment when tested using Naïve Bayes. Meanwhile, KNN showed 23.4% positive and 76.6% negative sentiment. The high negative sentiment in both classifiers suggests that Twitter users frequently express hate speech towards DPR-RI. Naïve Bayes algorithm showed the highest prediction accuracy at 98.32%, while the K-Nearest Neighbor algorithm had an accuracy of only 62.84%.

Multimodal Operation Data Mining for Grid Operation Violation Risk Prediction

With the continuous expansion of the power grid, the issue of operational safety has attracted increasing attention. In power grid operation control, unauthorized operations are one of the primary causes of personal accidents. Therefore, preventing and monitoring unauthorized actions by power grid operators is of critical importance. First, multimodal violation data are integrated through information systems, such as the power grid management platform, to construct a historical case database. Next, word vectors for three types of operation-related factors are generated using natural language processing techniques, and key vectors are selected based on generalized correlation coefficients using mutual information, enabling effective dimensionality reduction. Independent component analysis is then employed for feature extraction and further dimensionality reduction, allowing for the effective characterization of operational scenarios. For each historical case, a risk score is derived from a violation risk prediction model constructed using the Random Forests (RF) algorithm. When a high-risk score is identified, the K-Nearest Neighbor (KNN) algorithm is applied to locate similar scenarios in the historical case database where violations may have occurred. Real-time violation risk assessment is performed for each operation, providing early warnings to operators, thereby reducing the likelihood of violations, and enhancing the safety of power grid operations.

A Brownian Motion Restricted K-Nearest Neighbor Algorithm for Indoor Positioning

A Brownian Motion Restricted K-Nearest Neighbor Algorithm for Indoor Positioning

Comparative Analysis of Fall Detection Using Artificial Neural Networks (ANN) and K-Nearest Neighbors (KNN) Algorithms

Fall detection is a critical area of research due to its implications for public health, particularly among older adults more vulnerable to fall-related injuries. This study explores the application of pervasive computing and machine learning algorithms in detecting falls using accelerometer and gyroscope sensors. Leveraging a dataset obtained from smartphone sensors, the study employs data processing techniques and classification algorithms, including K-Nearest Neighbors (KNN) and Artificial Neural Networks (ANN), to differentiate fall events from other activities. Evaluation metrics such as accuracy, precision, recall, and F1-score are utilized to assess the performance of the models. The results demonstrate the effectiveness of both the ANN and KNN models in accurately predicting fall detection with high precision and recall scores. The study highlights the potential of pervasive computing systems and machine learning methods to enhance fall detection capabilities, contributing to the development of proactive measures for ensuring the safety and well-being of individuals at risk of falls. Future research directions include exploring alternative algorithms and sensor modalities to improve fall detection systems further.

An accurate roughness prediction in milling processes through analytical evaluation and KNN regression approach

An accurate roughness prediction in milling processes through analytical evaluation and KNN regression approach