Neighbor Algorithm Research Articles

Enhancing internet of things attack detection using principal component analysis and kernel principal component analysis with cosine distance and sigmoid kernel

The widespread adoption of internet of things (IoT) devices has brought about unprecedented levels of connectivity and convenience. However, it has also introduced significant challenges, particularly in the areas of security and privacy. This study addresses the critical issue of intrusion detection within IoT environments, with a specific focus on analyzing the Iot-23 dataset. Our methodology involves employing principal component analysis (PCA) and kernel PCA for dimensionality reduction. Subsequently, we utilize the k-nearest neighbors (KNN) algorithm for classification purposes. To optimize the performance of the KNN algorithm, we experiment with various feature scaling techniques, such as StandardScaler, MinMaxScaler, and RobustScaler, utilizing different distance metrics. In our analysis, we discovered that employing the cosine distance metric in combination with KNN resulted in superior intrusion detection performance when utilizing PCA. Additionally, when utilizing kernel PCA, we evaluated multiple kernel functions and determined that the radial basis function and sigmoid kernel yielded the most favorable results.

K-nearest neighbor algorithm for imputing missing longitudinal prenatal alcohol data

K-nearest neighbor algorithm for imputing missing longitudinal prenatal alcohol data

Algorithmic Trading Bot Using Artificial Intelligence Supertrend Strategy

Abstract: This article presents a trading strategy that combines the Super Trend indicator with the K-Nearest Neighbors (KNN) algorithm, utilizing artificial intelligence (AI) to automate market decision-making and enhance trading accuracy. The strategy integrates the SuperTrend indicator, which dynamically tracks market volatility, with the KNN algorithm, allowing the system to classify market trends as bullish, bearish, or neutral based on historical data. This enables the strategy to make intelligent, data-driven decisions in real-time without human intervention. The AI-driven approach automates the entire trading process, from data analysis to trade execution, improving efficiency and removing emotional biases from trading decisions. The KNN algorithm plays a key role in this automation by analyzing past market conditions and identifying patterns that inform future price movements. This allows the system to adapt to changing market trends and react quickly to new data, ensuring timely and accurate decisions. The results of the strategy indicate strong performance, with a Net Profit of 959.38 USD and a Gross Profit of 3,005.71 USD, demonstrating the strategy's ability to generate consistent returns. The Profit Factor of 1.469 further highlights the system's ability to produce profits while managing risk effectively. Additionally, the Sharpe Ratio of 0.558 shows that the strategy provides positive risk-adjusted returns, making it a reliable tool for automated trading. In conclusion, this AI-powered Super Trend-KNN strategy showcases the potential of combining artificial intelligence with technical indicators for automated trading. By eliminating the need for manual intervention and leveraging AI to adapt to market conditions, the strategy provides an efficient and scalable solution for intelligent decision-making in trading.

Single-epoch power positioning method for multi-beam LEO communication satellites

Low Earth Orbit (LEO) communication satellites offer reduced signal loss, fast movement, multi-beam, typically providing single coverage. This paper introduces a novel multi-beam power positioning method for low-orbit single-satellite, addressing the slow convergence and low accuracy of Doppler positioning. It establishes a power observation equation system, initializes with the nearest neighbor algorithm, and refines with the least squares method. Monte Carlo simulations indicate that with good initial values, the method converges in under 10 iterations, achieving 88.06% availability at 20° elevation with errors of 5,331 m (vertical) and 8,798 m (horizontal), and a timing error of 205 μs. At 70° elevation, all users converge with errors of 1,614 m and 1,088 m, and a timing error of 31.3 μs, demonstrating high power positioning availability. The statistical results show that power positioning users can obtain the positioning accuracy of kilometers and the timing accuracy of microseconds, which meets initial timing needs under strong confrontation, enhancing the medium and high orbit satellite navigation.

Non-Invasive and Accurate Blood Glucose Detection Based on an Equivalent Bioimpedance Spectrum

Accurate blood glucose monitoring is a key issue for the diagnosis and treatment of diabetes. For this purpose, a non-invasive blood glucose detection method is proposed, which makes use of the equivalent bioelectric impedance spectrum. An impedance detection platform is designed using an automatic balance bridge technique, which can acquire an impedance spectrum within the range of dispersion. Then, the K-nearest neighbor algorithm is used to extract the characteristics of the impedance spectrum. Furthermore, higher-order multiple regression methods are used to establish a blood glucose–electrical impedance spectrum model. Experimental results show that the proposed blood glucose–electrical impedance spectrum model can estimate the change in blood glucose and reliably identify the high blood glucose samples. The correlation between the proposed method and the biochemical blood glucose values can reach 0.89 and 0.87 in personal and multi-person blood glucose tests, respectively. Thus, the proposed method provides a feasible solution for non-invasive blood glucose detection and can help us identify diabetes mellitus.

WALLABY Pilot Survey: kNN identification of perturbed galaxies through Hi morphometrics

Abstract Galaxy morphology in stellar light can be described by a series of “non-parametric” or “morphometric” parameters, such as concentrationasymmetry-smoothness, Gini, M20, and Sersic fit. These parameters can be applied to column density maps of atomic hydrogen (Hi). The Hi distribution is susceptible to perturbations by environmental effects, e.g. inter-galactic medium pressure and tidal interactions. Therefore, Hi morphology can potentially identify galaxies undergoing ram-pressure stripping or tidal interactions. We explore three fields in theWALLABY Pilot Hi survey and identify perturbed galaxies based on a k-nearest Neighbor (kNN) algorithm using an Hi morphometric feature space. For training, we used labeled galaxies in the combined NGC 4808 and NGC 4636 fields with six Hi morphometrics to train and test a kNN classifier. The kNN classification is proficient in classifying perturbed galaxies with all metrics –accuracy, precision and recall– at 70-80%. By using the kNN method to identify perturbed galaxies in the deployment field, the NGC 5044 mosaic, we find that in most regards, the scaling relations of perturbed and unperturbed galaxies have similar distribution in the scaling relations of stellar mass vs star formation rate and the Baryonic Tully-Fisher relation, but the Hi and stellar mass relation flatter than of the unperturbed galaxies. Our results for NGC 5044 provide a prediction for future studies on the fraction of galaxies undergoing interaction in this catalogue and to build a training sample to classify such galaxies in the fullWALLABY survey.

An Artificial Intelligence Home Monitoring System That Uses CNN and LSTM and is Based on the Android Studio Development Platform

This paper developed an artificial intelligence home environment monitoring system by using the Android Studio development platform. A database was constructed within a server to store sensor data. The proposed system comprises multiple sensors, a message queueing telemetry transport (MQTT) communication protocol, cloud data storage and computation, and end device control. A mobile application was developed using MongoDB software, which is a file-oriented NoSQL database management system developed using C++. This system represents a new database for processing big sensor data. The k-nearest neighbor (KNN) algorithm was used to impute missing data. Node-RED development software was used within the server as a data-receiving, storage, and computing environment that is convenient to manage and maintain. Data on indoor temperature, humidity, and carbon dioxide concentrations are transmitted to a mobile phone application through the MQTT communication protocol for real-time display and monitoring. The system can control a fan or warning light through the mobile application to maintain ambient temperature inside the house and to warn users of emergencies. A long short-term memory (LSTM) model and a convolutional neural network (CNN) model were used to predict indoor temperature, humidity, and carbon dioxide concentrations. Average relative errors in the predicted values of humidity and carbon dioxide concentration were approximately 0.0415% and 0.134%, respectively, for data storage using the KNN algorithm. For indoor temperature prediction, the LSTM model had a mean absolute percentage error of 0.180% and a root-mean-squared error of 0.042 °C. The CNN–LSTM model had a mean absolute percentage error of 1.370% and a root-mean-squared error of 0.117 °C.

Online forecasting using neighbor-based incremental learning for electricity markets

Abstract Electricity market forecasting is very useful for the different actors involved in the energy sector to plan both the supply chain and market operation. Nowadays, energy demand data are data coming from smart meters and have to be processed in real-time for more efficient demand management. In addition, electricity prices data can present changes over time such as new patterns and new trends. Therefore, real-time forecasting algorithms for both demand and prices have to adapt and adjust to online data in order to provide timely and accurate responses. This work presents a new algorithm for electricity demand and prices forecasting in real-time. The proposed algorithm generates a prediction model based on the k-nearest neighbors algorithm, which is incrementally updated in an online scenario considering both changes to existing patterns and adding new detected patterns to the model. Both time-frequency and error threshold based model updates have been evaluated. Results using energy demand from 2007 to 2016 and prices data for different time periods from the Spanish electricity market are reported and compared with other benchmark algorithms.

Monkeypox diagnosis based on probabilistic K-nearest neighbors (PKNN) algorithm.

Although it is not a new illness and has been around since the previous century, monkeypox later resurgence is fraught with difficulties. This study presents a novel approach of diagnosing monkeypox using artificial intelligence, which is called Effective Monkeypox Diagnosis Strategy (EMDS). The proposed EMDS is established through two sequential stages, namely; (i) Pre-Processing Phase (PP) and (ii) Monkeypox Diagnosing phase (MDP). During PP the input image dataset is prepared through three processes, which are; feature extraction, feature selection, and anomaly rejection, while the actual diagnosis performed in the MDP. Features are extracted from input images using GoogleNet as an effective pre-trained deep learning model, while Leopard Seal Optimization (LSO) is employed to select the most instructive features. The major contribution of this paper is focused in two issues, which are; (i) introducing a new methodology for rejecting anomalies from the input image dataset based on interquartile range (IQR), and (ii) proposing a new instance of K-Nearest Neighbor classifier for monkeypox diagnosis, which is called; Probabilistic K-Nearest Neighbors (PKNN) Algorithm. The proposed PKNN combines evidence from distance based traditional KNN as well as the Naïve probabilistic theorem used by Naïve Bayes (NB) algorithm in an integrated way. Numerous experiments have been conducted considering the proposed EMDS as well as recent competitive strategies on two public monkeypox datasets, which are; the Monkeypox Skin Image and Lesion Datasets (MSID and MSLD, respectively). Initially, the performance of the basic contributions of the proposed EMDS, which are the outlier rejection methodology (ORM) and PKNN, are evaluated individually. Then, EMSD as a whole is evaluated. Moreover, an ablation study has also been conducted to evaluate the effect of ORM and PKNN on the performance of EMSD. Based on the experimental results, it is shown that EMDS outperforms recent monkeypox identification strategies as it achieves 99% diagnosis accuracy. Moreover, it indicates the maximum precision and recall with the minimum diagnosis time.

Reduction in Microgrid Topology Selection Time via Hybrid Branch and Bound and k-Nearest Neighbors Techniques

The global adoption of hybrid renewable energy systems (HRESs) is accelerating as a strategic response to escalating energy demands and the imperative to mitigate greenhouse gas emissions. Despite the development of various technological tools, such as pre-feasibility analysis, sizing, and simulation tools, challenges persist due to their limited flexibility in modifying system architectures and their typically long computation times, which hinder their practical efficiency. This study introduces a novel hybrid method that integrates the Branch and Bound (BB) heuristic search algorithm with the k-Nearest Neighbors (kNN) algorithm to drastically reduce the simulation time of microgrid models in Simulink. Validation considering four distinct case studies reveals that our method can decrease the simulation time by up to 94.68% while maintaining an acceptable accuracy. Specifically, simulation times in certain cases were reduced from approximately 21,780 and 118,580 s to 1442.7969 and 6306.0625 s, respectively. This significant reduction facilitates the rapid evaluation and selection of optimal HRES configurations, enhancing the efficiency of both editable and non-editable systems. Through streamlining the simulation process, this approach not only accelerates the design and analysis phases but also supports the broader adoption and deployment of HRESs, which is critical for achieving a sustainable future. This advancement offers a robust and efficient methodology for optimizing simulation times, thereby addressing a key bottleneck in the development and implementation of hybrid renewable energy solutions.

MSIMRS: Multi-Scale Superpixel Segmentation Integrating Multi-Source Remote Sensing Data for Lithology Identification in Semi-Arid Area

Lithology classification stands as a pivotal research domain within geological Remote Sensing (RS). In recent years, extracting lithology information from multi-source RS data has become an inevitable trend. Various classification image primitives yield distinct outcomes in lithology classification. The current research on lithology classification utilizing RS data has predominantly concentrated on pixel-level classification, which suffers from a long classification time and high sensitivity to noise. In order to explore the application potential of superpixel segmentation in lithology classification, this study proposed the Multi-scale superpixel Segmentation Integrating Multi-source RS data (MSIMRS), and conducted a lithology classification study in Duolun County, Inner Mongolia Autonomous Region, China combining MSIMRS and the Support Vector Machine (MSIMRS-SVM). In addition, pixel-level K-Nearest Neighbor (KNN), Random Forest (RF) and SVM classification algorithms, as well as deep-learning models including Resnet50 (Res50), Efficientnet_B8 (Effi_B8), and Vision Transformer (ViT) were chosen for a comparative analysis. Among these methods, our proposed MSIMRS-SVM achieved the highest accuracy in lithology classification in a typical semi-arid area, Duolun County, with an overall accuracy and Kappa coefficient of 92.9% and 0.92. Moreover, the findings indicate that incorporating superpixel segmentation into lithology classification resulted in notably fewer fragmented patches and significantly improved the visualization effect. The results showcase the application potential of superpixel primitives in lithology information extraction within semi-arid areas.

Fingerprint localization based on hybrid TOA, AOA, and RSS measurements

This paper presents a novel joint TOA-AOA-RSS fingerprint localization method aimed at reducing the necessity for collecting extensive fingerprint data for database construction. Initially, The Time-of-Arrival(TOA) is employed for coarse localization to narrow down the fingerprint database. Subsequently, Angle-of-Arrivals(AOAs) and Received Signal Strengths(RSSs) were used as feature parameters to construct the fingerprint database together with the coarse localization coordinates obtained from the TOA. Finally, a matching algorithm is utilized to determine the coordinate of the localization point. Additionally, we introduce an improved self adaptive weighted K nearest neighbor (ISAWKNN) algorithm is proposed based on Hybrid TOA,AOA, and RSS measurements. Simulation results illustrate the proposed algorithm improving the localization accuracy.

Performance of K-Nearest Neighbor Algorithm and C4.5 Algorithm in Classifying Citizens Eligible to Receive Direct Cash Assistance in Bandar Mahligai Village

Direct Cash Assistance, commonly called BLT, is one of the many programs the Indonesian government held to reduce the poverty rate of the Indonesian population. This study compares the KNN and C4.5 methods to determine the eligibility of residents eligible to receive Direct Cash Assistance in Bandar Mahligai Village. This study began with collecting resident data from the Bandar Mahligai village office. Then, the data obtained was taken into several attributes to be used in the classification process, namely the name of the head of the family, KK number, NIK, number of dependents, occupation, income, and monthly expenses. After the data is collected, the data will be classified using the KNN and C4.5 algorithms. There is a significant difference between the two algorithms in the classification process; the KNN algorithm by looking for the nearest neighbor data value, in this study, the K value = 9, while the C4.5 algorithm by building a decision tree from the attribute values taken based on resident data used as training data. The classification results of the two methods will be compared using a confusion matrix to obtain a higher accuracy technique. The results of testing using a confusion matrix for both algorithms are the accuracy produced by the KNN and C4.5 algorithms in classifying residents eligible for Direct Cash Assistance (BLT) of 90% in the system that has been built. The results of comparing the KNN and C4.5 algorithms for this study show that the KNN algorithm is better because the accuracy level reaches 90% in manual and system calculations. While the C4.5 method only gets 85% for the accuracy of its manual calculations, it receives an accuracy level of 90% in the system that has been built.

A hybrid data assimilation method based on real-time Ensemble Kalman filtering and KNN for COVID-19 prediction

This study introduces a hybrid data assimilation method that significantly improves the predictive accuracy of the time-dependent Susceptible-Exposed-Asymptomatic-Infected-Quarantined-Removed (SEAIQR) model for epidemic forecasting. The approach integrates real-time Ensemble Kalman Filtering (EnKF) with the K-Nearest Neighbors (KNN) algorithm, combining dynamic real-time adjustments with pattern recognition techniques tailored to the specific dynamics of epidemics. This hybrid methodology overcomes the limitations of single-model predictions in the face of increasingly complex transmission pathways in modern society. Numerical experiments conducted using COVID-19 case data from Xi’an, Shaanxi Province, China (December 9, 2021, to January 8, 2022) demonstrate a marked improvement in forecasting accuracy relative to traditional models and other data assimilation approaches. These findings underscore the potential of the proposed method to enhance the accuracy and reliability of predictive models, providing valuable insights for future epidemic forecasting and disease control strategies.

Classification of Anaemia Status Using The K-Nearest Neighbor Algorithm

Early detection and accurate diagnosis of anemia are crucial for public health management, with conventional methods like complete blood count often being costly and unavailable in remote areas. The use of machine learning techniques, specifically the k-nearest neighbor (KNN) algorithm, shows promise in classifying medical conditions including anemia with competitive accuracy compared to traditional methods. The implementation of KNN not only offers accuracy but also time and cost efficiency, providing reliable results quickly for medical professionals in the field. The algorithm's application involves determining the appropriate k-value for optimal accuracy, calculating distances using Euclidean distance, and voting for class prediction based on nearest neighbors. The analysis showcases the model's efficiency in predicting anemia status with an accuracy of 94.72% and promising precision and recall rates.

ATKB-PID: an adaptive control method for micro tension under complex hot rolling conditions

At present, the parameters of the controllers in hot rolling roughing microtension control systems are not adaptively adjustable to variations in working conditions, which compromises both width accuracy and production stability. To address this issue, this paper introduces an ATKB-PID adaptive micro tension control method. This method incorporates a linear attention layer and utilizes a K-Nearest Neighbors (KNN) algorithm to predict the optimal learning rate and inertia coefficient under actual operating conditions. Furthermore, an objective function is tailored to production indices to enhance model performance. Comparative experiments with both established and recently introduced controllers demonstrate that the proposed ATKB-PID method exhibits a smaller steady-state error and quicker adjustment time. The ATKB-PID control method is well-suited for the complex and dynamic microtension control demands in thermal roughing processes, showing promising application potential.

Review and Intercomparison of Machine Learning Applications for Short-term Flood Forecasting

Abstract Among natural hazards, floods pose the greatest threat to lives and livelihoods. To reduce flood impacts, short-term flood forecasting can contribute to early warnings that provide communities with time to react. This manuscript explores how machine learning (ML) can support short-term flood forecasting. Using two methods [strengths, weaknesses, opportunities, and threats (SWOT) and comparative performance analysis] for different forecast lead times (1–6, 6–12, 12–24, and 24–48 h), we evaluate the performance of machine learning models in 94 journal papers from 2001 to 2023. SWOT reveals that the best short-term flood forecasting was produced by hybrid, random forest (RF), long short-term memory (LSTM), artificial neural network (ANN), and adaptive neuro-fuzzy inference system (ANFIS) approaches. The comparative performance analysis, meanwhile, favors convolutional neural network, ANFIS, multilayer perceptron, k-nearest neighbors algorithm (KNN), hybrid, LSTM, ANN, and support vector machine (SVM) at 1–6 h; hybrid, ANFIS, ANN, and LSTM at 6–12 h; SVM, hybrid, and RF at 12–24 h; and hybrid and RF at 24–48 h. In general, hybrid approaches consistently perform well across all lead times. Trends such as hybridization, model selection, input data selection, and decomposition seem to improve the accuracy of models. Furthermore, effective stand-alone ML models such as ANN, SVM, RF, genetic algorithm, KNN, and LSTM, provide better outcomes through hybridization with other ML models. By including different machine learning models and parameters such as environmental, socio-economical, and climatic parameters, the hybrid system can produce more accurate flood forecasting, making it more effective for early warning operational purposes.

Artificial Intelligence Tools Addressing Challenges of Cancer Progression Due to Antimicrobial Resistance in Pathogenic Biofilm Systems

Infections, inflammation, and progression of multifactorial diseases are found to be integratively linked, including most Cancers. Dysfunctional microbiomes are also associated with several cancers in their tumor microenvironments. Antimicrobial peptides (AMPs) are short, positively charged peptides found in a diverse range of species, including bacteria and humans. As host defense peptides, they can destroy pathogenic infections, particularly those that are multidrug resistant. AMPs have raised hopes in the biomedical and pharmaceutical industries as fresh non-antibiotic strategies for combating infectious diseases. However, in vitro and in vivo verification of AMPs is problematic and may miss new antimicrobial drugs. Creating computational methods for quick and precise identification of AMPs and their functional forms is critical for developing new and more effective antimicrobial drugs. Machine learning techniques were recently discovered effective at mining, predicting, and producing efficient antimicrobial peptides from a large AMP database. We reviewed 76 articles, after following literature search rubrics to come to the following conclusions. Distance metric-constant K-based nearest neighbor algorithms (KNN), hidden Markov models (HMMs), support vector machine models (SVMs), random forest models (RFs), decision tree models, and deep neural network (DNN)-based models are some of the most popular AI tools for detecting antimicrobial activity in peptide sequence-derived structure and function. Knowledge graphs can further assist in identifying hub genes and antimicrobial peptides that target and block quorum sensing (QS) signals within the microbial networks. In conclusion, we state that currently no single AI method has been found appropriate for AMP discovery and accurately capable of predicting high-efficacy AMPs. Our current literature review and analysis identify cutting-edge algorithms or innovations that might be included in hybrid machine-learning approaches for the most effective AMP identification, creation, and prediction. Non-peptide, natural molecule-based approaches to AMR reduction are also being studied for development, with natural peptide scaffolds serving as the foundation.

Integrating machine learning and nano-QSAR models to predict the oxidative stress potential caused by single and mixed carbon nanomaterials in algal cells.

In silico methods are increasingly important in predicting the ecotoxicity of engineered nanomaterials (ENMs), encompassing both individual and mixture toxicity predictions. It is widely recognized that ENMs trigger oxidative stress effects by generating intracellular reactive oxygen species (ROS), serving as a key mechanism in their cytotoxicity studies. However, existing in silico methods still face significant challenges in predicting the oxidative stress effects induced by ENMs. Herein, we utilized laboratory-derived toxicity data and machine learning methods to develop quantitative nanostructure-activity relationship (nano-QSAR) classification and regression models, aiming to predict the oxidative stress effects of five carbon nanomaterials (fullerene, graphene, graphene oxide, single-walled carbon nanotubes, and multi-walled carbon nanotubes) and their binary mixtures on Scenedesmus obliquus cells. We constructed five nano-QSAR classification models by combining zeta potential (ζP) with the C4.5 decision tree, support vector machine, artificial neural network, naive Bayes, and K-nearest neighbor algorithms. Moreover, we constructed three classification models by integrating the features including ζP, hydrodynamic diameter (DH), and specific surface area (SSA) with the logistic regression, random forest, and Adaboost algorithms. The Accuracy, Recall, Precision and harmonic mean of Precision and Recall (F1-score) values of these models were all higher than 0.600, indicating an excellent performance in distinguishing whether CNMs have the potential to generate ROS. In addition, using the ζP, DH, and SSA descriptors, we combined decision tree regression, random forest regression, gradient boosting, and the Adaboost algorithm, and successfully constructed four nano-QSAR regression models with applicable application domains (all training and testing data points lie within 95% confidence intervals), goodness-of-fit (Rtrain2 ≥ 0.850), and robustness (cross-validation R2 ≥ 0.650) as well as predictive power (Rtest2 ≥ 0.610). The method developed would establish a fundamental basis for more precise evaluations of ecological risks posed by these materials from a mechanistic standpoint.

Lung Cancer Prediction Based on K-nearest Neighbor and Other Algorithms

Lung Cancer Prediction Based on K-nearest Neighbor and Other Algorithms