Neighbor Classification Algorithm Research Articles

A Comparative Study on the Impact of Feature Selection and Dataset Resampling on the Performance of the K-Nearest Neighbors (KNN) Classification Algorithm

A Comparative Study on the Impact of Feature Selection and Dataset Resampling on the Performance of the K-Nearest Neighbors (KNN) Classification Algorithm

Compressive strength detection of tunnel lining using hyperspectral images and machine learning

Traditional tunnel lining strength detection techniques are mostly contact-based, with relatively low detection efficiency. This study innovatively proposes hyperspectral imaging method to rapidly detect tunnel concrete lining strength from a machine vision perspective. Hyperspectral cameras were employed in indoor experiments to capture hyperspectral images of concrete specimens with different compressive strength levels. The differences of concrete strength based on hyperspectral reflectance characteristics were analysed using hyperspectral images and machine learning algorithms. Firstly, the K-Nearest Neighbors (KNN) classification algorithm was used to predict the classification of the concrete hyperspectral dataset with accuracy mostly exceeding 90 %. The results indicate distinctive differences in hyperspectral reflectance characteristics among concrete specimens. Furthermore, compressive strength prediction of different concrete specimens was carried out using Principal component regression (PCR), Partial least squares regression (PLSR), and Least Squares Support Vector Machine (LSSVM) machine learning models on both original and Savitzky-Golay(S-G) processed spectral data. LSSVM and PLSR models performed excellently in the visible light spectrums(400–1000 nm), with LSSVM excelling in the near-infrared spectrums(900–1700 nm). Finally, the feasibility of using Hyperspectral imaging(HSI) technology to detect tunnel lining strength was demonstrated at the shield tunnel model site. The predicted results were validated by combining with strength values measured by the rebound hammer, and presented promoising research path for automated non-destructive detection of concrete tunnel lining strength.

An Analysis of Traditional Methods and Deep Learning Methods in SSVEP-Based BCI: A Survey

The brain–computer interface (BCI) is a direct communication channel between humans and machines that relies on the central nervous system. Neuroelectric signals are collected by placing electrodes, and after feature sampling and classification, they are converted into control signals to control external mechanical devices. BCIs based on steady-state visual evoked potential (SSVEP) have the advantages of high classification accuracy, fast information conduction rate, and relatively strong anti-interference ability, so they have been widely noticed and discussed. From k-nearest neighbor (KNN), multilayer perceptron (MLP), and support vector machine (SVM) classification algorithms to the current deep learning classification algorithms based on neural networks, a wide variety of discussions and analyses have been conducted by numerous researchers. This article summarizes more than 60 SSVEP- and BCI-related articles published between 2015 and 2023, and provides an in-depth research and analysis of SSVEP-BCI. The survey in this article can save a lot of time for scholars in understanding the progress of SSVEP-BCI research and deep learning, and it is an important guide for designing and selecting SSVEP-BCI classification algorithms.

Accuracy of K-Nearest Neighbors Algorithm Classification For Archiving Research Publications

The Archives and Research Publication Information System plays an important role in managing academic research and scientific publications efficiently. With the increasing volume of research and publications carried out each year by university researchers, the Research Archives and Publications Information System is essential for organizing and processing these materials. However, managing large amounts of data poses challenges, including the need to accurately classify a researcher's field of study. To overcome these challenges, this research focuses on implementing the K-Nearest Neighbors classification algorithm in the Archives and Research Publications Information System application. This research aims to improve the accuracy of classification systems and facilitate better decision-making in the management of academic research. This research method is systematic involving data acquisition, pre-processing, algorithm implementation, and evaluation. The results of this research show that integrating Chi-Square feature selection significantly improves K-Nearest Neighbors performance, achieving 86% precision, 84.3% recall, 89.2% F1 Score, and 93.3% accuracy. This research contributes to increasing the efficiency of the Archives and Research Publication Information System in managing research and academic publications.

Test Cost Reduction for VLSI Adaptive Test With K-Nearest Neighbor Classification Algorithm

Test Cost Reduction for VLSI Adaptive Test With K-Nearest Neighbor Classification Algorithm

Agriculture data analysis using parallel k-nearest neighbour classification algorithm

A cost-effective and effective agriculture management system is created by utilizing data analytics (DA), internet of things (IoT), and cloud computing (CC). Geographic information system (GIS) technology and remote sensing predictions give users and stakeholders access to a variety of sensory data, including rainfall patterns and weather-related information (such as pressure, humidity, and temperatures). They have unstructured format for sensory data. The current systems do a poor job of analysing such data since they cannot effectively balance speed and memory usage. An effective categorization model (ECM) on agriculture management system is proposed to address this research difficulty. First, a classification technique called priority-based k-nearest neighbour (KNN) is provided to categorize unstructured multi-dimensional data into a structured form. Additionally, the Hadoop MapReduce (HMR) framework is used to do classification utilizing a parallel approach. Data from real-time IoT sensors used in agriculture is the subject of experiments. The suggested approach significantly outperforms previous approaches that are computing time, memory efficiency, model accuracy, and speedup.

Research on the application of Bagging W-KNN algorithm in alloy steel identification with PXRF analyzer

In response to the inadequate alloy steel identification capability and intelligent recognition of domestic portable X-ray fluorescence analyzers, as well as the impact of existing classification algorithms due to factors such as imbalanced data distribution, this paper proposes the Bagging W-KNN intelligent identification algorithm for alloy steel grade. This method is based on the K-nearest neighbor classification algorithm, employs the Chi-Square statistical method, Bagging ensemble algorithm, introduces the Gini index from the decision tree classification algorithm, and utilizes the Gaussian function probability estimation method. Comparative experiments with four typical algorithms—Decision Tree, KNN, SVM, and Naive Bayes—demonstrate that the proposed algorithm achieves accuracy, precision, recall, and F1 values of 97.01%, 97.30%, 96.69%, and 96.18% respectively, significantly outperforming the other four algorithms and improving prediction accuracy.

Monitoring of high-dimensional and high-frequency data streams: A nonparametric approach

ABSTRACT High-dimensional and high-frequency data streams (HHDS) have become widely available with the prevalence of data-acquisition technologies. Because HHDS have the characteristics of high dimensionality and temporal correlation, traditional statistical process control (SPC) techniques cannot be used directly to address the problem of monitoring HHDS. Most extant monitoring methods commonly assume that the process observations are independent or can be described by some parametric models and face the challenge posed by high-dimensional data. Little research has been conducted on the robust monitoring of HHDS that can simultaneously accommodate high dimensions and high frequencies. Therefore, in this paper, we propose a novel nonparametric approach for monitoring HHDS, based on data decorrelation, dimension reduction, and SPC. Specifically, process observations are first sequentially decorrelated and standardized using Cholesky decomposition, and then the k -nearest neighbors classification algorithm is applied to transform uncorrelated high-dimensional data into one-dimensional data. Finally, the traditional cumulative-sum procedure is used for online monitoring, based on an empirical log-likelihood ratio test. Numerical studies have shown that our monitoring scheme is sufficiently reliable and efficient for the online monitoring of HHDS. An illustrative example about the Dow Jones 30 industrial stock prices is presented to further validate the proposed approach.

Flexible wide-range multidimensional force sensors inspired by bones embedded in muscle

AbstractFlexible sensors have been widely studied for use in motion monitoring, human‒machine interactions (HMIs), personalized medicine, and soft intelligent robots. However, their practical application is limited by their low output performance, narrow measuring range, and unidirectional force detection. Here, to achieve flexibility and high performance simultaneously, we developed a flexible wide-range multidimensional force sensor (FWMFS) similar to bones embedded in muscle structures. The adjustable magnetic field endows the FWMFS with multidimensional perception for detecting forces in different directions. The multilayer stacked coils significantly improved the output from the μV to the mV level while ensuring FWMFS miniaturization. The optimized FWMFS exhibited a high voltage sensitivity of 0.227 mV/N (0.5–8.4 N) and 0.047 mV/N (8.4–60 N) in response to normal forces ranging from 0.5 N to 60 N and could detect lateral forces ranging from 0.2–1.1 N and voltage sensitivities of 1.039 mV/N (0.2–0.5 N) and 0.194 mV/N (0.5–1.1 N). In terms of normal force measurements, the FWMFS can monitor finger pressure and sliding trajectories in response to finger taps, as well as measure plantar pressure for assessing human movement. The plantar pressure signals of five human movements collected by the FWMFS were analyzed using the k-nearest neighbors classification algorithm, which achieved a recognition accuracy of 92%. Additionally, an artificial intelligence biometric authentication system is being developed that classifies and recognizes user passwords. Based on the lateral force measurement ability of the FWMFS, the direction of ball movement can be distinguished, and communication systems such as Morse Code can be expanded. This research has significant potential in intelligent sensing and personalized spatial recognition.

Comparative Analysis Of Machine Learning And Deep Learning Models Integrated With Altman Z-Score For Financial Distress Prediction In Companies Listed On The Indonesia Stock Exchange (IDX)

Financial distress is a condition in which a company experiences a decline in its financial situation, which is typically temporary. However, financial distress can worsen if not promptly addressed, leading to bankruptcy. Early identification of potential financial distress in a company is crucial for stakeholders such as investors, creditors, and regulators. In practice, predicting financial distress in a company is not an easy task. One of the methods commonly used to identify early symptoms of financial distress is the method introduced by Altman in 1986. Altman's research model, known as the Z-Score, determines a value based on standard calculations of financial ratios to indicate the likelihood of a company experiencing bankruptcy. The use of artificial intelligence, such as deep learning, can enhance the scope of research on the analysis and prediction of financial distress. This study aims to conduct a comparative analysis of machine learning models, such as the K-Nearest Neighbor Classifier and Random Forest Classifier, and deep learning models, such as Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN). This analysis is carried out to evaluate the success rate of the proposed deep learning models in predicting financial distress in companies operating in Indonesia. Based on the conducted research, the K-Nearest Neighbor Classifier algorithm achieved an accuracy of 77.42% during testing and 88.89% during validation, the Random Forest Classifier algorithm achieved an accuracy of 87.09% during testing and 95.24% during validation, the CNN model achieved an accuracy of 95.16% during testing and 96.83% during validation, and the RNN model achieved an accuracy of 93.55% during testing and 96.83% during validation. Based on these results, the deep learning method has a higher average success rate than machine learning models in predicting financial distress.

An efficient dynamic migration and consolidation method of VMs based on improved K-nearest neighbor algorithm and attribute weighting

Virtual machine (VM) consolidation and migration that only consider current workload can result in excessive unnecessary migrations. To address this issue, a VM consolidation algorithm based on resource utilization prediction is proposed. An improved K-nearest neighbor (KNN) classification algorithm weighted by attribute inconsistency is proposed to predict the workload of both the host and the VMs. Firstly, two distributions are partitioned according to the neighboring relationship for comparing consistency. Then, an inconsistency evaluation function based on earth mover’s distance (EMD) is designed to measure the inconsistency between the neighboring sample set of each sample under each attribute and the equivalent partition refined by the decision attribute. Finally, the inconsistency level of the neighboring samples is transformed into the importance of the corresponding attribute to implement the attribute weighting KNN classifier. When selecting the source host and target host for VM migration, both current and predicted overloads are considered to avoid unnecessary VM migrations. Simulation tests were performed with random and realistic workloads, and the results show that the proposed method can reduce the overall energy consumption of the host, while also reducing service level agreement (SLA) violations and VM migration.

Research on the Recommendation System of Music e-learning Resources with Blockchain based on Hybrid Deep Learning Model

Learners are confronted with an ever-growing array of diverse and complex educational resources as music education increasingly moves to online platforms. Traditional resource curation methods, which rely heavily on educators, fall short of meeting the dynamic needs of modern students. To address this issue, we present a novel recommendation system for music e-learning resources that combines the power of blockchain technology with a hybrid deep learning model. Our model combines blockchain's robust security and transparency features with advanced deep learning algorithms, enhancing the personalization and efficiency of resource recommendations. A backpropagation neural network with K nearest neighbor classification, traditional collaborative filtering (CF), and an improved CF algorithm are used in the hybrid approach. For the back propagation neural network algorithm, K nearest neighbor classification algorithm, traditional collaborative filtering (CF) and improved CF algorithm, the accuracy rate of improved CF algorithm is higher, reaching 95%. Comparing the proposed model with the association rule-based recommendation model and the content-based recommendation model, the model constructed in this study received high evaluation from experts, with an average score of 98, and more than 97% of them gave a high score of 95 or more, and the evaluation of experts tended to be consistent. Overall, the model proposed in this study can make better recommendations for music education learning resources and bring users a good learning experience, so this study has some practical application value. This research demonstrates a highly effective, blockchain-enhanced recommendation system for music e-learning resources. Our model has significant practical value and potential for adoption in online music education platforms because it provides tailored educational content and an enhanced learning experience.

A data-driven hybrid sensor fault detection/diagnosis method with flight test data

Fault diagnosis of multi-source signal systems is critical for the safe and reliable operation of modern industrial systems, and accurate fault diagnosis of systems based on multi-source signals remains challenging. This study proposes a data-driven hybrid fault detection/diagnosis method to identify sensor faults in complex systems through interactions between multiple sensors. Dynamic mode decomposition with control is used to obtain the approximate model of the investigated system from multi-source signals, extract the underlying physical mechanisms, combined with the Kalman filter observer to generate the residual between the observed data and the predicted data. Then the residual (moving innovation covariance matrix V k ) is input into the k-nearest neighbor classification algorithm for fault detection and diagnosis. The effectiveness of the proposed method was evaluated using the flight test braking system dataset. The results showed that the accuracy of the proposed method in fault detection and diagnosis (with accuracies of 100% and 100%, respectively) was significantly improved than that of using raw signal data (76.6% and 6.38%) or raw signal data and Vk (80.85% and 42.55%). The analysis of different parameters including fault severity, algorithm hyperparameter k , and sensor type showed that the proposed method has high robustness, generalization ability, and practicality.

An Integrated Approach for Accurate 3D Point Cloud Recognition of Substation Equipment Using PSO and kNN Classification

Low efficiency and poor accuracy are caused by missing data in traditional 3D reconstruction methods. This study suggests a new 3D point cloud recognition technique for substation equipment based on 3D laser scanning point clouds, which combines the k-nearest neighbour (KNN) classification algorithm and particle swarm optimisation (PSO) algorithm, to address these issues. The particle swarm optimisation algorithm optimises the coefficient weights of each subspace feature. The k-nearest neighbour classification algorithm is then used to finish the classification. To confirm the superiority and accuracy of the suggested approach, the impact of the point cloud subspace’s size and loss rate on the recognition effect is examined experimentally and contrasted with the enhanced iterative nearest point algorithm. With an average recognition time of 0.19 seconds and a recognition accuracy of over 95\%, the experimental results demonstrate the method’s good performance in terms of efficiency and accuracy, opening up a wide range of potential applications.

An Investigation on the Use of Clustering Algorithms for Data Preprocessing in Breast Cancer Diagnosis

Classification algorithms are commonly used as a decision support system for diagnosing many diseases, such as breast cancer. The accuracy of classification algorithms can be affected negatively if the data contains outliers and/or noisy data. For this reason, outlier detection methods are frequently used in this field. In this study, we propose and compare various models that use clustering algorithms to detect outliers in the data preprocessing stage of classification to investigate their effects on classification accuracy. Clustering algorithms such as DBSCAN, HDBSCAN, OPTICS, FuzzyCMeans, and MCMSTClustering (MCMST) were used separately in the data preprocessing stage of the k Nearest Neighbor (kNN) classification algorithm for outlier elimination, and then the results were compared. According to the obtained results, MCMST algorithm was more successful in outlier elimination. The classification accuracy of the kNN + MCMST model was 0.9834, which was the best one, while the accuracy of kNN algorithm without using any data preprocessing was 0.9719.

Research On Emotion Management Based on Speech Analysis for Nursing Homes

Speech emotion recognition is an important research area in artificial intelligence aimed at identifying the emotional states of speakers. This paper provides an overview of the current state and key algorithms of speech emotion recognition, focusing particularly on the emotional well-being of elderly residents in nursing homes. Firstly, the paper introduces the background and application areas of speech emotion recognition, emphasizing its significance in human-computer interaction, psychological health monitoring, and emotional intelligent systems. The paper extensively discusses methods of extracting emotional features, it adopts the K-Nearest Neighbors (KNN) classification algorithm, which serves as a simple yet effective classification method with potential in emotional speech recognition. This study aims to explore the design, implementation, and future directions of an emotion recognition system based on KNN. This algorithm exhibits a high fitting performance for emotional speech data, presenting advantages such as ease of implementation and alignment with the distribution characteristics of emotional speech data. Through multiple comparative experiments, the optimal K value for recognition has been determined, achieving a straightforward and convenient emotional recognition simulation. Finally, the paper summarizes the current state of speech emotion recognition, emphasizing its potential and significance in practical applications.

Classification and selection of the main features for the identification of toxicity in Agaricus and Lepiota with machine learning algorithms.

The occurrence of fungi is cosmopolitan, and while some mushroom species are beneficial to human health, others can be toxic and cause illness problems. This study aimed to analyze the organoleptic, ecological, and morphological characteristics of a group of fungal specimens and identify the most significant features to develop models for fungal toxicity classification using genetic algorithms and LASSO regression. The results of the study indicated that odor, spore print color, and habitat were the most significant characteristics identified by the genetic algorithm GALGO. Meanwhile, odor, gill size, stalk shape, and twelve other features were the relevant characteristics identified by LASSO regression. The importance score of the odor variable was 99.99%, gill size obtained 73.7%, stalk shape scored 39.9%, and the remaining variables did not score higher than 18%. Logistic regression, k-nearest neighbor (KNN), and XG-Boost classification algorithms were used to develop models using the features selected by both GALGO and LASSO. The models were evaluated using sensitivity, specificity, and accuracy metrics. The models with the highest AUC values were XGBoost, with a maximum value of 0.99 using the features selected by LASSO, followed by KNN with a maximum value of 0.99. The GALGO selection resulted in a maximum AUC of 0.98 in KNN and XGBoost. The models developed in this study have the potential to aid in the accurate identification of toxic fungi, which can prevent health problems caused by their consumption.

A Framework for Saudi Uniform Gait Recognition Based on Kinect Skeletal Tracking

Due to its robustness in challenge variation in gait recognition domain, gait recognition is considered as one of the popular remote biometric identification technologies. Gait data may be reliably collected from a long distance and is difficult to conceal or copy. This article investigated the use of Kinect to identify gait in Saudis wearing loose-fitting apparel that conceals the majority of body shapes, such as thobes or abayas. Because these clothes cover the majority of the joints, it is difficult to determine gait. This research uses the Kinect sensor version 2 as a technique to choose the top three joints with the greatest identification results, which are then used for gait recognition. The Y coordinates of joints are used as features, which are then put into the K Nearest Neighbor classification algorithm. Several experiments were carried out, and the results demonstrate that the system has a promising identification rate and is capable of achieving a high recognition performance when identifying or recognizing a person while also dealing with obstacles associated with the types of loose clothing worn by the participants.

Test

Due to its robustness in challenge variation in gait recognition domain, gait recognition is considered as one of the popular remote biometric identification technologies. Gait data may be reliably collected from a long distance and is difficult to conceal or copy. This article investigated the use of Kinect to identify gait in Saudis wearing loose-fitting apparel that conceals the majority of body shapes, such as thobes or abayas. Because these clothes cover the majority of the joints, it is difficult to determine gait. This research uses the Kinect sensor version 2 as a technique to choose the top three joints with the greatest identification results, which are then used for gait recognition. The Y coordinates of joints are used as features, which are then put into the K Nearest Neighbor classification algorithm. Several experiments were carried out, and the results demonstrate that the system has a promising identification rate and is capable of achieving a high recognition performance when identifying or recognizing a person while also dealing with obstacles associated with the types of loose clothing worn by the participants.

A framework for analyzing energy consumption in urban built-up areas based on single photonic radar and spatial big data

To achieve carbon neutrality quickly and deal with urban greenhouse effect, it is necessary to study the energy consumption of urban buildings. Energy consumption prediction is an important step in planning and managing energy use in buildings. At present, few studies have comprehensively considered the relationship between geometric features, functional types, location and energy use of buildings in urban built-up areas. In this paper, a spatial data-driven framework is introduced for the analysis and assessment of building energy consumption. The framework is grounded in the building centroid and is combined with single photon radar and point of interest data through the utilization of the nearest neighbor classification algorithm. Two megacities, Beijing and Shanghai, are taken as examples to illustrate the method and to generate the regional building energy use database. The results show that: a) building physical feature (geometric form, functional type) have a significant impact on energy consumption, and energy consumption is correlated with the economic level of the region; b) Energy use in urban built-up areas has obvious spatial agglomeration characteristics, and the siphon effect is obvious in region with high energy consumption. The contribution of the framework is to provide insights into the feasibility of employing multiple spatial data fusion for the analysis of energy consumption within urban built-up areas. This can be employed to address energy planning concerns and help promote sustainable environmental practices in urban areas worldwide.