K-nearest Neighbor Method Research Articles

Logistic regression analysis and machine learning for predicting post-stroke gait independence: a retrospective study

This study investigated whether machine learning (ML) has better predictive accuracy than logistic regression analysis (LR) for gait independence at discharge in subacute stroke patients (n = 843) who could not walk independently at admission. We developed prediction models using LR and five ML algorithms—specifically, the decision tree (DT), support vector machine, artificial neural network, ensemble learning, and k-nearest neighbor methods. Functional Independence Measure sub-items were used to evaluate the ability to walk independently. Model predictive accuracies were evaluated using areas under receiver operating characteristic curves (AUCs) as well as accuracy, precision, recall, F1 score, and specificity. The AUC for DT (0.812) was significantly lower than those for the other algorithms (p < 0.01); however, the AUC for LR (0.895) did not differ significantly from those for the other models (0.893–0.903). Other performance metrics showed no substantial differences between LR and ML algorithms. In conclusion, the DT algorithm had significantly low predictive accuracy, and LR showed no significant difference in predictive accuracy compared with the other ML algorithms. As its predictive accuracy is similar to that of ML, LR can continue to be used for predicting the prognosis of gait independence, with additional advantages of being easily understandable and manually computable.

Sentiment Analysis Towards the Film Dirty Vote on Twitter Social Media Using the K-Nearest Neighbor Algorithm

The appearance of the dirty vote film has received public attention and went viral on social media after being released and watched by millions of people in a short time. The dirty vote film has become a topic of discussion, one of which is on the social media platform Twitter. This research was conducted to determine the views or tendencies of public opinion regarding dirty vote films on Twitter social media using K-Nearest Neighbor which will be classified into positive, neutral and negative sentiment. The sentiment data that was collected in the data crawling process was 4000 pieces of data. Then after preprocessing there were 3978 data. Labeling was carried out using text blob, it was found that the negative sentiment class was 3470 superior to the positive sentiment class of 451 and the neutral sentiment class was 57. The 10-fold cross validation test produced an average accuracy value of 87.5%. Testing was carried out with 80% training data consisting of 3182 data and 20% test data consisting of 796 test data. The results of sentiment analysis show that the K-Nearest Neighbor method can be used for sentiment analysis. The accuracy value obtained was 87%, precision was 87%, recall was 100%, and f1-score was 93%.

Evaluating missing data handling methods for developing building energy benchmarking models

This study explored methods for handling missing data in the development of machine learning-based energy benchmarking models, assessing their training time, performance, and variance. Unlike the common assumption of missing completely at random, this study adopted a missing at random (MAR) perspective, which is more appropriate for building data. We compared the inherent missing data handling method of extreme gradient boosting (XGBoost) with the Median, k-nearest neighbors (KNN), and classification and regression trees (CART) methods, alongside Shapley additive explanation (SHAP) method for model interpretability. The findings indicate that, despite its computational demands, the CART method most accurately mirrors the original data distribution, thereby enhancing model performance and stability. The KNN method is effective, while the XGBoost method is viable under computational time constraints. This work highlights the importance of reliable test data for performing accurate evaluations of imputation methods. These results offer guidelines for the selection of imputation methods in model development, contributing to the improved accuracy of energy benchmarking models. The MAR-based approach for missing data analysis holds promise for future research on building energy data, providing crucial insights for accurate energy benchmark model performance assessments.

Sentiment Analysis of BMKG Weather Information Service Using K-Nearest Neighbor Method

The Meteorology, Climatology, and Geophysics Agency (BMKG) is a government institution that provides information related to air quality, climate, dry days, satellite imagery, wave forecasts, wind forecasts, and fire potential. This information is disseminated not only through BMKG's official website but also via the social media platform X, making it easier for the public to access up-to-date information. This study aims to classify user sentiment towards the weather information services provided by BMKG using the K-Nearest Neighbor (KNN) method. Data was collected through a web crawling technique, resulting in 1,031 data points analyzed in this research. The data processing stages included Pre-Processing and sentiment calculation using Vader's Sentiment and Random Forest. The classification results using the KNN algorithm showed an accuracy rate of 96%, with an average precision of 96%, an average recall of 96%, and an average f-measure of 96%. These findings indicate that the KNN model can effectively classify user sentiment towards BMKG's services.

Small data estimation for binary variables with big data: A comparison of calibrated nearest neighbour and hierarchical Bayes methods of estimation

A recent application in machine learning has introduced a novel approach, complemented by big data sources, aimed at providing precise estimates for small geographical areas. This method employs a dual strategy: (a) hybrid estimation, involving the integration of big data sources with imputed values derived from K nearest neighbours (KNN) to address missing target variable values from the big data source; and (b) calibration of the collective sum of small area estimates to an independent yet efficient national total. Evaluating its efficacy using simulated data from the 2016 Australian population census, the calibrated KNN (CKNN) method demonstrated superior performance compared to the Fay-Herriot method based on area-level covariates. This paper enhances the comparative analysis by contrasting the CKNN method with a hierarchical Bayes method using the logit-normal model (LN) relevant for binary data. Broadly speaking, the LN method can be viewed as the Bayesian equivalent of Battese-Harter-Fuller (BHF) method, which incorporates unit-level covariates. Our results demonstrate the CKNN method’s superiority over the LN method. However, the application of hybrid estimation to the LN method significantly diminishes this superiority. Although CKNN estimates maintain better precision, they are not as accurate as the estimates from the hybridized LN method.

NAKNN: An Efficient Classification of Indonesian News Texts with Nazief-Adriani and KNN

Internet usage in Indonesia has seen a significant increase, reaching 215.63 million users in 2022-2023, or 78.19% of the population. With the ease of internet access, digital news portals like Narasi TV have become a primary source of information for many people. However, the large number of news articles makes manual categorizing challenging. This study aims to classify Indonesian-language news documents from Narasi TV using the Nazief-Adriani algorithm for stemming and the K-Nearest Neighbor (KNN) method for classification. The text mining process begins with preprocessing, which includes case folding, tokenizing, stop-word filtering, and stemming. Using a dataset of 500 news documents, the study demonstrated that with a 90:10 data split, the average accuracy reached 93%, with the highest value being 100%. For the 80:20 data split, the average accuracy was 89%, with the highest value being 93%, and for a 70:30 data split, the average accuracy was 87%, with the highest value being 89%. In conclusion, the combination of the Nazief-Adriani algorithm and the KNN method with optimal k selection and random states obtained high accuracy, obtaining an average accuracy of 93%) in classifying Indonesian-language news documents. These results demonstrate the significant potential of text mining and classification techniques to manage digital news.

Heart Disease: Application of the K-Nearest Neighbor (KNN) Method

Heart Disease: Application of the K-Nearest Neighbor (KNN) Method

A Data-Driven Approach for Leveraging Inline and Offline Data to Determine the Causes of Monoclonal Antibody Productivity Reduction in the Commercial-Scale Cell Culture Process.

The monoclonal antibody (mAb) manufacturing process comes with high profits and high costs, and thus mAb productivity is of vital importance. However, many factors can impact the cell culture process, and lead to mAb productivity reduction. Nowadays, the biopharma industry is actively employing manufacturing information systems, which enable the integration of both online data and offline data. Although the volume of data is large, related data mining studies for mAb productivity improvement are rare. Therefore, a data-driven approach is proposed in this study to leverage both the inline and offline data of the cell culture process to discover the causes of mAb productivity reduction. The approach consists of four steps, namely data preprocessing, phase division, feature extraction and fusion, and cluster comparing. First, data quality issues are solved during the data preprocessing step. Next, the inline data are divided into several phases based on the moving window k-nearest neighbor method. Then, the inline data features are extracted via functional data analysis and combined with the offline data features. Finally, the causes of mAb productivity reduction are identified using the contrasting clusters via the principal component analysis method. A commercial-scale cell culture process case study is provided in this research to verify the effectiveness of the approach. Data from 35 batches were collected, and each batch contained nine inline variables and seven offline variables. The causes of mAb productivity reduction were identified to be the lack of nutrients, and recommended actions were taken according to the result, which was subsequently proven by six validation batches.

SENTIMENT ANALYSIS OF ELECTRIC CAR PRODUCT TRENDS IN INDONESIA USING BM25 AND K-NEAREST NEIGHBOR

The global and Indonesian shift towards electric vehicles (EVs) is driven by efforts to reduce emissions and promote sustainable energy. Social media, especially Twitter, functions as an important measuring tool regarding public sentiment towards electric vehicles in Indonesia, so that it can influence policy making. This research uses the BM25 and K-Nearest Neighbor (KNN) methods to analyze sentiment, which aims to improve EV adoption strategies. Conducted in 2023, this research applies data mining, specifically Knowledge Discovery and Data Mining (KDD), analyzing primary and secondary data descriptively and quantitatively starting with data collection from Twitter, followed by data crawling and initial text processing. Next, labeling, term frequency (TF) and inverse document frequency (IDF) calculations were carried out using the BM25 and KNN methods, with an Evaluation and Validation Diagram that visualized the process. The findings show that negative sentiment dominates at 48% (4800 data), followed by 34% (3400 data) neutral sentiment and 18% (1800 data) positive sentiment. The balanced distribution of sentiment highlights the diverse perceptions of society. BM25 and KNN pre-processing methods effectively reduce overfitting and underfitting, especially in negative and neutral sentiments. Accuracy testing without BM25 resulted in 58.6% to 60.25%, while integrating BM25 with KNN increased accuracy by 12.5% to 71% to 72.75%. Understanding sentiment provides a basis for decision making and policy development, as well as providing insight into public perceptions of electric vehicles in Indonesia. Implications include leveraging positive sentiment for marketing, adjusting strategies, refining pricing, addressing infrastructure and reliability issues, and collaborating with governments to increase adoption of electric vehicles in society.

Enhancing K-nearest neighbor algorithm: a comprehensive review and performance analysis of modifications

The k-Nearest Neighbors (kNN) method, established in 1951, has since evolved into a pivotal tool in data mining, recommendation systems, and Internet of Things (IoT), among other areas. This paper presents a comprehensive review and performance analysis of modifications made to enhance the exact kNN techniques, particularly focusing on kNN Search and kNN Join for high-dimensional data. We delve deep into 31 kNN search methods and 12 kNN join methods, providing a methodological overview and analytical insight into each, emphasizing their strengths, limitations, and applicability. An important feature of our study is the provision of the source code for each of the kNN methods discussed, fostering ease of experimentation and comparative analysis for readers. Motivated by the rising significance of kNN in high-dimensional spaces and a recognized gap in comprehensive surveys on exact kNN techniques, our work seeks to bridge this gap. Additionally, we outline existing challenges and present potential directions for future research in the domain of kNN techniques, offering a holistic guide that amalgamates, compares, and dissects existing methodologies in a coherent manner.Graphical

K-Nearest Neighbor Method for Early Detection of Diabetes Patients Based on Symptoms and Clinical Data

Diabetes is a chronic disease rarely detected and develops quickly. Diabetes can trigger other chronic diseases such as kidney failure and heart disease. Early detection is necessary to help patients treat diabetes before the disease becomes more severe. Various health examination methods to detect diabetes, but these examinations require medical expert action and cannot be carried out by anyone. In addition, examination costs are often unaffordable. This research aims to apply data mining methods, especially k-Nearest Neighbor (KNN), for early detection of diabetes patients based on disease symptoms and patient clinical data. KNN is used to classify patient symptoms and clinical data into two classes, diabetes and non-diabetes, calculating the distance between test data and training data using Euclidean Distance. The research results show that a lower k-value provides a higher accuracy value. However, accuracy at low k-values ​​is insufficient to conclude the performance of KNN for early diabetes detection. High accuracy at low k-values ​​has the potential for overfitting, and the model is not generalizing well. Apart from that, if you use a low k-value, the model only sees patterns from 1 or a few neighbors, which results in the pattern of the data not being captured by the KNN model using a k-value that is too high also risks the model becoming underfitting. The model is too general, which makes the model unreliable. This research made use of the k-fold cross-validation technique to circumvent these issues. It is possible to avoid overfitting in the constructed KNN model by employing this method. The researchers are employing k-fold=10 and k-fold=20 in their investigation. KNN This research carried out this analysis by looking at the accuracy of each iteration of the k and k-fold values. The higher the k-fold value, the more accuracy the KNN produces. Inversely proportional to the k-fold cross-validation value, the higher the k-value in KNN, the decreases the accuracy. The KNN method applied in this research provides an accuracy of 98.2692% with higher precision than recall. These findings suggest that KNN can be an effective and efficient tool for early diabetes detection.

Recognizing Handwritten Digits on MNIST Dataset using KNN Algorithm

Handwritten digit recognition is a critical job in computer vision and is used as a frequent benchmark for testing machine learning algorithms. This work describes the creation of a recognition system utilizing the K-Nearest Neighbors (KNN) method, which was chosen for its simplicity and ease of understanding. The system is built on the MNIST dataset, which contains a vast number of photographs of handwritten digits. The process begins with data collection and investigation, which involves analyzing the content and properties of the MNIST dataset to better comprehend the range of handwriting styles. This is followed by data preparation, which consists of standardizing pixel values to increase algorithm performance and dividing the dataset into training and testing sets. This split aids in assessing the model's generalization capabilities. KNN was selected as the model due to its non-parametric nature, meaning it does not make assumptions about the data's underlying distribution. This characteristic makes it versatile and effective for classification tasks like digit recognition. The model is trained in a unique way compared to other machine learning methods: instead of learning parameters, KNN stores all the training data and uses it during the prediction phase to classify new data points based on the nearest neighbors. The performance of the model was evaluated using accuracy as a metric, which measures the percentage of correctly classified digits. Different values of kkk, the number of neighbors, were tested to find the optimal setting. The results showed that KNN could effectively classify handwritten digits with significant accuracy. Finally, the paper discusses future work and deployment considerations. It highlights the potential for deploying KNN-based digit recognition systems in real-world applications and suggests further research to refine preprocessing techniques, optimize model parameters, and explore more advanced models, such as neural networks, to enhance accuracy and efficiency. This study demonstrates the practical applicability of KNN in digit recognition and outlines a path for future improvements.

Evaluation of input variable selection methods in artificial neural networks for estimating missing daily precipitation

ABSTRACT This study evaluates different input variable selection (IVS) methods for precise daily precipitation estimation using artificial neural network (ANN) models. The effectiveness of the models is measured using the average Nash-Sutcliffe efficiency (NSE) from 50 runs per model. Initially, a multiple linear regression and a base model with all 16 parameters resulted in test NSE scores of 0.390 and 0.656, respectively. Subsequently, the self-organizing map (SOM), analytic hierarchy process, K-nearest neighbour, and K-means methods were used to select input variables of different types. The SOM method achieved its best performance with a test NSE of 0.692 when four variables were selected, while the other methods reached their peak performance with the same NSE of 0.718 when two similar variables were selected. This highlights the importance of IVS methods in using ANN models to overcome overfitting and achieve an efficient model for precise precipitation estimation.

Analysis of Performance Comparison between K-Nearest Neighbor (KNN) Method and Naïve Bayes Method in Reward for Honda Motorcycle Salesman Tour

Honda Indako Trading Coy Krakatau is a company in the automotive and spare parts industry. As the main dealer of Honda motorcycles and spare parts for North Sumatra and Aceh, the company faces challenges in boosting sales and maintaining employee loyalty. To address this, the company offers a reward salesman tour for employees who meet certain criteria. However, the current evaluation system is too simple and does not fully capture the quality of employees, especially their product knowledge and involvement in company campaigns. This study aims to solve these issues using data mining techniques, specifically the Naïve Bayes and K-Nearest Neighbors (KNN) methods. These methods were chosen for their accuracy and simplicity. The K-Nearest Neighbor method (K=11) showed an accuracy of 94.04%, a precision of 83.78%, and a recall of 96.87%, while the Naïve Bayes method showed an accuracy of 81.81%, a precision of 72.00%, and a recall of 81.25%.

Sentiment Analysis of Bali Calendar Application Reviews using K-Nearest Neighbor

The Bali Calendar application received various responses from its users, comprising both positive accolades and negative critiques. This study employs the K-Nearest Neighbor (KNN) method to categorize sentiments into positive and negative, gauging public satisfaction with the Bali Calendar app. Additionally, the Tomek Links method is implemented to enhance the KNN classification code's performance in scrutinizing app reviews. The research distinguishes data timelines into pre and post-Covid periods due to an elevated number of negative reviews post-update during the pandemic.Pre-Covid results reveal KNN accuracy peaked at 93.7% and 94.3% without or with Tomek Links with parameter K=5 and K=3. Post-Covid, KNN accuracy reached 86.0% and 87.2% without or with Tomek Links with parameter K=9. Notably, Tomek Links yield a higher accuracy boost in post-Covid data (1.2%) compared to pre-Covid (0.6%). This underscores Tomek Links' impact on KNN accuracy amid unbalanced datasets.

Machine Learning to Predict Student Satisfaction Level Using KNN Method and Naive Bayes Method

This research aims to apply machine learning techniques in classifying student satisfaction levels at the Faculty of Science and Technology, using the K-Nearest Neighbors (KNN) and Naive Bayes methods. This method was chosen because of its ability to manage classification data and provide accurate predictions regarding student satisfaction with the faculty. It is hoped that this research will provide a deeper understanding of the factors that influence student satisfaction as well as the potential for developing a better evaluation system in the future. This research was carried out through structured stages, starting from selecting the right data to collect relevant information, designing the model by applying the KNN and Naive Bayes methods, to evaluating the performance of the model being built. The data used consisted of 110 student data, where the classification results showed that 104 students were satisfied and 6 other students were dissatisfied with the faculty. The evaluation process produced excellent accuracy, with the Test and Score results and confusion matrix showing an accuracy level exceeding 90%. In conclusion, this research succeeded in showing that the KNN and Naive Bayes methods were effective in classifying the level of student satisfaction at the Faculty of Science and Technology. The results obtained confirm that both methods are reliable in managing and analyzing student satisfaction data efficiently, and provide valuable insights for educational institutions to improve student services and experiences in the future

Deep fine-KNN classification of ovarian cancer subtypes using efficientNet-B0 extracted features: a comprehensive analysis

This study presents a robust approach for the classification of ovarian cancer subtypes through the integration of deep learning and k-nearest neighbor (KNN) methods. The proposed model leverages the powerful feature extraction capabilities of EfficientNet-B0, utilizing its deep features for subsequent fine-grained classification using the fine-KNN approach. The UBC-OCEAN dataset, encompassing histopathological images of five distinct ovarian cancer subtypes, namely, high-grade serous carcinoma (HGSC), clear-cell ovarian carcinoma (CC), endometrioid carcinoma (EC), low-grade serous carcinoma (LGSC), and mucinous carcinoma (MC), served as the foundation for our investigation. With a dataset comprising 725 images, divided into 80% for training and 20% for testing, our model exhibits exceptional performance. Both the validation and testing phases achieved 100% accuracy, underscoring the efficacy of the proposed methodology. In addition, the area under the curve (AUC), a key metric for evaluating the model’s discriminative ability, demonstrated high performance across various subtypes, with AUC values of 0.94, 0.78, 0.69, 0.92, and 0.94 for MC. Furthermore, the positive likelihood ratios (LR+) were indicative of the model’s diagnostic utility, with notable values for each subtype: CC (27.294), EC (9.441), HGSC (12.588), LGSC (17.942), and MC (17.942). These findings demonstrate the effectiveness of the model in distinguishing between ovarian cancer subtypes, positioning it as a promising tool for diagnostic applications. The demonstrated accuracy, AUC values, and LR+ values underscore the potential of the model as a valuable diagnostic tool, contributing to the advancement of precision medicine in the field of ovarian cancer research.

Implementation of K-Nearest Neighbor Method for Selection of New Employee Candidates (Case Study: CV. Syntax Corporation Indonesia)

Implementation of K-Nearest Neighbor Method for Selection of New Employee Candidates (Case Study: CV. Syntax Corporation Indonesia)

Advancing architectural frameworks for vibration signature classification in rotating machinery

Advancements in data-driven predictive maintenance have significantly improved digital twin applications for rotating machinery, offering robust solutions for smart manufacturing challenges. These improvements are crucial since equipment failures can cause extensive and costly disruptions to both maintenance schedules and operations. As precision and reliability are critical in production processes, undetected fluctuations in operating frequencies can swiftly escalate to complete part failure, leading to prolonged repairs and productivity loss. This study explores an integrated dataflow pipeline, specifically through Siemens’ MindSphere, to enable continuous predictive maintenance and enhance data acquisition and management. Particularly, conditions such as normal operation, mass balance, rotating imbalance, and mechanical looseness are classified using support vector machine (SVM), neural network (NN), and K-Nearest Neighbor (KNN) methods for the purpose of comparing results. Our results highlight the efficacy of ensemble techniques in collecting and diagnosing vibration signatures, thereby enabling proactive maintenance. To classify various failure signatures, we have proposed a framework to interpret time-series and frequency-dependent data for determining failure types. This research exemplifies how merging data-driven methods with digital twin can improve the accuracy and reliability of condition monitoring. Additionally, we introduce a cloud-based architecture for the diagnosis of rotating machinery, utilizing Application Programming Interface (API) configurations, and develop a real-time dashboard for streaming and visualizing classified data, fostering immediate and informed decision-making.

Implementation of Data Mining for Speech Recognition Classification of Sundanese Dialect Using KNN Method with MFCC Feature Extraction

The importance of preservation and development of speech recognition technology for regional languages such as Sundanese, which have unique phonetic characteristics. Regional language speech recognition can assist in the development of local, educational, and cultural preservation applications to implement and evaluate the effectiveness of the combination of MFCC and KNN methods in classifying Sundanese dialect speech recognition. Methods used include trait extraction with MFCC, which converts voice data into numerical representations based on frequency characteristics, and classification with KNN, which groups data based on similarity to train data. The Dataset used consisted of speech recordings of Western and Southern Sundanese dialects. The results showed that the k-Nearest Neighbors (KNN) method can classify Sundanese dialect speech recognition with an accuracy of 80.00%, showing good ability in distinguishing "Western" and "southern" dialects. Mel-Frequency Cepstral Coefficients (MFCC) proved to be very effective in extracting sound features, helping KNN achieve low error rates. The combination of MFCC and KNN proved effective for speech recognition classification of Sundanese dialects, providing satisfactory results with high accuracy.