Traditional Classification Methods Research Articles

Classification of field wheat varieties based on a lightweight G-PPW-VGG11 model

IntroductionIn agriculture, especially wheat cultivation, farmers often use multi-variety planting strategies to reduce monoculture-related harvest risks. However, the subtle morphological differences among wheat varieties make accurate discrimination technically challenging. Traditional variety classification methods, reliant on expert knowledge, are inefficient for modern intelligent agricultural management. Numerous existing classification models are computationally complex, memory-intensive, and difficult to deploy on mobile devices effectively. This study introduces G-PPW-VGG11, an innovative lightweight convolutional neural network model, to address these issues.MethodsG-PPW-VGG11 ingeniously combines partial convolution (PConv) and partially mixed depthwise separable convolution (PMConv), reducing computational complexity and feature redundancy. Simultaneously, incorporating ECANet, an efficient channel attention mechanism, enables precise leaf information capture and effective background noise suppression. Additionally, G-PPW-VGG11 replaces traditional VGG11’s fully connected layers with two pointwise convolutional layers and a global average pooling layer, significantly reducing memory footprint and enhancing nonlinear expressiveness and training efficiency.ResultsRigorous testing showed G-PPW-VGG11's superior performance, with an impressive 93.52% classification accuracy and only 1.79MB memory usage. Compared to VGG11, G-PPW-VGG11 showed a 5.89% increase in accuracy, 35.44% faster inference, and a 99.64% reduction in memory usage. G-PPW-VGG11 also surpasses traditional lightweight networks in classification accuracy and inference speed. Notably, G-PPW-VGG11 was successfully deployed on Android and its performance evaluated in real-world settings. The results showed an 84.67% classification accuracy with an average time of 291.04ms per image.DiscussionThis validates the model's feasibility for practical agricultural wheat variety classification, establishing a foundation for intelligent management. For future research, the trained model and complete dataset are made publicly available.

Multi-Task Scenario Encrypted Traffic Classification and Parameter Analysis.

The widespread use of encrypted traffic poses challenges to network management and network security. Traditional machine learning-based methods for encrypted traffic classification no longer meet the demands of management and security. The application of deep learning technology in encrypted traffic classification significantly improves the accuracy of models. This study focuses primarily on encrypted traffic classification in the fields of network analysis and network security. To address the shortcomings of existing deep learning-based encrypted traffic classification methods in terms of computational memory consumption and interpretability, we introduce a Parameter-Efficient Fine-Tuning method for efficiently tuning the parameters of an encrypted traffic classification model. Experimentation is conducted on various classification scenarios, including Tor traffic service classification and malicious traffic classification, using multiple public datasets. Fair comparisons are made with state-of-the-art deep learning model architectures. The results indicate that the proposed method significantly reduces the scale of fine-tuning parameters and computational resource usage while achieving performance comparable to that of the existing best models. Furthermore, we interpret the learning mechanism of encrypted traffic representation in the pre-training model by analyzing the parameters and structure of the model. This comparison validates the hypothesis that the model exhibits hierarchical structure, clear organization, and distinct features.

A novel quantitative method to evaluate lumbar disc degeneration: MRI histogram analysis.

This study aimed to use MRI histogram analysis to routine MRI sequences to evaluate lumbar disc degeneration (LDD), illustrate the correlation between this novel method and the traditional Pfirrmann classification method, and more importantly, perform comprehensive agreement analysis of MRI histogram analysis in various situations to evaluate its objectivity and stability. Lumbar MRI images from 133 subjects were included in this study. LDD was classified into grades by Pfirrmann classification and was measured as peak separation value by MRI histogram analysis. Correlation analysis between the two methods was performed and cutoff values were determined. In addition, the agreement analysis of peak separation value was performed by intraclass correlation coefficient (ICC) in four scenarios, including inter-resolution, inter-observer, inter-regions of interest (ROI) and inter-slice. Peak separation values were strongly correlated with Pfirrmann grades (r = - 0.847). The inter-resolution agreements of peak separation value between original image resolution of 2304 × 2304 and compressed image resolutions (1152 × 1152, 576 × 576, 288 × 288) were good to excellent (ICCs were 0.916, 0.876 and 0.822), except 144 × 144 was moderate (ICC = 533). The agreements of inter-observer (ICC = 0.982) and inter-ROI (ICC = 0.915) were excellent. Compared with the mid-sagittal slice, the inter-slice agreements were good for the first adjacent slices (ICCs were 0.826 and 0.844), and moderate to good for the second adjacent slices (ICC = 0.733 and 0.753). MRI histogram analysis, used in routine MRI sequences, demonstrated a strong correlation with Pfirrmann classification and good agreements in various scenarios, expanding the range of application and providing an effective, objective and quantitative tool to evaluate LDD.

Winter Wheat Mapping in Shandong Province of China with Multi-Temporal Sentinel-2 Images

Wheat plays an important role in China’s and the world’s food supply, and it is closely related to economy, culture and life. The spatial distribution of wheat is of great significance to the rational planning of wheat cultivation areas and the improvement of wheat yield and quality. The current rapid development of remote sensing technology has greatly improved the efficiency of traditional agricultural surveys. The extraction of crop planting structure based on remote sensing images and technology is a popular topic in many researches. In response to the shortcomings of traditional methods, this research proposed a method based on the fusion of the pixel-based and object-oriented methods to map the spatial distribution of winter wheat. This method was experimented and achieved good results within Shandong Province. The resulting spatial distribution map of winter wheat has an overall accuracy of 92.2% with a kappa coefficient of 0.84. The comparison with the actual situation shows that the accuracy of the actual recognition of winter wheat is higher and better than the traditional pixel-based classification method. On this basis, the spatial pattern of winter wheat in Shandong was analyzed, and it was found that the topographic undulations had a great influence on the spatial distribution of wheat. This study vividly demonstrates the advantages and possibilities of combining pixel-based and object-oriented approaches through experiments, and also provides a reference for the next related research. Moreover, the winter wheat map of Shandong produced in this research is important for yield assessment, crop planting structure adjustment and the rational use of land resources.

A cyber defense system against phishing attacks with deep learning game theory and LSTM-CNN with African vulture optimization algorithm (AVOA)

AbstractPhishing attacks pose a significant threat to online security, utilizing fake websites to steal sensitive user information. Deep learning techniques, particularly convolutional neural networks (CNNs), have emerged as promising tools for detecting phishing attacks. However, traditional CNN-based image classification methods face limitations in effectively identifying fake pages. To address this challenge, we propose an image-based coding approach for detecting phishing attacks using a CNN-LSTM hybrid model. This approach combines SMOTE, an enhanced GAN based on the Autoencoder network, and swarm intelligence algorithms to balance the dataset, select informative features, and generate grayscale images. Experiments on three benchmark datasets demonstrate that the proposed method achieves superior accuracy, precision, and sensitivity compared to other techniques, effectively identifying phishing attacks and enhancing online security.

Review of Convolutional Neural Network Models and Image Classification

With the arrival of the era of big data and the improvement of computing power, deep learning has swept the world. Traditional image classification methods are difficult to deal with the huge image data, and cannot meet the requirements of people on the accuracy and speed of image classification, the image classification method based on convolutional neural network breaks through the bottleneck of the traditional image classification method, and becomes the mainstream algorithm of image classification, how to effectively use convolutional neural network to classify images has become a hot spot of research in the field of computer vision at home and abroad. In this paper, we review the research background, significance and current research status of convolutional neural network model and image classification, study two image classification methods based on ResNet and ShuffleNet, and provide a comprehensive review of the construction methods and characteristics of the two deep convolutional neural network model structures, and finally compare and analyse the performance of the two classification models.

A novel applied climate classification method for assessing atmospheric influence on anomalous coastal water levels

AbstractClimate classification is a commonly used tool to simplify, visualize and make sense of an otherwise unwieldy amount of climate data in applied climate science research. Typically, these classifications have stemmed from one of two perspectives, either a circulation‐to‐environment (C2E) approach, or an environment‐to‐circulation approach (E2C), each with advantages and drawbacks. This research discusses a novel environment‐to‐circulation‐to‐environment (ECE) perspective to applied climate classification, and develops a specific ECE methodology that utilizes canonical correlation and discriminant analysis—the CANDECE method. The benefits of the ECE approach generally, and the CANDECE methodology specifically, are demonstrated in applying climate classification to aid in modelling anomalous water levels (AWLs) along portions of the East and West coasts of the United States. Results show that the CANDECE method performs better than two traditional classification methods (k‐means and self‐organizing maps [SOMs]) at relating AWLs to their broad‐scale atmospheric setups, especially with regard to both high and low extreme AWLs. It is further demonstrated that, compared with the West coast, the CANDECE method is particularly advantageous along the southeastern US coast, where the primary modes of atmospheric variability (which drive the classifications produced by SOMs and k‐means) do not align with the relevant circulation‐based factors driving AWL variability. While AWLs were utilized for demonstrating the ECE proof‐of‐concept herein, ECE and CANDECE are designed to be useful for any climate application.

Efficient and non-destructive classification of lily bulbs by laser-induced breakdown spectroscopy combined with machine learning methods

The study presented here is a pioneering attempt to utilize Laser-Induced Breakdown Spectroscopy (LIBS) for the non-destructive testing and classification of lily bulbs. Given the complexities and time-consuming nature of traditional classification methods based on organic matter content detection, the gradual adoption of spectral technologies as an alternative tool is timely. In this research, the Isolation Forest algorithm was employed to eliminate outliers, thereby enhancing data quality. Various variable selection methods combined with five different classification algorithms were used to establish models. Both full spectrum and feature band variable classification models achieved classification accuracy rates exceeding 99% on the prediction set. Among these, the Logistic Regression (LR) model demonstrated the most exceptional performance, with classification accuracy rates of 100% in both cross-validation and prediction sets. Through the analysis of feature variable importance ranking and spectral line elements, elements such as Na, K, Fe, Ca, P, Mg, and N were identified as potentially crucial for the identification of the origin of lily bulbs. These findings demonstrate the effectiveness of using LIBS combined with machine learning to classify lily bulbs, and provide a theoretical reference for origin identification and variety recognition of other medicinal and edible foods.

Efficient residual network using hyperspectral images for corn variety identification.

Corn seeds are an essential element in agricultural production, and accurate identification of their varieties and quality is crucial for planting management, variety improvement, and agricultural product quality control. However, more than traditional manual classification methods are needed to meet the needs of intelligent agriculture. With the rapid development of deep learning methods in the computer field, we propose an efficient residual network named ERNet to identify hyperspectral corn seeds. First, we use linear discriminant analysis to perform dimensionality reduction processing on hyperspectral corn seed images so that the images can be smoothly input into the network. Second, we use effective residual blocks to extract fine-grained features from images. Lastly, we detect and categorize the hyperspectral corn seed images using the classifier softmax. ERNet performs exceptionally well compared to other deep learning techniques and conventional methods. With 98.36% accuracy rate, the result is a valuable reference for classification studies, including hyperspectral corn seed pictures.

A comparative study of soil classification machine learning models for construction management

Prior to the construction of buildings and roads, soil classification plays a vital role to ensure proper project management and durability of the structure. Civil engineers need to possess knowledge about soil behavior and properties of soil classification to construct reliable and long-lasting infrastructures. However, traditional soil classification methods are both expensive and time-consuming. Recently, machine learning (ML) has become increasingly popular in solving complex problems in Geotechnical Engineering, leading to novel approaches for automating soil classification. This research evaluates the effectiveness of various machine learning algorithms, including Multinomial Logistic Regression (MLR), Gaussian Naive Bayes (GNB), Extreme Gradient Boosting (XGBoost), Random Forest, and Artificial Neural Network-Multilayer Layer Perceptron (ANN-MLP), in classifying soils. The paper also implemented Hard and Soft Voting Ensemble models. Each model was quantitatively evaluated and compared using various metrics. The models achieved high scores in multiple performance metrics across the soil classes with accuracies ranging between 87% and 93%, except the Naive Bayes model with a balanced accuracy of 77.6% while the hard-voting model outperformed the others with a balanced accuracy of 93%. The study’s results benefit industry practitioners and academic researchers for integrating and assessing ML algorithms in soil classification.

A PTM-Based Framework for Enhanced User Requirement Classification in Product Design

Accurately identifying and classifying customer requirements is crucial for successful product design. However, traditional methods for requirement classification, such as Kano models based on questionnaires, can be time-consuming and may not capture all requirements accurately. Analyzing large volumes of user reviews using simple natural language processing techniques can also result in accuracy issues. To address these challenges, we propose a framework that combines pre-trained models (PTMs), Kano models, and the sentiment analysis technique. Our approach integrates an LDA-K-Means model enhanced by PTM ERNIE for pinpointing product feature topics within user reviews. Then, a sentiment analysis is performed using the fine-tuned PTM SKEP to assess user satisfaction with features. Finally, the Kano model is applied to perform requirement classification. We evaluate our framework quantitatively, demonstrating its superior performance compared to the baseline models. Our sentiment analysis model also outperforms the other baseline models. Moreover, a case study on smartphones illustrates the effectiveness of our framework. This research results suggest that leveraging a suitable PTM can better address the problem of requirement classification in user review analyses, leading to improved product design.

Efficiency of clustering methods and self-organizing maps of Adriatic sardines and anchovies regarding organochlorine and fatty acid burden.

The Adriatic Sea plays a crucial role as both a significant fishing ground and a thriving trading market for small pelagic edible fish. Recognized for their nutritional value, these fish are esteemed for their high protein content and abundance of polyunsaturated omega-3 and omega-6 fatty acids, making them a sought-after and healthful food choice. Nevertheless, pelagic species can also serve as a reservoir for lipophilic organochlorine pollutants, posing potential risks to human health. In this study, we compared traditional classification methods traditional principal component analysis (PCA) and Ward's clustering with an advanced self-organizing map (SOM) algorithm in determining distribution patterns of 24 organochlorines and 19 fatty acids in sardine and anchovy samples taken from the eastern Adriatic. The outcomes reveal the strengths and weaknesses of the three approaches (PCA, Ward's clustering, and SOM). However, it is evident that SOM has proven to be the most effective in offering detailed information and data visualization. Although sardines and anchovies exhibit similar distribution patterns for p,p'-DDE, PCB-28, PCB-138, PCB-153, PCB-118, and PCB-170, they differ in the concentrations of fatty acids such as stearic, palmitic, myristic, oleic, docosapentaenoic, and docosahexaenoic acid. Our findings supply valuable insights for environmental authorities and fish consumers concerning the potential risks associated with organochlorines in these two types of fish.

Cloud computing-based framework for heart disease classification using quantum machine learning approach

Abstract Accurate early identification and treatment of cardiovascular diseases can prevent heart failure problems and reduce mortality rates. This study aims to use quantum learning to predict heart problems to increase the accuracy of traditional prediction and classification methods. Machine learning (ML) and deep learning (DL) techniques need quantum learning to quickly and accurately analyze massive volumes of complex data. With quantum computing, the suggested DL and ML algorithms can change their predictions on the basis of changes in the dataset. This approach could help with the early and accurate detection of chronic diseases. The Cleveland heart disease dataset is undergoing preliminary processing to validate missing values to increase the precision rate and prevent incorrect forecasts. This study examined the feasibility of employing and deploying a quantum ML (QML) framework via cloud computing to categorize cardiac conditions. The research was divided into four sections. First, the principal component analysis was used to preprocess the Cleveland dataset, recursive feature elimination was used to select features, and min–max normalization was used to give the dataset a high-dimensional value. Second, we compared traditional classifiers, such as support vector machine (SVM) and artificial neural network, with the quantum approach to verify the quantum approach’s efficiency. Third, we examined two unique QML classification methods: quantum neural networks (QNNs) and quantum SVM (QSVM). Fourth, bagging-QSVM was developed and deployed as an ensemble learning model. Experimental results using the QNN show an accuracy of 77%, a precision of 76%, a recall of 73%, and an F1 score of 75%. With an accuracy of 85%, a precision of 79%, a recall of 90%, and an F1-score of 84%, the QSVM method demonstrated a much better performance than the QNN. Particularly, the Bagging_QSVM model exhibited an outstanding performance, with a flawless score of 100% across all critical performance measures. The study shows that the bagging method for ensemble learning is a solid way of increasing the accuracy of quantum method predictions.

A lightweight convolutional neural network (CNN) model for diatom classification: DiatomNet.

Diatoms are a type of algae with many species. Accurate and quick classification of diatom species is important in many fields, such as water quality analysis and weather change forecasting. Traditional methods for diatom classification, specifically morphological taxonomy and molecular detection, are time-consuming and may not provide satisfactory performance. However, in recent years, deep learning has demonstrated impressive performance in this task, just like other image classification problems. On the other hand, networks with more layers do not guarantee increased accuracy. While increasing depth can be useful in capturing complex features and patterns, it also introduces challenges such as vanishing gradients, overfitting, and optimization challenges. Therefore, in our work, we propose DiatomNet, a lightweight convolutional neural network (CNN) model that can classify diatom species accurately while requiring low computing resources. A recently introduced dataset consisting of 3,027 diatom images and 68 diatom species is used to train and evaluate the model. The model is compared with well-known and successful CNN models (i.e., AlexNet, GoogleNet, Inceptionv3, ResNet18, VGG16, and Xception) and their customized versions obtained with transfer learning. The comparison is based on several success metrics: accuracy, precision, recall, F-measure, number of learnable parameters, training, and prediction time. Eventually, the experimental results reveal that DiatomNet outperforms the other models regarding all metrics with just a few exceptions. Therefore, it is a lightweight but strong candidate for diatom classification tasks.

Garbage Object Detection Based on Improved YOLOv5

Traditional waste classification methods often rely on manual feature extraction and manual rule design, which cannot meet the needs of practical application scenarios. This thesis proposes a YOLOv5[1] target detection method for garbage classification, aiming to solve the problem of automation and efficiency in garbage classification. First, we introduce semi-supervision to enhance the model's detection robustness as well as its extensiveness. Second, we incorporate Mixup, which fuses multiple different datasets to obtain new images with occlusions, which are trained in order to improve the robustness of the model for targets with complex backgrounds. In addition, we introduce a mosaic data enhancement algorithm to defocus the target and improve the accuracy of target detection. The proposed garbage target detection method based on the improved YOLOv5 has made significant progress in improving the detection performance, providing more effective tools and technical support for environmental protection and urban management. This method is expected to be widely popularized in practical applications.

Research on the application of graph neural networks in text classification

With the rapid development of the Internet and social media, a large amount of text data is constantly generated, and text classification has become an important task. Text classification is an important branch in the field of natural language processing and has attracted the attention of many researchers in recent years. Due to the ease of editing text data, most texts in the network are manually constructed and uploaded by users. Therefore, the standardization of online texts and the classification of texts with different granularity are of great significance in the field of information retrieval. This article introduces the basic concepts of text classification and three text classification methods: knowledge engineering (rule) based text classification methods, traditional machine learning-based text classification methods, and deep neural network-based text classification methods. This article also analyzes the advantages and disadvantages of the three methods. Subsequently, the basic concepts and common models of graph neural networks were explored. An application case of graph neural networks in text classification is provided. This article provides effective suggestions for text classification applications in the field of natural language processing.

SwitchTab: Switched Autoencoders Are Effective Tabular Learners

Self-supervised representation learning methods have achieved significant success in computer vision and natural language processing (NLP), where data samples exhibit explicit spatial or semantic dependencies. However, applying these methods to tabular data is challenging due to the less pronounced dependencies among data samples. In this paper, we address this limitation by introducing SwitchTab, a novel self-supervised method specifically designed to capture latent dependencies in tabular data. SwitchTab leverages an asymmetric encoder-decoder framework to decouple mutual and salient features among data pairs, resulting in more representative embeddings. These embeddings, in turn, contribute to better decision boundaries and lead to improved results in downstream tasks. To validate the effectiveness of SwitchTab, we conduct extensive experiments across various domains involving tabular data. The results showcase superior performance in end-to-end prediction tasks with fine-tuning. Moreover, we demonstrate that pre-trained salient embeddings can be utilized as plug-and-play features to enhance the performance of various traditional classification methods (e.g., Logistic Regression, XGBoost, etc.). Lastly, we highlight the capability of SwitchTab to create explainable representations through visualization of decoupled mutual and salient features in the latent space.

Multi-Label Supervised Contrastive Learning

Multi-label classification is an arduous problem given the complication in label correlation. Whilst sharing a common goal with contrastive learning in utilizing correlations for representation learning, how to better leverage label information remains challenging. Previous endeavors include extracting label-level presentations or mapping labels to an embedding space, overlooking the correlation between multiple labels. It exhibits a great ambiguity in determining positive samples with different extent of label overlap between samples and integrating such relations in loss functions. In our work, we propose Multi-Label Supervised Contrastive learning (MulSupCon) with a novel contrastive loss function to adjust weights based on how much overlap one sample shares with the anchor. By analyzing gradients, we explain why our method performs better under multi-label circumstances. To evaluate, we conduct direct classification and transfer learning on several multi-label datasets, including widely-used image datasets such as MS-COCO and NUS-WIDE. Validation indicates that our method outperforms the traditional multi-label classification method and shows a competitive performance when comparing to other existing approaches.

Deep Incomplete Multi-View Learning Network with Insufficient Label Information

Due to the efficiency of integrating semantic consensus and complementary information across different views, multi-view classification methods have attracted much attention in recent years. However, multi-view data often suffers from both the miss of view features and insufficient label information, which significantly decrease the performance of traditional multi-view classification methods in practice. Learning for such simultaneous lack of feature and label is crucial but rarely studied. To tackle these problems, we propose a novel Deep Incomplete Multi-view Learning Network (DIMvLN) by incorporating graph networks and semi-supervised learning in this paper. Specifically, DIMvLN firstly designs the deep graph networks to effectively recover missing data with assigning pseudo-labels of large amounts of unlabeled instances and refine the incomplete feature information. Meanwhile, to enhance the label information, a novel pseudo-label generation strategy with the similarity constraints of unlabeled instances is proposed to exploit additional supervisory information and guide the completion module to preserve more semantic information of absent multi-view data. Besides, we design view-specific representation extractors with the autoencoder structure and contrastive loss to learn high-level semantic representations for each view, promote cross-view consistencies and augment the separability between different categories. Finally, extensive experimental results demonstrate the effectiveness of our DIMvLN, attaining noteworthy performance improvements compared to state-of-the-art competitors on several public benchmark datasets. Code will be available at GitHub.

Heart Sound Signals Classification with Image Conversion Employed

The number of patients with cardiovascular diseases worldwide is increasing rapidly, while medical resources are increasingly scarce. Heart sound classification, as the most direct means of discovering cardiovascular diseases, is attracting the attention of researchers around the world. Although great progress has been made in heart sound classification in recent years, most of them are based on traditional statistical feature methods and temporal dimension features. These traditional temporal dimension feature representation and classification methods cannot achieve good classification accuracy. This paper proposes a new partition attention module and Fusionghost module, and the entire network framework is named PANet. Without segmentation of the heart sound signal, the heart sound signal is converted into a bispectrum and input into the proposed framework for feature extraction and classification tasks. The network makes full use of multi-scale feature extraction and feature map fusion, improving the network feature extraction ability. This paper conducts a comprehensive study of the performance of different network parameters and different module numbers, and compares the performance with the most advanced algorithms currently available. Experiments have shown that for two classification problems (normal or abnormal), the classification accuracy rate on the 2016 PhysioNet/CinC Challenge database reached 97.89%, the sensitivity was 96.96%, and the specificity was 98.85%.