Optimizing Network Traffic Classification Models with a Hybrid Approach for Large-Scale Data

Attacks on websites and network servers are among the most critical threats in network security. Network behavior identification is one of the most effective ways to identify malicious network intrusions. Analyzing abnormal network traffic patterns and traffic classification based on labeled network traffic data are among the most effective approaches for network behavior identification. Traditional methods for network traffic classification utilize algorithms such as Naive Bayes, Decision Tree and XGBoost. However, network traffic classification, which is required for network behavior identification, generally suffers from the problem of low accuracy even with the recently proposed deep learning models. To improve network traffic classification accuracy thus improving network intrusion detection rate, this paper proposes a new network traffic classification model, called ArcMargin, which incorporates metric learning into a convolutional neural network (CNN) to make the CNN model more discriminative. ArcMargin maps network traffic samples from the same category more closely while samples from different categories are mapped as far apart as possible. The metric learning regularization feature is called additive angular margin loss, and it is embedded in the object function of traditional CNN models. The proposed ArcMargin model is validated with three datasets and is compared with several other related algorithms. According to a set of classification indicators, the ArcMargin model is proofed to have better performances in both network traffic classification tasks and open-set tasks. Moreover, in open-set tasks, the ArcMargin model can cluster unknown data classes that do not exist in the previous training dataset.

Network intrusion detection has an important role in providing security to networks and computer systems. It applies different artificial intelligence technologies in order to improve performance against various cyber-attacks. Applying Deep Learning (DL) techniques has a considerable impact compared to using traditional Machine Learning (ML) methods. Recently, Convolutional Neural Network (CNN) has been widely used by researchers to enhance Intrusion Detection Systems (IDSs). This paper aims to build a customized CNN model to improve the accuracy of IDSs. The study involves comparing the results obtained from the proposed CNN model with those obtained from Random Forest which is a well-known machine learning technique utilized frequently in IDSs. The performance of both models was evaluated using standard measurements such as accuracy and F-measure. Two datasets were used, UNSW-NB15 and CSE-CICIDS2018, to demonstrate the efficacy of our proposed model. The proposed CNN model achieved better results than the Random Forest algorithm. A comparison with existing recent IDSs was carried out. The result of this study provides insights and proves the effectiveness of using CNNs for IDSs and helps in identifying the best approach for building efficient and accurate CNN based IDSs with the accuracy of 99.18% using CSE-CICIDS2018 dataset and 99.70% using UNSW-NB15 dataset.

Deep learning-based classification and mutation prediction from histopathological images of hepatocellular carcinoma.

Although hydraulic accumulators play a vital role in the hydraulic system, they face the challenges of being broken by continuous abnormal pulsating pressure which occurs due to the malfunction of hydraulic systems. Hence, this study develops anomaly detection algorithms to detect abnormalities of pulsating pressure for hydraulic accumulators. A digital pressure sensor was installed in a hydraulic accumulator to acquire the pulsating pressure data. Six anomaly detection algorithms were developed based on the acquired data. A threshold averaging algorithm over a period based on the averaged maximum/minimum thresholds detected anomalies 2.5 h before the hydraulic accumulator failure. In the support vector machine (SVM) and XGBoost model that distinguish normal and abnormal pulsating pressure data, the SVM model had an accuracy of 0.8571 on the test set and the XGBoost model had an accuracy of 0.8857. In a convolutional neural network (CNN) and CNN autoencoder model trained with normal and abnormal pulsating pressure images, the CNN model had an accuracy of 0.9714, and the CNN autoencoder model correctly detected the 8 abnormal images out of 11 abnormal images. The long short-term memory (LSTM) autoencoder model detected 36 abnormal data points in the test set.

<div class="section abstract"><div class="htmlview paragraph">In the automotive embedded system domain, the measurements from vehicle and Hardware-In-Loop are currently evaluated against the testcases, either manually or via automation scripts. These evaluations are localized; they evaluate a limited number of signals for a particular measurement without considering system-level behavior. This results in defect leakage. This study aims to develop a tool that can notify anomalies at the signal level in a new measurement without referring to the testcases, considering a more significant number of system-level signals, thereby significantly reducing the defect leakage. The tool learns important features and patterns of each maneuver from many historical measurements using deep learning techniques. We tried two CNN (convolution neural network) models. The first one is a specially designed CNN that does this maneuver classification and class-specific feature extraction. The second model we tried is the FCN (Fully Convolutional Network) Classification model. CNN-based architecture can be trained faster than the recurrent neural network (RNN) model because it utilizes features extracted from the input data. A Generative Adversarial Network (GAN) model is used in series with the CNN model to clone each of these maneuvers for predicting the anomalies. During the testing phase, the CNN model maps the test measurement to the most similar maneuver from the list of already learned maneuvers, followed by the GAN model outputting the anomalies, if any. To validate the tool, 12 measurements, each of 3 different maneuvers, were selected from an old and matured function in the brake system. The class-specific feature-based classification model resulted in 33% accuracy. However, with the Fully Convolutional Network Classification model, we got 100% accuracy. We injected anomalies in one CSV file for testing purposes. The anomaly detection module predicted all the anomalies correctly. Our future goal is to implement this model at the deployment level.</div></div>

BackgroundContinuous contrast-enhanced ultrasound (CEUS) video is a challenging direction for radiomics research. We aimed to evaluate machine learning (ML) approaches with radiomics combined with the XGBoost model and a convolutional neural network (CNN) for discriminating between benign and malignant lesions in CEUS videos with a duration of more than 1 min.MethodsWe gathered breast CEUS videos of 109 benign and 81 malignant tumors from two centers. Radiomics combined with the XGBoost model and a CNN was used to classify the breast lesions on the CEUS videos. The lesions were manually segmented by one radiologist. Radiomics combined with the XGBoost model was conducted with a variety of data sampling methods. The CNN used pretrained 3D residual network (ResNet) models with 18, 34, 50, and 101 layers. The machine interpretations were compared with prospective interpretations by two radiologists. Breast biopsies or pathological examinations were used as the reference standard. Areas under the receiver operating curves (AUCs) were used to compare the diagnostic performance of the models.ResultsThe CNN model achieved the best AUC of 0.84 on the test cohort with the 3D-ResNet-50 model. The radiomics model obtained AUCs between 0.65 and 0.75. Radiologists 1 and 2 had AUCs of 0.75 and 0.70, respectively.ConclusionsThe 3D-ResNet-50 model was superior to the radiomics combined with the XGBoost model in classifying enhanced lesions as benign or malignant on CEUS videos. The CNN model was superior to the radiologists, and the radiomics model performance was close to the performance of the radiologists.

The intrusion detection based on deep learning method has been widely attempted for representation learning. However, in various deep learning models for intrusion detection, there is rarely convolutional neural networks (CNN) model. In this work, we propose a image conversion method of NSL-KDD data. Convolutional neural networks automatically learn the features of graphic NSL-KDD transformation via the proposed graphic conversion technique. We evaluate the performance of the image conversion method by binary class classification experiments with NSL-KDD Test\(^+\) and Test\(^{-21}\). Different structures of CNN are testified for comparison. On the two NSL-KDD test datasets, CNN performed better than most standard classifier although the CNN did not improve state of the art completely. Results show that the CNN model is sensitive to image conversion of attack data and our proposed method can be used for intrusion detection.

Based on studies using high-medium resolution images, convolutional neural networks (CNNs) and semantic segmentation have shown superiority over classical machine learning (ML), particularly in small-scale mapping. However, few/no studies have assessed the techniques on coarse resolution image classification for extensive area land cover mapping. In this study, we evaluated the performance and feasibility of three CNN models (1-D CNN, 2-D CNN, and 3-D CNN), and U-net for coarse-resolution satellite image classification and compared them to a random forest (RF) classifier. We utilized time-series, coarse resolution (1 km) composite imageries acquired by FengYun-3C visible and infrared radiometer. Labeled datasets were collected as shapefiles and split into three independent datasets: training, validation, and test datasets, and preprocessed to meet each model's input format requirements. We conducted several experiments to optimize models and select the best models. Then, the best models were evaluated on an unseen dataset. Among the DL models, one-dimensional (1-D) CNN achieved the highest overall accuracy (OA) 0. 87 and kappa (<italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k</i>) 0.84, 2% higher than the best results attained by 2-D CNN, 3-D CNN, and U-net models. However, 1-D CNN is outperformed by RF which achieved 0.89 (OA) and 0.87 (k). Achieving the best and the second-best results using RF and 1-D CNN models, respectively, indicates the superiority of the pixel-based method and the insignificance of spatial information in coarse-resolution image classification. Furthermore, although the DL models can yield high accuracy, especially 1-D CNN, they are less feasible than RF classifiers for coarse-resolution satellite image classification in extensive area land cover mapping.

An intrusion detection system works to recognize the attacks using either the signature or signature-less method. The signature-less method suffers from a lot of false alarms that affect accuracy and recall. Commonly used IDS (intrusion detection system) Dataset experiences imbalance which causes a high false alarms rate. Nowadays CNN (convolution neural network) excels in image and computer vision. Using CNN in IDS is promising. The paper proposes a hybrid approach between CNN and ML (SVM, KNN). CNN is efficiently utilized to get important features from the dataset. Then ML used to classify the data. Using the hybrid approaches to benefit from the advantage of machine learning (high accuracy, Low false alarms) and Deep learning which deal with a large amount of data and reduce the number of feature of the dataset (feature extraction). In this paper we used 10% of KDDcup1999 dataset. The experimental results showed enhancement in the detection accuracy to 99.3 and reduction in losses to 0.03.

A CONVOLUTIONAL NEURAL NETWORK FOR AUTOMATIC DISCRIMINATION OF PAUSE EPISODES DETECTED BY AN INSERTABLE CARDIAC MONITOR

Tunnel boring machine vibration-based deep learning for the ground identification of working faces

IntroductionInterstitial/alveolar syndrome (IS) is a condition detectable on lung ultrasound (LUS) that indicates underlying pulmonary or cardiac diseases associated with significant morbidity and increased mortality rates. However, diagnosing IS using LUS can be challenging and time-consuming, and it requires clinical expertise.MethodsIn this study, multiple convolutional neural network (CNN) models were trained as binary classifiers to accurately screen for IS in LUS frames by distinguishing between IS-present and healthy cases. The CNN models were initially pre-trained using a generic image dataset to learn general visual features (ImageNet) and then fine-tuned on our specific dataset of 108 LUS clips from 54 patients (27 healthy and 27 with IS, two clips per patient) to perform a binary classification task. Each clip in the dataset was assessed by a clinical sonographer to determine the presence of IS features or confirm healthy lung status. The dataset was split into training (70%), validation (15%), and testing (15%) sets.ResultsFollowing the process of fine-tuning, we successfully extracted features from pre-trained DL models. These extracted features were then utilised to train multiple machine learning (ML) classifiers, resulting in significantly improved accuracy in IS classification compared with the individual CNN models. Advanced visual interpretation techniques such as heatmaps based on gradient-weighted class activation mapping (Grad-CAM) and local interpretable model-agnostic explanations (LIME) were implemented to further analyse the outcomes. The best-trained ML model achieved a test accuracy rate of 98.2%, with specificity, recall, precision, and F1 score values above 97.9%.ConclusionOur study demonstrates the feasibility of using a pre-trained CNN as a diagnostic tool for IS screening on LUS frames, integrating targeted data filtering, feature extraction, and fusion techniques. The data-filtering technique refines the training dataset by excluding LUS frames that lack IS-related features (e.g., absence of B-lines). Feature fusion combines features learnt from different models or “fused” to enhance overall predictive performance. This study confirms the practicality of using pre-trained CNN models with feature extraction and fusion techniques for screening IS using LUS frames. This represents a noteworthy advancement in improving the efficiency of diagnosis. In the next steps, validation on larger datasets will assess the applicability and robustness of these CNN models in more complex clinical settings.

INTRODUCTION: When Diabetic Retinopathy (DR) is not identified promptly; it frequently results in sight impairment. To properly diagnose and treat DR, preprocessing of picture methods and precise prediction models are essential. With the help of numerous well-liked filters and a Deep CNN (Convolutional Neural Network) model, the comprehensive method for DR image preparation and prognosis presented in this research is described. Using the filters that focus boundaries and contours in the ocular pictures is the first step in the initial processing stage. This procedure tries to find anomalies linked to DR. By the usage of filters, the excellence of pictures can be developed and minimize disturbances, preserving critical information. The Deep CNN algorithm has been trained to generate forecasts on the cleaned retinal pictures following the phase of preprocessing. The filters efficiently eliminate interference without sacrificing vital data. Convolutional type layers, pooling type layers, and fully associated layers are used in the CNN framework, which was created especially for image categorization tasks, to acquire data and understand the relationships associated with DR. OBJECTIVES: Using image preprocessing techniques such as the Sobel, Wiener, Gaussian, and non-local mean filters is a promising approach for DR analysis. Then, predicting using a CNN completes the approach. These preprocessing filters enhance the images and prepare them for further examination. The pre-processed images are fed into a CNN model. The model extracts significant information from the images by identifying complex patterns. DR or classification may be predicted by the CNN model through training on a labeled dataset. METHODS: The Method Preprocessing is employed for enhancing the clarity and difference of retina fundus picture by removing noise and fluctuation. The preprocessing stage is utilized for the normalization of the pictures and non-uniform brightness adjustment in addition to contrast augmentation and noise mitigation to remove noises and improve the rate of precision of the subsequent processing stages. RESULTS: To improve image quality and reduce noise, preprocessing techniques including Sobel, Wiener, Gaussian, and non-local mean filters are frequently employed in image processing jobs. For a particular task, the non-local mean filter produces superior results; for enhanced performance, it may be advantageous to combine it with a CNN. Before supplying the processed images to the CNN for prediction, the non-local mean filter can assist reduce noise and improve image details. CONCLUSION: A promising method for DR analysis entails the use of image preprocessing methods such as the Sobel, Wiener, Gaussian, and non-local mean filters, followed by prediction using a CNN. These preprocessing filters improve the photos and get them ready for analysis. After being pre-processed, the photos are sent into a CNN model, which uses its capacity to discover intricate patterns to draw out important elements from the images. The CNN model may predict DR or classification by training it on a labeled dataset. The development of computer-aided diagnosis systems for DR is facilitated by the integration of CNN prediction with image preprocessing filters. This strategy may increase the effectiveness of healthcare workers, boost patient outcomes, and lessen the burden of DR.

The main goal of this research was to accurately diagnose diseases in pepper plants using convolutional neural network (CNN) models and visual parameters features. Thus, we aimed to build a computing system that can utilise visual cues to identify plant diseases with almost 100% reliability. A total of 2,200 images were trained and tested on a dataset, which was divided into healthy leaves and those with bacterial ailments. The images were preprocessed, resized to 300x300 pixels, and then segmented to extract the relevant traits from them. This CNN model, in a word, is accurate because it detects diseases with 99.65% accuracy. If we want to speak of a high accuracy rate, that's the CNN model. It learns to identify the intricate patterns and features in pepper plants that are associated with diseases. CNN can make revolutionary changes to the identification of plant diseases and help prevent crop damage through timely treatments. Automatic identification of the disease makes life easier for both agriculturists and scientists. The results underscore the importance of image preprocessing, segmentation, and feature extraction in improving the ability of CNN models to locate diseases. Additionally, the performance of the CNN model was compared with other machine learning models such as KNN, Decision Tree, ANN, and Random Forest. It was found that the developed CNN model can predict the response with greater accuracy than the others. Modern high-tech precision farming systems might utilise proposed CNN models for plant disease diagnosis.

Data-driven mineral prospectivity mapping (MPM) based on deep learning methods has become a powerful tool for mineral exploration targeting in the past years. Convolutional neural networks (CNNs) have shown great success in this field because of their powerful ability to capture the complex spatial geo-anomalies related to mineralization. However, the exploration big data applied to MPM mainly relies on the high dimensions of evidence layers (other than spatial dimensions), namely, a large number of channels. This impedes the extraction of key channel features related to mineralization when using traditional CNNs. In this paper, we developed an ensemble MPM method based on CNN and Attention model: the ATT–CNN method. Specifically, a channel attention layer is added after the convolution operation of the CNN to enhance the extraction of key channel features in complex exploration data, thereby improving the feature extraction ability and prediction accuracy of CNN for MPM. A case study of W–Sn mineral prospectivity modeling in the Nanling metallogenic belt in South China was used to verify the proposed method. To alleviate the issue of training sample scarcity, we used data augmentation methods (including sliding window and random zero noise addition) when training CNN models. The results show that the prediction accuracies of the ATT–CNN model (92.949% and 94.872% using sliding window and random zero noise addition, respectively) are higher than those of the traditional CNN (91.667% and 92.308%, respectively). Moreover, the improved areas under the receiver operating characteristic curves (AUC) of ATT–CNN (0.987 and 0.971) compared to those of the CNN (0.970 and 0.964) suggest that the proposed ensemble method improves the geological generalization of CNN. The high agreement with known deposits suggests that the areas targeted in this study can guide future mineral exploration of the W–Sn mineralization in the Nanling range.