Feature Extraction Model Research Articles

Multimedia Human-Computer Interaction Method in Video Animation Based on Artificial Intelligence Technology

With the development of computer technology innovation, be able to deal with the media comprehensive information and real-time information interaction with the computer multimedia technology arises at the historic moment, it promotes the application fields of computer widen to industrial all aspects of life. As the product of digital technology, animation technology plays an irreplaceable role in the production of multimedia courseware. However, the existing human-computer interaction methods have shortcomings such as incomplete extraction of video features and poor human-computer interaction effect. In this context, this paper designs a multimedia human-computer interaction method for animation works based on CNN model. First of all, the original video data is collected and preprocessed. Then it is input into the HCI framework based on CNN model for feature extraction. Finally, the effectiveness and practicability of the proposed method are proved by simulation experiments, which provides a reference and basis for the research of modern human-computer interaction.

Lung Cancer Classification based on Auxiliary Classifier (WGAN) Optimised with HOA from CT Images

ABSTRACT The cancer diagnosis is currently experiencing an alteration of molecular biomarkers using s paradigm for the diagnostic panel. One of the most important genomic datasets showing genetic sequences is the classification of lung cancer. Many research studies have been conducted in this area, but none of them yields satisfied outcomes on account of lower classification accuracy. At first, the data are collected through the lung cancer dataset. Afterward, data are fed into pre-processing. The pre-processing segment removes the noise and enhances the input images utilising Dynamic Context-Sensitive Filtering. The pre-processing output is fed to the feature extraction segment. Here, four statistical features are extracted based on the Force Invariant Improved Feature Extraction Model. The extracting features are fed to the feature segmentation segment. Lung cancer images can segment the ROI region using Adaptive Density-Based Spatial Clustering. After that, the segmentation features are given to ACWGAN for effectively categorizing cancer and non-cancer of the lung cancer Hence, the Hunter–prey optimisation algorithm is employed to optimise the ACWGAN classifier. It classifies the lung cancer images accurately. The LCC-ACWGAN-HPOA-CTI algorithm is activated in MATLAB under the lung cancer database. The performance of the LCC-ACWGAN-HPOA-CTI approach shows higher accuracy and lower computation time than those of the existing methods.

EEGDiR: Electroencephalogram denoising network for temporal information storage and global modeling through Retentive Network

Electroencephalogram (EEG) signals are pivotal in clinical medicine, brain research, and neurological disorder studies. However, their susceptibility to contamination from physiological and environmental noise challenges the precision of brain activity analysis. Advances in deep learning have yielded superior EEG signal denoising techniques that eclipse traditional approaches. In this research, we deploy the Retentive Network architecture – initially crafted for large language models (LLMs) – for EEG denoising, exploiting its robust feature extraction and comprehensive modeling prowess. Furthermore, its inherent temporal structure alignment makes the Retentive Network particularly well-suited for the time-series nature of EEG signals, offering an additional rationale for its adoption. To conform the Retentive Network to the unidimensional characteristic of EEG signals, we introduce a signal embedding tactic that reshapes these signals into a two-dimensional embedding space conducive to network processing. This avant-garde method not only carves a novel trajectory in EEG denoising but also enhances our comprehension of brain functionality and the accuracy in diagnosing neurological ailments. Moreover, in response to the labor-intensive creation of deep learning datasets, we furnish a standardized, preprocessed dataset poised to streamline deep learning advancements in this domain.

Mitigating imbalances in heterogeneous feature fusion for multi-class 6D pose estimation

Most 6D pose studies often treat RGB and Depth features equally in fusion, potentially limiting model generalization, especially in multi-class tasks. This limitation arises from prevalent static map generation strategies that overlook discriminative features in downsampling sparse point clouds. Additionally, the commonly adopted direct concatenation approach in heterogeneous feature fusion often leads to an averaging effect, thereby reducing the effectiveness of each feature. To tackle these challenges, we propose an effective model for dynamic graph structure feature extraction, aimed at capturing richer features from point clouds. And we introduce an adaptive fusion method for heterogeneous features, which takes into account the unequal contributions to 6D pose estimation. Validation on benchmark datasets LineMOD and YCB-Video demonstrates its effectiveness for multi-class 6D pose estimation, surpassing existing fusion methods. Of particular significance, our method attains state-of-the-art (SOTA) results on the YCB-Video dataset. The code for this study can be accessed at https://github.com/ZEROhands/6D_Pose_Estimate.

WUREN: Whole-modal union representation for epitope prediction

B-cell epitope identification plays a vital role in the development of vaccines, therapies, and diagnostic tools. Currently, molecular docking tools in B-cell epitope prediction are heavily influenced by empirical parameters and require significant computational resources, rendering a great challenge to meet large-scale prediction demands. When predicting epitopes from antigen-antibody complex, current artificial intelligence algorithms cannot accurately implement the prediction due to insufficient protein feature representations, indicating novel algorithm is desperately needed for efficient protein information extraction. In this paper, we introduce a multimodal model called WUREN (Whole-modal Union Representation for Epitope predictioN), which effectively combines sequence, graph, and structural features. It achieved AUC-PR scores of 0.213 and 0.193 on the solved structures and AlphaFold-generated structures, respectively, for the independent test proteins selected from DiscoTope3 benchmark. Our findings indicate that WUREN is an efficient feature extraction model for protein complexes, with the generalizable application potential in the development of protein-based drugs. Moreover, the streamlined framework of WUREN could be readily extended to model similar biomolecules, such as nucleic acids, carbohydrates, and lipids.

Harbor seal whiskers optimization algorithm with deep learning-based medical imaging analysis for gastrointestinal cancer detection.

Gastrointestinal (GI) cancer detection includes the detection of cancerous or potentially cancerous lesions within the GI tract. Earlier diagnosis is critical for increasing the success of treatment and improving patient outcomes. Medical imaging plays a major role in diagnosing and detecting GI cancer. CT scans, endoscopy, MRI, ultrasound, and positron emission tomography (PET) scans can help detect lesions, abnormal masses, and changes in tissue structure. Artificial intelligence (AI) and machine learning (ML) methods are being gradually applied to medical imaging for cancer diagnosis. ML algorithms, including deep learning methodologies like convolutional neural network (CNN), are applied frequently for cancer diagnosis. These models learn features and patterns from labelled datasets to discriminate between normal and abnormal areas in medical images. This article presents a new Harbor Seal Whiskers Optimization Algorithm with Deep Learning based Medical Imaging Analysis for Gastrointestinal Cancer Detection (HSWOA-DLGCD) technique. The goal of the HSWOA-DLGCD algorithm is to explore the GI images for the cancer diagnosis. In order to accomplish this, the HSWOA-DLGCD system applies bilateral filtering (BF) approach for the removal of noise. In addition, the HSWOA-DLGCD technique makes use of HSWOA with Xception model for feature extraction. For cancer recognition, the HSWOA-DLGCD technique applies extreme gradient boosting (XGBoost) model. Finally, the parameters compared with the XGBoost system can be selected by moth flame optimization (MFO) system. The experimental results of the HSWOA-DLGCD technique could be verified on the Kvasir database. The simulation outcome demonstrated a best possible solution of the HSWOA-DLGCD method than other recent methods.

Leveraging Deep Learning for Automated Reconstruction of Indoor Unstructured Elements in Scan-to-BIM

Abstract. Achieving automatic 3D reconstruction for indoor scenes is extremely useful in the field of scene understanding. Building information modeling (BIM) models are essential for lowering project costs, assisting in building planning and renovations, as well as improving building management efficiency. However, nearly all current available scan-to-BIM approaches employ manual or semi-automatic methods. These approaches concentrate solely on significant structured objects, neglecting other unstructured elements such as furniture. The limitation arises from challenges in modeling incomplete point clouds of obstructed objects and capturing indoor scene details. Therefore, this research introduces an innovative and effective reconstruction framework based on deep learning semantic segmentation and model-driven techniques to address these limitations. The proposed framework utilizes wall segment recognition, feature extraction, opening detection, and automatic modeling to reconstruct 3D structured models of point clouds with different room layouts in both Manhattan and non-Manhattan architectures. Moreover, it provides 3D BIM models of actual unstructured elements by detecting objects, completing point clouds, establishing bounding boxes, determining type and orientation, and automatically generating 3D BIM models with a parametric algorithm implemented into the Revit software. We evaluated this framework using publicly available and locally generated point cloud datasets with varying furniture combinations and layout complexity. The results demonstrate the proposed framework's efficiency in reconstructing structured indoor elements, exhibiting completeness and geometric accuracy, and achieving precision and recall values greater than 98%. Furthermore, the generated unstructured 3D BIM models keep essential real-scene characteristics such as geometry, spatial locations, numerical aspects, various shapes, and orientations compared to literature methods.

Facial Recognition and Classification of Terracotta Warriors in the Mausoleum of the First Emperor Using Deep Learning

Abstract. The facial features of the Terracotta Warriors unearthed from the Mausoleum of the First Emperor of Qin are authentic depictions of the appearance of soldiers from the same period. Recognizing facial features to classify the Terracotta Warriors is one of the crucial aspects of archaeological research. Due to limitations in the collection of facial samples from the Terracotta Warriors, an enhanced SqueezeNet model is proposed for deep learning facial recognition. The FaceNet backbone feature extraction network has been improved by replacing the initial 7×7 convolution kernel with three 3×3 convolution kernels. The model's feature extraction layer is composed of alternating convolution layers, pooling layers, Fire modules, and pooling layers, with the introduction of an exponential function to smooth the shape of the loss function. Finally, facial classification of 295 Terracotta Warriors is accomplished using Agglomerative Clustering. The model demonstrates a facial recognition accuracy of 95.6%, showing a respective improvement of 4.1% and 2.8% compared to the classical SqueezeNet and Inception_ResNetV1 models. This approach better meets the requirements for facial recognition and classification of Terracotta Warriors, providing intelligent and efficient technical support for technological archaeology.

A Novel Optimized Colonic adenocarcinoma Detection using Deep Transfer Learning Approach with XceptionTS Model

Colonic adenocarcinoma is a major contributor to global mortality, highlighting the crucial need for efficient detection and classification techniques. This research presents a new method called XceptionTS for classifying and detecting colon cancer using colonoscopy pictures. The XceptionTS method utilizes deep transfer learning techniques by leveraging the Xception model architecture. Nonlinear Mean Filtering (NMF) is used as a noise reduction method in image processing to improve the quality of colonoscopy pictures. We combine the MobileNetV2 and ResNet-50 models for healthcare image segmentation and feature extraction, respectively. The XceptionTS classifier efficiently gives accurate class labels to medical photos by combining Tabu Search Optimization with the strong Xception architecture. The assessment of the effectiveness of XceptionTS model is done using a dataset of 1560 colonoscopy images. An extensive comparison study is undertaken by analyzing the efficacy of our suggested approach with existing research. The XceptionTS system outperforms previous methodologies in colon cancer classification and detection tasks, showing higher accuracy and robustness according to experimental results. Our findings indicate that the XceptionTS technique shows potential as an advanced tool to increase the effectiveness of Colonic adenocarcinoma diagnosis, which could lead to better patient outcomes and healthcare management.

Fabric pilling image segmentation by embedding dual-attention mechanism U-Net network

The initial step in fabric pilling rating is to segment and localize the pilling region, which is a crucial and challenging task. This paper presents a fabric puckering image segmentation method that is integrated into a U-Net network with a dual-attention mechanism. We have enhanced the fully convolutional neural network (U-Net) model by incorporating the dual-attention mechanism. This modification has resulted in a powerful feature extraction capability, enabling the objective and accurate segmentation of the fabric puckering region. We refer to this improved model as the dual-attention U-Net. The network model for fabric pilling feature extraction adopts the improved VGG16 model architecture as its encoding part. The model parameters are initialized with VGG16 pre-training weights to accelerate convergence speed. Second, the feature fusion between the corresponding layers of the encoding part and the decoding part was fed into the dual-attention mechanism module to strengthen the weight values of the fabric pilling region adaptively, which made the model more focused on the fabric pilling target region; Third, the dual-attention U-Net model was trained by data augmentation and migration learning strategies to prevent overfitting; Finally, the performance of the model was evaluated with the collected fabric pilling data set. The results of the experiments indicate that the claimed dual-attention U-Net model is superior to the typical U-Net model in terms of accuracy and precision. The dual-attention U-Net model achieved 99.03% accuracy for fabric pilling segmentation.

Recognition of EEG-based movement intention combined with channel selection adopting deep learning methods

Brain-computer interface (BCI) is an emerging technology which provides a road to control communication and external devices. Electroencephalogram (EEG)-based motor imagery (MI) tasks recognition has important research significance for stroke, disability and others in BCI fields. However, enhancing the classification performance for decoding MI-related EEG signals presents a significant challenge, primarily due to the variability across different subjects and the presence of irrelevant channels. To address this issue, a novel hybrid structure is developed in this study to classify the MI tasks via deep separable convolution network (DSCNN) and bidirectional long short-term memory (BLSTM). First, the collected time-series EEG signals are initially processed into a matrix grid. Subsequently, data segments formed using a sliding window strategy are inputted into proposed DSCNN model for feature extraction (FE) across various dimensions. And, the spatial-temporal features extracted are then fed into the BLSTM network, which further refines vital time-series features to identify five distinct types of MI-related tasks. Ultimately, the evaluation results of our method demonstrate that the developed model achieves a 98.09% accuracy rate on the EEGMMIDB physiological datasets over a 4-second period for MI tasks by adopting full channels, outperforming other existing studies. Besides, the results of the five evaluation indexes of Recall, Precision, Test-auc, and F1-score also achieve 97.76%, 97.98%, 98.63% and 97.86%, respectively. Moreover, a Gradient-class Activation Mapping (GRAD-CAM) visualization technique is adopted to select the vital EEG channels and reduce the irrelevant information. As a result, we also obtained a satisfying outcome of 94.52% accuracy with 36 channels selected using the Grad-CAM approach. Our study not only provides an optimal trade-off between recognition rate and number of channels with half the number of channels reduced, but also it can also advances practical application research in the field of BCI rehabilitation medicine, effectively.

Multi-agent reinforcement learning method for cutting parameters optimization based on simulation and experiment dual drive environment

Improving production efficiency while ensuring product surface quality is a constant focus of manufacturers. Cutting parameter optimization is an important technique for ensuring high-efficiency and high-quality production. In this paper, a novel method for cutting parameter optimization that integrates multi-agent reinforcement learning with a dual-drive virtual machining environment is proposed. First, a feature extraction, fusion and generation model for cutting simulation and experimental data is proposed to solve the problem of incomplete data acquisition in the production process. Second, a Markov decision model for optimizing cutting parameters is defined, and a virtual machining environment driven by both simulation and experimental data is constructed. Third, a novel multi-agent reinforcement learning method called Q-MIX-MATD3, in which a twin delay deep deterministic policy gradient, value function decomposition and a teacher model are combined, is proposed to explore the cutting parameter optimization policy by interacting with the virtual machining environment. Finally, the proposed method is verified on a commutator production line. Moreover, the results show that the accuracy of the virtual machining environment driven by both simulation and experiment increases by more than 5 %, response efficiency increases by 31 %, and Q-MIX-MATD3-based cutting parameter optimization method reduces time cost by 98 % and achieves the optimization effect of the classical optimization method.

A Comparative Study of Feature Extraction Models for Image Caption Generation

A Comparative Study of Feature Extraction Models for Image Caption Generation

Image Caption Generator using Deep Learning

Image Caption Generation has always been a study of great interest to the researchers in the Artificial Intelligence department. Being able to program a machine to accurately describe an image or an environment like an average human has major applications in the field of robotic vision, business and many more. Automatic caption generation with attention mechanisms aims at generating more descriptive captions containing coarse to fine semantic contents in the image. This has been a challenging task in the field of artificial intelligence. In this paper, we present different image caption generating models based on deep neural networks, focusing on the various CNN techniques and analyzing their influence on the sentence generation. We have also generated captions for sample images and compared the different feature extraction and encoder models to analyse which model gives better accuracy and generates the desired results

Proposing Smart System for Detecting and Monitoring Vehicle Using Multiobject Multicamera Tracking

Nowadays, the strong development of the economy and society has driven the increase in traffic participation, making traffic management increasingly difficult. To effectively address this issue, AI applications are being applied to improve urban traffic management and operations. Therefore, we propose a smart system to detect and monitor vehicles across multiple surveillance cameras. Our system leverages data collected from traffic surveillance cameras and harnesses the power of deep learning technology to detect and track vehicles smoothly. To achieve this, we use the YOLO model for detection in conjunction with the DeepSORT algorithm for precise vehicle tracking on each camera. Furthermore, our system uses a ResNet backbone model for feature extraction of objects within each camera’s frame. It utilizes cosine distance to identify similar objects in other cameras, facilitating multicamera tracking. To ensure optimal performance, our system is implemented using the NVIDIA DeepStream SDK, enabling it to achieve an impressive speed of 21 fps on each camera and an average of precision approximately 85% for three modules. The results of our study affirm the system’s suitability and its potential for practical applications in the field of urban traffic management.

Deep learning and radiomics-based approach to meningioma grading: exploring the potential value of peritumoral edema regions

Objective. To address the challenge of meningioma grading, this study aims to investigate the potential value of peritumoral edema (PTE) regions and proposes a unique approach that integrates radiomics and deep learning techniques. Approach. The primary focus is on developing a transfer learning-based meningioma feature extraction model (MFEM) that leverages both vision transformer (ViT) and convolutional neural network (CNN) architectures. Additionally, the study explores the significance of the PTE region in enhancing the grading process. Main results. The proposed method demonstrates excellent grading accuracy and robustness on a dataset of 98 meningioma patients. It achieves an accuracy of 92.86%, precision of 93.44%, sensitivity of 95%, and specificity of 89.47%. Significance. This study provides valuable insights into preoperative meningioma grading by introducing an innovative method that combines radiomics and deep learning techniques. The approach not only enhances accuracy but also reduces observer subjectivity, thereby contributing to improved clinical decision-making processes.

Construction and validation of a deep learning prognostic model based on digital pathology images of stage III colorectal cancer

BackgroundTNM staging is the main reference standard for prognostic prediction of colorectal cancer (CRC), but the prognosis heterogeneity of patients with the same stage is still large. This study aimed to classify the tumor microenvironment of patients with stage III CRC and quantify the classified tumor tissues based on deep learning to explore the prognostic value of the developed tumor risk signature (TRS). MethodsA tissue classification model was developed to identify nine tissues (adipose, background, debris, lymphocytes, mucus, smooth muscle, normal mucosa, stroma, and tumor) in whole-slide images (WSIs) of stage III CRC patients. This model was used to extract tumor tissues from WSIs of 265 stage III CRC patients from The Cancer Genome Atlas and 70 stage III CRC patients from the Sixth Affiliated Hospital of Sun Yat-sen University. We used three different deep learning models for tumor feature extraction and applied a Cox model to establish the TRS. Survival analysis was conducted to explore the prognostic performance of TRS. ResultsThe tissue classification model achieved 94.4 % accuracy in identifying nine tissue types. The TRS showed a Harrell's concordance index of 0.736, 0.716, and 0.711 in the internal training, internal validation, and external validation sets. Survival analysis showed that TRS had significant predictive ability (hazard ratio: 3.632, p = 0.03) for prognostic prediction. ConclusionThe TRS is an independent and significant prognostic factor for PFS of stage III CRC patients and it contributes to risk stratification of patients with different clinical stages.

A Multiple Attention Convolutional Neural Networks for Diesel Engine Fault Diagnosis.

Fault diagnosis can improve the safety and reliability of diesel engines. An end-to-end method based on a multi-attention convolutional neural network (MACNN) is proposed for accurate and efficient diesel engine fault diagnosis. By optimizing the arrangement and kernel size of the channel and spatial attention modules, the feature extraction capability is improved, and an improved convolutional block attention module (ICBAM) is obtained. Vibration signal features are acquired using a feature extraction model alternating between the convolutional neural network (CNN) and ICBAM. The feature map is recombined to reconstruct the sequence order information. Next, the self-attention mechanism (SAM) is applied to learn the recombined sequence features directly. A Swish activation function is introduced to solve "Dead ReLU" and improve the accuracy. A dynamic learning rate curve is designed to improve the convergence ability of the model. The diesel engine fault simulation experiment is carried out to simulate three kinds of fault types (abnormal valve clearance, abnormal rail pressure, and insufficient fuel supply), and each kind of fault varies in different degrees. The comparison results show that the accuracy of MACNN on the eight-class fault dataset at different speeds is more than 97%. The testing time of the MACNN is much less than the machine running time (for one work cycle). Therefore, the proposed end-to-end fault diagnosis method has a good application prospect.

Application research of image classification algorithm based on deep learning in household garbage sorting

The classification of garbage types is an important issue in today's world, and its proper implementation can contribute to environmental conservation and improved efficiency of recycling processes. Unfortunately, the classification of garbage types is currently predominantly performed through human supervision, which leads to high errors and environmental risks. It is crucial to automate this procedure utilizing machine vision methods as a result. This research proposes a revolutionary deep learning-based strategy for classifying domestic waste. The suggested method uses deep learning methods to extract information from images. The Capuchin Search Algorithm (CapSA) is used to improve the hyperparameters of the convolutional neural network (CNN) used as the feature extraction model. Furthermore, for categorizing the retrieved features from the CNN model, a hybrid learning model based on Error-Correcting Output Codes (ECOC) and Artificial Neural Networks (ANN) is used. The classification accuracy may be successfully increased by using this hybrid model, and the benefit becomes more pronounced as the number of target categories rises. The TrashNet and HGCD databases were used to assess the suggested method's effectiveness, and its results in waste type detection were contrasted with those of earlier techniques. Based on the study findings, the suggested approach can identify trash types with an accuracy of 98.81 % and 99.01 % on the TrashNet and HGCD databases, respectively. This is at least a 1.46 % improvement over earlier approaches. The study's conclusions validate that the suggested strategy may be used in real-world scenarios and show how successful the approaches used in it are.

Application of Stacking Ensemble Learning in Predicting Copper’s Flotation Concentrate Grade

Addressing issues such as a low operational condition recognition efficiency, strong subjectivity, and significant fluctuations in Outotec X fluorescence analysis data in copper flotation production, a copper concentrate grade classification model is constructed based on image processing technology and the Stacking ensemble learning algorithm. Firstly, a feature extraction model for copper concentration flotation foam images is established, extracting color, texture, and size statistical features to build a feature dataset. Secondly, to avoid redundancy in the feature data, which could reduce model accuracy, a combined correlation feature selection is employed for dimensionality reduction, with the filtered feature subset being used as the model input. Finally, to fully leverage the strengths of each model, a Stacking ensemble learning copper concentrate grade classification model is constructed with support vector machine (SVM), random forest (RF), and adaptive boosting (AdaBoost) as base models and logistic regression (LR) as the meta-model. The experimental results show that this ensemble model achieves good recognition for different grade categories, with a precision, recall, and F1 score of 90.01%, 89.85%, and 89.93%, respectively. The accuracy of this Stacking ensemble model, with a 7% improvement over Outotec X fluorescence analysis, demonstrates a potential to meet the daily production needs of beneficiation plants.