CNN-based Classification Research Articles

Deep learning to combat knee osteoarthritis and severity assessment by using CNN-based classification

BackgroundIn today’s digital age, various diseases drastically reduce people’s quality of life. Arthritis is one amongst the most common and debilitating maladies. Osteoarthritis affects several joints, including the hands, knees, spine, and hips. This study focuses on the medical disorder underlying Knee Osteoarthritis (KOA) which severely impairs people’s quality of life. KOA is characterised by restricted mobility, stiffness, and terrible pain and can be caused by a range of factors such as ageing, obesity, and traumas. This degenerative disorder leads to progressive wear and tear of the knee joint.MethodsTo combat arthritis in the kneecap, this study employs a 12-layer Convolutional Neural Network (CNN) to reach deep learning capabilities. A collection of data from the Osteoarthritis Initiative (OAI) is used to classify KOA. Through the use of medical image processing; the study ascertains whether an individual has this ailment. A sophisticated CNN architecture created especially for binary classification and KOA severity utilising deep learning algorithms is the main component of this work.ResultsThe cross-entropy loss function is an important component of the model’s laborious design that classifies data into two groups. The remaining section uses the Kellgren-Lawrence (KL) grade to classify the disease’s severity. In the binary classification, the proposed algorithm outperforms previous methods with an accuracy rate of 92.3%, and in the multiclassification, its accuracy rate is 78.4% which is superior to the previous findings.ConclusionLooking ahead, the research broadens the scope of this work by gathering information from various sources and using these methods on a wider range of datasets and situations. The potential for major advancements in the field of osteoarthritis detection and classification is highlighted by this forward-looking approach. Furthermore, this method reduces the intervention of medical practitioners and ultimately results in accurate diagnosis.Clinical trial numberNot applicable.

CNN-Based Neurodegenerative Disease Classification Using QR-Represented Gait Data.

The primary aim of this study is to develop an effective and reliable diagnostic system for neurodegenerative diseases by utilizing gait data transformed into QR codes and classified using convolutional neural networks (CNNs). The objective of this method is to enhance the precision of diagnosing neurodegenerative diseases, including amyotrophic lateral sclerosis (ALS), Parkinson's disease (PD), and Huntington's disease (HD), through the introduction of a novel approach to analyze gait patterns. The research evaluates the CNN-based classification approach using QR-represented gait data to address the diagnostic challenges associated with neurodegenerative diseases. The gait data of subjects were converted into QR codes, which were then classified using a CNN deep learning model. The dataset includes recordings from patients with Parkinson's disease (n = 15), Huntington's disease (n = 20), and amyotrophic lateral sclerosis (n = 13), and from 16 healthy controls. The accuracy rates obtained through 10-fold cross-validation were as follows: 94.86% for NDD versus control, 95.81% for PD versus control, 93.56% for HD versus control, 97.65% for ALS versus control, and 84.65% for PD versus HD versus ALS versus control. These results demonstrate the potential of the proposed system in distinguishing between different neurodegenerative diseases and control groups. The results indicate that the designed system may serve as a complementary tool for the diagnosis of neurodegenerative diseases, particularly in individuals who already present with varying degrees of motor impairment. Further validation and research are needed to establish its wider applicability.

On the Impact of Discrete Atomic Compression on Image Classification by Convolutional Neural Networks

Digital images play a particular role in a wide range of systems. Image processing, storing and transferring via networks require a lot of memory, time and traffic. Also, appropriate protection is required in the case of confidential data. Discrete atomic compression (DAC) is an approach providing image compression and encryption simultaneously. It has two processing modes: lossless and lossy. The latter one ensures a higher compression ratio in combination with inevitable quality loss that may affect decompressed image analysis, in particular, classification. In this paper, we explore the impact of distortions produced by DAC on performance of several state-of-the-art classifiers based on convolutional neural networks (CNNs). The classic, block-splitting and chroma subsampling modes of DAC are considered. It is shown that each of them produces a quite small effect on MobileNetV2, VGG16, VGG19, ResNet50, NASNetMobile and NASNetLarge models. This research shows that, using the DAC approach, memory expenses can be reduced without significant degradation of performance of the aforementioned CNN-based classifiers.

Scalable CNN-based classification of selective sweeps using derived allele frequencies.

Selective sweeps can successfully be distinguished from neutral genetic data using summary statistics and likelihood-based methods that analyze single nucleotide polymorphisms (SNPs). However, these methods are sensitive to confounding factors, such as severe population bottlenecks and old migration. By virtue of machine learning, and specifically convolutional neural networks (CNNs), new accurate classification models that are robust to confounding factors have been recently proposed. However, such methods are more computationally expensive than summary-statistic-based ones, yielding them impractical for processing large-scale genomic data. Moreover, SNP data are frequently preprocessed to improve classification accuracy, further exacerbating the long analysis times. To this end, we propose a 1D CNN-based model, dubbed FAST-NN, that does not require any preprocessing while using only derived allele frequencies instead of summary statistics or raw SNP data, thereby yielding a sample-size-invariant, scalable solution. We evaluated several data fusion approaches to account for the variance of the density of genetic diversity across genomic regions (a selective sweep signature), and performed an extensive neural architecture search based on a state-of-the-art reference network architecture (SweepNet). The resulting model, FAST-NN, outperforms the reference architecture by up to 12% inference accuracy over all challenging evolutionary scenarios with confounding factors that were evaluated. Moreover, FAST-NN is between 30× and 259× faster on a single CPU core, and between 2.0× and 6.2× faster on a GPU, when processing sample sizes between 128 and 1000 samples. Our work paves the way for the practical use of CNNs in large-scale selective sweep detection. https://github.com/SjoerdvandenBelt/FAST-NN.

Unrealistic Data Augmentation Improves the Robustness of Deep Learning-Based Classification of Dopamine Transporter SPECT Against Variability Between Sites and Between Cameras.

We propose strongly unrealistic data augmentation to improve the robustness of convolutional neural networks (CNNs) for automatic classification of dopamine transporter SPECT against the variability between sites and between cameras. Methods: A CNN was trained on a homogeneous dataset comprising 1,100 123I-labeled 2β-carbomethoxy-3β-(4-iodophenyl)-N-(3-fluoropropyl)nortropane SPECT images using strongly unrealistic data augmentation based on gaussian blurring and additive noise. Strongly unrealistic data augmentation was compared with no augmentation and intensity-based nnU-Net augmentation on 2 independent datasets with lower (n = 645) and considerably higher (n = 640) spatial resolution. Results: The CNN trained with strongly unrealistic augmentation achieved an overall accuracy of 0.989 (95% CI, 0.978-0.996) and 0.975 (95% CI, 0.960-0.986) in the independent test datasets, which was better than that without (0.960, 95% CI, 0.942-0.974; 0.953, 95% CI, 0.934-0.968) and with nnU-Net augmentation (0.972, 95% CI, 0.956-0.983; 0.950, 95% CI, 0.930-0.966) (all McNemar P < 0.001). Conclusion: Strongly unrealistic data augmentation results in better generalization of CNN-based classification of 123I-labeled 2β-carbomethoxy-3β-(4-iodophenyl)-N-(3-fluoropropyl)nortropane SPECT images to unseen acquisition settings. We hypothesize that this can be transferred to other nuclear imaging applications.

Diabetic Retinopathy Severity Level Detection Using Convolution Neural Network

Diabetic retinopathy is a common complication of diabetes mellitus, leading to damage and blockage of retinal blood vessels. Early and accurate detection of diabetic retinopathy severity levels is crucial for timely treatment and prevention of blindness. Diagnostic methods rely on manual examination and human interpretation, resulting in slower and less efficient treatment processes. As a branch of artificial intelligence, computer vision offers a potential solution to analyze retinal images quickly and accurately. The developed system employs image processing techniques and a CNN-based classification model to detect and classify the severity levels of diabetic retinopathy. By providing an automated and efficient approach, the system aims to assist doctors and optometrists in making informed decisions and reducing subjectivity in diagnosis. Early detection through this system can facilitate prompt treatment and improve patient outcomes. The developed system achieves promising results through experimentation and testing with various datasets, with accuracy ranging from 80% to 97%. This project's integration of artificial intelligence, machine learning, and image processing technologies demonstrates their potential in healthcare applications, particularly in diabetic retinopathy diagnosis.

A Multi-Step Image Pre-Enhancement Strategy for a Fish Feeding Behavior Analysis Using Efficientnet

To enhance the accuracy of lightweight CNN classification models in analyzing fish feeding behavior, this paper addresses the image quality issues caused by external environmental factors and lighting conditions, such as low contrast and uneven illumination, by proposing a Multi-step Image Pre-enhancement Strategy (MIPS). This strategy includes three critical steps: initially, images undergo a preliminary processing using the Multi-Scale Retinex with Color Restoration (MSRCR) algorithm, effectively reducing the impact of water surface reflections and enhancing the visual effect of the images; secondly, the Multi-Metric-Driven Contrast Limited Adaptive Histogram Equalization (mdc) technique is applied to further improve image contrast, especially in areas of low contrast, by adjusting the local contrast levels to enhance the clarity of the image details; finally, Unsharp Masking (UM) technology is employed to sharpen the images, emphasizing their edges to increase the clarity of the image details, thereby significantly improving the overall image quality. Experimental results on a custom dataset have confirmed that this pre-enhancement strategy significantly boosts the accuracy of various CNN-based classification models, particularly for lightweight CNN models, and drastically reduces the time required for model training compared to the use of advanced ResNet models. This research provides an effective technical route for improving the accuracy and efficiency of an image-based analysis of fish feeding behavior in complex environments.

Latent diffusion model-based MRI superresolution enhances mild cognitive impairment prognostication and Alzheimer's disease classification

IntroductionTimely diagnosis and prognostication of Alzheimer's disease (AD) and mild cognitive impairment (MCI) are pivotal for effective intervention. Artificial intelligence (AI) in neuroradiology may aid in such appropriate diagnosis and prognostication. This study aimed to evaluate the potential of novel diffusion model-based AI for enhancing AD and MCI diagnosis through superresolution (SR) of brain magnetic resonance (MR) images. Methods1.5T brain MR scans of patients with AD or MCI and healthy controls (NC) from Alzheimer's Disease Neuroimaging Initiative 1 (ADNI1) were superresolved to 3T using a novel diffusion model-based generative AI (d3T*) and a convolutional neural network-based model (c3T*). Comparisons of image quality to actual 1.5T and 3T MRI were conducted based on signal-to-noise ratio (SNR), naturalness image quality evaluator (NIQE), and Blind/Referenceless Image Spatial Quality Evaluator (BRISQUE). Voxel-based volumetric analysis was then conducted to study whether 3T* images offered more accurate volumetry than 1.5T images. Binary and multiclass classifications of AD, MCI, and NC were conducted to evaluate whether 3T* images offered superior AD classification performance compared to actual 1.5T MRI. Moreover, CNN-based classifiers were used to predict conversion of MCI to AD, to evaluate the prognostication performance of 3T* images. The classification performances were evaluated using accuracy, sensitivity, specificity, F1 score, Matthews correlation coefficient (MCC), and area under the receiver-operating curves (AUROC). ResultsAnalysis of variance (ANOVA) detected significant differences in image quality among the 1.5T, c3T*, d3T*, and 3T groups across all metrics. Both c3T* and d3T* showed superior image quality compared to 1.5T MRI in NIQE and BRISQUE with statistical significance. While the hippocampal volumes measured in 3T* and 3T images were not significantly different, the hippocampal volume measured in 1.5T images showed significant difference. 3T*-based AD classifications showed superior performance across all performance metrics compared to 1.5T-based AD classification. Classification performance between d3T* and actual 3T was not significantly different. 3T* images offered superior accuracy in predicting the conversion of MCI to AD than 1.5T images did. ConclusionsThe diffusion model-based MRI SR enhances the resolution of brain MR images, significantly improving diagnostic and prognostic accuracy for AD and MCI. Superresolved 3T* images closely matched actual 3T MRIs in quality and volumetric accuracy, and notably improved the prediction performance of conversion from MCI to AD.

Radiomics-Based Analysis of Intestinal Ultrasound Images for Inflammatory Bowel Disease: A Feasibility Study.

The increasing adoption of intestinal ultrasound (IUS) for monitoring inflammatory bowel diseases (IBD) by IBD providers has uncovered new challenges regarding standardized image interpretation and limitations as a research tool. Artificial intelligence approaches can help address these challenges. We aim to determine the feasibility of radiomic analysis of IUS images and to determine if a radiomics-based classification model can accurately differentiate between normal and abnormal IUS images. We will also compare the radiomic-based model's performance to a convolutional neural network (CNN)-based classification model to understand which method is more effective for extracting meaningful information from IUS images. Retrospectively analyzing IUS images obtained during routine outpatient visits, we developed and tested radiomic-based and CNN-based models to distinguish between normal and abnormal images, with abnormal images defined as bowel wall thickness > 3mm or bowel hyperemia with modified Limberg score ≥ 1 (both are surrogate markers for inflammation). Model performances were measured by area under the receiver operator curve (AUC). For this feasibility study, 125 images (33% abnormal) were analyzed. A radiomic-based model using XG boost yielded the best classifier model with average test AUC 0.98%, 93.8% sensitivity, 93.8% specificity, and 93.7% accuracy. The CNN-based classification model yielded an average testing AUC of 0.75. Radiomic analysis of IUS images is feasible, and a radiomic-based classification model could accurately differentiate abnormal from normal images. Our findings establish methods to facilitate future radiomic-based IUS studies that can help standardize image interpretation and expand IUS research capabilities.

Enhancing lung cancer diagnosis with data fusion and mobile edge computing using DenseNet and CNN

The recent advancements in automated lung cancer diagnosis through the application of Convolutional Neural Networks (CNN) on Computed Tomography (CT) scans have marked a significant leap in medical imaging and diagnostics. The precision of these CNN-based classifiers in detecting and analyzing lung cancer symptoms has opened new avenues in early detection and treatment planning. However, despite these technological strides, there are critical areas that require further exploration and development. In this landscape, computer-aided diagnostic systems and artificial intelligence, particularly deep learning methods like the region proposal network, the dual path network, and local binary patterns, have become pivotal. However, these methods face challenges such as limited interpretability, data variability handling issues, and insufficient generalization. Addressing these challenges is key to enhancing early detection and accurate diagnosis, fundamental for effective treatment planning and improving patient outcomes. This study introduces an advanced approach that combines a Convolutional Neural Network (CNN) with DenseNet, leveraging data fusion and mobile edge computing for lung cancer identification and classification. The integration of data fusion techniques enables the system to amalgamate information from multiple sources, enhancing the robustness and accuracy of the model. Mobile edge computing facilitates faster processing and analysis of CT scan images by bringing computational resources closer to the data source, crucial for real-time applications. The images undergo preprocessing, including resizing and rescaling, to optimize feature extraction. The DenseNet-CNN model, strengthened by data fusion and edge computing capabilities, excels in extracting and learning features from these CT scans, effectively distinguishing between healthy and cancerous lung tissues. The classification categories include Normal, Benign, and Malignant, with the latter further sub-categorized into adenocarcinoma, squamous cell carcinoma, and large cell carcinoma. In controlled experiments, this approach outperformed existing state-of-the-art methods, achieving an impressive accuracy of 99%. This indicates its potential as a powerful tool in the early detection and classification of lung cancer, a significant advancement in medical imaging and diagnostic technology.

Generative adversarial networks for anonymous acneic face dataset generation.

It is well known that the performance of any classification model is effective if the dataset used for the training process and the test process satisfy some specific requirements. In other words, the more the dataset size is large, balanced, and representative, the more one can trust the proposed model's effectiveness and, consequently, the obtained results. Unfortunately, large-size anonymous datasets are generally not publicly available in biomedical applications, especially those dealing with pathological human face images. This concern makes using deep-learning-based approaches challenging to deploy and difficult to reproduce or verify some published results. In this paper, we propose an efficient method to generate a realistic anonymous synthetic dataset of human faces, focusing on attributes related to acne disorders at three distinct levels of severity (Mild, Moderate, and Severe). Notably, our approach initiates from a small dataset of facial acne images, leveraging generative techniques to augment and diversify the dataset, ensuring comprehensive coverage of acne severity levels while maintaining anonymity and realism in the synthetic data. Therefore, a specific hierarchy StyleGAN-based algorithm trained at distinct levels is considered. Moreover, the utilization of generative adversarial networks for augmentation offers a means to circumvent potential privacy or legal concerns associated with acquiring medical datasets. This is attributed to the synthetic nature of the generated data, where no actual subjects are present, thereby ensuring compliance with privacy regulations and legal considerations. To evaluate the performance of the proposed scheme, we consider a CNN-based classification system, trained using the generated synthetic acneic face images and tested using authentic face images. Consequently, we show that an accuracy of 97.6% is achieved using InceptionResNetv2. As a result, this work allows the scientific community to employ the generated synthetic dataset for any data processing application without restrictions on legal or ethical concerns. Moreover, this approach can also be extended to other applications requiring the generation of synthetic medical images.

Learning visual stimulus-evoked EEG manifold for neural image classification

Visual neural decoding, namely the ability to interpret external visual stimuli from patterns of brain activity, is a challenging task in neuroscience research. Recent studies have focused on characterizing patterns of activity across multiple neurons that can be described in terms of population-level features. In this study, we combine spatial, spectral, and temporal features to achieve neural manifold classification capable to characterize visual perception and to simulate the working memory activity in the human brain. We treat spatio-temporal and spectral information separately by means of custom deep learning architectures based on Riemann manifold and the two-dimensional EEG spectrogram representation. In addition, a CNN-based classification model is used to classify visual stimulus-evoked EEG signals while viewing the 11-class (i.e., all-black plus 0-9 digit images) MindBigData Visual MNIST dataset. The effectiveness of the proposed integration strategy is evaluated on the stimulus-evoked EEG signal classification task, achieving an overall accuracy of 86%, comparable to state-of-the-art benchmarks.

Deep learning-based phenotype classification of three ark shells: Anadara kagoshimensis, Tegillarca granosa, and Anadara broughtonii

The rapid and accurate classification of aquatic products is crucial for ensuring food safety, production efficiency, and economic benefits. However, traditional manual methods for classifying ark shell species based on phenotype are time-consuming and inefficient, especially during peak seasons when the demand is high and labor is scarce. This study aimed to develop a deep learning model for the automated identification and classification of commercially important three ark shells (Tegillarca granosa, Anadara broughtonii, and Anadara kagoshimensis) from images. The ark shells were collected and identified using a polymerase chain reaction method developed in a previous study, and a total of 1,400 images were categorized into three species. Three convolutional neural network (CNN) models, Visual Geometry Group Network (VGGnet), Inception-Residual Network (ResNet), and SqueezeNet, were then applied to two different classification sets, Set-1 (four bivalve species) and Set-2 (three ark shell species). Our results showed that SqueezeNet demonstrated the highest accuracy during the training phase for both classification sets, whereas Inception-ResNet exhibited superior accuracy during the validation phase. Similar results were obtained after developing a third classification set (Set-3) to classify six categories by combining Set-1 and Set-2. Overall, the developed CNN-based classification model exhibited a performance comparable or superior to that presented in previous studies and can provide a theoretical basis for bivalve classification, thereby contributing to improved food safety, production efficiency, and economic benefits in the aquatic products industry.

A Comparative Analysis of Combination of CNN-Based Models with Ensemble Learning on Imbalanced Data

This study investigates the usefulness of the Synthetic Minority Oversampling Technique (SMOTE) in conjunction with convolutional neural network (CNN) models, which include both single and ensemble classifiers. The objective of this research is to handle the difficulty of multi-class imbalanced image classification. The application of SMOTE in imbalanced picture datasets is still underexplored, even though CNNs have been shown to be successful in image classification and that ensemble learning approaches have improved their performance. To investigate whether or not SMOTE can increase classification accuracy and other performance measures when combined with CNN-based classifiers, our research makes use of a CIFAR-10 dataset that has been artificially step-imbalanced and has varying imbalanced ratios. We conducted experiments using five distinct models, namely AdaBoost, XGBoost, standalone CNN, CNN-AdaBoost, and CNN-XGBoost, on datasets that were either imbalanced or SMOTE-balanced. Metrics such as accuracy, precision, recall, F1-score, and the area under the receiver operating characteristic curve (AUC) were included in the evaluation process. The findings indicate that SMOTE dramatically improves the accuracy of minority classes, and that the combination of ensemble classifiers with CNNs and oversampling techniques significantly improves overall classification performance, particularly in situations when there is a high-class imbalance. When it comes to enhancing imbalanced classification tasks, this study demonstrates the potential of merging oversampling techniques with CNN-based ensemble classifiers to minimize the impacts of class imbalance in picture datasets. This suggests a promising direction for future research in this area.

Detection of lung cancer through SERS analysis of serum

Early detection and postoperative assessment are crucial for improving overall survival among lung cancer patients. Here, we report a non-invasive technique that integrates Raman spectroscopy with machine learning for the detection of lung cancer. The study encompassed 88 postoperative lung cancer patients, 73 non-surgical lung cancer patients, and 68 healthy subjects. The primary aim was to explore variations in serum metabolism across these cohorts. Comparative analysis of average Raman spectra was conducted, while principal component analysis was employed for data visualization. Subsequently, the augmented dataset was used to train convolutional neural networks (CNN) and Resnet models, leading to the development of a diagnostic framework. The CNN model exhibited superior performance, as verified by the receiver operating characteristic curve. Notably, postoperative patients demonstrated an increased likelihood of recurrence, emphasizing the crucial need for continuous postoperative monitoring. In summary, the integration of Raman spectroscopy with CNN-based classification shows potential for early detection and postoperative assessment of lung cancer.

Hyperspectral image classification method based on narrowing semantic gap convolutional neural network

ABSTRACT In recent years, numerous hyperspectral image classification methods based on convolutional neural network (CNN) have been proposed in recent years. However, the majority of CNN-based classification models fail to take into account the semantic gap between shallow and deep features, and instead, just sum up or splice these two types of features, which leads to subpar feature fusion. To address the above problems, the paper proposes a hyperspectral image classification method based on Narrowing Semantic Gap Convolutional Neural Network (NSGCNN). We developed the feature fusion sub-network, which consists of Feature Semantic Enhancement Module (FSEM), Spatial Detail Supplement Module (SDCM), and Cross-layer Feature Fusion Module (CFFM). FSEM extracts rich global semantic information based on multi-scale dilated convolution. Reverse attention mechanism is introduced in the SDCM to complement deep-layer features with fine spatial features like edges and textures. The fusing of hierarchical features is then achieved using CFFM. Additionally, we can regulate the model’s parameter count by regulating the number of output feature maps. Experimental results on three benchmark hyperspectral datasets demonstrate that NSGCNN outperforms other state-of-the-art methods in terms of classification performance and significantly outperforms them in terms of model complexity.

Improving Explainability in CNN-Based Classification of Mask Images with HayCAM+: An Enhanced Visual Explanation Technique

Improving Explainability in CNN-Based Classification of Mask Images with HayCAM+: An Enhanced Visual Explanation Technique

Spectrally Segmented-Enhanced Neural Network for Precise Land Cover Object Classification in Hyperspectral Imagery

The paradigm shift brought by deep learning in land cover object classification in hyperspectral images (HSIs) is undeniable, particularly in addressing the intricate 3D cube structure inherent in HSI data. Leveraging convolutional neural networks (CNNs), despite their architectural constraints, offers a promising solution for precise spectral data classification. However, challenges persist in object classification in hyperspectral imagery or hyperspectral image classification, including the curse of dimensionality, data redundancy, overfitting, and computational costs. To tackle these hurdles, we introduce the spectrally segmented-enhanced neural network (SENN), a novel model integrating segmentation-based, multi-layer CNNs, SVM classification, and spectrally segmented dimensionality reduction. SENN adeptly integrates spectral–spatial data and is particularly crucial for agricultural land classification. By strategically fusing CNNs and support vector machines (SVMs), SENN enhances class differentiation while mitigating overfitting through dropout and early stopping techniques. Our contributions extend to effective dimensionality reduction, precise CNN-based classification, and enhanced performance via CNN-SVM fusion. SENN harnesses spectral information to surmount challenges in “hyperspectral image classification in hyperspectral imagery”, marking a significant advancement in accuracy and efficiency within this domain.

Skeleton-based Human Activity Classification in Sparse Image Sequences

Research results on human activity classification in video are described, based on initial human skeleton estimation in video frames. Both single person actions and two-person interactions are considered. The initial skeleton data is estimated in selected video frames by OpenPose, HRNet or other dedicated library. Important contributions of presented work are computational steps of skeleton tracking and -refinement, and relational feature extraction from pairs of skeleton joints. It is shown, that this feature engineering significantly increases the classification accuracy. Regarding the final neural network encoder-classifier, two different architectures are designed and tested. The first solution is a lightweight MLP network, implementing the idea of a "mixture of pose experts". Several pose classifiers (experts) are trained independently on different time periods (snapshots) of single-person visual actions (or 2-person interactions), while the final classification is a time-related pooling of weighted expert classifications. All pose experts use the same deep encoding network. The second (middle weight) solution is based on a LSTM network.Both solutions are trained and tested on the action set of the well-known NTU RGB+D dataset, although only 2D data are used.Our results show comparable performance with some of the best reported STM- and CNN-based classifiers for this dataset. We conclude that by reducing the noise of skeleton data, highly successful lightweight- and midweight-approaches to visual activity recognition in image sequences can be achieved.

Exploring new horizons in neuroscience disease detection through innovative visual signal analysis

Brain disorders pose a substantial global health challenge, persisting as a leading cause of mortality worldwide. Electroencephalogram (EEG) analysis is crucial for diagnosing brain disorders, but it can be challenging for medical practitioners to interpret complex EEG signals and make accurate diagnoses. To address this, our study focuses on visualizing complex EEG signals in a format easily understandable by medical professionals and deep learning algorithms. We propose a novel time–frequency (TF) transform called the Forward–Backward Fourier transform (FBFT) and utilize convolutional neural networks (CNNs) to extract meaningful features from TF images and classify brain disorders. We introduce the concept of eye-naked classification, which integrates domain-specific knowledge and clinical expertise into the classification process. Our study demonstrates the effectiveness of the FBFT method, achieving impressive accuracies across multiple brain disorders using CNN-based classification. Specifically, we achieve accuracies of 99.82% for epilepsy, 95.91% for Alzheimer’s disease (AD), 85.1% for murmur, and 100% for mental stress using CNN-based classification. Furthermore, in the context of naked-eye classification, we achieve accuracies of 78.6%, 71.9%, 82.7%, and 91.0% for epilepsy, AD, murmur, and mental stress, respectively. Additionally, we incorporate a mean correlation coefficient (mCC) based channel selection method to enhance the accuracy of our classification further. By combining these innovative approaches, our study enhances the visualization of EEG signals, providing medical professionals with a deeper understanding of TF medical images. This research has the potential to bridge the gap between image classification and visual medical interpretation, leading to better disease detection and improved patient care in the field of neuroscience.