Advanced Deep Learning Models Research Articles

Semantic Safeguards: Harnessing BERT and Advanced Deep Learning Models Outperforming in the Detection of Hate Speech on Social Networks

Semantic Safeguards: Harnessing BERT and Advanced Deep Learning Models Outperforming in the Detection of Hate Speech on Social Networks

Advanced Deep Learning Models for Accurate Retinal Disease State Detection

Advanced Deep Learning Models for Accurate Retinal Disease State Detection

A comprehensive review on zero-shot-learning techniques

Advancements in computational capabilities have enabled the implementation of advanced deep learning models across various domains of knowledge, yet the increasing complexity and scarcity of data in specialized areas pose significant challenges. Zero-shot learning (ZSL), a subset of transfer learning, has emerged as an innovative solution to these challenges, focusing on classifying unseen categories present in the test set but absent during training. Unlike traditional methods, ZSL utilizes semantic descriptions, like attribute lists or natural language phrases, to map intermediate features from the training data to unseen categories effectively, enhancing the model’s applicability across diverse and complex domains. This review provides a concise synthesis of the advancements, methodologies, and applications in the field of zero-shot learning, highlighting the milestones achieved and possible future directions. We aim to offer insights into the contemporary developments in ZSL, serving as a comprehensive reference for researchers exploring the potentials and challenges of implementing ZSL-based methodologies in real-world scenarios.

Anatomy-Guided Spatio-Temporal Graph Convolutional Networks (AG-STGCNs) for Modeling Functional Connectivity Between Gyri and Sulci Across Multiple Task Domains.

The cerebral cortex is folded as gyri and sulci, which provide the foundation to unveil anatomo-functional relationship of brain. Previous studies have extensively demonstrated that gyri and sulci exhibit intrinsic functional difference, which is further supported by morphological, genetic, and structural evidences. Therefore, systematically investigating the gyro-sulcal (G-S) functional difference can help deeply understand the functional mechanism of brain. By integrating functional magnetic resonance imaging (fMRI) with advanced deep learning models, recent studies have unveiled the temporal difference in functional activity between gyri and sulci. However, the potential difference of functional connectivity, which represents functional dependency between gyri and sulci, is much unknown. Moreover, the regularity and variability of the G-S functional connectivity difference across multiple task domains remains to be explored. To address the two concerns, this study developed new anatomy-guided spatio-temporal graph convolutional networks (AG-STGCNs) to investigate the regularity and variability of functional connectivity differences between gyri and sulci across multiple task domains. Based on 830 subjects with seven different task-based and one resting state fMRI (rs-fMRI) datasets from the public Human Connectome Project (HCP), we consistently found that there are significant differences of functional connectivity between gyral and sulcal regions within task domains compared with resting state (RS). Furthermore, there is considerable variability of such functional connectivity and information flow between gyri and sulci across different task domains, which are correlated with individual cognitive behaviors. Our study helps better understand the functional segregation of gyri and sulci within task domains as well as the anatomo-functional-behavioral relationship of the human brain.

Application of residual network based on multispectral attention mechanism in stepped eddy current thermography defect detection

The stepped eddy current thermography nondestructive testing technique has a low and uneven temperature rise under weak excitation conditions, which brings great challenges to the quantitative analysis of defects in the inner wall of pressure vessels. To solve the above problems, this paper proposes a multi-spectral channel attention residual network model based on a Gramian angular difference field (GADF) for automatic detection and quantification. Firstly, the noise reduction and compression of temperature time series data are accomplished by singular value decomposition and piecewise aggregate approximation. Secondly, three infrared feature strategies commonly used for quantitative analysis were transformed by GADF and Gramian angular sum field (GASF) techniques to filter out the infrared feature data sets that contain the most defective feature information. Finally, the frequency domainization of the feature map is realized by embedding the multispectral channel attention in the residual network. The global dependencies and relevant essential features of infrared data are effectively captured, and the redundant feature information generated by deep learning feature maps is suppressed. The effectiveness of the model is verified by comparing several time-series models with advanced deep-learning models. The results show that the proposed model has excellent performance in terms of accuracy, stability, and generalization ability. Meanwhile, the model can effectively extract the defects in the region of uneven temperature rise.

Deep Learning Algorithms for Skin Disease Classification

Skin diseases are a serious concern of public health worldwide, and successful treatment needs a correct and timely diagnosis. Traditional diagnostic methods mostly depend on dermatologist’s visual observation and this leads to subjective interpretations coupled with time-consuming processes. Deep learning algorithms have lately been known as powerful means for automated medical image analysis that present more accurate and quicker results at the same time. This study analyses the usage of state-of-the-art deep learning algorithms like YOLOv8, Deep CNN, and ResNet50 used for classification of skin diseases using dermatological images. Classifying the skin conditions relies heavily on the ability to identify and extract essential features. Different skin conditions were covered under large dataset thus providing a comprehensive foundation for training and validation aimed at ensuring that the models could generalize well across different diseases. Each algorithm also employs transfer learning techniques by utilizing pre-trained models based on large image datasets in order to improve adaptability and generalization over new data types. The use of deep learning algorithms in classifying skin diseases represents a significant method to achieve efficient and accurate diagnosis with benefits to both patients and healthcare professionals as is the trend in medical image analysis. The advanced deep learning models introduced in this paper excel at classifying complex skin diseases, outperforming the machine learning approaches in performance.

Medical Symptom Text Classification through NLP in Healthcare

Abstract: Medical symptom text classification through Natural Language Processing (NLP) is a rapidly evolving field that aims to leverage computational techniques to analyse and interpret vast amounts of textual data generated in healthcare settings. This paper provides a comprehensive survey of current methodologies, applications, challenges, and future directions in this domain. We begin by discussing the importance of symptom classification for improving patient outcomes, supporting clinical decisionmaking, and enhancing disease surveillance. We then review traditional machine learning approaches and advanced deep learning models, highlighting their respective strengths and limitations. Key pre-processing techniques crucial for handling medical jargon and ensuring data privacy are also examined. The paper further explores real-world applications, including clinical decision support systems, disease outbreak detection, and patient monitoring. Despite significant advancements, challenges such as data quality, model interpretability, and regulatory compliance remain. Finally, we identify emerging trends and potential future developments that could drive further innovation in NLP for healthcare. This survey aims to provide a valuable resource for researchers and practitioners seeking to understand and contribute to the field of medical symptom text classification.

Real-time segmentation of short videos under VR technology in dynamic scenes

Abstract This work addresses the challenges of scene segmentation and low segmentation accuracy in short videos by employing virtual reality (VR) technology alongside a 3D DenseNet model for real-time segmentation in dynamic scenes. First, this work extracted short videos by frame and removed redundant background information. Then, the volume rendering algorithm in VR technology was used to reconstruct short videos in dynamic scenes in 3D. It enriched the detailed information of short videos, and finally used the 3D DenseNet model for real-time segmentation of short videos in dynamic scenes, improving the accuracy of segmentation. The experiment compared the performance of High resolution network, Mask region based convolutional neural network, 3D U-Net, Efficient neural network models on the Densely annotation video segmentation dataset. The experimental results showed that the segmentation accuracy of the 3D DenseNet model has reached 99.03%, which was 15.11% higher than that of the ENet model. The precision rate reached 98.33%, and the average segmentation time reached 0.64 s, improving the segmentation accuracy and precision rate. It can adapt to various scene situations and has strong robustness. The significance of this research lies in its innovative approach in tackling these issues. By integrating VR technology with advanced deep learning models, we can achieve more precise segmentation of dynamic scenes in short videos, enabling real-time processing. This has significant practical implications for fields such as video editing, VR applications, and intelligent surveillance. Furthermore, the outcomes of this research contribute to advancing computer vision in video processing, providing valuable insights for the development of future intelligent video processing systems.

Developing explainable models for lncRNA-Targeted drug discovery using graph autoencoders

The application of explainable artificial intelligence technology is crucial in lncRNA-targeted drug discovery, given lncRNA’s role in regulating a broad spectrum of diseases, including cancer. Current advanced deep learning models efficiently predict the association between lncRNA and disease, facilitating the discovery of potential lncRNA-targeted drug. However, these models have notable limitations, including a tendency to overfit due to their focus on integrating various similarity networks for feature extraction of lncRNA and diseases. Additionally, they employ complex classifiers to predict unknown lncRNA-disease associations (LDAs), resulting in reduced interpretability. We designed an explainable model named EM-LTDD, utilizing graph autoencoders (GAE) and self-supervised learning strategies, aimed at identifying potential drugs targeting lncRNA. The EM-LTDD model improves self-supervised training by employing a novel strategy that masks parts of the known lncRNA-disease network. This approach not only enhances the model’s interpretability but also mitigates the impact of noise. Furthermore, the EM-LTDD model reconstructs the lncRNA-disease network with a robust collaborative decoder, minimizing information loss caused by occlusion and improving node representation. Experimental results demonstrate the effectiveness of our model compared to existing leading models, promising to significantly aid in the discovery and design of lncRNA-targeted drugs. Our code and data are available at: https://github.com/huiyingliulevy/EM-LTDD.

A Comparative Sentiment Analysis of Greek Clinical Conversations Using BERT, RoBERTa, GPT-2, and XLNet.

In addressing the critical role of emotional context in patient-clinician conversations, this study conducted a comprehensive sentiment analysis using BERT, RoBERTa, GPT-2, and XLNet. Our dataset includes 185 h of Greek conversations focused on hematologic malignancies. The methodology involved data collection, data annotation, model training, and performance evaluation using metrics such as accuracy, precision, recall, F1-score, and specificity. BERT outperformed the other methods across all sentiment categories, demonstrating its effectiveness in capturing the emotional context in clinical interactions. RoBERTa showed a strong performance, particularly in identifying neutral sentiments. GPT-2 showed promising results in neutral sentiments but exhibited a lower precision and recall for negatives. XLNet showed a moderate performance, with variations across categories. Overall, our findings highlight the complexities of sentiment analysis in clinical contexts, especially in underrepresented languages like Greek. These insights highlight the potential of advanced deep-learning models in enhancing communication and patient care in healthcare settings. The integration of sentiment analysis in healthcare could provide insights into the emotional states of patients, resulting in more effective and empathetic patient support. Our study aims to address the gap and limitations of sentiment analysis in a Greek clinical context, an area where resources are scarce and its application remains underexplored.

Enhancing E-Learning Adaptability with Automated Learning Style Identification and Sentiment Analysis: A Hybrid Deep Learning Approach for Smart Education

In smart education, adaptive e-learning systems personalize the educational process by tailoring it to individual learning styles. Traditionally, identifying these styles relies on learners completing surveys and questionnaires, which can be tedious and may not reflect their true preferences. Additionally, this approach assumes that learning styles are fixed, leading to a cold-start problem when automatically identifying styles based on e-learning platform behaviors. To address these challenges, we propose a novel approach that annotates unlabeled student feedback using multi-layer topic modeling and implements the Felder–Silverman Learning Style Model (FSLSM) to identify learning styles automatically. Our method involves learners answering four FSLSM-based questions upon logging into the e-learning platform and providing personal information like age, gender, and cognitive characteristics, which are weighted using fuzzy logic. We then analyze learners’ behaviors and activities using web usage mining techniques, classifying their learning sequences into specific styles with an advanced deep learning model. Additionally, we analyze textual feedback using latent Dirichlet allocation (LDA) for sentiment analysis to enhance the learning experience further. The experimental results demonstrate that our approach outperforms existing models in accurately detecting learning styles and improves the overall quality of personalized content delivery.

Synthetic Media Analysis Using Deep Learning

In an era characterized by the rapid evolution of digital content creation, synthetic media, particularly deepfake videos, present a formidable challenge to the veracity and integrity of online information. Addressing this challenge requires sophisticated analytical techniques capable of discerning between authentic and manipulated media. This research paper presents a comprehensive study on synthetic media analysis leveraging deep learning methodologies. The suggested method integrates advanced deep learning models, including Convolutional Neural Networks (CNNs) like VGG (Visual Geometry Group), alongside recurrent structures such as LSTM (Long Short-Term Memory). These models are trained and evaluated on a meticulously curated dataset, ensuring diversity and relevance in the synthetic media samples. To facilitate experimentation and reproducibility, the dataset is securely hosted on a reliable platform such as Google Drive. Prior to model training, preprocessing steps including frame extraction are employed to extract essential visual features from the video data. The VGG model serves as a feature extractor, capturing high-level representations of visual content, while the LSTM model learns temporal dependencies and contextual information across frames. Following comprehensive experimentation, the proposed method's ability to detect synthetic media is thoroughly assessed, utilizing metrics such as accuracy. This research contributes to the ongoing discourse on digital media forensics by providing insights into the efficacy of deep learning techniques for synthetic media analysis. The findings underscore the importance of continuous research and development in combating the proliferation of synthetic media, thereby safeguarding the authenticity and trustworthiness of online content. Index Terms—CNN, LSTM, VGG

Enhanced Multi-Task Traffic Forecasting in Beyond 5G Networks: Leveraging Transformer Technology and Multi-Source Data Fusion

Managing cellular networks in the Beyond 5G (B5G) era is a complex and challenging task requiring advanced deep learning approaches. Traditional models focusing on internet traffic (INT) analysis often fail to capture the rich temporal and spatial contexts essential for accurate INT predictions. Furthermore, these models do not account for the influence of external factors such as weather, news, and social trends. This study proposes a multi-source CNN-RNN (MSCR) model that leverages a rich dataset, including periodic, weather, news, and social data to address these limitations. This model enables the capture and fusion of diverse data sources for improved INT prediction accuracy. An advanced deep learning model, the transformer-enhanced CNN-RNN (TE-CNN-RNN), has been introduced. This model is specifically designed to predict INT data only. This model demonstrates the effectiveness of transformers in extracting detailed temporal-spatial features, outperforming conventional CNN-RNN models. The experimental results demonstrate that the proposed MSCR and TE-CNN-RNN models outperform existing state-of-the-art models for traffic forecasting. These findings underscore the transformative power of transformers for capturing intricate temporal-spatial features and the importance of multi-source data and deep learning techniques for optimizing cell site management in the B5G era.

Harnessing large language models over transformer models for detecting Bengali depressive social media text: A comprehensive study

In an era where the silent struggle of underdiagnosed depression pervades globally, our research delves into the crucial link between mental health and social media. This work focuses on early detection of depression, particularly in extroverted social media users, using LLMs such as GPT 3.5, GPT 4 and our proposed GPT 3.5 fine-tuned model DepGPT, as well as advanced Deep learning models(LSTM, Bi-LSTM, GRU, BiGRU) and Transformer models(BERT, BanglaBERT, SahajBERT, BanglaBERT-Base). The study categorized Reddit and X datasets into “Depressive” and “Non-Depressive” segments, translated into Bengali by native speakers with expertise in mental health, resulting in the creation of the Bengali Social Media Depressive Dataset (BSMDD). Our work provides full architecture details for each model and a methodical way to assess their performance in Bengali depressive text categorization using zero-shot and few-shot learning techniques. Our work demonstrates the superiority of SahajBERT and Bi-LSTM with FastText embeddings in their respective domains also tackles explainability issues with transformer models and emphasizes the effectiveness of LLMs, especially DepGPT (GPT 3.5 fine-tuned), demonstrating flexibility and competence in a range of learning contexts. According to the experiment results, the proposed model, DepGPT, outperformed not only Alpaca Lora 7B in zero-shot and few-shot scenarios but also every other model, achieving a near-perfect accuracy of 0.9796 and an F1-score of 0.9804, high recall, and exceptional precision. Although competitive, GPT-3.5 Turbo and Alpaca Lora 7B show relatively poorer effectiveness in zero-shot and few-shot situations. The work emphasizes the effectiveness and flexibility of LLMs in a variety of linguistic circumstances, providing insightful information about the complex field of depression detection models.

Forward Head Posture Classification Using Deep Learning Models on Facial Recognition Data

Forward Head Posture (FHP) refers to a condition where the head protrudes forward, significantly contributing to neck pain and being associated with decreased productivity and psychological distress. This study investigates the nuanced classification of FHP and proposes a universally applicable methodology for its identification and analysis using deep learning. Leveraging the Korean Facial Image (K-FACE) dataset, rigorous image preprocessing with the Yolo-v8 model was conducted to facilitate accurate measurement of the CranioVertebral Angle (CVA) from various perspectives. The study meticulously evaluated the classification effectiveness of three advanced deep learning models: EfficientNet-B7, NFNet-F7, and ResNet-152. Among these, EfficientNet-B7 demonstrated superior performance with an accuracy of 0.69 and a recall score of 0.69 compared to other models. Additionally, comparisons based on camera angles within the EfficientNet-B7 model highlighted its excellence, particularly at the ±75° angle. The importance of image regions in EfficientNet-B7 was confirmed through Grad-CAM analysis, emphasizing the critical role of the neck region in accurately classifying FHP images. This comprehensive performance comparison and the proposed detailed classification methodology underscore the potential for generalization in FHP classification. Furthermore, by leveraging a unique dataset and employing state-of-the-art classification techniques, this research offers a novel perspective on the discourse surrounding FHP. Future research could integrate expanded facial image datasets and apply transfer learning techniques to further enhance the precision of FHP classification, thereby improving diagnostic accuracy and offering targeted interventions for individuals experiencing neck pain associated with FHP.

Optimizing Hyperspectral Image Classification Through Advanced Deep Learning Models Enhanced by Adam

Optimizing Hyperspectral Image Classification Through Advanced Deep Learning Models Enhanced by Adam

Assessing the quality of experience in wireless networks for multimedia applications: A comprehensive analysis utilizing deep learning-based techniques

In the context of the burgeoning progression of wireless network technology and the corresponding escalation in the demand for mobile Internet-based multimedia transmission services, the task of preserving and augmenting user satisfaction has emerged as an imperative concern. This necessitates a sophisticated and accurate evaluation of multimedia service quality within the sphere of wireless networks. To systematically address the nuanced issue of user experience quality, the present study introduces a novel method for evaluating multimedia Quality of Experience (QoE) in wireless networks, employing an advanced deep learning model as the underlying analytical framework. Initially, the research undertakes the task of modeling the video session process, giving due consideration to the status of each temporal interval within the session's architecture. Subsequently, the challenge of QoE prediction is dissected and investigated through the lens of recurrent neural networks (RNNs), culminating in the proposition of an all-encompassing QoE prediction model that harmoniously integrates video information, Quality of Service (QoS) data, user behavior analytics, and facial expression analysis. The empirical segment of this research serves to validate the efficacy of the suggested video QoE evaluation method, engaging both quantitative and qualitative comparison metrics with contemporaneous state-of-the-art QoE models, employing the RTVCQoE dataset as the empirical foundation. The experimental findings illuminate that the QoE model elucidated in this study transcends competing models in performance metrics such as PLCC, SRCC, and KRCC. Consequently, this investigation stands as a seminal contribution to academic literature, furnishing an exacting and dependable QoE evaluation methodology. Such a contribution augments the user experience landscape in multimedia services within wireless networks, and instigates further scholarly exploration and technological innovation in the mobile Internet domain.

PV Identifier: Extraction of small-scale distributed photovoltaics in complex environments from high spatial resolution remote sensing images

The precise location and size of distributed photovoltaics (PVs) is critical to infer the actual installed capacity and assess the remaining PV generation potential, and is therefore the cornerstone of strategic planning for distributed PV deployment. However, identifying small-scale distributed PVs in complex contexts from high spatial resolution remote sensing (HSRRS) images to obtain their information remains an issue. In this study, we propose an advanced deep learning model, called PV Identifier, to enhance the identification accuracy of small-scale PV systems from HSRRS images. PV Identifier uses a fine-grained feature layer (FFL) compatible with the size of PVs to improve the detection capability of the small-scale distributed PVs. At the same time, it effectively distinguishes between PVs and similar background using a novel semantic constraint module (SCM). We test PV Identifier on a distributed PV dataset in California. Experiments show that the inclusion of the FFL positively affects the model's sensitivity to small distributed PVs. Specifically, the PV Identifier with the FFL increases the Recall of identifying residential rooftop PVs by 1.9% compared to the model without the FFL. In addition, the integration of the SCM effectively improves the model's ability to locate residential rooftop PVs in complex environments, resulting in a 1.8% increase in the corresponding Precision. Compared to the four commonly used segmentation models, PV Identifier exhibits superior identification performance for residential rooftop PVs and commercial and industrial PVs, with an Intersection over Union (IoU) of 74.1% and 89.3%, respectively, which is at least 4.1% and 1.8% higher than other models. Overall, PV Identifier provides a viable solution to the problem of identifying small-scale distributed PV in complex backgrounds from HSRRS images.

Talk2Data: A Natural Language Interface for Exploratory Visual Analysis via Question Decomposition

Through a natural language interface (NLI) for exploratory visual analysis, users can directly “ask” analytical questions about the given tabular data. This process greatly improves user experience and lowers the technical barriers of data analysis. Existing techniques focus on generating a visualization from a concrete question. However, complex questions, requiring multiple data queries and visualizations to answer, are frequently asked in data exploration and analysis, which cannot be easily solved with the existing techniques. To address this issue, in this article, we introduce Talk2Data, a natural language interface for exploratory visual analysis that supports answering complex questions. It leverages an advanced deep-learning model to resolve complex questions into a series of simple questions that could gradually elaborate on the users’ requirements. To present answers, we design a set of annotated and captioned visualizations to represent the answers in a form that supports interpretation and narration. We conducted an ablation study and a controlled user study to evaluate the Talk2Data’s effectiveness and usefulness.

A comprehensive review on zero-shot-learning techniques

Advancements in computational capabilities have enabled the implementation of advanced deep learning models across various domains of knowledge, yet the increasing complexity and scarcity of data in specialized areas pose significant challenges. Zero-shot learning (ZSL), a subset of transfer learning, has emerged as an innovative solution to these challenges, focusing on classifying unseen categories present in the test set but absent during training. Unlike traditional methods, ZSL utilizes semantic descriptions, like attribute lists or natural language phrases, to map intermediate features from the training data to unseen categories effectively, enhancing the model’s applicability across diverse and complex domains. This review provides a concise synthesis of the advancements, methodologies, and applications in the field of zero-shot learning, highlighting the milestones achieved and possible future directions. We aim to offer insights into the contemporary developments in ZSL, serving as a comprehensive reference for researchers exploring the potentials and challenges of implementing ZSL-based methodologies in real-world scenarios.