Integration Of Deep Learning Research Articles

A Cloud-Connected Digital System for Type-1 Diabetes Prediction using Time Series LSTM Model

Abstract Millions of people worldwide suffer from diabetes, a medical condition that is spreading at an accelerating pace. Numerous studies show that risk factors that may arise from diabetes can be avoided if the disease is detected early. The health-care monitoring system has benefited greatly from early diabetes prediction made possible by the integration of Deep Learning (DL) and Machine Learning (ML) algorithms. The objective of many early studies was to increase the prediction model accuracy. However, DL algorithms often cannot fully exploit the potential of the available datasets because they are too small. This study includes a very accurate DL model as well as a novel system that integrates cloud services and allows users to directly enhance an existing data set, which can increase the accuracy of DL techniques. Therefore, the Long Short-Term Memory (LSTM) model with controller is chosen for efficient type-1 diabetes prediction. Experimental validation of the proposed Nonlinear Model Predictive Control (NMPC)_LSTM algorithm method is compared with other conventional DL algorithms. The proposed controller method achieves excellent blood glucose set point tracking and the proposed algorithms achieves 98.95% accuracy for the obtained data. It outperforms other existing methods with an increase in percentage accuracy compared to the Benchmark Pima Indian Diabetes Datasets (PIDD).

ArguteDUB: Deep Learning Based Distributed Uplink Beamforming in 6G-Based IoV

In the last decade, MIMO spatial multiplexing and distributed beamforming play a significant role in improving data throughput through cooperative transmission. It has been widely used in wireless communication, especially in 6 G. However, the distributed uplink beamforming is still an open problem in highly dynamic environments. However, the proposed 6 G technology represents the further integration of deep learning and wireless communication. In this paper, we propose Argute Distributed Uplink Beamforming (ArguteDUB), which uses a feedback algorithm with an offline-trained deep learning model to implement highly dynamic distributed uplink beamforming for the Internet of Vehicles (IoV) in 6 G. Specifically, each vehicle enables the base station (BS)/access point (AP) to separate different channel state information (CSI) by inserting orthogonal sequences into the sending data. The BS adopts deep learning to filter the noise and predict the beamforming weight to achieve phase synchronization. Unlike traditional distributed uplink beamforming, ArguteDUB can be adapted to the highly dynamic time-varying channels. The simple network structure ensures the fast response of ArguteDUB. In addition, we make ArguteDUB Orthogonal Frequency Division Multiplexing (OFDM) compatible so that it can be easily deployed in 6 G networks. Our evaluation shows that ArguteDUB has an signal-to-noise ratio (SNR) gain of about 5 dB to 5.3 dB over the single vehicle transmission mode.

Exploring the Role of Deep Learning in Forecasting for Sustainable Development Goals: A Systematic Literature Review

This paper aims to explore the relationship between deep learning and forecasting within the context of the Sustainable Development Goals (SDGs). The primary objective is to systematically review 38 articles published between 2019 and 2023, following PRISMA guidelines, to understand the current landscape of deep learning forecasting for SDGs. Using data from 2019-2023 allows capturing the latest developments in deep learning forecasting for Sustainable Development Goals (SDGs), while excluding data before 2019 and after 2023 is based on the desire to avoid including potentially less relevant or unpublished research and to maintain focus on the most current and contextually relevant literature. The methodological approach involves analyzing the application of deep learning methods for forecasting within various SDG fields and identifying trends, challenges, and opportunities. The literature review results reveal the popularity of LSTM models, challenges related to data availability, and the interconnected nature of SDGs. Additionally, the study demonstrates that deep learning models enhance forecast accuracy and computational performance, as measured by Mean Absolute Percentage Error (MAPE), Root Mean Square Error (RMSE), and R-squared (R2). The findings underscore the importance of advanced data preparation techniques and the integration of deep learning with SDGs to improve forecasting outcomes. The novelty of this research lies in its comprehensive overview of the current landscape and its valuable insights for researchers, policymakers, and stakeholders interested in advancing sustainable development goals through deep learning forecasting. Finally, the paper suggests future research directions, including exploring the potential of hybrid forecasting models and investigating the impact of emerging technologies on SDG forecasting methodologies. Innovative methods for imputing missing values in deep learning forecasting models could be further explored to enhance predictive accuracy and robustness.

A survey on brain MRI segmentation

Neurological disorders pose a significant challenge in medical diagnostics, requiring accurate and efficient analysis of brain Magnetic Resonance Imaging (MRI) scans. This study introduces a novel approach for enhanced neurological diagnosis through the application of deep learning techniques to automate the segmentation of brain structures in MRI images. The proposed method leverages the power of convolutional neural networks (CNNs) to extract intricate patterns and features from complex neuro imaging data. The research involves the development and training of a deep learning model capable of accurately delineating key anatomical regions, such as the cortex, hippocampus, and ventricles. The model is trained on a large data set of annotated MRI scans, optimizing its performance through rigorous validation processes. The utilization of deep learning enables the algorithm to learn and generalize from diverse imaging data, improving its adaptability to variations in patient demographics and scanner characteristics. To evaluate the effectiveness of the proposed approach, comprehensive experiments are conducted on a diverse set of MRI datasets, encompassing various neurological conditions. Quantitative metrics, including Dice coefficient and Hausdorff distance, are employed to assess the segmentation accuracy compared to ground truth annotations. Additionally, the clinical relevance of the automated segmentation is validated through collaboration with neurologists and radiologists. The results demonstrate that the deep learning- enabled segmentation method consistently outperforms traditional image processing techniques, providing more accurate and reliable segmentation results. The proposed approach not only streamlines the diagnostic process but also has the potential to uncover subtle abnormalities that may be overlooked by manual inspection. In conclusion, the integration of deep learning into the segmentation of brain MRI scans presents a promising avenue for enhancing neurological diagnosis. The automated and precise delineation of brain structures contributes to the efficiency and accuracy of diagnostic workflows, ultimately improving patient outcomes and facilitating timely interventions in the realm of neurological disorders.

Advancements in Drowsiness Detection: A Review

This review study looks at current advancements in sleepiness detection technologies to address the urgent problem of driving while sleepy leading to accidents. In order to prevent future accidents, it analyzes several approaches and technology and emphasizes how crucial it is to correctly recognize drowsy conditions in drivers. Important results highlight the effectiveness of methods for real-time drowsiness detection such as convolutional neural networks (CNNs), eye aspect ratio (EAR) analysis, and deep learning integration. Additionally, improvements in computer vision algorithms make it possible to precisely analyze facial landmarks and eye blinking patterns, which improves the accuracy of detection systems. In order to protect driver comfort and system reliability, the evaluation emphasizes the importance of non-intrusive fatigue detection techniques while also emphasizing the necessity to reduce false warnings. Remarkably, certain models detect drowsy-eye with an accuracy of above 95%. All things considered, the review emphasizes how important cutting-edge technology is in reducing the risks related to drunk driving, especially deep learning and computer vision algorithms. It promotes the deployment of reliable sleepiness detection technologies in order to increase road safety and reduce accidents brought on by fatigued drivers. Key Words: Drowsiness detection, Eye blink duration, Facial landmark detection, Deep learning algorithms, Computer vision, Eye aspect ratio, Road safety.

Cross-Modal Supervised Human Body Pose Recognition Techniques for Through-Wall Radar.

Through-wall radar human body pose recognition technology has broad applications in both military and civilian sectors. Identifying the current pose of targets behind walls and predicting subsequent pose changes are significant challenges. Conventional methods typically utilize radar information along with machine learning algorithms such as SVM and random forests to aid in recognition. However, these approaches have limitations, particularly in complex scenarios. In response to this challenge, this paper proposes a cross-modal supervised through-wall radar human body pose recognition method. By integrating information from both cameras and radar, a cross-modal dataset was constructed, and a corresponding deep learning network architecture was designed. During training, the network effectively learned the pose features of targets obscured by walls, enabling accurate pose recognition (e.g., standing, crouching) in scenarios with unknown wall obstructions. The experimental results demonstrated the superiority of the proposed method over traditional approaches, offering an effective and innovative solution for practical through-wall radar applications. The contribution of this study lies in the integration of deep learning with cross-modal supervision, providing new perspectives for enhancing the robustness and accuracy of target pose recognition.

Multi-granularity coverage criteria for deep reinforcement learning systems

Deep reinforcement learning (DRL) systems are progressively being deployed in safety- and security-critical domains, such as self-driving cars and unmanned aerial vehicles, raising concerns about their trustworthiness. DRL, a integration of deep learning (DL) and reinforcement learning (RL) principles, represents a machine learning technique. Existing DL coverage criteria primarily focus on neuron coverage, overlooking the unique features of RL, thus falling short in assessing the test adequacy of DRL systems.This paper introduces the first set of coverage criteria designed to systematically measure the elements of DRL systems exercised by test inputs. DRL elements, including states, actions, and policies, are leveraged to define coverage criteria that consider multi-levels and multi-granularities. Furthermore, these coverage criteria undergo optimization through the application of combinatorial coverage principles. State coverage is employed as feedback to guide test case selection for DRL systems. Empirical studies have been conducted to assess the performance of the proposed coverage criteria on five well-known DRL environments. The experiments demonstrate the effectiveness of these coverage criteria in detecting unexpected behaviors, highlighting that the proposed test case selection guided by state coverage serves as an effective strategy.

Categorization of Dehydrated Food through Hybrid Deep Transfer Learning Techniques

The essentiality of categorizing dry foods plays a crucial role in maintaining quality control and ensuring food safety for human consumption. The effectiveness and precision of classification methods are vital for enhanced evaluation of food quality and streamlined logistics. To achieve this, we gathered a dataset of 11,500 samples from Mendeley and proceeded to employ various transfer learning models, including VGG16 and ResNet50. Additionally, we introduce a novel hybrid model, VGG16-ResNet, which combines the strengths of both architectures. Transfer learning involves utilizing knowledge acquired from one task or domain to enhance learning and performance in another. By fusing multiple Deep Learning techniques and transfer learning strategies, such as VGG16-ResNet50, we developed a robust model capable of accurately classifying a wide array of dry foods. The integration of Deep Learning (DL) and transfer learning techniques in the context of dry food classification signifies a drive towards automation and increased efficiency within the food industry. Notably, our approach achieved remarkable results, achieving a classification accuracy of 99.78% for various dry food images, even when dealing with limited training data for VGG16-ResNet50.

Integration of Deep Learning with Vibration-Based Identification Method

The vibration-based identification method has long been used as an alternative to mechanical tests for material characterization. Its non-destructive nature, high efficiency in parameter identification of anisotropic materials and its ability to achieve structure-level homogenization make it very attractive for both academic community and industry. Due to the absence of explicit mapping from the result of vibration test to elastic constants, conventional vibration-based identification approaches generally rely on the minimization of a cost function built on modal properties or Frequency Response Function (FRF) curve. In this paper, a direct relation from FRFs to mechanical properties is established by deep neural network, which offers a new perspective to solve the inverse identification problem. Specifically, this mapping is approximately built with Multilayer Perceptrons (MLPs) and the network’s weights are learned from massive training data. The training data-i.e., the FRF curves, is generated by a finite element model whose input parameters are selected by Latin Hypercube Sampling (LHS). After training, the obtained model is validated by dataset unseen during training process and will be further used to predict mechanical properties of materials from FRFs obtained by vibration test. The effectiveness and efficiency of the developed method are demonstrated on the case study of an aluminum plate. Both the Young’s modulus and Poisson’s ratio are retrieved with high accuracy.

OCT Images Diagnosis Based on Deep Learning – A Review

The recent advancements in deep learning technology have significantly transformed the field of medical imaging, namely in the diagnosis of ocular illnesses. The progress made in this field has improved the capacity to extract and evaluate intricate characteristics in images, with Optical Coherence Tomography (OCT) playing a crucial role. OCT has become known for its safe qualities and its high level of detail, rendering it an essential instrument in the diagnosis of eye diseases. The interesting improvement in research is centered around the integration of deep learning with OCT for the purpose of automating the detection of eye diseases. We conducted a comprehensive study that explores several diagnostic methods and the wide-ranging uses of OCT. Additionally, it addresses the accessibility of publicly available datasets that are specifically tailored to optical coherence tomography (OCT). The paper provides a detailed review of the most recent advancements in computer-assisted diagnostic methods for diseases of the eye, such as age-related macular degeneration, glaucoma, and diabetic macular edema, with a particular focus on the effective use of OCT. Moreover, the paper systematically analyzes the primary challenges that deep learning faces in OCT image interpretation, emphasizing the intricate nature and possibilities of this field.

Integration of deep learning and improved multi-objective algorithm to optimize reservoir operation for balancing human and downstream ecological needs

Dam (reservoir)-induced alterations of flow and water temperature regimes can threaten downstream fish habitats and native aquatic ecosystems. Alleviating the negative environmental impacts of dam-reservoir and balancing the multiple purposes of reservoir operation have attracted wide attention. While previous studies have incorporated ecological flow requirements in reservoir operation strategies, a comprehensive analysis of trade-offs among hydropower benefits, ecological flow, and ecological water temperature demands is lacking. Hence, this study develops a multi-objective ecological scheduling model, considering total power generation, ecological flow guarantee index, and ecological water temperature guarantee index simultaneously. The model is based on an integrated multi-objective simulation-optimization (MOSO) framework which is applied to Three Gorges Reservoir. To that end, first, a hybrid long short-term memory and one-dimensional convolutional neural network (LSTM_1DCNN) model is utilized to simulate the dam discharge temperature. Then, an improved epsilon multi-objective ant colony optimization for continuous domain algorithm (ε-MOACOR) is proposed to investigate the trade-offs among the competing objectives. Results show that LSTM _1DCNN outperforms other competing models in predicting dam discharge temperature. The conflicts among economic and ecological objectives are often prominent. The proposed ε-MOACOR has potential in resolving such conflicts and has high efficiency in solving multi-objective benchmark tests as well as reservoir optimization problem. More realistic and pragmatic Pareto-optimal solutions for typical dry, normal and wet years can be generated by the MOSO framework. The ecological water temperature guarantee index objective, which should be considered in reservoir operation, can be improved as inflow discharge increases or the temporal distribution of dam discharge volume becomes more uneven.

Identification and Classification of Coix seed Storage Years Based on Hyperspectral Imaging Technology Combined with Deep Learning

Developing a fast and non-destructive methodology to identify the storage years of Coix seed is important in safeguarding consumer well-being. This study employed the utilization of hyperspectral imaging (HSI) in conjunction with conventional machine learning techniques such as support vector machines (SVM), k-nearest neighbors (KNN), random forest (RF), extreme gradient boosting (XGBoost), as well as the deep learning method of residual neural network (ResNet), to establish identification models for Coix seed samples from different storage years. Under the fusion-based modeling approach, the model’s classification accuracy surpasses that of visible to near infrared (VNIR) and short-wave infrared (SWIR) spectral modeling individually. The classification accuracy of the ResNet model and SVM exceeds that of other conventional machine learning models (KNN, RF, and XGBoost). Redundant variables were further diminished through competitive adaptive reweighted sampling feature wavelength screening, which had less impact on the model’s accuracy. Upon validating the model’s performance using an external validation set, the ResNet model yielded more satisfactory outcomes, exhibiting recognition accuracy exceeding 85%. In conclusion, the comprehensive results demonstrate that the integration of deep learning with HSI techniques effectively distinguishes Coix seed samples from different storage years.

Adaptive neural acceleration unit based on heterogeneous multicore hardware architecture FPGA and software-defined hardware

ABSTRACT This study is anchored in a heterogeneous multicore hardware architecture, specifically Field Programmable Gate Arrays (FPGAs), and software-defined hardware. It employs dynamic planning for the reconfiguration of a software-defined System-on-Chip (SOC) to expedite neural network processes. The reconfigured software-defined SOC serves as an efficient data processor, facilitating the hybrid development and verification of domain-specific System-on-Chip architectures, adhering to the Advanced Microcontroller Bus Architecture (AMBA) standard. The proposed block data trimming methodology significantly enhances overall hybrid computing efficiency by mitigating throughput limitations inherent in Systolic array hardware. The designed Systolic array Matrix Multiply Unit (MMU) is evaluated for a maximum MMU size of 32 × 32 and 1,024 Multiply Accumulator (MAC) units. Hybrid dynamic circuits are devised for the synthesis of int8, int16, int32, and int64 data types and associated logic circuits to validate the performance of parallel computing. It is anticipated that this proposed system can find utility in the development and deployment of unmanned devices, as well as in the integration of deep learning and multi-sensory fusion involving acoustic, tactile, and force sensory components.

Integration of Deep Learning and Sparrow Search Algorithms to Optimize Greenhouse Microclimate Prediction for Seedling Environment Suitability

The climatic parameters within greenhouse facilities, such as temperature, humidity, and light, exert significant influence on the growth and yield of crops, particularly seedlings. Therefore, it is crucial to establish an accurate predictive model to monitor and adjust the greenhouse microclimate for optimizing the greenhouse environment to the fullest extent. To precisely forecast the greenhouse microclimate and assess the suitability of nursery environments, this study focuses on greenhouse environmental factors. This study leveraged open-source APIs to acquire meteorological data, integrated a model based on Convolutional Neural Networks (CNN) and Long Short-Term Memory Networks (LSTM), and utilized the sparrow search algorithm to optimize model parameters, consequently developing a time series greenhouse microclimate prediction model. Furthermore, Squeeze-and-Excitation (SE) Networks were employed to enhance the model’s attention mechanism, enabling more accurate predictions of environmental factors within the greenhouse. The predictive results indicated that the optimized model achieved high precision in forecasting the greenhouse microclimate, with average errors of 0.540 °C, 0.936%, and 1.586 W/m2 for temperature, humidity, and solar radiation, respectively. The coefficients of determination (R2) reached 0.940, 0.951, and 0.936 for temperature, humidity, and solar radiation, respectively. In comparison to individual CNN or LSTM models, as well as the back-propagation (BP) neural network, the proposed model demonstrates a significant improvement in predictive accuracy. Moreover, this research was applied to the greenhouse nursery environment, demonstrating that the proposed model significantly enhanced the efficiency of greenhouse seedling cultivation and the quality of seedlings. Our study provided an effective approach for optimizing greenhouse environmental control and nursery environment suitability, contributing significantly to achieving sustainable and efficient agricultural production.

Integration of Deep Learning and Collaborative Robot for Assembly Tasks

Human–robot collaboration has gained attention in the field of manufacturing and assembly tasks, necessitating the development of adaptable and user-friendly forms of interaction. To address this demand, collaborative robots (cobots) have emerged as a viable solution. Deep Learning has played a pivotal role in enhancing robot capabilities and facilitating their perception and understanding of the environment. This study proposes the integration of cobots and Deep Learning to assist users in assembly tasks such as part handover and storage. The proposed system includes an object classification system to categorize and store assembly elements, a voice recognition system to classify user commands, and a hand-tracking system for close interaction. Tests were conducted for each isolated system and for the complete application as used by different individuals, yielding an average accuracy of 91.25%. The integration of Deep Learning into cobot applications has significant potential for transforming industries, including manufacturing, healthcare, and assistive technologies. This work serves as a proof of concept for the use of several neural networks and a cobot in a collaborative task, demonstrating communication between the systems and proposing an evaluation approach for individual and integrated systems.

Research on a Fault Diagnosis Method for the Braking Control System of an Electric Multiple Unit Based on Deep Learning Integration

A fault diagnosis method based on deep learning integration is proposed focusing on fault text data to effectively improve the efficiency of fault repair and the accuracy of fault localization in the braking control system of an electric multiple unit (EMU). First, the Borderline-SMOTE algorithm is employed to synthesize minority class samples at the boundary, addressing the data imbalance and optimizing the distribution of data within the fault text. Then, a multi-dimensional word representation is generated using the multi-layer bidirectional transformer architecture from the pre-training model, BERT. Next, BiLSTM captures bidirectional context semantics and, in combination with the attention mechanism, highlights key fault information. Finally, the LightGBM classifier is employed to reduce model complexity, enhance analysis efficiency, and increase the practicality of the method in engineering applications. An experimental analysis of fault data from the braking control system of the EMU indicates that the deep learning integration method can further improve diagnostic performance.

Anticancer Drug Discovery Based on Natural Products: From Computational Approaches to Clinical Studies.

Globally, malignancies cause one out of six mortalities, which is a serious health problem. Cancer therapy has always been challenging, apart from major advances in immunotherapies, stem cell transplantation, targeted therapies, hormonal therapies, precision medicine, and palliative care, and traditional therapies such as surgery, radiation therapy, and chemotherapy. Natural products are integral to the development of innovative anticancer drugs in cancer research, offering the scientific community the possibility of exploring novel natural compounds against cancers. The role of natural products like Vincristine and Vinblastine has been thoroughly implicated in the management of leukemia and Hodgkin's disease. The computational method is the initial key approach in drug discovery, among various approaches. This review investigates the synergy between natural products and computational techniques, and highlights their significance in the drug discovery process. The transition from computational to experimental validation has been highlighted through in vitro and in vivo studies, with examples such as betulinic acid and withaferin A. The path toward therapeutic applications have been demonstrated through clinical studies of compounds such as silvestrol and artemisinin, from preclinical investigations to clinical trials. This article also addresses the challenges and limitations in the development of natural products as potential anti-cancer drugs. Moreover, the integration of deep learning and artificial intelligence with traditional computational drug discovery methods may be useful for enhancing the anticancer potential of natural products.

Deep Learning: A Primer for Neurosurgeons.

This chapter explores the transformative impact of deep learning (DL) on neurosurgery, elucidating its pivotal role in enhancing diagnostic performance, surgical planning, execution, and postoperative assessment. It delves into various deep learning architectures, including convolutional and recurrent neural networks, and their applications in analyzing neuroimaging data for brain tumors, spinal cord injuries, and other neurological conditions. The integration of DL in neurosurgical robotics and the potential for fully autonomous surgical procedures are discussed, highlighting advancements in surgical precision and patient outcomes. The chapter also examines the challenges of data privacy, quality, and interpretability that accompany the implementation of DL in neurosurgery. The potential for DL to revolutionize neurosurgical practices through improved diagnostics, patient-specific surgical planning, and the advent of intelligent surgical robots is underscored, promising a future where technology and healthcare converge to offer unprecedented solutions in neurosurgery.

The Evolution and Clinical Impact of Deep Learning Technologies in Breast MRI.

The integration of deep learning (DL) in breast MRI has revolutionized the field of medical imaging, notably enhancing diagnostic accuracy and efficiency. This review discusses the substantial influence of DL technologies across various facets of breast MRI, including image reconstruction, classification, object detection, segmentation, and prediction of clinical outcomes such as response to neoadjuvant chemotherapy and recurrence of breast cancer. Utilizing sophisticated models such as convolutional neural networks, recurrent neural networks, and generative adversarial networks, DL has improved image quality and precision, enabling more accurate differentiation between benign and malignant lesions and providing deeper insights into disease behavior and treatment responses. DL's predictive capabilities for patient-specific outcomes also suggest potential for more personalized treatment strategies. The advancements in DL are pioneering a new era in breast cancer diagnostics, promising more personalized and effective healthcare solutions. Nonetheless, the integration of this technology into clinical practice faces challenges, necessitating further research, validation, and development of legal and ethical frameworks to fully leverage its potential.

Research on microbial data modeling and disease prediction by fusion and integration of deep learning

Abstract The dynamics of microbial communities are closely related to human health. Deep learning techniques have shown great potential in bioinformatics by demonstrating powerful data analysis capabilities in areas such as microbial data modeling and disease Prediction since recent years. Our paper explores new approaches combining deep learning techniques with microbial data to generate more precise predictive models for early diagnosis and treatment. This study is dedicated to developing a method for modeling microbial data and predicting diseases that incorporates deep learning. Multiple deep learning models combine data from microbial communities to improve prediction accuracy through an integrated learning strategy. Experiments were conducted on two primary disease datasets: Inflammatory Bowel Disease (IBD) and Colorectal Cancer (Colorectal). This research method’s AUC values were 0.897 and 0.876, which is an improvement compared to traditional machine learning methods. A new perspective on the study of disease mechanisms was provided by identifying highly correlated microbial markers through feature selection analysis. This study can effectively enhance the use of microbial data in disease prediction by integrating deep learning models, which provides powerful technical support for future clinical diagnosis and treatment.