Neural Network-based Deep Learning Research Articles

Topographic Clinical Insights From Deep Learning-Based Geographic Atrophy Progression Prediction.

To explore the contributions of fundus autofluorescence (FAF) topographic imaging features to the performance of convolutional neural network-based deep learning (DL) algorithms in predicting geographic atrophy (GA) growth rate. Retrospective study with data from study eyes from three clinical trials (NCT02247479, NCT02247531, NCT02479386) in GA. The algorithm was initially trained with full FAF images, and its performance was considered benchmark. Ablation experiments investigated the contribution of imaging features to the performance of the algorithms. Three FAF image regions were defined relative to GA: Lesion, Rim, and Background. For No Lesion, No Rim, and No Background datasets, a single region of interest was removed at a time. For Lesion, Rim, and Background Shuffled datasets, individual region pixels were randomly shuffled. For Lesion, Rim, and Background Mask datasets, masks of the regions were used. A Convex Hull dataset was generated to evaluate the importance of lesion size. Squared Pearson correlation (r2) was used to compare the predictive performance of ablated datasets relative to the benchmark. The Rim region influenced r2 more than the other two regions in all experiments, indicating the most relevant contribution of this region to the performance of the algorithms. In addition, similar performance was observed for all regions when pixels were shuffled or only a mask was used, indicating intensity information was not independently informative without textural context. These ablation experiments enabled topographic clinical insights on FAF images from a DL-based GA progression prediction algorithm. Results from this study may lead to new insights on GA progression prediction.

Novel Antenna for Partial Discharge Detection and Classification: A Convolutional Neural Network-Based Deep Learning Approach

Novel Antenna for Partial Discharge Detection and Classification: A Convolutional Neural Network-Based Deep Learning Approach

A deep learning-driven discovery of berberine derivatives as novel antibacterial against multidrug-resistant Helicobacter pylori

Helicobacter pylori (H. pylori) is currently recognized as the primary carcinogenic pathogen associated with gastric tumorigenesis, and its high prevalence and resistance make it difficult to tackle. A graph neural network-based deep learning model, employing different training sets of 13,638 molecules for pre-training and fine-tuning, was aided in predicting and exploring novel molecules against H. pylori. A positively predicted novel berberine derivative 8 with 3,13-disubstituted alkene exhibited a potency against all tested drug-susceptible and resistant H. pylori strains with minimum inhibitory concentrations (MICs) of 0.25–0.5 μg/mL. Pharmacokinetic studies demonstrated an ideal gastric retention of 8, with the stomach concentration significantly higher than its MIC at 24 h post dose. Oral administration of 8 and omeprazole (OPZ) showed a comparable gastric bacterial reduction (2.2-log reduction) to the triple-therapy, namely OPZ + amoxicillin (AMX) + clarithromycin (CLA) without obvious disturbance on the intestinal flora. A combination of OPZ, AMX, CLA, and 8 could further decrease the bacteria load (2.8-log reduction). More importantly, the mono-therapy of 8 exhibited comparable eradication to both triple-therapy (OPZ + AMX + CLA) and quadruple-therapy (OPZ + AMX + CLA + bismuth citrate) groups. SecA and BamD, playing a major role in outer membrane protein (OMP) transport and assembling, were identified and verified as the direct targets of 8 by employing the chemoproteomics technique. In summary, by targeting the relatively conserved OMPs transport and assembling system, 8 has the potential to be developed as a novel anti-H. pylori candidate, especially for the eradication of drug-resistant strains.

Molybdenum Disulfide-Assisted Spontaneous Formation of Multistacked Gold Nanoparticles for Deep Learning-Integrated Surface-Enhanced Raman Scattering.

Several fabrication methods have been developed for label-free detection in various fields. However, fabricating high-density and highly ordered nanoscale architectures by using soluble processes remains a challenge. Herein, we report a biosensing platform that integrates deep learning with surface-enhanced Raman scattering (SERS), featuring large-area, close-packed three-dimensional (3D) architectures of molybdenum disulfide (MoS2)-assisted gold nanoparticles (AuNPs) for the on-site screening of coronavirus disease (COVID-19) using human tears. Some AuNPs are spontaneously synthesized without a reducing agent because the electrons induced on the semiconductor surface reduce gold ions when the Fermi level of MoS2 and the gold electrolyte reach equilibrium. With the addition of polyvinylpyrrolidone, a two-dimensional large-area MoS2 layer assisted in the formation of close-packed 3D multistacked AuNP structures, resembling electroless plating. This platform, with a convolutional neural network-based deep learning model, achieved outstanding SERS performance at subterascale levels despite the microlevel irradiation power and millisecond-level acquisition time and accurately assessed susceptibility to COVID-19. These results suggest that our platform has the potential for rapid, low-damage, and high-throughput label-free detection of exceedingly low analyte concentrations.

A one-dimensional convolutional neural network-based deep learning approach for predicting cardiovascular diseases

Early detection of cardiovascular diseases (CVDs) is crucial for managing cardiovascular diseases and improving patient outcomes. Deep neural networks have the potential to reduce the reliance on costly and time-consuming clinical tests, leading to cost savings for patients and healthcare systems. This study proposes the development of specialized convolutional neural networks for the automated selection of essential variables, employing various preprocessing procedures. It evaluates the approach using the UCI repository heart disease dataset, focusing on early-stage heart disease identification to enhance early prediction and intervention for CVD. To address the challenge of achieving higher accuracy, we introduce an approach using one-dimensional convolutional neural networks, incorporating extensive testing to optimize the network architecture and enhance predictive performance. Additionally, recognizing the impact of features on accuracy, a comprehensive data analysis was performed. Through a meticulous selection process, we identified and utilized key features that significantly influenced the accuracy of our model, contributing to more reliable predictions. Finally, cross-validation techniques were implemented to precisely evaluate the efficacy of our work. Numerous experiments were conducted to demonstrate the relevance of our research. The prediction accuracy was found to be 99.95% when employing a train–test approach, while it was approximately 98.53% when employing K-Fold cross-validation. In comparison to existing literature, our approach outperforms a recent best study that proposed a Catboost model, achieving an F1-score of about 92.3% and an average accuracy of 90.94%. This signifies a substantial improvement in predictive performance, with a percentage improvement of approximately 9.90% compared to the Catboost model.

Neural-Integrated Meshfree (NIM) Method: A differentiable programming-based hybrid solver for computational mechanics

While deep learning and data-driven modeling approaches based on deep neural networks (DNNs) have recently attracted increasing attention for solving partial differential equations, their practical applications to real-world scientific and engineering problems remain limited due to the relatively low accuracy and high computational costs. In this study, we present a differentiable programming-based hybrid meshfree approach within the field of computational mechanics. This approach seamlessly integrates neural network-based deep learning architectures with physics-based meshfree discretization techniques, thus referred to as the neural-integrated meshfree (NIM) method. To effectively approximate the solution, NIM employs a hybrid scheme called NeuroPU approximation, which combines continuous DNN representations with partition of unity (PU) basis functions associated with the underlying spatial discretization. This neural-numerical hybridization not only enhances the solution representation through functional space decomposition but also reduces both the size of DNN model and the need of automatic differentiation for spatial gradient computations, leading to a significant improvement in training efficiency. Under the NIM framework, we propose two truly meshfree solvers: the strong form-based NIM (S-NIM) and the local variational form-based NIM (V-NIM). In the S-NIM solver, the strong-form governing equation is directly considered in the loss function, while the V-NIM solver employs a local Petrov–Galerkin approach that allows the construction of variational residuals based on arbitrary overlapping subdomains. This ensures both the satisfaction of underlying physics and the preservation of the meshfree property. We perform extensive numerical experiments on both stationary and transient benchmark problems to assess the effectiveness of the proposed NIM methods in terms of accuracy, scalability, generalizability, and convergence properties. Moreover, comparative analysis with other physics-informed machine learning methods demonstrates that NIM, especially V-NIM, significantly enhances both accuracy and efficiency in end-to-end predictive capabilities.

Emotional Recognition Based on Faces through Deep Learning Algorithms

Facial expressions have long been a straightforward way for humans to determine emotions, but computer systems find it significantly more difficult to do the same. Emotion recognition from facial expressions, a subfield of social signal processing, is employed in many different circumstances, but is especially useful for human-computer interaction. Many studies have been conducted on automatic emotion recognition, with the majority utilizing machine learning techniques. However, the identification of basic emotions such as fear, sadness, surprise, anger, happiness, and contempt remains a challenging subject in computer vision. Recently, deep learning has gained more attention as potential solutions for a range of real-world problems, such as emotion recognition. In this work, we refined the convolutional neural network method to discern seven basic emotions and assessed several preprocessing approaches to illustrate their impact on CNN performance. The goal of this research is to enhance facial emotions and features by using emotional recognition. Computers may be able to forecast mental states more accurately and respond with more customised answers if they can identify or recognise the facial expressions that elicit human responses. Consequently, we investigate how a convolutional neural network-based deep learning technique may enhance the recognition of emotions from facial features (CNN). Consequently, we investigate how a convolutional neural network-based deep learning technique may enhance the recognition of emotions from facial features (CNN). Our dataset, which comprises of roughly 32,298 pictures for testing and training, includes multiple face expressions. After noise removal from the input image, the pretraining phase helps reveal face detection, including feature extraction. The preprocessing system helps with this.

Genetic Programming-Based Evolutionary Deep Learning for Data-Efficient Image Classification

Data-efficient image classification is a challenging task that aims to solve image classification using small training data. Neural network-based deep learning methods are effective for image classification, but they typically require large-scale training data and have major limitations such as requiring expertise to design network architectures and having poor interpretability. Evolutionary deep learning is a recent hot topic that combines evolutionary computation with deep learning. However, most evolutionary deep learning methods focus on evolving architectures of neural networks, which still suffer from limitations such as poor interpretability. To address this, this paper proposes a new genetic programming-based evolutionary deep learning approach to data-efficient image classification. The new approach can automatically evolve variable-length models using many important operators from both image and classification domains. It can learn different types of image features from colour or gray-scale images, and construct effective and diverse ensembles for image classification. A flexible multi-layer representation enables the new approach to automatically construct shallow or deep models/trees for different tasks and perform effective transformations on the input data via multiple internal nodes. The new approach is applied to solve five image classification tasks with different training set sizes. The results show that it achieves better performance in most cases than deep learning methods for data-efficient image classification. A deep analysis shows that the new approach has good convergence and evolves models with high interpretability, different lengths/sizes/shapes, and good transferability.

Convolutional Neural Network-Based Deep Learning Engine for Mastoidectomy Instrument Recognition and Movement Tracking.

To develop a convolutional neural network-based computer vision model to recognize and track 2 mastoidectomy surgical instruments-the drill and the suction-irrigator-from intraoperative video recordings of mastoidectomies. Technological development and model validation. Academic center. Ten 1-minute videos of mastoidectomies done for cochlear implantation by varying levels of resident surgeons were collected. For each video, containing 900 frames, an open-access computer vision annotation tool was used to annotate the drill and suction-irrigator class images with bounding boxes. A mastoidectomy instrument tracking module, which extracts the center coordinates of bounding boxes, was developed using a feature pyramid network and layered with DETECTRON, an open-access faster-region-based convolutional neural network. Eight videos were used to train the model, and 2 videos were used for testing. Outcome measures included Intersection over Union (IoU) ratio, accuracy, and average precision. For an IoU of 0.5, the mean average precision for the drill was 99% and 86% for the suction-irrigator. The model proved capable of generating maps of drill and suction-irrigator stroke direction and distance for the entirety of each video. This computer vision model can identify and track the drill and suction-irrigator from videos of intraoperative mastoidectomies performed by residents with excellent precision. It can now be employed to retrospectively study objective mastoidectomy measures of expert and resident surgeons, such as drill and suction-irrigator stroke concentration, economy of motion, speed, and coordination, setting the stage for characterization of objective expectations for safe and efficient mastoidectomies.

Abstract 1043: Identification of the novel immune synapse-localized proteome for immuno-oncology using Microscoop-induced targeted photo-biotinylation

Abstract Although tens of immune synapse (IS) protein species are known, there remain many unknown IS-localized protein species. Understanding the proteome of the IS between a target cell and a lymphocyte is crucial for advancing immuno-oncology. The low abundance of ISs and the lack of a definitive enrichment marker have limited efficient proteomic profiling. Here, we used Microscoop™, an innovative system that integrates microscopy, machine learning, and targeted photo-biotinylation to enable precise and spatially specific enrichment of IS proteins, thereby facilitating proteomic discovery of the IS. We utilized Raji B cells as antigen-presenting cells (APCs) and induced IS formation with Jurkat T cells. The system first employed immunofluorescence imaging of CD3, a common IS marker in Jurkat T cells, and used a convolutional neural network-based deep learning algorithm to train the recognition of ISs from CMTPX-stained Raji B cells. Our automated system then successfully achieved spatially-targeted biotin-tagging of proteins at ISs through thousands of fields of view of imaging, deep learning-driven pattern generation, and photochemical labeling. Subsequent streptavidin pull-down and mass spectrometry analysis enabled the identification of IS-specific proteins. Remarkably, our spatial proteomic approach led to the isolation and identification of hundreds of different species at the IS interface, including proteins associated with key components of T-cell receptor (TCR) signaling pathways such as the TCR/CD3 complex, Src and Tec family tyrosine kinases, and pivotal NF-kB signaling proteins. Beyond these, we also identified a significant enrichment of proteins not previously associated with the IS. Our study not only illuminates previously unknown aspects of immune regulation at the IS interface, but also shedded light on proteins potentially important for immuno-oncology. These insights have significant implications for cancer research, particularly in understanding and manipulating immune responses for therapeutic purposes. Citation Format: Weng-Man Chong, Cecile Li, Chun-Kai Huang, Chantal Hoi Yin Cheung, Hsiao-Jen Chang, Chia-Wen Chung, Jung-Chi Liao. Identification of the novel immune synapse-localized proteome for immuno-oncology using Microscoop-induced targeted photo-biotinylation [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 1043.

Improving rainfall-runoff modeling in the Mekong river basin using bias-corrected satellite precipitation products by convolutional neural networks

Accurate rainfall-runoff (RR) modeling is crucial for effective Mekong River Basin (MRB) water resource management. Satellite precipitation products (SPPs) can offer valuable data for such modeling; however, these products often exhibit biases that may adversely affect hydrological simulations. This study aimed to improve RR modeling using bias-corrected SPPs and the Soil and Water Assessment Tool (SWAT) model for MRB. A convolutional neural network-based deep learning framework was employed to correct biases in four SPPs (TRMM, PERSIANN-CDR, CHIRPS, and CMORPH), resulting in four respective bias-corrected SPPs (ADJ_TRMM, ADJ_CDR, ADJ_CHIR, and ADJ_CMOR). The bias-corrected products were compared against a gauge-based dataset in terms of rainfall analysis, and their performance within the SWAT model was assessed over calibration (2004–2013) and validation (2014–2015). Bias-corrected products demonstrated superior performance in rainfall analysis, with ADJ_TRMM outperforming other products. The SWAT model calibration results showed satisfactory performance across all stations, with a Nash-Sutcliffe Efficiency (NSE) ranging from [0.76–0.87]. Integrating bias-corrected SPPs into the SWAT model significantly increased the RR simulations in the MRB, indicated by higher NSE values [0.72–0.85] compared to uncorrected SPPs [-0.37 to 0.85] at the Kratie station. Besides, the inconsistent performance of bias-corrected products between rainfall analysis and RR modeling was observed, with ADJ_CDR outperforming ADJ_TRMM in the SWAT model. These results highlight the significance of using bias-corrected SPPs in hydrological modeling applications, especially in areas with limited ground-based precipitation data, and highlight the need for further research to refine bias correction methods and address the limitations of the SWAT model.

Use of machine learning techniques for identifying ischemic stroke instead of the rule-based methods: a nationwide population-based study

BackgroundMany studies have evaluated stroke using claims data; most of these studies have defined ischemic stroke using an operational definition following the rule-based method. Rule-based methods tend to overestimate the number of patients with ischemic stroke.ObjectivesWe aimed to identify an appropriate algorithm for identifying stroke by applying machine learning (ML) techniques to analyze the claims data.MethodsWe obtained the data from the Korean National Health Insurance Service database, which is linked to the Ilsan Hospital database (n = 30,897). The performance of prediction models (extreme gradient boosting [XGBoost] or gated recurrent unit [GRU]) was evaluated using the area under the receiver operating characteristic curve (AUROC), the area under precision–recall curve (AUPRC), and calibration curve.ResultsIn total, 30,897 patients were enrolled in this study, 3145 of whom (10.18%) had ischemic stroke. XGBoost, a tree-based ML technique, had the AUROC was 94.46% and AUPRC was 92.80%. GRU showed the highest accuracy (99.81%), precision (99.92%) and recall (99.69%).ConclusionsWe proposed recurrent neural network-based deep learning techniques to improve stroke phenotyping. This can be expected to produce rapid and more accurate results than the rule-based methods.

Applying a Recurrent Neural Network-Based Deep Learning Model for Gene Expression Data Classification

The importance of gene expression data processing in solving the classification task is determined by its ability to discern intricate patterns and relationships within genetic information, enabling the precise categorization and understanding of various gene expression profiles and their consequential impacts on biological processes and traits. In this study, we investigated various architectures and types of recurrent neural networks focusing on gene expression data. The effectiveness of the appropriate model was evaluated using various classification quality criteria based on type 1 and type 2 errors. Moreover, we calculated the integrated F1-score index using the Harrington desirability method, the value of which allowed us to improve the objectivity of the decision making when model effectiveness was evaluated. The final decision regarding model effectiveness was made based on a comprehensive classification quality criterion, which was calculated as the weighted sum of classification accuracy, integrated F1-score index, and loss function values. The simulation results show higher appeal of a single-layer GRU recurrent network with 75 neurons in the recurrent layer. We also compared convolutional and recurrent neural networks on gene expression data classification. Although convolutional neural networks showcase benefits in terms of loss function value and training time, a comparative analysis revealed that in terms of classification accuracy calculated on the test data subset, the GRU neural network model is slightly better than the CNN and LSTM models. The classification accuracy when using the GRU network was 97.2%; in other cases, it was 97.1%. In the first case, 954 out of 981 objects were correctly identified. In other cases, 952 objects were correctly identified.

A Deep-Learning Algorithm to Predict Short-Term Progression to Geographic Atrophy on Spectral-Domain Optical Coherence Tomography

The identification of patients at risk of progressing from intermediate age-related macular degeneration (iAMD) to geographic atrophy (GA) is essential for clinical trials aimed at preventing disease progression. DeepGAze is a fully automated and accurate convolutional neural network-based deep learning algorithm for predicting progression from iAMD to GA within 1 year from spectral-domain optical coherence tomography (SD-OCT) scans. To develop a deep-learning algorithm based on volumetric SD-OCT scans to predict the progression from iAMD to GA during the year following the scan. This retrospective cohort study included participants with iAMD at baseline and who either progressed or did not progress to GA within the subsequent 13 months. Participants were included from centers in 4 US states. Data set 1 included patients from the Age-Related Eye Disease Study 2 AREDS2 (Ancillary Spectral-Domain Optical Coherence Tomography) A2A study (July 2008 to August 2015). Data sets 2 and 3 included patients with imaging taken in routine clinical care at a tertiary referral center and associated satellites between January 2013 and January 2023. The stored imaging data were retrieved for the purpose of this study from July 1, 2022, to February 1, 2023. Data were analyzed from May 2021 to July 2023. A position-aware convolutional neural network with proactive pseudointervention was trained and cross-validated on Bioptigen SD-OCT volumes (data set 1) and validated on 2 external data sets comprising Heidelberg Spectralis SD-OCT scans (data sets 2 and 3). Prediction of progression to GA within 13 months was evaluated with area under the receiver-operator characteristic curves (AUROC) as well as area under the precision-recall curve (AUPRC), sensitivity, specificity, positive predictive value, negative predictive value, and accuracy. The study included a total of 417 patients: 316 in data set 1 (mean [SD] age, 74 [8]; 185 [59%] female), 53 in data set 2, (mean [SD] age, 83 [8]; 32 [60%] female), and 48 in data set 3 (mean [SD] age, 81 [8]; 32 [67%] female). The AUROC for prediction of progression from iAMD to GA within 1 year was 0.94 (95% CI, 0.92-0.95; AUPRC, 0.90 [95% CI, 0.85-0.95]; sensitivity, 0.88 [95% CI, 0.84-0.92]; specificity, 0.90 [95% CI, 0.87-0.92]) for data set 1. The addition of expert-annotated SD-OCT features to the model resulted in no improvement compared to the fully autonomous model (AUROC, 0.95; 95% CI, 0.92-0.95; P = .19). On an independent validation data set (data set 2), the model predicted progression to GA with an AUROC of 0.94 (95% CI, 0.91-0.96; AUPRC, 0.92 [0.89-0.94]; sensitivity, 0.91 [95% CI, 0.74-0.98]; specificity, 0.80 [95% CI, 0.63-0.91]). At a high-specificity operating point, simulated clinical trial recruitment was enriched for patients progressing to GA within 1 year by 8.3- to 20.7-fold (data sets 2 and 3). The fully automated, position-aware deep-learning algorithm assessed in this study successfully predicted progression from iAMD to GA over a clinically meaningful time frame. The ability to predict imminent GA progression could facilitate clinical trials aimed at preventing the condition and could guide clinical decision-making regarding screening frequency or treatment initiation.

Structural and functional connectome relationships in early childhood

There is strong evidence that the functional connectome is highly related to the white matter connectome in older children and adults, though little is known about structure-function relationships in early childhood. We investigated the development of cortical structure-function coupling in children longitudinally scanned at 1, 2, 4, and 6 years of age (N = 360) and in a comparison sample of adults (N = 89). We also applied a novel graph convolutional neural network-based deep learning model with a new loss function to better capture inter-subject heterogeneity and predict an individual’s functional connectivity from the corresponding structural connectivity. We found regional patterns of structure-function coupling in early childhood that were consistent with adult patterns. In addition, our deep learning model improved the prediction of individual functional connectivity from its structural counterpart compared to existing models.

PAIP 2020: Microsatellite instability prediction in colorectal cancer.

Microsatellite instability (MSI) refers to alterations in the length of simple repetitive genomic sequences. MSI status serves as a prognostic and predictive factor in colorectal cancer. The MSI-high status is a good prognostic factor in stage II/III cancer, and predicts a lack of benefit to adjuvant fluorouracil chemotherapy in stage II cancer but a good response to immunotherapy in stage IV cancer. Therefore, determining MSI status in patients with colorectal cancer is important for identifying the appropriate treatment protocol. In the Pathology Artificial Intelligence Platform (PAIP) 2020 challenge, artificial intelligence researchers were invited to predict MSI status based on colorectal cancer slide images. Participants were required to perform two tasks. The primary task was to classify a given slide image as belonging to either the MSI-high or the microsatellite-stable group. The second task was tumor area segmentation to avoid ties with the main task. A total of 210 of the 495 participants enrolled in the challenge downloaded the images, and 23 teams submitted their final results. Seven teams from the top 10 participants agreed to disclose their algorithms, most of which were convolutional neural network-based deep learning models, such as EfficientNet and UNet. The top-ranked system achieved the highest F1 score (0.9231). This paper summarizes the various methods used in the PAIP 2020 challenge. This paper supports the effectiveness of digital pathology for identifying the relationship between colorectal cancer and the MSI characteristics.

Enhancing heart disease diagnosis through precise heart sound including infrasound

Recent research has been pushing the frontier of diagnosing cardiovascular diseases, which have a high mortality rate globally. The need for swift responses to acute diseases has underscored the importance of continuous health monitoring and the development of monitoring diagnostic technology. Our work focused on an overlooked aspect—the microphones used to measure heart sounds. Existing ones, particularly capacitive MEMS types, measure only heart sounds primarily within the audible frequency range, potentially limiting the diagnostic accuracy. To overcome these limitations, we used microphones capable of measuring down to infrasound areas. We also designed an experimental environment to capture the precise heart sounds. The crux of our approach was using the full information of heart sounds through infrasound measurements. A convolutional neural network-based deep learning model was employed for algorithm development and validated using the PhysioNet 2016 CinC’s open-source heart sound data. We conducted an experiment on the impact of low-frequency components on heart sound diagnosis using a new infrasound dataset measured at Seoul St. Mary's Hospital of the Catholic University of Korea. Accuracy and sensitivity, respectively, improved on average by 2% and 4%, showing that datasets including low-frequency components generally performed better.

Decentralized Task Assignment for Mobile Crowdsensing With Multi-Agent Deep Reinforcement Learning

Task assignment is a fundamental research problem in mobile crowdsensing (MCS) since it directly determines an MCS system’s practicality and economic value. Due to the complex dynamics of tasks and workers, task assignment problems are usually NP-hard, and approximation-based methods are preferred to impractical optimal methods. In the literature, a graph neural network-based deep reinforcement learning (GDRL) method is proposed in Xu and Song (2022) to solve routing problems in MCS and shows high performance and time efficiency. However, GDRL, as a centralized method, has to cope with the limitation in scalability and the challenge of privacy protection. In this paper, we propose a multi-agent deep reinforcement learning-based method named CQDRL to solve a task assignment problem in a decentralized fashion. The CQDRL method not only inherits the merits of GDRL over traditional heuristic and metaheuristic methods but also exploits computation potentials in mobile devices and protects workers’ privacy with a decentralized decision-making scheme. Our extensive experiments show that the CQDRL method can achieve significantly better performance than other traditional methods and performs fairly close to the centralized GDRL method.

A Comparative Study of Object Detection using YOLO and SSD Algorithms

One of the most significant and difficult areas of computer vision is object detection, which is used in many aspects of daily life, including security monitoring, autonomous vehicle operation, and so on, to find instances of semantic objects belonging to a particular class. In this survey, we first look at the current approaches of typical detection models and discuss the benchmark datasets in order to comprehensively and deeply comprehend the major development status of the object detection pipeline. This project explains how convolutional neural network-based deep learning techniques are used for object detection. In this study, deep learning methods for cutting-edge object identification systems are evaluated. Any kind of visual medium is represented by a computer as a collection of numerical numbers. In order to inspect the contents of images, they need image processing techniques. In order to determine which is the quickest and most effective object detection algorithm, this research analyzes two popular algorithms: Single Shot Detection (SSD) and You Only Look Once (YOLO). The COCO (Common Object in Context) dataset is used in this comparative research to assess the effectiveness of the two algorithms and to analyze their strengths and weaknesses in terms of factors like accuracy, precision, and speed. Based on the findings analysis, it can be said that YOLO-v3 outperforms SSD in the same testing scenario. Keywords- Object Detection, Deep learning, CNN, COCO, YOLO, SSD

Data-Driven Soft Sensing for Batch Processes Using Neural Network-Based Deep Quality-Relevant Representation Learning

Soft sensors provide a means to reliably estimate unmeasurable variables, thereby playing a prevalent role in formulating closed-loop control in batch processes. In soft sensor development, enhancing quality-relevant information and eliminating quality-irrelevant information are important. This study proposes a neural network-based deep quality-relevant representation learning approach to improve the soft sensing performance in dynamic batch processes. The structure of a deep neural network is optimized in a layer-by-layer manner. First, given the generally abundant predictor variables, the maximal relevanceminimal redundancy criterion is used to optimize the input layer, select the most beneficial variables, and eliminate modeling redundancy. Second, mutual information-based quality-relevant representation selection is performed in the middle layers to enhance the quality-relevant information and eliminate the influence of irrelevant representations. Third, deep quality-relevant representations are extracted, and a soft sensor model is developed. The proposed method is tested on a fed-batch penicillin fermentation process and an industrial injection molding process. Lastly, it shows that the proposed method outperforms several state-of-the-art approaches, thereby confirming its effectiveness.