Average Precision Score Research Articles

Advancing low‐light object detection with you only look once models: An empirical study and performance evaluation

AbstractLow‐light object detection is needed for ensuring security, enabling surveillance, and enhancing safety in diverse applications, including autonomous vehicles, surveillance systems, and search and rescue operations. A comprehensive study on low‐light object detection is presented using state‐of‐the‐art you only look once (YOLO) models, including YOLOv3, YOLOv5, YOLOv6, and YOLOv8, aiming to enhance detection performance under challenging low‐light conditions. The ExDark dataset is a dataset that consists of adequate low‐light images, modified to simulate realistic low‐light scenarios, and employed for evaluation. The deep learning algorithm optimises YOLO's architecture for low‐light detection by adapting the network structure and training strategies while preserving the algorithm's integrity. The experimental results show that YOLOv8 consistently outperforms baseline models, achieving significant improvements in accuracy and robustness in low‐light scenarios. The deep learning algorithm that acquired the best score, YOLOv8s, had a mean average precision score of 0.5513. This work contributes to the field of low‐light object detection, offering promising solutions for real‐world applications like nighttime surveillance and autonomous navigation in low‐light conditions, addressing the growing demand for advanced low‐light object detection.

Machine-Learning Predictions of Critical Temperatures from Chemical Compositions of Superconductors.

In the quest for advanced superconducting materials, the accurate prediction of critical temperatures (Tc) poses a formidable challenge, largely due to the complex interdependencies between superconducting properties and the chemical and structural characteristics of a given material. To address this challenges, we have developed a machine-learning framework that aims to elucidate these complicated and hitherto poorly understood structure-property and property-property relationships. This study introduces a novel machine-learning-based workflow, termed the Gradient Boosted Feature Selection (GBFS), which has been tailored to predict Tc for superconductors by employing a distributed gradient-boosting framework. This approach integrates exploratory data analyses, statistical evaluations, and multicollinearity reduction techniques to select highly relevant features from a high-dimensional feature space, derived solely from the chemical composition of materials. Our methodology was rigorously tested on a data set comprising approximately 16,400 chemical compounds with around 12,000 unique chemical compositions. The GBFS workflow enabled the development of a classification model that distinguishes compositions likely to exhibit Tc values greater than 10 K. This model achieved a weighted average F1-score of 0.912, an AUC-ROC of 0.986, and an average precision score of 0.919. Additionally, the GBFS workflow underpinned a regression model that predicted Tc values with an R2 of 0.945, an MAE of 3.54 K, and an RMSE of 6.57 K on a test set obtained via random splitting. Further exploration was conducted through out-of-sample Tc predictions, particularly those exceeding the liquid nitrogen temperature, and out-of-distribution predictions for (Ca1-xLax)FeAs2 based on varying lanthanum content. The outcome of our study underscores the significance of systematic feature analysis and selection in enhancing predictive model performance, offering various advantages over models that rely primarily on algorithmic complexity. This research not only advances the field of superconductivity but also sets a precedent for the application of machine learning in materials science.

Enhancing fruit and vegetable detection in unconstrained environment with a novel dataset

Automating the detection of fruits and vegetables using computer vision is essential for modernizing agriculture, improving efficiency, ensuring food quality, and contributing to sustainable and technologically advanced farming practices. This paper presents an end-to-end pipeline for detecting and localizing fruits and vegetables in real-world scenarios. To achieve this, a dataset named FRUVEG67 was curated that includes images of 67 classes of fruits and vegetables captured in unconstrained scenarios, with only a few manually annotated samples per class. A semi-supervised data annotation algorithm (SSDA) was developed that generates bounding boxes for objects to label the remaining nonannotated images. For detection, Fruit and Vegetable Detection Network (FVDNet) was proposed, an ensemble version of YOLOv8n featuring three distinct grid configurations. In addition, an averaging approach for the prediction of the bounding box and a voting mechanism for the prediction of the classes was implemented. Finally Jensen–Shannon Divergence (JSD) in conjunction with focal loss was integrated as the overall loss function for better detection of smaller objects. Experimental results highlight the superiority of FVDNet compared to recent versions of YOLO, showcasing remarkable improvements in detection and localization performance. An impressive mean average precision (mAP) score of 0.82 across all classes was achieved. Furthermore, the efficacy of FVDNet on open-category refrigerator images were evaluated, where it demonstrates promising results.

Automatic Paddy Planthopper Detection and Counting Using Faster R-CNN

Counting planthoppers manually is laborious and yields inconsistent results, particularly when dealing with species with similar features, such as the brown planthopper (Nilaparvata lugens; BPH), whitebacked planthopper (Sogatella furcifera; WBPH), zigzag leafhopper (Maiestas dorsalis; ZIGZAG), and green leafhopper (Nephotettix malayanus and Nephotettix virescens; GLH). Most of the available automated counting methods are limited to populations of a small density and often do not consider those with a high density, which require more complex solutions due to overlapping objects. Therefore, this research presents a comprehensive assessment of an object detection algorithm specifically developed to precisely detect and quantify planthoppers. It utilises annotated datasets obtained from sticky light traps, comprising 1654 images across four distinct classes of planthoppers and one class of benign insects. The datasets were subjected to data augmentation and utilised to train four convolutional object detection models based on transfer learning. The results indicated that Faster R-CNN VGG 16 outperformed other models, achieving a mean average precision (mAP) score of 97.69% and exhibiting exceptional accuracy in classifying all planthopper categories. The correctness of the model was verified by entomologists, who confirmed a classification and counting accuracy rate of 98.84%. Nevertheless, the model fails to recognise certain samples because of the high density of the population and the significant overlap among them. This research effectively resolved the issue of low- to medium-density samples by achieving very precise and rapid detection and counting.

AEPF: Attention-Enabled Point Fusion for 3D Object Detection.

Current state-of-the-art (SOTA) LiDAR-only detectors perform well for 3D object detection tasks, but point cloud data are typically sparse and lacks semantic information. Detailed semantic information obtained from camera images can be added with existing LiDAR-based detectors to create a robust 3D detection pipeline. With two different data types, a major challenge in developing multi-modal sensor fusion networks is to achieve effective data fusion while managing computational resources. With separate 2D and 3D feature extraction backbones, feature fusion can become more challenging as these modes generate different gradients, leading to gradient conflicts and suboptimal convergence during network optimization. To this end, we propose a 3D object detection method, Attention-Enabled Point Fusion (AEPF). AEPF uses images and voxelized point cloud data as inputs and estimates the 3D bounding boxes of object locations as outputs. An attention mechanism is introduced to an existing feature fusion strategy to improve 3D detection accuracy and two variants are proposed. These two variants, AEPF-Small and AEPF-Large, address different needs. AEPF-Small, with a lightweight attention module and fewer parameters, offers fast inference. AEPF-Large, with a more complex attention module and increased parameters, provides higher accuracy than baseline models. Experimental results on the KITTI validation set show that AEPF-Small maintains SOTA 3D detection accuracy while inferencing at higher speeds. AEPF-Large achieves mean average precision scores of 91.13, 79.06, and 76.15 for the car class's easy, medium, and hard targets, respectively, in the KITTI validation set. Results from ablation experiments are also presented to support the choice of model architecture.

Deep learning approach for detecting tomato flowers and buds in greenhouses on 3P2R gantry robot

In recent years, significant advancements have been made in the field of smart greenhouses, particularly in the application of computer vision and robotics for pollinating flowers. Robotic pollination offers several benefits, including reduced labor requirements and preservation of costly pollen through artificial tomato pollination. However, previous studies have primarily focused on the labeling and detection of tomato flowers alone. Therefore, the objective of this study was to develop a comprehensive methodology for simultaneously labeling, training, and detecting tomato flowers specifically tailored for robotic pollination. To achieve this, transfer learning techniques were employed using well-known models, namely YOLOv5 and the recently introduced YOLOv8, for tomato flower detection. The performance of both models was evaluated using the same image dataset, and a comparison was made based on their Average Precision (AP) scores to determine the superior model. The results indicated that YOLOv8 achieved a higher mean AP (mAP) of 92.6% in tomato flower and bud detection, outperforming YOLOv5 with 91.2%. Notably, YOLOv8 also demonstrated an inference speed of 0.7 ms when considering an image size of 1920×1080\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$1920 \ imes 1080$$\\end{document} pixels resized to 640×640\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$640 \ imes 640$$\\end{document} pixels during detection. The image dataset was acquired during both morning and evening periods to minimize the impact of lighting conditions on the detection model. These findings highlight the potential of YOLOv8 for real-time detection of tomato flowers and buds, enabling further estimation of flower blooming peaks and facilitating robotic pollination. In the context of robotic pollination, the study also focuses on the deployment of the proposed detection model on the 3P2R gantry robot. The study introduces a kinematic model and a modified circuit for the gantry robot. The position-based visual servoing method is employed to approach the detected flower during the pollination process. The effectiveness of the proposed visual servoing approach is validated in both un-clustered and clustered plant environments in the laboratory setting. Additionally, this study provides valuable theoretical and practical insights for specialists in the field of greenhouse systems, particularly in the design of flower detection algorithms using computer vision and its deployment in robotic systems used in greenhouses.

Deep learning-based structure segmentation and intramuscular fat annotation on lumbar magnetic resonance imaging.

Lumbar disc herniation (LDH) is a prevalent cause of low back pain. LDH patients commonly experience paraspinal muscle atrophy and fatty infiltration (FI), which further exacerbates the symptoms of low back pain. Magnetic resonance imaging (MRI) is crucial for assessing paraspinal muscle condition. Our study aims to develop a dual-model for automated muscle segmentation and FI annotation on MRI, assisting clinicians evaluate LDH conditions comprehensively. The study retrospectively collected data diagnosed with LDH from December 2020 to May 2022. The dataset was split into a 7:3 ratio for training and testing, with an external test set prepared to validate model generalizability. The model's performance was evaluated using average precision (AP), recall and F1 score. The consistency was assessed using the Dice similarity coefficient (DSC) and Cohen's Kappa. The mean absolute percentage error (MAPE) was calculated to assess the error of the model measurements of relative cross-sectional area (rCSA) and FI. Calculate the MAPE of FI measured by threshold algorithms to compare with the model. A total of 417 patients being evaluated, comprising 216 males and 201 females, with a mean age of 49 ± 15 years. In the internal test set, the muscle segmentation model achieved an overall DSC of 0.92 ± 0.10, recall of 92.60%, and AP of 0.98. The fat annotation model attained a recall of 91.30%, F1 Score of 0.82, and Cohen's Kappa of 0.76. However, there was a decrease on the external test set. For rCSA measurements, except for longissimus (10.89%), the MAPE of other muscles was less than 10%. When comparing the errors of FI for each paraspinal muscle, the MAPE of the model was lower than that of the threshold algorithm. The models demonstrate outstanding performance, with lower error in FI measurement compared to thresholding algorithms.

Bangladeshi crops leaf disease detection using YOLOv8

The agricultural sector in Bangladesh is a cornerstone of the nation's economy, with key crops such as rice, corn, wheat, potato, and tomato playing vital roles. However, these crops are highly vulnerable to various leaf diseases, which pose significant threats to crop yields and food security if not promptly addressed. Consequently, there is an urgent need for an automated system that can accurately identify and categorize leaf diseases, enabling early intervention and management. This study explores the efficacy of the latest state-of-the-art object detection model, YOLOv8 (You Only Look Once), in surpassing previous models for the automated detection and categorization of leaf diseases in these five major crops. By leveraging modern computer vision techniques, the goal is to enhance the efficiency of disease detection and management. A dataset comprising 19 classes, each with 150 images, totaling 2850 images, was meticulously curated and annotated for training and evaluation. The YOLOv8 framework, known for its capability to detect multiple objects simultaneously, was employed to train a deep neural network. The system's performance was evaluated using standard metrics such as mean Average Precision (mAP) and F1 score. The findings demonstrate that the YOLOv8 framework successfully identifies leaf diseases, achieving a high mAP of 98% and an F1 score of 97%. These results underscore the significant potential of this approach to enhance crop disease management, thereby improving food security and promoting agricultural sustainability in Bangladesh.

Classification of Prostate Cancer in 3D Magnetic Resonance Imaging Data based on Convolutional Neural Networks

Abstract Prostate cancer is a commonly diagnosed cancerous disease among men world-wide. Even with modern technology such as multi-parametric magnetic resonance tomography and guided biopsies, the process for diagnosing prostate cancer remains time consuming and requires highly trained professionals. In this paper, different convolutional neural networks (CNN) are evaluated on their abilities to reliably classify whether an MRI sequence contains malignant lesions. Implementations of a ResNet, a ConvNet and a ConvNeXt for 3D image data are trained and evaluated. The models are trained using different data augmentation techniques, learning rates, and optimizers. The data is taken from a private dataset, provided by Cantonal Hospital Aarau. The best result was achieved with a ResNet3D, yielding an average precision score of 0.4583 and AUC ROC score of 0.6214.

Multivariable model for gait pattern differentiation in elderly patients with hip and knee osteoarthritis: A wearable sensor approach

BackgroundHip and knee osteoarthritis (OA) patients demonstrate distinct gait patterns, yet detecting subtle abnormalities with wearable sensors remains uncertain. This study aimed to assess a predictive model's efficacy in distinguishing between hip and knee OA gait patterns using accelerometer data. MethodParticipants with hip or knee OA underwent overground walking assessments, recording lower limb accelerations for subsequent time and frequency domain analyses. Logistic regression with regularization identified associations between frequency domain features of acceleration signals and OA, and k-nearest neighbor classification distinguished knee and hip OA based on selected acceleration signal features. FindingsWe included 57 knee OA patients (30 females, median age 68 [range 49–89], median BMI 29.7 [range 21.0–45.9]) and 42 hip OA patients (19 females, median age 70 [range 47–89], median BMI 28.3 [range 20.4–37.2]). No significant difference could be found in the time domain's averaged shape of acceleration signals. However, in the frequency domain, five selected features showed a diagnostic ability to differentiate between knee and hip OA. Using these features, a model achieved a 77 % accuracy in classifying gait cycles into hip or knee OA groups, with average precision, recall, and F1 score of 77 %, 76 %, and 78 %, respectively. InterpretationThe study demonstrates the effectiveness of wearable sensors in differentiating gait patterns between individuals with hip and knee OA, specifically in the frequency domain. The results highlights the promising potential of wearable sensors and advanced signal processing techniques for objective assessment of OA in clinical settings.

Radar-Based Elderly Fall Detection Using Smoothed Pseudo Wigner Ville Distribution and XGBoost Learning.

Falls among the elderly population pose significant health risks, often leading to morbidity and decreased quality of life. Traditional fall detection methods, namely wearable devices and cameras, have limitations such as lighting conditions and privacy concerns. Radar-based fall detection has emerged as a promising alternative, offering unobtrusive technique. In this study, an attempt has been made to classify fall detection using smoothed pseudo wigner-ville distribution (SPWVD) images and XGBoost learning. For this, online publicly available radar database (N=15) is considered. Radar signals is employed to SPWVD for time-frequency representation images. Ten features are extracted and applied to XGBoost learning. Experiments are performed and performance is evaluated using 10-fold cross validation. The proposed approach is able to discriminate elderly fall. Using XGBoost learning, the approach yields a maximum average classification accuracy, f1-score, precision, sensitivity, specificity, and kappa scores of 87.47%, 87.38%, 88.12%, 86.81%, 88.31% and 74.94% respectively. The combination of conventional features with concentration measures and median frequency obtained the second best performance. Thus, the proposed framework could be utilized for accurate and efficient detection of falls among the elderly population in their private spaces.

Detection and Segmentation of Mouth Region in Stereo Stream Using YOLOv6 and DeepLab v3+ Models for Computer-Aided Speech Diagnosis in Children

This paper describes a multistage framework for face image analysis in computer-aided speech diagnosis and therapy. Multimodal data processing frameworks have become a significant factor in supporting speech disorders’ treatment. Synchronous and asynchronous remote speech therapy approaches can use audio and video analysis of articulation to deliver robust indicators of disordered speech. Accurate segmentation of articulators in video frames is a vital step in this agenda. We use a dedicated data acquisition system to capture the stereovision stream during speech therapy examination in children. Our goal is to detect and accurately segment four objects in the mouth area (lips, teeth, tongue, and whole mouth) during relaxed speech and speech therapy exercises. Our database contains 17,913 frames from 76 preschool children. We apply a sequence of procedures employing artificial intelligence. For detection, we train the YOLOv6 (you only look once) model to catch each of the three objects under consideration. Then, we prepare the DeepLab v3+ segmentation model in a semi-supervised training mode. As preparation of reliable expert annotations is exhausting in video labeling, we first train the network using weak labels produced by initial segmentation based on the distance-regularized level set evolution over fuzzified images. Next, we fine-tune the model using a portion of manual ground-truth delineations. Each stage is thoroughly assessed using the independent test subset. The lips are detected almost perfectly (average precision and F1 score of 0.999), whereas the segmentation Dice index exceeds 0.83 in each articulator, with a top result of 0.95 in the whole mouth.

SDMNet: Spatially dilated multi-scale network for object detection for drone aerial imagery

Multi-scale object detection is a preeminent challenge in computer vision and image processing. Several deep learning models that are designed to detect various objects miss out on the detection capabilities for small objects, reducing their detection accuracies. Intending to focus on different scales, from extremely small to large-sized objects, this work proposes a Spatially Dilated Multi-Scale Network (SDMNet) architecture for UAV-based ground object detection. It proposes a Multi-scale Enhanced Effective Channel Attention mechanism to preserve the object details in the images. Additionally, the proposed model incorporates dilated convolution, sub-pixel convolution, and additional prediction heads to enhance object detection performance specifically for aerial imaging. It has been evaluated on two popular aerial image datasets, VisDrone 2019 and UAVDT, containing publicly available annotated images of ground objects captured from UAV. Different performance metrics, such as precision, recall, mAP, and detection rate, benchmark the proposed architecture with the existing object detection approaches. The experimental results demonstrate the effectiveness of the proposed model for multi-scale object detection with an average precision score of 54.2% and 98.4% for VisDrone and UAVDT datasets, respectively.

Segmenting hydrogen‐induced cracking defects in steel through scanning acoustic microscopy and deep neural networks

AbstractHydrogen‐induced cracking (HIC) presents a significant concern in industries, such as oil and gas, petrochemicals, and aerospace, where high‐strength steel is prevalently used. This phenomenon compromises the structural integrity of steel pipelines and equipment. Accurate detection and monitoring of HIC are crucial for the safety and reliability of these assets. While traditional defect detection methods are usually costly and easily affected by human physiological state, deep learning approaches offer both time and financial benefits along with high accuracy. This study focuses on employing deep learning to segment HIC in steel, utilizing the robust and state‐of‐the‐art YOLOv8‐seg architecture for defect identification and segmentation. The process involves acquiring two‐dimensional B‐scan images through a scanning acoustic microscopy (SAM) system, followed by employing the YOLOv8‐seg architecture to address the segmentation task within these images. The experimental results demonstrate the effectiveness of the YOLOv8‐seg model, achieving a mean average precision (mAP) score greater than ˜0.95. Notably, this research pioneers the development of a framework for reconstructing HIC within steel based on B‐scan image segmentation results, offering researchers and professionals a comprehensive understanding of internal defects in steel blocks. This work underscores the potential of YOLOv8‐seg architecture for accurate detection and segmentation of HIC in steel, providing a valuable tool for inspection and maintenance activities.

Pineapple Detection with YOLOv7-Tiny Network Model Improved via Pruning and a Lightweight Backbone Sub-Network

High-complexity network models are challenging to execute on agricultural robots with limited computing capabilities in a large-scale pineapple planting environment in real time. Traditional module replacement often struggles to reduce model complexity while maintaining stable network accuracy effectively. This paper investigates a pineapple detection framework with a YOLOv7-tiny model improved via pruning and a lightweight backbone sub-network (the RGDP-YOLOv7-tiny model). The ReXNet network is designed to significantly reduce the number of parameters in the YOLOv7-tiny backbone network layer during the group-level pruning process. Meanwhile, to enhance the efficacy of the lightweight network, a GSConv network has been developed and integrated into the neck network, to further diminish the number of parameters. In addition, the detection network incorporates a decoupled head network aimed at separating the tasks of classification and localization, which can enhance the model’s convergence speed. The experimental results indicate that the network before pruning optimization achieved an improvement of 3.0% and 2.2%, in terms of mean average precision and F1 score, respectively. After pruning optimization, the RGDP-YOLOv7-tiny network was compressed to just 2.27 M in parameter count, 4.5 × 109 in computational complexity, and 5.0MB in model size, which were 37.8%, 34.1%, and 40.7% of the original YOLOv7-tiny network, respectively. Concurrently, the mean average precision and F1 score reached 87.9% and 87.4%, respectively, with increases of 0.8% and 1.3%. Ultimately, the model’s generalization performance was validated through heatmap visualization experiments. Overall, the proposed pineapple object detection framework can effectively enhance detection accuracy. In a large-scale fruit cultivation environment, especially under the constraints of hardware limitations and limited computational power in the real-time detection processes of agricultural robots, it facilitates the practical application of artificial intelligence algorithms in agricultural engineering.

Deep learning application of vertebral compression fracture detection using mask R-CNN

Vertebral compression fractures (VCFs) of the thoracolumbar spine are commonly caused by osteoporosis or result from traumatic events. Early diagnosis of vertebral compression fractures can prevent further damage to patients. When assessing these fractures, plain radiographs are used as the primary diagnostic modality. In this study, we developed a deep learning based fracture detection model that could be used as a tool for primary care in the orthopedic department. We constructed a VCF dataset using 487 lateral radiographs, which included 598 fractures in the L1-T11 vertebra. For detecting VCFs, Mask R-CNN model was trained and optimized, and was compared to three other popular models on instance segmentation, Cascade Mask R-CNN, YOLOACT, and YOLOv5. With Mask R-CNN we achieved highest mean average precision score of 0.58, and were able to locate each fracture pixel-wise. In addition, the model showed high overall sensitivity, specificity, and accuracy, indicating that it detected fractures accurately and without misdiagnosis. Our model can be a potential tool for detecting VCFs from a simple radiograph and assisting doctors in making appropriate decisions in initial diagnosis.

Continuous Recognition of Teachers’ Hand Signals for Students with Attention Deficits

In the era of inclusive education, students with attention deficits are integrated into the general classroom. To ensure a seamless transition of students’ focus towards the teacher’s instruction throughout the course and to align with the teaching pace, this paper proposes a continuous recognition algorithm for capturing teachers’ dynamic gesture signals. This algorithm aims to offer instructional attention cues for students with attention deficits. According to the body landmarks of the teacher’s skeleton by using vision and machine learning-based MediaPipe BlazePose, the proposed method uses simple rules to detect the teacher’s hand signals dynamically and provides three kinds of attention cues (Pointing to left, Pointing to right, and Non-pointing) during the class. Experimental results show the average accuracy, sensitivity, specificity, precision, and F1 score achieved 88.31%, 91.03%, 93.99%, 86.32%, and 88.03%, respectively. By analyzing non-verbal behavior, our method of competent performance can replace verbal reminders from the teacher and be helpful for students with attention deficits in inclusive education.

VisioSignNet: A Dual-Interactive Neural Network for enhanced traffic sign detection

Effective traffic sign detection is crucial for the safety and operational efficiency of autonomous vehicle navigation systems, particularly in dynamically changing environments. Addressing the primary challenges of long-range pixel dependencies and enhancing the detectability of small objects in complex scenes, we present VisioSignNet: A Dual-Interactive Neural Network designed for enhanced traffic sign detection. This architecture incorporates Local and Global Interactive Modules (LGIM) and Enhancing Channel and Space Interaction (ECSI) modules. The LGIM is engineered to balance local and global feature interactions, while the ECSI optimizes the interchange of information across channel and spatial dimensions. Their synergistic interaction not only enhances the perceptual field at early processing stages but also significantly improves the recognition of small-scale, critical traffic signs. Evaluated on the TT100K and GTSDB datasets, VisioSignNet achieved mean average precision (mAP) scores of 90.5% and 97%, respectively, with a model size of 26M parameters. Its enhanced variant, VisioSignNet_l, with 34M parameters, reached mAP scores of 93.2% and 97.8%. These outcomes substantiate VisioSignNet’s efficacy in tackling the complexities of traffic sign detection, confirming its potential as a robust solution in the field of autonomous driving technologies.

Early detection of pediatric health risks using maternal and child health data

Machine learning (ML)-driven diagnosis systems are particularly relevant in pediatrics given the well-documented impact of early-life health conditions on later-life outcomes. Yet, early identification of diseases and their subsequent impact on length of hospital stay for this age group has so far remained uncharacterized, likely because access to relevant health data is severely limited. Thanks to a confidential data use agreement with the California Department of Health Care Access and Information, we introduce Ped-BERT: a state-of-the-art deep learning model that accurately predicts the likelihood of 100+ conditions and the length of stay in a pediatric patient’s next medical visit. We link mother-specific pre- and postnatal period health information to pediatric patient hospital discharge and emergency room visits. Our data set comprises 513.9K mother–baby pairs and contains medical diagnosis codes, length of stay, as well as temporal and spatial pediatric patient characteristics, such as age and residency zip code at the time of visit. Following the popular bidirectional encoder representations from the transformers (BERT) approach, we pre-train Ped-BERT via the masked language modeling objective to learn embedding features for the diagnosis codes contained in our data. We then continue to fine-tune our model to accurately predict primary diagnosis outcomes and length of stay for a pediatric patient’s next visit, given the history of previous visits and, optionally, the mother’s pre- and postnatal health information. We find that Ped-BERT generally outperforms contemporary and state-of-the-art classifiers when trained with minimum features. We also find that incorporating mother health attributes leads to significant improvements in model performance overall and across all patient subgroups in our data. Our most successful Ped-BERT model configuration achieves an area under the receiver operator curve (ROC AUC) of 0.927 and an average precision score (APS) of 0.408 for the diagnosis prediction task, and a ROC AUC of 0.855 and APS of 0.815 for the length of hospital stay task. Further, we examine Ped-BERT’s fairness by determining whether prediction errors are evenly distributed across various subgroups of mother–baby demographics and health characteristics, or if certain subgroups exhibit a higher susceptibility to prediction errors.

XRAInet: AI-based decision support for pneumothorax and pleural effusion management.

This study aimed to develop and assess the performance of an artificial intelligence(AI)-driven decision support system, XRAInet, in accurately identifying pediatric patients with pleural effusion or pneumothorax and determining whether tube thoracostomy intervention is warranted. In this diagnostic accuracy study, we retrospectively analyzed a data set containing 510 X-ray images from 170 pediatric patients admitted between 2005 and 2022. Patients were categorized into two groups: Tube (requiring tube thoracostomy) and Conservative (managed conservatively). XRAInet, a deep learning-based algorithm, was trained using this data set. We evaluated its performance using various metrics, including mean Average Precision (mAP), recall, precision, and F1 score. XRAInet, achieved a mAP score of 0.918. This result underscores its ability to accurately identify and localize regions necessitating tube thoracostomy for pediatric patients with pneumothorax and pleural effusion. In an independent testing data set, the model exhibited a sensitivity of 64.00% and specificity of 96.15%. In conclusion, XRAInet presents a promising solution for improving the detection and decision-making process for cases of pneumothorax and pleural effusion in pediatric patients using X-ray images. These findings contribute to the expanding field of AI-driven medical imaging, with potential applications for enhancing patient outcomes. Future research endeavors should explore hybrid models, enhance interpretability, address data quality issues, and align with regulatory requirements to ensure the safe and effective deployment of XRAInet in healthcare settings.