Image Detection Research Articles

Enhancing Multi-Object Detection in Ultrasound Images Through Semi-Supervised Learning, Focal Loss and Relation of Frame

ObjectiveTo identify musculoskeletal anatomical structures in real time by using deep learning techniques. MethodsAn automated annotation system based on deep learning neural networks was designed to aid in the real-time identification of anatomical structures. Additionally, novel algorithms aimed at diminishing model training duration while enhancing accuracy were introduced. In this study, we proposed a semi-supervised learning (SSL) approach that substantially reduced annotation time. We also adopted the focal loss (FL) method to enhance the accuracy of challenging structures. Additionally, during the inference stage, we harnessed the temporal continuity of video frames, which involved leveraging information from preceding frames to facilitate recognition of structures in the current image. Training the model through a combination of SSL and FL yielded superior performance compared with supervised learning, while also substantially mitigating any expense linked to annotations. During inference, the incorporation of frame continuity helped to avoid discontinuity and bolster accuracy. ResultsForearm tissue detection was demonstrated by properly configuring the SSL approach, including FL and the filtering threshold. Comparable performance with supervised learning was achieved while only using 30% of the training data. The real-time experimental results also demonstrated that implementing relation of frame reduced the number of missing frames during inference and successfully increased the confidence scores of detected objects. ConclusionThis proposed system has the potential to aid medical professionals in efficiently and effectively diagnosing musculoskeletal disorders, ultimately leading to enhanced patient outcomes.

Computer-aided diagnosis of pituitary microadenoma on dynamic contrast-enhanced MRI based on spatio-temporal features

Computer-aided diagnosis (CAD) of pituitary microadenoma (PM) can assist doctors in decision-making, leading to improved lesion detection rates and diagnostic accuracy. However, the performance of existing CAD methods for PM detection has been hindered by the difficulty in obtaining high-quality segmentation results. This is primarily due to the small size of PM lesions and the relatively low resolution of Magnetic Resonance Imaging (MRI) images. To address these challenges, this paper proposes a new medical image detection and segmentation model based on spatio-temporal information. The proposed model aims to addresses the disease classification of PM by designing a network module based on multi-scale feature fusion. This module ensures comprehensive extraction of target semantic information while retaining clear spatial information, achieving classification from dynamic contrast-enhanced MRI(DCE-MRI) to identify positive PM samples. For the lesion segmentation of PM, after ROI Align alignment, the model further adds a semantic segmentation module named Dual-path Semantic Segmentation Module (DSSM) behind the mask head and classification head. This module captures more precise spatio-temporal semantic information, reducing accuracy loss and achieving pituitary segmentation. Finally, leveraging the results of pituitary detection, a feature pyramid network (FPN) layer is redesigned named Reuse Underlying Information Module (RUIM) to reuse low-level information, enhancing the detection capability for PM and thus achieving precise object detection and segmentation. The proposed model achieves an accuracy of 97.10% for PM, mAP of 50.24%, which is superior to multiple representative deep models for medical data. The code is available at https://github.com/BUCT-IUSRC/Research__PM-CAD.

Ship Wake Detection in a Single SAR Image via a Modified Low-Rank Constraint

Ship Wake Detection in a Single SAR Image via a Modified Low-Rank Constraint

Optimasi Deteksi Tumor Otak Menggunakan Adaptive Multiscale Retinex dan YOLOV10 Pada Citra Digital

The incidence of brain tumors in Indonesia continues to rise annually, affecting both adults and children. Therefore, an effective detection system is required to differentiate MRI images showing the presence of brain tumors from those that do not. This distinction is crucial in the analysis and diagnosis of medical images. This study aims to optimize brain tumor detection in digital images by combining the Adaptive Multiscale Retinex (AMSR) method with the YOLOv10 algorithm. AMSR enhances the quality and contrast of brain images, making critical details more visible. The method adjusts the scale and intensity of image lighting to address uneven illumination and improve the visibility of brain structures. YOLOv10 is recognized for its speed and accuracy in real-time object detection. This algorithm employs deep learning techniques to identify and classify objects with high precision on enhanced brain image datasets. The model's performance was evaluated using metrics such as accuracy, sensitivity, specificity, and computation time. Results indicate that the combination of AMSR and YOLOv10 improves the accuracy and efficiency of brain tumor detection compared to conventional methods. The YOLOv10 model achieved a detection accuracy of 92%. This study provides significant contributions to early brain tumor detection technology, with important implications for the healthcare sector.

Ship target detection in SAR images based on SimAM attention YOLOv8

AbstractDeep learning has been widely applied in ship detection in synthetic aperture radar (SAR) imagery due to their powerful feature representation capabilities. However, YOLOv8 models treat all regions of the image equally during convolutional feature processing, resulting in less‐than‐ideal outcomes. To address this limitation, this study proposes a simple, parameter‐free attention module (SimAM) attention‐based YOLOv8 algorithm for ship detection in SAR images. The proposed algorithm first passes through a backbone network, which incorporates SimAM attention modules. The SimAM attention mechanism successfully allocates the convolutional neural network's 3D weights effectively using an energy function method, without introducing additional parameters. This mechanism enables the network to automatically emphasize key features in the image, enhancing its ability to represent target areas and suppress background interference. Subsequently, deep features are upsampled and fused with relatively shallow features to extract features at three different scales and achieve target detection, ultimately outputting classification and positional information of the targets. The effectiveness of the model on the SAR‐ship‐dataset is experimentally validated achieving an mAP50 value of 97.72% and an mAP50‐95 value of 68.99%, confirming the superiority of the proposed model.

Multimodal Social Media Fake News Detection Based on 1D-CCNet Attention Mechanism

Due to the explosive rise of multimodal content in online social communities, cross-modal learning is crucial for accurate fake news detection. However, current multimodal fake news detection techniques face challenges in extracting features from multiple modalities and fusing cross-modal information, failing to fully exploit the correlations and complementarities between different modalities. To address these issues, this paper proposes a fake news detection model based on a one-dimensional CCNet (1D-CCNet) attention mechanism, named BTCM. This method first utilizes BERT and BLIP-2 encoders to extract text and image features. Then, it employs the proposed 1D-CCNet attention mechanism module to process the input text and image sequences, enhancing the important aspects of the bimodal features. Meanwhile, this paper uses the pre-trained BLIP-2 model for object detection in images, generating image descriptions and augmenting text data to enhance the dataset. This operation aims to further strengthen the correlations between different modalities. Finally, this paper proposes a heterogeneous cross-feature fusion method (HCFFM) to integrate image and text features. Comparative experiments were conducted on three public datasets: Twitter, Weibo, and Gossipcop. The results show that the proposed model achieved excellent performance.

Multi-feature fusion dehazing based on CycleGAN

Under the foggy environment, lane line images are obscured by haze, which leads to lower detection accuracy, higher false detection of lane lines. To address the above problems, a multi-layer feature fusion dehazing network based on CycleGAN architecture is proposed. Firstly, the foggy image is enhanced to remove the fog in the image, and then the lane line detection network is used for detection. For the dehazing network, a multi-layer feature fusion module is used in the generator to fuse the features of different coding layers of U-Net to enhance the network’s recovery of information such as details and edges, and a frequency domain channel attention mechanism is added at the key nodes of the network to enhance the network’s attention to different fog concentrations. At the same time, to improve the discriminant effect of the discriminator, the discriminator is extended to a global and local discriminator. The experimental results show that the dehaze effect on Reside and other test data sets is better than the comparison method. The peak signal-to-noise ratio is improved by 2.26 dB compared to the highest GCA-Net algorithm. According to the lane detection of fog images, it is found that the proposed network improves the accuracy of lane detection on foggy days.

G-YOLO: A Lightweight Infrared Aerial Remote Sensing Target Detection Model for UAVs Based on YOLOv8

A lightweight infrared target detection model, G-YOLO, based on an unmanned aerial vehicle (UAV) is proposed to address the issues of low accuracy in target detection of UAV aerial images in complex ground scenarios and large network models that are difficult to apply to mobile or embedded platforms. Firstly, the YOLOv8 backbone feature extraction network is improved and designed based on the lightweight network, GhostBottleneckV2, and the remaining part of the backbone network adopts the depth-separable convolution, DWConv, to replace part of the standard convolution, which effectively retains the detection effect of the model while greatly reducing the number of model parameters and calculations. Secondly, the neck structure is improved by the ODConv module, which adopts an adaptive convolutional structure to adaptively adjust the convolutional kernel size and step size, which allows for more effective feature extraction and detection based on targets at different scales. At the same time, the neck structure is further optimized using the attention mechanism, SEAttention, to improve the model’s ability to learn global information of input feature maps, which is then applied to each channel of each feature map to enhance the useful information in a specific channel and improve the model’s detection performance. Finally, the introduction of the SlideLoss loss function enables the model to calculate the differences between predicted and actual truth bounding boxes during the training process, and adjust the model parameters based on these differences to improve the accuracy and efficiency of object detection. The experimental results show that compared with YOLOv8n, the G-YOLO reduces the missed and false detection rates of infrared small target detection in complex backgrounds. The number of model parameters is reduced by 74.2%, the number of computational floats is reduced by 54.3%, the FPS is improved by 71, which improves the detection efficiency of the model, and the average accuracy (mAP) reaches 91.4%, which verifies the validity of the model for UAV-based infrared small target detection. Furthermore, the FPS of the model reaches 556, and it will be suitable for wider and more complex detection task such as small targets, long-distance targets, and other complex scenes.

Staining-Independent Malaria Parasite Detection and Life Stage Classification in Blood Smear Images

Malaria is a leading cause of morbidity and mortality in tropical and sub-tropical regions. This research proposed a malaria diagnosis system based on the you only look once algorithm for malaria parasite detection and the convolutional neural network algorithm for malaria parasite life stage classification. Two public datasets are utilized: MBB and MP-IDB. The MBB dataset includes human blood smears infected with Plasmodium vivax (P. vivax). While the MP-IDB dataset comprises 4 species of malaria parasites: P. vivax, P. ovale, P. malariae, and P. falciparum. Four distinct stages of life exist in every species, including ring, trophozoite, schizont, and gametocyte. For the MBB dataset, detection and classification accuracies of 0.92 and 0.93, respectively, were achieved. For the MP-IDB dataset, the proposed algorithms yielded the accuracies for detection and classification as follows: 0.84 and 0.94 for P. vivax; 0.82 and 0.93 for P. ovale; 0.79 and 0.93 for P. malariae; and 0.92 and 0.96 for P. falciparum. The detection results showed the models trained by P. vivax alone provide good detection capabilities also for other species of malaria parasites. The classification performance showed the proposed algorithms yielded good malaria parasite life stage classification performance. The future directions include collecting more data and exploring more sophisticated algorithms.

A novel target detection method with dual‐domain multi‐frequency feature in side‐scan sonar images

AbstractSide‐scan sonar (SSS) detection is a key method in underwater environmental security and subsea resource development. However, many detection approaches primarily concentrate on tracking the evolution path of optical image object detection tasks when using acoustic images, resulting in complex structures and limited versatility. To tackle this issue, we introduce a pioneering dual‐domain multi‐frequency network (D2MFNet) meticulously crafted to harness the distinct characteristics of SSS image detection. In D2MFNet, a novel method for optimizing and improving the detection sensitivity in different frequency ranges called multi‐frequency combined attention mechanism (MFCAM) is proposed. This mechanism amplifies the relevance of dual‐domain features across different channels and spaces. Moreover, we introduce a dual‐domain feature pyramid network (D2FPN) significantly augments the depth and breadth of feature information in underwater small datasets. The methods offer plug‐and‐play functionality with substantial performance enhancements. Extensive experiments are conducted to validate the efficacy of the proposed techniques, and the results showcase their state‐of‐the‐art performance. MFCAM improves the mAP by 16.9% in the KLSG dataset and 15.5% in the SCTD dataset. The mAP of D2FPN was improved by 8.4% in the KLSG dataset and by 9.8% in the SCTD dataset. The code and models will be publicly available at https://dagshub.com/estrellaww00/D2MFNet.

A Low-Power, High-Resolution Analog Front-End Circuit for Carbon-Based SWIR Photodetector

Carbon nanotube field-effect transistors (CNT-FETs) have shown great promise in infrared image detection due to their high mobility, low cost, and compatibility with silicon-based technologies. This paper presents the design and simulation of a column-level analog front-end (AFE) circuit tailored for carbon-based short-wave infrared (SWIR) photodetectors. The AFE integrates a Capacitor Trans-impedance Amplifier (CTIA) for current-to-voltage conversion, coupled with Correlated Double Sampling (CDS) for noise reduction and operational amplifier offset suppression. A 10-bit/125 kHz Successive Approximation analog-to-digital converter (SAR ADC) completes the signal processing chain, achieving rail-to-rail input/output with minimized component count. Fabricated using 0.18 μm CMOS technology, the AFE demonstrates a high signal-to-noise ratio (SNR) of 59.27 dB and an Effective Number of Bits (ENOB) of 9.35, with a detectable current range from 500 pA to 100.5 nA and a total power consumption of 7.5 mW. These results confirm the suitability of the proposed AFE for high-precision, low-power SWIR detection systems, with potential applications in medical imaging, night vision, and autonomous driving systems.

Detection rate of gastrin-releasing peptide receptor (GRPr) targeted tracers for positron emission tomography (PET) imaging in primary prostate cancer: a systematic review and meta-analysis.

The gastrin-releasing peptide receptor (GRPr) has gained recognition as a promising target for both diagnostic and therapeutic applications in a variety of human cancers. This study aims to explore the primary tumor detection capabilities of [68Ga] Ga-GRPr PET imaging, specifically in newly diagnosed intra-prostatic prostate cancer lesions (PCa). Following PRISMA-DTA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy Studies) guidelines, a systematic literature search was conducted using the Medline, Embase, Scopus, and Web of Science databases. Data regarding patient characteristics and imaging procedure details-including the type of radiotracer used, administered activity, image acquisition time, scanner modality, criteria, and detection rate of index test-were extracted from the included studies. The pooled patient-and lesion-based detection rates, along with their corresponding 95% confidence intervals (CI), were calculated using a random effects model. The final analysis included 9 studies involving 291 patients and 350 intra-prostatic lesions with [68Ga] Ga-GRPr PET imaging in primary PCa. In per-patient-based analysis of [68Ga] Ga-GRPr PET imaging, the pooled detection rates of overall and patients with Gleason score ≥ 7 were 87.09% (95% CI 74.98-93.82) and 89.01% (95% CI 68.17-96.84), respectively. In per-lesion-based analysis, the pooled detection rate [68Ga] Ga-GRPr PET imaging was 78.54% (95% CI 69.8-85.29). The pooled detection rate mpMRI (multiparametric magnetic resonance imaging) in patient-based analysis was 91.85% (95% CI 80.12-96.92). The difference between the detection rates of the mpMRI and [68Ga] Ga-GRPr PET imaging was not statistically significant (OR 0.90, 95% CI 0.23-3.51). Our findings suggest that [68Ga] Ga-GRPr PET imaging has the potential as a diagnostic target for primary PCa. Future research is needed to determine the effectiveness of [68Ga] Ga-GRPr PET in delivering additional imaging data and guiding therapeutic decisions.

Retraction Note: Human motion image detection and tracking method based on gaussian mixture model combined with light sensor

Retraction Note: Human motion image detection and tracking method based on gaussian mixture model combined with light sensor

Ultra-lightweight convolution-transformer network for early fire smoke detection

BackgroundForests are invaluable resources, and fire is a natural process that is considered an integral part of the forest ecosystem. Although fire offers several ecological benefits, its frequent occurrence in different parts of the world has raised concerns in the recent past. Covering millions of hectares of forest land, these fire incidents have resulted in the loss of human lives, wild habitats, civil infrastructure, and severe damage to the environment. Around 90% of wildland fires have been caused by humans intentionally or unintentionally. Early detection of fire close to human settlements and wildlife centuries can help mitigate fire hazards. Numerous artificial intelligence-based solutions have been proposed in the past decade that prioritize the detection of fire smoke, as it can be caught through remote sensing and provide an early sign of wildland fire. However, most of these methods are either computationally intensive or suffer from a high false alarm rate. In this paper, a lightweight deep neural network model is proposed for fire smoke detection in images captured by satellites or other remote sensing sources.ResultsWith only 0.6 million parameters and 0.4 billion floating point operations per second, the hybrid network of convolutional and vision transformer blocks efficiently detects smoke in normal and foggy environmental conditions. It outperforms seven state-of-the-art methods on four datasets, including a self-collected dataset from the “Moderate Resolution Imaging Spectroradiometer” satellite imagery. The model achieves an accuracy of more than 99% on three datasets and 93.90% on the fourth dataset. The t-distributed stochastic neighbor embedding of extracted features by the proposed model demonstrates its superior feature learning capabilities. It is remarkable that even a tiny occurrence of smoke covering just 2% of the satellite image area is efficiently detected by the model.ConclusionsWith low memory and computational demands, the proposed model works exceedingly well, making it suitable for deployment in resource constrained devices for forest surveillance and early fire smoke detection.

Retraction Note: Application of infrared image detection based on high-resolution image processing in motion recognition

Retraction Note: Application of infrared image detection based on high-resolution image processing in motion recognition

Three-dimensional object reconstruction based on spin–orbit interaction of light

Three-dimensional (3D) reconstruction has received extensive attention in recent years and is of great significance to various application fields. We propose a simple method of 3D object reconstruction based on spin–orbit interactions occurring from light reflection at the air–glass interface. By rotating the object, edge images of the object in various orientations are obtained; we overlap these edge images to ultimately reconstruct the 3D object. This 3D image detection based on spin–orbit interaction of light provides a low energy consumption, low cost, and more algorithmic method compared to traditional 3D image processing. This can be used in fields such as medicine, autonomous vehicles, planetary observation, and other areas.

A novel multiscale cGAN approach for enhanced salient object detection in single haze images

In computer vision, image dehazing is a low-level task that employs algorithms to analyze and remove haze from images, resulting in haze-free visuals. The aim of Salient Object Detection (SOD) is to locate the most visually prominent areas in images. However, most SOD techniques applied to visible images struggle in complex scenarios characterized by similarities between the foreground and background, cluttered backgrounds, adverse weather conditions, and low lighting. Identifying objects in hazy images is challenging due to the degradation of visibility caused by atmospheric conditions, leading to diminished visibility and reduced contrast. This paper introduces an innovative approach called Dehaze-SOD, a unique integrated model that addresses two vital tasks: dehazing and salient object detection. The key novelty of Dehaze-SOD lies in its dual functionality, seamlessly integrating dehazing and salient object identification into a unified framework. This is achieved using a conditional Generative Adversarial Network (cGAN) comprising two distinct subnetworks: one for image dehazing and another for salient object detection. The first module, designed with residual blocks, Dark Channel Prior (DCP), total variation, and the multiscale Retinex algorithm, processes the input hazy images. The second module employs an enhanced EfficientNet architecture with added attention mechanisms and pixel-wise refinement to further improve the dehazing process. The outputs from these subnetworks are combined to produce dehazed images, which are then fed into our proposed encoder–decoder framework for salient object detection. The cGAN is trained with two modules working together: the generator aims to produce haze-free images, whereas the discriminator distinguishes between the generated haze-free images and real haze-free images. Dehaze-SOD demonstrates superior performance compared to state-of-the-art dehazing methods in terms of color fidelity, visibility enhancement, and haze removal. The proposed method effectively produces high-quality, haze-free images from various hazy inputs and accurately detects salient objects within them. This makes Dehaze-SOD a promising tool for improving salient object detection in challenging hazy conditions. The effectiveness of our approach has been validated using benchmark evaluation metrics such as mean absolute error (MAE), peak signal-to-noise ratio (PSNR), and structural similarity index measure (SSIM).

Empirical Study of Ovarian Tumors Detection and Classification in Ultrasound Images

Ovarian cancer is one of the leading causesof death in women. Ultrasound images often provide initialfindings and diagnosis before further tests are performed.Despite some progress in medical image analysis, the detectionand recognition of ovarian cancers remains still quite limited.Most existing works focused on detecting or classifying twotumor categories, namely benign and malignant lesions. Thispaper presents an initial comprehensive study of ovariantumor detection, and at the same time classifies eight classesof ovarian tumors in ultrasound images using deep-learningmodels. Due to the lack of training data, we implemented adata augmentation process and examined the improvementof performance with and without data augmentation. Experimentscarried out on the OTU-2D set of MMOTU dataset withYOLOv5, YOLOv7, and YOLOv7 variants show promisingdetection and classification results.

An improved YOLOv8-CGA-ASF-DBB method for multi-class wear debris recognition of online visual ferrograph image

Abstract The analysis of wear based on On-Line Visual Ferrograph (OLVF) provides crucial insights for the analysis of wear faults in mechanical equipment.However, online ferrograph analysis has been greatly limited by the low imaging quality and recognition accuracy of particle chains and high hubbles when analyzing lubricant oils in practical applications. To address this issue,this paper proposes an enhanced OLVF wear image detection model based on YOLOv8 and applies it to the multi-class intelligent recognition of ferrograph images .The Cascade Group Attention(CGA) module is introduced enhance the diversity of features and improve computational efficiency. The fusion of attention scale sequence is introduced to achieve precise and rapid recognition of small targets. This Diverse Branch Block(DBB) module is introduced efficiently extracts features without compromising reasoning speed during training. For verification , a test of the bridge transmission box was conducted based on OLVF, and 992 ferrograph images were collected. Experimental results reveal that the improved algorithm achieves an accuracy of 94.53% on the dataset of bridge transmission box ferrograph wear debris images collected through OLVF. This represents a 5.2% increase in recognition accuracy compared to the original algorithm, while maintaining a processing time of only 0.69ms per image. These findings provide compelling evidence for the significant enhancements in both recognition accuracy and processing speed achieved by the improved algorithm, thereby establishing its considerable value for engineering applications.

Advancements in Image Detection: A Comprehensive Approach to Object Localization and Classification using Deep Learning Techniques

Advancements in Image Detection: A Comprehensive Approach to Object Localization and Classification using Deep Learning Techniques