Image Techniques Research Articles

Deep Learning With Optical Coherence Tomography for Melanoma Identification and Risk Prediction.

Malignant melanoma is the most severe skin cancer with a rising incidence rate. Several noninvasive image techniques and computer-aided diagnosis systems have been developed to help find melanoma in its early stages. However, most previous research utilized dermoscopic images to build a diagnosis model, and only a few used prospective datasets. This study develops and evaluates a convolutional neural network (CNN) for melanoma identification and risk prediction using optical coherence tomography (OCT) imaging of mice skin. Longitudinal tests are performed on four animal models: melanoma mice, dysplastic nevus mice, and their respective controls. The CNN classifies melanoma and healthy tissues with high sensitivity (0.99) and specificity (0.98) and also assigns a risk score to each image based on the probability of melanoma presence, which may facilitate early diagnosis and management of melanoma in clinical settings.

A review on depth perception techniques in organoid images

Organoids are an in vitro model that can simulate the complex structure and function of tissues in vivo. Functions such as classification, screening and trajectory recognition have been realized through organoid image analysis, but there are still problems such as low accuracy in recognition classification and cell tracking. Deep learning algorithm and organoid image fusion analysis are the most advanced organoid image analysis methods. In this paper, the organoid image depth perception technology is investigated and sorted out, the organoid culture mechanism and its application concept in depth perception are introduced, and the key progress of four depth perception algorithms such as organoid image and classification recognition, pattern detection, image segmentation and dynamic tracking are reviewed respectively, and the performance advantages of different depth models are compared and analyzed. In addition, this paper also summarizes the depth perception technology of various organ images from the aspects of depth perception feature learning, model generalization and multiple evaluation parameters, and prospects the development trend of organoids based on deep learning methods in the future, so as to promote the application of depth perception technology in organoid images. It provides an important reference for the academic research and practical application in this field.

A comprehensive review on performance-based comparative analysis, categorization, classification and mapping of text extraction system techniques for images

A comprehensive review on performance-based comparative analysis, categorization, classification and mapping of text extraction system techniques for images

A systematic literature review on pancreas segmentation from traditional to non-supervised techniques in abdominal medical images

Abdominal organs play a significant role in regulating various functional systems. Any impairment in its functioning can lead to cancerous diseases. Diagnosing these diseases mainly relies on radiologists’ subjective assessment, which varies according to professional abilities and clinical experience. Computer-Aided Diagnosis (CAD) system is designed to assist clinicians in identifying various pathological changes. Hence, automatic pancreas segmentation is a vital input to the CAD system in the diagnosis of cancer at its early stages. Automatic segmentation is achieved through traditional methods like atlas-based and statistical models, and nowadays, it is achieved through artificial intelligence approaches like machine learning and deep learning using various imaging modalities. This study investigates and analyses the various state-of-the-art multi-organ and pancreas segmentation approaches to identify the research gaps and future perspectives for the research community. The objective is achieved by framing the research questions using the PICOC framework and then selecting 140 research articles using a systematic process through the Covidence tool to conclude the answers to the respective questions. The literature search has been conducted on five databases of original studies published from 2003 to 2023. Initially, the literature analysis is presented in terms of publication, and the comparative analysis of the current study is presented with existing review studies. Then, existing studies are analyzed, focusing on semi-automatic and automatic multi-organ segmentation and pancreas segmentation, using various learning methods. Finally, the various critical issues, the research gaps and the future perspectives of segmentation methods based on published evidence are summarized.

Detection and isolation of brain tumors in cancer patients using neural network techniques in MRI images

MRI imaging primarily focuses on the soft tissues of the human body, typically performed prior to a patient's transfer to the surgical suite for a medical procedure. However, utilizing MRI images for tumor diagnosis is a time-consuming process. To address these challenges, a new method for automatic brain tumor diagnosis was developed, employing a combination of image segmentation, feature extraction, and classification techniques to isolate the specific region of interest in an MRI image corresponding to a brain tumor. The proposed method in this study comprises five distinct steps. Firstly, image pre-processing is conducted, utilizing various filters to enhance image quality. Subsequently, image thresholding is applied to facilitate segmentation. Following segmentation, feature extraction is performed, analyzing morphological and structural properties of the images. Then, feature selection is carried out using principal component analysis (PCA). Finally, classification is performed using an artificial neural network (ANN). In total, 74 unique features were extracted from each image, resulting in a dataset of 144 observations. Principal component analysis was employed to select the top 8 most effective features. Artificial Neural Networks (ANNs) leverage comprehensive data and selective knowledge. Consequently, the proposed approach was evaluated and compared with alternative methods, resulting in significant improvements in precision, accuracy, and F1 score. The proposed method demonstrated notable increases in accuracy, with improvements of 99.3%, 97.3%, and 98.5% in accuracy, Sensitivity and F1 score. These findings highlight the efficiency of this approach in accurately segmenting and classifying MRI images.

A Cubical Persistent Homology-Based Technique for Image Denoising with Topological Feature Preservation

Image denoising is a fundamental challenge in image processing, where the objective is to remove noise while preserving critical image features. Traditional denoising methods, such as Wavelet, Total Variation (TV) minimization, and Non-Local Means (NLM), often struggle to maintain the topological integrity of image features, leading to the loss of essential structures. This study proposes a Cubical Persistent Homology-Based Technique (CPHBT) that leverages persistence barcodes to identify significant topological features and reduce noise. The method selects filtration levels that preserve important features like loops and connected components. Applied to digit images, our method demonstrates superior performance, achieving a Peak Signal-to-Noise Ratio (PSNR) of 46.88 and a Structural Similarity Index Measure (SSIM) of 0.99, outperforming TV (PSNR: 21.52, SSIM: 0.9812) and NLM (PSNR: 22.09, SSIM: 0.9822). These results confirm that cubical persistent homology offers an effective solution for image denoising by balancing noise reduction and preserving critical topological features, thus enhancing overall image quality.

Lipid imaging mass spectrometry: Towards a new molecular histology

Lipid research is attracting greater attention, as these molecules are key components to understand cell metabolism and the connection between genotype and phenotype. The study of lipids has also been fueled by the development of new and powerful technologies, able to identify an increasing number of species in a single run and at decreasing concentrations. One of such key developments has been the image techniques that enable the visualization of lipid distribution over a tissue with cell resolution. Thanks to the spatial information reported by such techniques, it is possible to associate a lipidome trait to individual cells, in fixed metabolic stages, which greatly facilitates understanding the metabolic changes associated to diverse pathological conditions, such as cancer. Furthermore, the image of lipids is becoming a kind of new molecular histology that has great chances to make an impact in the diagnostic units of the hospitals. Here, we examine the current state of the technology and analyze what the next steps to bring it into the diagnosis units should be. To illustrate the potential and challenges of this technology, we present a case study on clear cell renal cell carcinoma, a good model for analyzing malignant tumors due to their significant cellular and molecular heterogeneity.

Insights from tensile fracture properties and full-field strain evolution of deep coral reef limestone under dynamic loads

Coral reef limestone (CRL) commonly undergoes dynamic tension when underground structures of island reefs encounter impacts, explosions, or seismic activities. Given the complexity of biological pores, the dynamic tensile fracture characteristics of CRL are poorly understood. Therefore, the dynamic tensile fracture behaviors of deep CRL were systematically observed by Split Hopkinson Pressure Bar tests and digital image techniques. Comparing to traditional rocks, the macro-pores near failure band would significantly change cracking path. The failure patterns are dominated by loading rate. The strongly dependence of dynamic tensile strength and dynamic crack initiation toughness on loading rate suggests the two indices overcome the effect of CRL macro-pores under dynamic impacts. At low loading rates, tensile fractures predominantly follow intergranular cracks, whereas transgranular cracks dominate at higher rates. The fractal dimension of fracture surface decreases with increasing crack propagation velocity, loading rate, and dynamic crack initiation toughness. Due to the unique marine sedimentary environment, the mechanical heterogeneity in multiple scales distinguishes CRL from terrestrial rock materials. The insights into underlying mechanisms of dynamic tension provide support to optimization of blasting scheme and stability assessments for island underground engineering.

Research on improved underwater cable image processing technique based on CNN-GAN

In this study, we propose a CNN-GAN-based real-time processing technique for filtering images of underwater cables used in power systems. This addresses the excessive interference impurities that are frequently observed in images captured by remotely operated vehicles (ROVs). The process begins with the input of the original image into the convolutional neural network (CNN). Subsequently, the training outcomes, which serve as input parameters for the generative adversarial network (GAN), facilitate the filtering process. The system also calculates both the structural similarity index measure (SSIM) and peak signal-to-noise ratio (PSNR), performing model updates via backward propagation. This technique utilizes deep learning technologies to achieve rapid, real-time filtering of underwater cable images. The experimental results reveal that the loss function of the CNN reaches 0.16 with an accuracy of 97.5%, while the loss function of the adversarial GAN network approaches 0.05. Compared with traditional methods such as DDN, JORDOR, RESCAN, and PRENet, the proposed CNN-GAN algorithm exhibits superior performance, as evidenced by the higher PSNR and SSIM values. Specifically, for clear water images, the PSNR reaches 29.86 dB and the SSIM is 0.9045. For severely polluted images, the PSNR is 28.67 dB and the SSIM is 0.8965, while for unevenly illuminated images, the PSNR and SSIM values are 24.37 dB and 0.88, respectively. These enhancements significantly benefit the monitoring and maintenance of power systems.

Zero-shot image segmentation for monitoring thermal conditions of individual cage-free laying hens

Body temperature is a critical indicator of the health and productivity of egg-laying chickens and other domesticated animals. Recent advancements in thermography allow for precise surface temperature measurement without physical contact with animals, reducing animal stress from human handling. Gold standard temperature analysis via thermography requires manual selection of limited points for an object of interest, which could be time-consuming and inadequate for representing the comprehensive thermal profile of a chicken’s body. The objective of this study was to leverage and optimize a zero-shot artificial intelligence technology for the automatic segmentation of individual cage-free laying hens within thermal images, providing insights into their overall thermal conditions. A zero-shot image segmentation model (Segment Anything, “SAM”) was modified by replacing manual selections of target points with automatic selection of the initial point using pre-processing techniques (e.g., thresholding) in each thermal image. The model was also incorporated with post-processing techniques integrated with a machine learning classifier to improve segmentation accuracy. Three versions of modified SAM models (i.e., SAM, FastSAM, and MobileSAM), two common instance segmentation algorithms (i.e., YOLOv8 and Mask R-CNN), and two foundation segmentation models (i.e., U2-Net and ISNet) were comparatively evaluated to determine the optimal one for bird segmentation from thermal images. A total of 1,917 thermal images were collected from cage-free laying hens (Hy-Line W-36) at 77–80 weeks of age. The image dataset exhibited considerable variations such as feathers, bird movement, body gestures, and the specific conditions of cage-free facilities. The experimental results demonstrate that the modified SAM did not only surpass the six zero-shot models—YOLOv8, Mask R-CNN, FastSAM, MobileSAM, U2Net, and ISNet—but also outperformed other modified SAM-based models (Modified FastSAM and Modified MobileSAM) in terms of hen detection performance, achieving a success rate of 84.4 %, and in segmentation performance, with an intersection over union of 85.5 %, recall of 91.0 %, and an F1 score of 92.3 %. The optimal model, modified SAM, was pipelined to extract statistics including the averages (°C) of mean (27.03, 27.04, 28.53, 26.68), median (26.27, 26.84, 28.28, 26.78), 25th percentile (25.33, 25.61, 27.26, 25.53), and 75th percentile (28.04, 27.95, 29.22, 27.55) of surface body temperature of individual laying hens in thermal images for each week. More statistics of hen body surface temperature can be extracted based on the segmentation results. The developed pipeline is a useful tool for automatically evaluating the thermal conditions of individual birds.

Self-supervised learning for CT image denoising and reconstruction: a review.

This article reviews the self-supervised learning methods for CT image denoising and reconstruction. Currently, deep learning has become a dominant tool in medical imaging as well as computer vision. In particular, self-supervised learning approaches have attracted great attention as a technique for learning CT images without clean/noisy references. After briefly reviewing the fundamentals of CT image denoising and reconstruction, we examine the progress of deep learning in CT image denoising and reconstruction. Finally, we focus on the theoretical and methodological evolution of self-supervised learning for image denoising and reconstruction.

Automatic Segmentation of Hemorrhages in the Ultra-wide Field Retina: Multi-scale Attention Subtraction Networks and An Ultra-wide Field Retinal Hemorrhage Dataset.

Ultra-wide field (UWF) retinal imaging can improve the detection rate of retinal hemorrhage as compared with conventional fundus images. However, hemorrhages in UWF retinal images can also become smaller and more widely distributed, which can be time consuming and labor intensive. With the development of computer technology, automatic segmentation techniques can assist physicians in diagnosis. However, the lack of publicly available UWF retinal hemorrhage segmentation datasets has limited the development of automatic hemorrhage segmentation techniques in UWF retinal images. We present a large-scale high-quality UWF retinal hemorrhage segmentation dataset, named UWF-RHS Dataset, for public use. To the best of our knowledge, we are the first team to make the UWF retinal hemorrhage segmentation dataset publicly available. In addition, we propose a multi-scale attention subtraction network (MASNet) for UWF retinal hemorrhage segmentation. Specifically, highly focused lesion features are extracted by using the proposed multi-scale attention subtraction (MAS) module at the progress of the skip-connection. Several comparative experiments and ablation experiments were performed at the UWF-RHS Dataset, and all experiments state that our proposed method is effective in diagnosing retinal hemorrhages with state-of-the-art results. The proposed UWF-RHS dataset and MASNet will greatly facilitate the development of automated segmentation techniques for UWF retinal hemorrhages. Links to the UWF-RHS dataset and the MASNet model code are available fromhttps://github.com/wurenkai/UWF-RHS-Dataset-and-MASNet.

Flying foxes optimization with reinforcement learning for vehicle detection in UAV imagery

Intelligent transportation systems (ITS) are globally installed in smart cities, which enable the next generation of ITS depending on the potential integration of autonomous and connected vehicles. Both technologies are being tested widely in various cities across the world. However, these two developing technologies are vital in allowing a fully automatic transportation system; it is necessary to automate other transportation and road components. Unmanned aerial vehicles (UAVs) or drones are utilized for many surveillance applications in the ITS. Detecting on-ground vehicles in drone images is significant for disaster rescue operations, traffic and parking management, and navigating uneven territories. This study presents a flying foxes optimization with deep learning-based vehicle detection and classification model on aerial images (FFODL-VDCAI) technique for ITS application. The main objective of the FFODL-VDCAI technique is to automate and accurately classify vehicles that exist in aerial images. Three primary processes are involved in the presented FFODL-VDCAI technique. Initially, the FFODL-VDCAI approach utilizes YOLO-GD (Ghost-Net and Depthwise convolution) for vehicle detection, where the YOLO-GD uses lightweight Ghost Net in place on the backbone network of YOLO-v4 and interchanges the conventional convolutional with depthwise separable convolutional and pointwise convolutional. Next, the FFO technique is used for hyperparameter tuning the Ghost Net technique. Finally, a deep Q-network (DQN) based reinforcement learning technique is used to classify detected vehicles effectively. A comprehensive simulation analysis of the FFODL-VDCAI methodology is conducted on the UAV image dataset. The performance validation of the FFODL-VDCAI methodology exhibited superior values of 96.15% and 92.03% under PSU and Stanford datasets concerning various aspects.

Reviewing Approaches and Techniques for Detecting Suspicious Human Behavior: A Comprehensive Survey

The paper aims to review related works that focus on detecting suspicious human behavior using machine-learning techniques. Suspicious human behavior refers to behaviors that may indicate involvement in or preparation for a crime. Detecting such behaviors before a crime is committed allows law enforcement to take early action and prevent criminal activities. One of the challenges in developing an effective detection system for suspicious human behavior is the absence of a well-defined definition for such behaviors. Different definitions can lead to various methods for designing the detection system. The paper explores different definitions and their implications on the design of detection systems and mentions two types of methods that can be used for detecting suspicious human behavior: image-based methods and saliency mapping. Image-based methods utilize image or video recognition techniques to analyze objects held by individuals or recognize specific activities. Saliency mapping, on the other hand, focuses on emphasizing the movement of individuals using techniques like optical flow calculation to generate saliency maps. Additionally, the paper highlights the increasing popularity of embedded machine learning, particularly on portable platforms. The use of embedded machine learning allows for the deployment of machine learning models on mobile or lightweight devices. This can be relevant for developing efficient and portable systems for detecting suspicious human behavior. Overall, the paper aims to provide an overview of existing works in the field of suspicious human behavior detection using machine learning, exploring different definitions and methods employed in the literature.

Anisotropic sparse transformation for spectral CT image reconstruction

AbstractPhoton‐counting detector‐based computed tomography (PCD‐CT) is an advanced realization of spectral CT, the multi‐energy projection data is captured from the same object, hence, CT images can provide additional spectral resolution, making it possible to perform material decomposition. However, multiple projections may have a low signal‐to‐noise ratio (SNR), such that CT images suffer from noise. To handle this problem, a spectral CT image reconstruction method based on anisotropic sparse transformation (AST) is proposed. To increase the quality of reconstruction, AST through an anisotropic guided filter (AGF) and quasi norm is proposed. Then, as a new regularization, AST is introduced into an iterative reconstruction process, generating an AST‐based method. Moreover, to utilize the correlation among projection data, the average image serves as the guidance image of AGF, it varies with the iterative index, resulting in a technique of dynamic average image (DAI). The AST‐based model involves quasi norm minimization, hence an effective strategy is employed to solve the corresponding problem. A series of experiments were performed. The experiment showed that, compared to other listed methods, the result of the AST‐based method can achieve better visualization and higher quantitative indexes, hence it has application potential in the medical imaging field.

The application status of sequencing technology in global respiratory infectious disease diagnosis.

Next-generation sequencing (NGS) has revolutionized clinical microbiology, particularly in diagnosing respiratory infectious diseases and conducting epidemiological investigations. This narrative review summarizes conventional methods for routine respiratory infection diagnosis, including culture, smear microscopy, immunological assays, image techniques as well as polymerase chain reaction(PCR). In contrast to conventional methods, there is a new detection technology, sequencing technology, and here we mainly focus on the next-generation sequencing NGS, especially metagenomic NGS(mNGS). NGS offers significant advantages over traditional methods. Firstly, mNGS eliminates assumptions about pathogens, leading to faster and more accurate results, thus reducing diagnostic time. Secondly, it allows unbiased identification of known and novel pathogens, offering broad-spectrum coverage. Thirdly, mNGS not only identifies pathogens but also characterizes microbiomes, analyzes human host responses, and detects resistance genes and virulence factors. It can complement targeted sequencing for bacterial and fungal classification. Unlike traditional methods affected by antibiotics, mNGS is less influenced due to the extended survival of pathogen DNA in plasma, broadening its applicability. However, barriers to full integration into clinical practice persist, primarily due to cost constraints and limitations in sensitivity and turnaround time. Despite these challenges, ongoing advancements aim to improve cost-effectiveness and efficiency, making NGS a cornerstone technology for global respiratory infection diagnosis.

Few-shot Learning using Data Augmentation: A Literature Review

This paper examines few-shot learning, a machine-learning approach that allows models to generalize well with scarce labeled data. It overviews few-shot learning concepts and reviews data augmentation techniques tailored for this scenario. It evaluates these image and object recognition techniques and discusses their benefits and limitations. An experimental setup is described, with selected datasets and metrics to assess the augmentation strategies. Baseline models are analyzed, and the comparative results are presented, identifying key trends and areas for further research in few-shot learning.

A Review of Medical Image Registration for Different Modalities.

Medical image registration has become pivotal in recent years with the integration of various imaging modalities like X-ray, ultrasound, MRI, and CT scans, enabling comprehensive analysis and diagnosis of biological structures. This paper provides a comprehensive review of registration techniques for medical images, with an in-depth focus on 2D-2D image registration methods. While 3D registration is briefly touched upon, the primary emphasis remains on 2D techniques and their applications. This review covers registration techniques for diverse modalities, including unimodal, multimodal, interpatient, and intra-patient. The paper explores the challenges encountered in medical image registration, including geometric distortion, differences in image properties, outliers, and optimization convergence, and discusses their impact on registration accuracy and reliability. Strategies for addressing these challenges are highlighted, emphasizing the need for continual innovation and refinement of techniques to enhance the accuracy and reliability of medical image registration systems. The paper concludes by emphasizing the importance of accurate medical image registration in improving diagnosis.

Rare-earth nanocrystalline scintillators for biomedical application: A review

Rare-earth scintillating materials have been widely utilized in nuclear image technique, security screening and high energy physics research. Researchers have devoted extensive efforts to size design, surface modification, and drug assembly to transform them into prospective nanomaterials for diagnostics and cancer treatment. This review endeavors to summarize the advanced preparation technology and design concept of rare-earth nanocrystalline scintillators (RENSs), and offers fundamental guidance for the application of various materials in biomedical research. Specifically, it focuses on RENSs with excellent biocompatibility, outstanding stability, uniform size distribution, and strong drug loading capacity to meet subsequent practical applications. Additionally, this review reports on the application of RENSs in the biomedical field. Specifically, bioimaging and antitumor therapy are the most prevalently utilized and promising areas. X-ray excited optical imaging (XEOL) is combined with advanced imaging techniques (CT, MRI, etc.) to obtain comprehensive information about deep tissue. The combination of X-ray radiation therapy and photodynamic therapy technology can realize safe anti-tumor therapy under the condition of low-dose irradiation. Furthermore, this review also enumerates several recent highlight research strategies and the prospects of RENSs in the biomedical application in the future.

Method for evaluation of geological strength index of carbonate cliff rocks: Coupled hyperspectral-digital borehole image technique

The deterioration of unstable rock mass raised interest in evaluating rock mass quality. However, the traditional evaluation method for the geological strength index (GSI) primarily emphasizes the rock structure and characteristics of discontinuities. It ignores the influence of mineral composition and shows a deficiency in assessing the integrity coefficient. In this context, hyperspectral imaging and digital panoramic borehole camera technologies are applied to analyze the mineral content and integrity of rock mass. Based on the carbonate mineral content and fissure area ratio, the strength reduction factor and integrity coefficient are calculated to improve the GSI evaluation method. According to the results of mineral classification and fissure identification, the strength reduction factor and integrity coefficient increase with the depth of rock mass. The rock mass GSI calculated by the improved method is mainly concentrated between 40 and 60, which is close to the calculation results of the traditional method. The GSI error rates obtained by the two methods are mostly less than 10%, indicating the rationality of the hyperspectral-digital borehole image coupled evaluation method. Moreover, the sensitivity of the fissure area ratio (Sr) to GSI is greater than that of the strength reduction factor (α), which means the proposed GSI is suitable for rocks with significant fissure development. The improved method reduces the influence of subjective factors and provides a reliable index for the deterioration evaluation of rock mass.