Image Feature Extraction Method Research Articles

Breast density prediction from low and standard dose mammograms using deep learning: effect of image resolution and model training approach on prediction quality

Purpose. To improve breast cancer risk prediction for young women, we have developed deep learning methods to estimate mammographic density from low dose mammograms taken at approximately 1/10th of the usual dose. We investigate the quality and reliability of the density scores produced on low dose mammograms focussing on how image resolution and levels of training affect the low dose predictions. Methods. Deep learning models are developed and tested, with two feature extraction methods and an end-to-end trained method, on five different resolutions of 15,290 standard dose and simulated low dose mammograms with known labels. The models are further tested on a dataset with 296 matching standard and real low dose images allowing performance on the low dose images to be ascertained. Results. Prediction quality on standard and simulated low dose images compared to labels is similar for all equivalent model training and image resolution versions. Increasing resolution results in improved performance of both feature extraction methods for standard and simulated low dose images, while the trained models show high performance across the resolutions. For the trained models the Spearman rank correlation coefficient between predictions of standard and low dose images at low resolution is 0.951 (0.937 to 0.960) and at the highest resolution 0.956 (0.942 to 0.965). If pairs of model predictions are averaged, similarity increases. Conclusions. Deep learning mammographic density predictions on low dose mammograms are highly correlated with standard dose equivalents for feature extraction and end-to-end approaches across multiple image resolutions. Deep learning models can reliably make high quality mammographic density predictions on low dose mammograms.

An Image Feature Extraction Algorithm Based on Tissue P System

As digital images continue to generate an increasing amount of data, image feature extraction has become a crucial component of image recognition. This paper proposes an image feature extraction method based on membrane computing to extract image features. The author first uses the rotation invariant local phase quantization (RILPQ) to extract image features and combines the tissue P system with the binary particle swarm optimization (MBPSO) to select the best image features and maximize the classification accuracy. Based on 4 public datasets, 28 datasets are newly constructed, and the proposed method is verified on 28 datasets. Specifically, firstly, local binary pattern (LBP) algorithm and RILPQ are used to extract image features, and then MBPSO, binary particle swarm optimization (BPSO), genetic algorithm (GA) and membrane genetic algorithm (MGA) are used to select the optimal features. The experimental results demonstrate that our proposed image feature extraction method achieves high classification accuracy, stability, and convergence.

A Review of Image and Text Feature Extraction Methods in Fake News Detection Tasks

A Review of Image and Text Feature Extraction Methods in Fake News Detection Tasks

Enhanced Diagnostics Based on Deep Learning for Varicose Vein Detection

Varicose veins, a prevalent vascular condition affecting a significant portion of the population, necessitate early detection for optimal intervention and improved patient outcomes. This study introduces a novel diagnostic approach for varicose vein detection, leveraging the capabilities of deep learning. Varicose veins represent a prevalent vascular condition that can lead to discomfort and complications if not identified and treated promptly. This research introduces an advanced diagnostic methodology for varicose vein detection, utilizing deep learning techniques. Our approach harnesses the capabilities of deep neural networks, specifically employing a convolution neural network (CNN) architecture. Trained on a diverse dataset of vascular images, the model demonstrates a high proficiency in identifying varicose veins by capturing nuanced patterns and subtle features. Fine-tuning through transfer learning ensures adaptability to variations in patient demographics and imaging conditions. To enhance diagnostic precision, our system incorporates advanced image processing techniques and feature extraction methods. The integration of image segmentation algorithms and anatomical feature analysis provides detailed insights into the extent and severity of varicose veins. Furthermore, the model is designed to accommodate multi-modal imaging data, incorporating information from various imaging modalities to enhance diagnostic accuracy. Validation of our approach is conducted on a comprehensive dataset encompassing a spectrum of varicose vein cases, including varying degrees of severity. The results underscore the superior performance of our deep learning-based diagnostic system, achieving notable sensitivity and specificity in varicose vein detection. This proposed enhanced diagnostic tool holds promise for healthcare professionals, streamlining the diagnostic process and facilitating early and accurate identification of varicose veins. The potential implications include improved patient outcomes through timely intervention and the development of personalized treatment strategies. As we continue refining and expanding our model, its integration into clinical practice could contribute to a more efficient and effective management of varicose vein disorders.

Enhancing Rice Crop Resilience: Leveraging Image Processing Techniques in Deep Learning Models to Predict Salinity Stress of Rice during the Seedling Stage

One of the most significant staple crops in the world is rice. Rice seedlings are particularly susceptible to salt stress during the seedling stage, which can negatively affect crop quality and yield. Traditional approaches for assessing the susceptibility of rice crops to salt stress during the seedling stage are deemed inadequate and time consuming. The study emphasizes the necessity of employing a deep learning model instead of traditional methods to identify and classify salinity stress in rice seedlings using field images. To predict salinity stress in rice crops, this research examines the significance of image processing methods employed in deep learning models. To enhance the clarity and visual representation of salinity-induced stress symptoms, we explore several image enhancement techniques, such as noise reduction, contrast augmentation, and image normalization. To further capture and quantify the distinct visual features related to salinity stress, feature extraction techniques such as texture analysis, shape analysis, and color-based segmentation are used. We employ a deep learning model such as VGG16 and VGG19 models to use these extracted features as input to effectively classify the severity of salinity stress in rice seedlings as 1,3,5,7,9 scores. A comprehensive set of rice seedling images from field taken under various salinity stress conditions is used to assess the suggested method. The effectiveness of image processing techniques in improving the discriminatory power of deep learning models for salinity stress prediction is demonstrated by experimental results with 99.40%. The combination of image enhancement and feature extraction methods significantly improves the overall accuracy and reliability of the predictions, enabling farmers to make informed decisions regarding crop management and potential interventions to mitigate salinity stress.

ALIKE-APPLE: A Lightweight Method for the Detection and Description of Minute and Similar Feature Points in Apples

Current image feature extraction methods fail to adapt to the fine features of apple image texture, resulting in image matching errors and degraded image processing accuracy. A multi-view orthogonal image acquisition system was constructed with apples as the research object. The system consists of four industrial cameras placed around the apple at different angles and one camera placed on top. Following the image acquisition through the system, synthetic image pairs—both before and after transformation—were generated as the input dataset. This generation process involved each image being subjected to random transformations. Through learning to extract more distinctive and descriptive features, the deep learning-based keypoint detection method surpasses traditional techniques by broadening the application range and enhancing detection accuracy. Therefore, a lightweight network called ALIKE-APPLE was proposed for surface feature point detection. The baseline model for ALIKE-APPLE is ALIKE, upon which improvements have been made to the image feature encoder and feature aggregation modules. It comprises an Improved Convolutional Attention Module (ICBAM) and a Boosting Resolution Sampling Module (BRSM). The proposed ICBAM replaced max pooling in the original image feature encoder for downsampling. It enhanced the feature fusion capability of the model by utilizing spatial contextual information and learning region associations in the image. The proposed BRSM replaced the bilinear interpolation in the original feature aggregator for upsampling, overcoming the apple side image’s geometric distortion and effectively preserving the texture details and edge information. The model size was shrunk by optimizing the number of downsampling operations from the image encoder of the original model. The experimental results showed that the average number of observed keypoints and the average matching accuracy were improved by 166.41% and 37.07%, respectively, compared with the baseline model. The feature detection model of ALIKE-APPLE was found to perform better than the optimal SuperPoint. The feature point distribution of ALIKE-APPLE showed an improvement of 10.29% in average standard deviation (Std), 8.62% in average coefficient of variation (CV), and 156.12% in average feature point density (AFPD). Moreover, the mean matching accuracy (MMA) of ALIKE-APPLE improved by 125.97%. Thus, ALIKE-APPLE boasts a more consistent allocation of feature points and greater precision in matching.

Between neurons and networks: investigating mesoscale brain connectivity in neurological and psychiatric disorders.

The study of brain connectivity has been a cornerstone in understanding the complexities of neurological and psychiatric disorders. It has provided invaluable insights into the functional architecture of the brain and how it is perturbed in disorders. However, a persistent challenge has been achieving the proper spatial resolution, and developing computational algorithms to address biological questions at the multi-cellular level, a scale often referred to as the mesoscale. Historically, neuroimaging studies of brain connectivity have predominantly focused on the macroscale, providing insights into inter-regional brain connections but often falling short of resolving the intricacies of neural circuitry at the cellular or mesoscale level. This limitation has hindered our ability to fully comprehend the underlying mechanisms of neurological and psychiatric disorders and to develop targeted interventions. In light of this issue, our review manuscript seeks to bridge this critical gap by delving into the domain of mesoscale neuroimaging. We aim to provide a comprehensive overview of conditions affected by aberrant neural connections, image acquisition techniques, feature extraction, and data analysis methods that are specifically tailored to the mesoscale. We further delineate the potential of brain connectivity research to elucidate complex biological questions, with a particular focus on schizophrenia and epilepsy. This review encompasses topics such as dendritic spine quantification, single neuron morphology, and brain region connectivity. We aim to showcase the applicability and significance of mesoscale neuroimaging techniques in the field of neuroscience, highlighting their potential for gaining insights into the complexities of neurological and psychiatric disorders.

Headland Identification and Ranging Method for Autonomous Agricultural Machines

Headland boundary identification and ranging are the key supporting technologies for the automatic driving of intelligent agricultural machinery, and they are also the basis for controlling operational behaviors such as autonomous turning and machine lifting. The complex, unstructured environments of farmland headlands render traditional image feature extraction methods less accurate and adaptable. This study utilizes deep learning and binocular vision technologies to develop a headland boundary identification and ranging system built upon the existing automatic guided tractor test platform. A headland image annotation dataset was constructed, and the MobileNetV3 network, notable for its compact model structure, was employed to achieve binary classification recognition of farmland and headland images. An improved MV3-DeeplabV3+ image segmentation network model, leveraging an attention mechanism, was constructed, achieving a high mean intersection over union (MIoU) value of 92.08% and enabling fast and accurate detection of headland boundaries. Following the detection of headland boundaries, binocular stereo vision technology was employed to measure the boundary distances. Field experiment results indicate that the system’s average relative errors of distance in ranging at distances of 25 m, 20 m, and 15 m are 6.72%, 4.80%, and 4.35%, respectively. This system is capable of meeting the real-time detection requirements for headland boundaries.

Image Recognition for Fruit-Picking Robots

This summary presents the solutions to the five questions posed in the competition regarding apple image recognition. The objective is to establish a robust apple image recognition model that accurately counts the number of apples, estimates their positions, determines their maturity state, calculates their masses, and recognizes them based on provided image datasets. The specific answers to each question are as follows: Using the image dataset of harvest-ready apples provided in Attachment 1, an image feature extraction method is employed to establish a mathematical model for counting the number of apples in each image. The distribution of all apples in Attachment 1 is then depicted in a histogram. The precise number of apples in each image is determined, enabling a comprehensive understanding of the dataset. Utilizing the image dataset of harvest-ready apples provided in Attachment 1, the positions of the apples in each image are identified. The left bottom corner of the image serves as the coordinate origin, and a two-dimensional scatter diagram is created, illustrating the geometric coordinates of all apples in Attachment 1. This analysis facilitates the visualization of the spatial distribution of apples within the dataset. Based on the image dataset of harvest-ready apples provided in Attachment 1, a mathematical model is developed to assess the maturity state of apples in each image. By applying this model, a histogram is generated, illustrating the distribution of maturity levels across all apples in Attachment 1. This analysis provides insights into the overall maturity status of the dataset.

Survey of multilevel feature extraction methods for RGB-D images

Survey of multilevel feature extraction methods for RGB-D images

The Use of Visual Communication Technology in the Cultural Connotation and Design Expression of Traditional Cultural and Creative Products

Abstract Traditional cultural and creative products need to be combined with cultural connotations on the basis of traditional cultural products, and modern visual communication design laws and design theories are used as the methods to broaden the product display medium and extend the product value. In this paper, we first sort out the cultural connotation of cultural and creative products and the design and development motives and explore the specific implementation path of cultural and creative product design based on visual communication design. Secondly, it studies the extraction of visual elements of traditional cultural and creative product patterns by the SURF image feature extraction method. Firstly, it realizes the acquisition of styling visual elements by the Canny operator in the edge detection algorithm. Then it acquires accurate color visual elements based on the K-Means primary color extraction algorithm improved by the contour coefficient method. In the traditional cultural and creative product design examples, it is found that the average Dice conventional culture coefficient image extraction based on the SURF method is 0.731, and the structural similarity of primary color extraction reaches 0.792 with the original image of traditional culture. Traditional cultural and creative products have a comprehensive evaluation score of between 4.3 and 4.5, which indicates high satisfaction. Carrying out the design of conventional cultural and creative products with visual communication design, its central performance is in visual attractiveness and formal innovativeness in order to burst the vitality of traditional cultural and creative products.

IMAGE FEATURE EXTRACTION METHODS FOR STRUCTURE DETECTION FROM UNDERWATER IMAGERY

Abstract. The use of autonomous underwater vehicles (AUVs) for surveying underwater infrastructure presents a potential cost saving in comparison to remotely operated vehicles (ROVs). One of the challenges when processing images of underwater structures captured by an AUV, is that vast number of images captured during the mission usually do not show the structure. For instance, images captured during the dive to the structure or of the sea floor, or of the deep sea facing away from the structure. Too many images captured, without relevant information for a 3D reconstruction of the structure, leads to increased processing time and issues during the reconstruction process. There are two solutions to reduce the images to only images showing the structure. Firstly, only images of the structure are captured in the first place or remove images that are not useful after the capture and before further processing. This study developed and evaluated techniques that would enable the first strategy to be applied in an AUV. To apply this strategy in an AUV, would require an on-board structure detection system to ensure that they are correctly orientated for capturing useful footage during a survey mission. However, the marine environment poses several challenges to image-based object detection. Furthermore, small AUVs have limited power and computational resources available while deployed on a mission. To investigate the suitability of creating a lightweight structure detection model for the purpose of image evaluation, three computationally efficient image feature extraction methods (colour moments, local binary patterns (LBP), and Haar wavelet decomposition) were evaluated for their ability to distinguish underwater structures from background areas using unsupervised k-means models. LBP was found to be an effective method for identifying underwater structures in open water conditions. For identifying a structure against the seabed, colour moments were identified as the most effective method.

Adaptive feature extraction method for capsule endoscopy images

The traditional feature-extraction method of oriented FAST and rotated BRIEF (ORB) detects image features based on a fixed threshold; however, ORB descriptors do not distinguish features well in capsule endoscopy images. Therefore, a new feature detector that uses a new method for setting thresholds, called the adaptive threshold FAST and FREAK in capsule endoscopy images (AFFCEI), is proposed. This method, first constructs an image pyramid and then calculates the thresholds of pixels based on the gray value contrast of all pixels in the local neighborhood of the image, to achieve adaptive image feature extraction in each layer of the pyramid. Subsequently, the features are expressed by the FREAK descriptor, which can enhance the discrimination of the features extracted from the stomach image. Finally, a refined matching is obtained by applying the grid-based motion statistics algorithm to the result of Hamming distance, whereby mismatches are rejected using the RANSAC algorithm. Compared with the ASIFT method, which previously had the best performance, the average running time of AFFCEI was 4/5 that of ASIFT, and the average matching score improved by 5% when tracking features in a moving capsule endoscope.

Highway Visibility Estimation in Foggy Weather via Multi-Scale Fusion Network.

Poor visibility has a significant impact on road safety and can even lead to traffic accidents. The traditional means of visibility monitoring no longer meet the current needs in terms of temporal and spatial accuracy. In this work, we propose a novel deep network architecture for estimating the visibility directly from highway surveillance images. Specifically, we employ several image feature extraction methods to extract detailed structural, spectral, and scene depth features from the images. Next, we design a multi-scale fusion network to adaptively extract and fuse vital features for the purpose of estimating visibility. Furthermore, we create a real-scene dataset for model learning and performance evaluation. Our experiments demonstrate the superiority of our proposed method to the existing methods.

Skinophile: The Art Of Skincare Selection With Haar Wavelet

In this study, a mobile application has been developed with the primary objective of classifying facial skin types to facilitate the selection of appropriate skincare products tailored to individual skin needs. The motivation behind this research stems from the widespread issue of individuals being unaware of their specific skin types, which often leads to suboptimal skincare routines and, in some cases, adverse effects such as skin dullness and damage. To address this challenge, a comprehensive problem-solving approach has been adopted. The methodology encompasses the utilization of the Haar Wavelets method for facial image feature extraction, complemented by the application of the Support Vector Machine (SVM) algorithm for precise skin type classification. Face Recognition technology has also been integrated to enhance the accuracy and reliability of the classification process.In terms of system development, an Agile methodology has been employed, facilitating swift and cost-effective project completion. This agile approach ensures the development process is efficient, reducing both time and financial resources.The mobile application developed for this purpose utilizes the Python programming language, specifically incorporating the PyWavelets library. The culmination of this research effort is a user-friendly mobile application that enables users to capture their facial images. Subsequently, the application employs advanced algorithms to identify their specific skin type, providing personalized recommendations for suitable skincare products and routines. This innovative solution aims to empower individuals with the knowledge and tools necessary to enhance the effectiveness of their skincare regimen, ultimately promoting healthier and more radiant skin.

Review of Object Detection Algorithms for Sonar Images based on Deep Learning

Background: Deep learning object detection algorithm is widely used in the field of image classification and has become an indispensable part. With the improvement of image classification accuracy, sonar image target detection algorithm based on deep learning has gradually become the focus of more and more people's research. Objective: This article aims to provide a summary and analysis of deep learning-based sonar image object detection algorithms, with the hope of offering insights for future research in the field of sonar target detection technology. Method: This paper systematically summarizes sonar image target detection algorithms based on deep learning. According to the method principle, the existing deep learning target detection algorithms are divided into four categories: target detection algorithm based on candidate region, deep target detection method based on regression, Anchor Free deep learning target detection algorithm, and search-based target detection and recognition algorithm. Then, the performance of algorithms based on COCO data sets is compared, and the standard sonar data sets and formats are introduced. Results: The sonar image object detection algorithm based on deep learning has made significant progress. The combination of deep learning and object detection methods has been applied to sonar images, resulting in the emergence of excellent performing algorithms. However, most algorithms are still in the developmental stage and face challenges in practical applications. Subsequently, several invention patents have been developed based on the aforementioned algorithms, including a feature extraction method for side-scan sonar images based on fully convolutional neural networks, an underwater sonar image target detection method based on improved YOLOv3-tiny, and more. Conclusion: Sonar image object detection technology based on deep learning has a wide range of application needs but also faces many difficulties and challenges, we still need to continue to learn and explore in future research, and we believe that we can make greater breakthroughs in the future.

Forward stagewise regression with multilevel memristor for sparse coding

Sparse coding is a prevalent method for image inpainting and feature extraction, which can repair corrupted images or improve data processing efficiency, and has numerous applications in computer vision and signal processing. Recently, several memristor-based in-memory computing systems have been proposed to enhance the efficiency of sparse coding remarkably. However, the variations and low precision of the devices will deteriorate the dictionary, causing inevitable degradation in the accuracy and reliability of the application. In this work, a digital-analog hybrid memristive sparse coding system is proposed utilizing a multilevel Pt/Al2O3/AlOx/W memristor, which employs the forward stagewise regression algorithm: The approximate cosine distance calculation is conducted in the analog part to speed up the computation, followed by high-precision coefficient updates performed in the digital portion. We determine that four states of the aforementioned memristor are sufficient for the processing of natural images. Furthermore, through dynamic adjustment of the mapping ratio, the precision requirement for the digit-to-analog converters can be reduced to 4 bits. Compared to the previous system, our system achieves higher image reconstruction quality of the 38 dB peak-signal-to-noise ratio. Moreover, in the context of image inpainting, images containing 50% missing pixels can be restored with a reconstruction error of 0.0424 root-mean-squared error.

Algorithm and simulation study of oil painting classification based on visual perception and improved embedded learning

This paper presents an in-depth study and analysis of oil painting classification and simulation using an improved embedded learning fusion vision perception algorithm. This paper analyzes and models the image quality evaluation problem by simulating the human visual system and extracting quality perception features as the main entry point to improve the prediction accuracy of the overall algorithm. This paper proposes a multi-classification method of CCNN, which uses the similarity measure based on information first to achieve multi-classification of artwork styles and artists, and this part is the main part of this paper. This paper uses the wiki art repository to construct a dataset of oil paintings, including over 2000 works by 20 artists in 13 styles. CNN achieves an accuracy of 85.75% on the artist classification task, which is far more effective than traditional deep learning networks such as Resnet. Finally, we use the network model of this paper and other network models to train the classification of 3, 4, and 6 categories of art images. The accuracy of art image classification by this paper’s algorithm is higher than that of the current mainstream convolutional neural network models, and the extracted features are more comprehensive and more accurate than traditional art image feature extraction methods, which do not rely on researchers to extract image features. Experiments show that the proposed method can achieve excellent prediction accuracy for both synthetic distorted images and distorted images.

Superpixel-Based Style Transfer Method for Single-Temporal Remote Sensing Image Identification in Forest Type Groups

Forests are the most important carbon reservoirs on land, and forest carbon sinks can effectively reduce atmospheric CO2 concentrations and mitigate climate change. In recent years, various satellites have been launched that provide opportunities for identifying forest types with low cost and high time efficiency. Using multi-temporal remote sensing images and combining them with vegetation indices takes into account the vegetation growth pattern and substantially improves the identification accuracy, but it has high requirements for imaging, such as registration, multiple times, etc. Sometimes, it is difficult to satisfy, the plateau area is severely limited by the influence of clouds and rain, and Gaofen (GF) data require more control points for orthophoto correction. The study area was chosen to be Huize County, situated in Qujing City of Yunnan Province, China. The analysis was using the GF and Landsat images. According to deep learning and remote sensing image feature extraction methods, the semantic segmentation method of F-Pix2Pix was proposed, and the domain adaptation method according to transfer learning effectively solved the class imbalance in needleleaf/broadleaf forest identification. The results showed that (1) this method had the best performance and a higher accuracy than the existing products, 21.48% in non-forest/forest and 29.44% in needleleaf/broadleaf forest for MIoU improvement. (2) Applying transfer learning domain adaptation to semantic segmentation showed significant benefits, and this approach utilized satellite images of different resolutions to solve the class imbalance problem. (3) It can be used for long-term monitoring of multiple images and has strong generalization. The identification of needleleaf and broadleaf forests combined with the actual geographical characteristics of the forest provides a foundation for the accurate estimation of regional carbon sources/sinks.

Image segmentation and feature extraction method for lung lesion detection in computed tomography images

Lung cancer is a form of cancer that causes uncontrollable cell growth in the lungs. Patients with lung cancer frequently miss a treatment, face higher health care costs, and get the worst outcomes. The detection of the existence of lung cancer can be performed in a variety of ways, such as computed tomography (CT), magnetic resonance imaging (MRI), and radiography. Many researchers have developed ways of automating lung cancer diagnosis using image processing techniques because of the noise and low image quality between the cancer cells, the lung, and the background. This study develops an image processing technique that uses image segmentation algorithms to segment lung nodules in computed tomography images using feature extraction. In the initial phase, it is essential to establish a rigorous image processing framework with the following sequential steps: (i) object edge identification and (ii) lesion boundary recognition. The architecture includes image processing techniques, thresholding, and morphological detections (erosion and dilation). Lesions can have various sizes and shapes, both regular and irregular. The new method has been applied to find the lesions using their roundness size. In addition to learning purely from CT scans, the previously studied lesion characteristics are also integrated. Data was collected from the Advanced Medical and Dental Institute (AMDI), Universiti Sains Malaysia, Penang. The manual segmentation was used image segmented in the MATLAB software function to remove the background of the images. The perimeter evaluates such as accuracy, recall, and F-score. Based on the analysis the performance of lung lesion segmentation of accuracy is 99.95, recall at 45.76%, and the F-score is 60.67%. For lung lesion detection, the results shows it consist of 3-5 slices with the value of roundness. Besides, lesion detection also have continuity for the roundness value. The experiment results found clear support for the next step of this research for classifications of lesions.