Image Features Research Articles

Prediction of benign and malignant ground glass pulmonary nodules based on multi-feature fusion of attention mechanism.

The purpose of this study was to develop and validate a new feature fusion algorithm to improve the classification performance of benign and malignant ground-glass nodules (GGNs) based on deep learning. We retrospectively collected 385 cases of GGNs confirmed by surgical pathology from three hospitals. We utilized 239 GGNs from Hospital 1 as the training and internal validation set, and 115 and 31 GGNs from Hospital 2 and Hospital 3, respectively, as external test sets 1 and 2. Among these GGNs, 172 were benign and 203 were malignant. First, we evaluated clinical and morphological features of GGNs at baseline chest CT and simultaneously extracted whole-lung radiomics features. Then, deep convolutional neural networks (CNNs) and backpropagation neural networks (BPNNs) were applied to extract deep features from whole-lung CT images, clinical, morphological features, and whole-lung radiomics features separately. Finally, we integrated these four types of deep features using an attention mechanism. Multiple metrics were employed to evaluate the predictive performance of the model. The deep learning model integrating clinical, morphological, radiomics and whole lung CT image features with attention mechanism (CMRI-AM) achieved the best performance, with area under the curve (AUC) values of 0.941 (95% CI: 0.898-0.972), 0.861 (95% CI: 0.823-0.882), and 0.906 (95% CI: 0.878-0.932) on the internal validation set, external test set 1, and external test set 2, respectively. The AUC differences between the CMRI-AM model and other feature combination models were statistically significant in all three groups (all p<0.05). Our experimental results demonstrated that (1) applying attention mechanism to fuse whole-lung CT images, radiomics features, clinical, and morphological features is feasible, (2) clinical, morphological, and radiomics features provide supplementary information for the classification of benign and malignant GGNs based on CT images, and (3) utilizing baseline whole-lung CT features to predict the benign and malignant of GGNs is an effective method. Therefore, optimizing the fusion of baseline whole-lung CT features can effectively improve the classification performance of GGNs.

Optimizing Plant Disease Classification with Hybrid Convolutional Neural Network–Recurrent Neural Network and Liquid Time-Constant Network

This paper addresses the practical challenge of detecting tomato plant diseases using a hybrid lightweight model that combines a Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN). Traditional image classification models demand substantial computational resources, limiting their practicality. This study aimed to develop a model that can be easily implemented on low-cost IoT devices while maintaining high accuracy with real-world images. The methodology leverages a CNN for extracting high-level image features and an RNN for capturing temporal relationships, thereby enhancing model performance. The proposed model incorporates a Closed-form Continuous-time Neural Network, a lightweight variant of liquid time-constant networks, and integrates Neural Circuit Policy to capture long-term dependencies in image patterns, reducing overfitting. Augmentation techniques such as random rotation and brightness adjustments were applied to the training data to improve generalization. The results demonstrate that the hybrid models outperform their single pre-trained CNN counterparts in both accuracy and computational cost, achieving a 97.15% accuracy on the test set with the proposed model, compared to around 94% for state-of-the-art pre-trained models. This study provides evidence of the effectiveness of hybrid CNN-RNN models in improving accuracy without increasing computational cost and highlights the potential of liquid neural networks in such applications.

Bearing fault diagnosis based on enhanced Canberra distance feature in SDP image

Abstract Feature enhancement is important in mechanical equipment fault diagnosis. A limited set of characteristic parameters is insufficient for diagnosing bearing signals with multiple fault types. The presence of noise increases the difficulty of extracting fault features from images. To address the challenge of diagnosing rolling bearing faults in complex environments, this study presents an enhanced weighted image fusion framework aimed at enhancing fault features within the images, which enables accurate diagnosis of bearing faults using a limited number of features. The proposed method encompasses four distinct stages. In the first stage, a symmetrized dot pattern method is employed to transform one-dimensional time-series data into two-dimensional images, visualizing the signal in a 2D format. In the second stage, image binarization and an improved weighted fusion method are utilized to simplify subsequent processing and enhance the image features. The third stage involves extracting the image’s contrast and maximum singular value to improve the Canberra distance calculation. Finally, the enhanced Canberra distance is used for classifying bearing faults. Performance testing of the image feature enhancement is conducted on various datasets containing rolling bearings. Comparative experiments with alternative enhancement methods demonstrate the superiority of the proposed improved weighted image fusion framework. Comparative experiments with the original Canberra distance validate the effectiveness of the enhanced Canberra distance. Additionally, experiments conducted in noisy environments confirm the robustness of the proposed approach. Furthermore, the image feature enhancement method is applied to other bearing datasets, and the experimental results demonstrate its effectiveness in enhancing fault feature representation and achieving accurate diagnosis of rolling bearings.

Accuracy and efficiency of 2D/3D single-vertebra spine navigation registration method based on dual-view feature fusion

Objective: To investigate the accuracy and efficiency of spine 2D/3D preoperative CT and intraoperative X-ray registration through a framework for spine 2D/3D single-vertebra navigation registration based on the fusion of dual-position image features. Methods: The preoperative CT and intraoperative anteroposterior (AP) and lateral (LAT) X-ray images of 140 lumbar spine patients who visited Huashan Hospital Affiliated to Fudan University from January 2020 to December 2023 were selected. In order to achieve rapid and high-precision single vertebra registration in clinical orthopedic surgery, a designed transformation parameter feature extraction module combined with a lightweight module of channel and spatial attention (CBAM) was used to accurately extract the local single vertebra image transformation information. Subsequently, the fusion regression module was used to complement the features of the anterior posterior (AP) and lateral (LAT) images to improve the accuracy of the registration parameter regression. Two 1×1 convolutions were used to reduce the parameter calculation amount, improve computational efficiency, and accelerate intraoperative registration time. Finally, the regression module outputed the final transformation parameters. Comparative experiments were conducted using traditional iterative methods (Opt-MI, Opt-NCC, Opt-C2F) and existing deep learning methods convolutional neural network (CNN) as control group. The registration accuracy (mRPD), registration time, and registration success rate were compared among the iterative methods. Results: Through experiments on real CT data, the image-guided registration accuracy of the proposed method was verified. The method achieved a registration accuracy of (0.81±0.41) mm in the mRPD metric, a rotational angle error of 0.57°±0.24°, and a translation error of (0.41±0.21) mm. Through experimental comparisons on mainstream models, the selected DenseNet alignment accuracy was significantly better than ResNet as well as VGG (both P<0.05). Compared to existing deep learning methods [mRPD: (2.97±0.99) mm, rotational angle error: 2.64°±0.54°, translation error: (2.15±0.41) mm, registration time: (0.03±0.05) seconds], the proposed method significantly improved registration accuracy (all P<0.05). The registration success rate reached 97%, with an average single registration time of only (0.04±0.02) seconds. Compared to traditional iterative methods [mRPD: (0.78±0.26) mm, rotational angle error: 0.84°±0.57°, translation error: (1.05±0.28) mm, registration time: (35.5±10.5) seconds], registration efficiency of the proposed method was significantly improved (all P<0.05). The dual-position study also compensated for the limitations in the single-view perspective, and significantly outperforms both the front and side single-view perspectives in terms of positional transformation parameter errors (both P<0.05). Conclusion: Compared to existing methods, the proposed CT and X-ray registration method significantly reduces registration time while maintaining high registration accuracy, achieving efficient and precise single vertebra registration.

Dense projection fusion for 3D object detection

Fusing information from LiDAR and cameras can effectively enhance the overall perceptivity of autonomous vehicles in various scenarios. Despite the relatively good results achieved by point-wise fusion and Bird’s-Eye-View (BEV) fusion, they still cannot fully leverage the image information and lack of effective depth information. For any fusion methods, the multi-modal features first need to be concatenated along the channel, and then the fused features are extracted using convolutional layers. However, this type of fusion methods is effective, but too coarse which causes that the fused features cannot pay more attention to the regions with important features and suffer from severe noise. To tackle these issues, we propose in this paper a Dense Projection Fusion (DPFusion) approach. It consists of two new modules: dense depth map guided BEV transform (DGBT) module and multi-modal feature adaptive fusion (MFAF) module. The DGBT module first quickly estimates the depth of each pixel and then projects all image features to the BEV space, making full use of the image information. The MFAF module computes the image weights and point cloud weights for each channel in each BEV grid and then adaptively weights and fuses the image BEV features with the point cloud BEV features. It is worth pointing out that the MFAF module makes the fused features pay more attention to background outline and object outline. Our proposed DPFusion demonstrates competitive results in 3D object detection, achieving a mean Average Precision (mAP) of 70.4 and a nuScenes detection score (NDS) of 72.3 on the nuScenes validation set.

Multi-stage reasoning on introspecting and revising bias for visual question answering

Visual Question Answering (VQA) is a task that involves predicting an answer to a question depending on the content of an image. However, recent VQA methods have relied more on language priors between the question and answer rather than the image content. To address this issue, many debiasing methods have been proposed to reduce language bias in model reasoning. However, the bias can be divided into two categories: good bias and bad bias. Good bias can benefit to the answer prediction, while the bad bias may associate the models with the unrelated information. Therefore, instead of excluding good and bad bias indiscriminately in existing debiasing methods, we proposed a bias discrimination module to distinguish them. Additionally, bad bias may reduce the model’s reliance on image content during answer reasoning and thus attend little on image features updating. To tackle this, we leverage Markov theory to construct a Markov field with image regions and question words as nodes. This helps with feature updating for both image regions and question words, thereby facilitating more accurate and comprehensive reasoning about both the image content and question. To verify the effectiveness of our network, we evaluate our network on VQA v2 and VQA cp v2 datasets and conduct extensive quantity and quality studies to verify the effectiveness of our proposed network. Experimental resu- lts show that our network achieves significant performance against the previous state-of-the-art methods.

Development of an online prediction system for soil organic matter and soil moisture content based on multi-modal fusion

Realizing accurate determination of in situ soil organic matter (SOM) content and soil moisture (SM) content in the field is of great importance for improving agricultural production efficiency. However, the feature information of a single sensor is limited, and there is still a certain gap in modeling accuracy compared to traditional laboratory methods. The variations of SM in the field also interfere with data collection, limiting the application of single sensor. In order to realize the efficient detection of in-situ SOM and SM content, this study developed an online detection system for SOM and SM content based on the fusion of characteristic wavelengths, visible images and thermal imaging image features. Firstly, based on a vehicle-mounted platform, a visible-thermal imaging camera and a characteristic wavelength integration device were integrated in a deep pine plow to realize the simultaneous acquisition of in-situ soil multi-sensor data. Then, a lightweight multimodal network was constructed to obtain thermal visible light image features and characteristic wavelength features through branch networks, achieving deep fusion of different modal data and predicting SOM and SM content. Finally, output the forecasting results of SOM and SM content, and transmit the predictive information to the cloud platform for storage. It was verified that the Multi-modal proposed in this study worked best in the laboratory environment, with a predicted R2 of 0.91 and RMSE of 2.9 g/kg for SOM, and a predicted R2 of 0.92 and RMSE of 0.77 % for SM. Compared with single image or characteristic spectral data, the fusion of visible image and characteristic wavelength effectively improved the prediction accuracy of SOM. The real-time prediction of SM was realized by fusing thermal imaging data, and the elimination of the moisture effect of visible images and characteristic wavelengths was also realized with the help of deep fusion of Multi-modal network. After field validation, the R2 of the Multi-modal system was 0.84 and the RMSE was 5.0 g/kg for SOM, and the R2 of the SM was 0.88 and the RMSE was 1.03 %. Despite the differences in soil types between the validation field and the sampling field, the system still demonstrated strong generalization and achieved high accuracy prediction of in-situ SOM and SM in the field, which effectively improves the efficiency and applicability of field. The efficiency and applicability of soil testing effectively improve the efficiency and provide technical guidance for precision management in the field.

Social Event Classification Based on Multimodal Masked Transformer Network

The key to multimodal social event classification is to fully and accurately utilize the features of both image and text modalities. However, most existing methods have the following limitations: (1) they simply concatenate the image features and text features of the event, and (2) there is irrelevant contextual information between different modalities, which leads to mutual interference. Therefore, it is not enough to only consider the relationship between the modalities of multimodal data, but also the irrelevant contextual information (i.e., regions or words) between the modalities. To overcome these limitations, a novel social event classification method based on multimodal masked transformer network (MMTN) is proposed. A better representation of text and image is learned through an image-text encoding network. Then, the obtained image and text representations are input into the multimodal masked transformer network to fuse the multimodal information, and the relationship between the modalities of multimodal information is modeled by calculating the similarity between the multimodal information, masking the irrelevant context between the modalities. Extensive experiments on two benchmark datasets show that the proposed multimodal masked transformer network model achieves state-of-the-art performance.

OGRN: optical-guided residual dense network for SAR image super-resolution reconstruction network

ABSTRACT Although Convolutional Neural Networks have significantly improved the development of SAR image super-resolution (SR) technology in recent years, it is a very challenging problem to reconstruct SAR image with large-scale factors, such as ×4 and ×8 due to limited available information from low-resolution image. The co-registered high-resolution optical image has been successfully applied to enhance the quality of SAR image due to its discriminative characteristics. Compared with single-frame SAR image SR reconstruction technology, optical image-guided SAR image SR reconstruction technology has better performance. This paper proposes an optical-guided residual dense network (OGRN) for SAR image super-resolution reconstruction network. The network is an end-to-end network. Its most important characteristic is that the SR model of SAR images can be obtained through optical image assistance during training, and high-quality SAR images can be generated without optical image assistance during testing. Firstly, a new dense residual backbone network that extracts high-frequency information is constructed. It can extract and propagate high-frequency features of SAR images efficiently to improve the feature representation ability of the network for high-frequency features. Then, the extracted high-frequency features of the SAR image are used to generate an optical image through the designed SAR-to-Optical image translation network. Finally, a reconstruction module is constructed based on the proposed fusion module for optical and SAR images. The fusion module fuses the high-frequency feature information of the extracted optical images with the SAR image features to provide features for SAR image SR reconstruction. Extensive experiments conducted on Sen1-2 and QXS datasets demonstrated that under the guidance of optical image, our OGRN can achieve excellent performance in both quantitative assessment metrics and visual quality.

Detection and isolation of brain tumors in cancer patients using neural network techniques in MRI images

MRI imaging primarily focuses on the soft tissues of the human body, typically performed prior to a patient's transfer to the surgical suite for a medical procedure. However, utilizing MRI images for tumor diagnosis is a time-consuming process. To address these challenges, a new method for automatic brain tumor diagnosis was developed, employing a combination of image segmentation, feature extraction, and classification techniques to isolate the specific region of interest in an MRI image corresponding to a brain tumor. The proposed method in this study comprises five distinct steps. Firstly, image pre-processing is conducted, utilizing various filters to enhance image quality. Subsequently, image thresholding is applied to facilitate segmentation. Following segmentation, feature extraction is performed, analyzing morphological and structural properties of the images. Then, feature selection is carried out using principal component analysis (PCA). Finally, classification is performed using an artificial neural network (ANN). In total, 74 unique features were extracted from each image, resulting in a dataset of 144 observations. Principal component analysis was employed to select the top 8 most effective features. Artificial Neural Networks (ANNs) leverage comprehensive data and selective knowledge. Consequently, the proposed approach was evaluated and compared with alternative methods, resulting in significant improvements in precision, accuracy, and F1 score. The proposed method demonstrated notable increases in accuracy, with improvements of 99.3%, 97.3%, and 98.5% in accuracy, Sensitivity and F1 score. These findings highlight the efficiency of this approach in accurately segmenting and classifying MRI images.

Live feature transformation scale extraction of face images based on deep learning algorithm

In view of the low extraction accuracy and efficiency of the current feature extraction methods of face images, a method for extracting the scale of live feature transformation of face images based on deep learning algorithm is proposed. First, the deep learning method is used to complete the denoising of face images; then the Gabor wave filter is used to decompose the face signal, and it is input into the deep subspace model to complete the extraction of feature transformation scale; finally, the live feature transformation scale extraction of face images is completed based on (particle PSO swarm optimization algorithm). Experimental results show that the proposed method for extracting face image features has higher accuracy, faster recognition speed and better overall application effect.

Rolling bearing fault diagnosis method based on wavelet packet logarithmic energy map

Aiming at the fault diagnosis problem of rolling bearings, a diagnosis method based on wavelet packet logarithmic energy map is proposed. Firstly, a new wavelet packet node logarithmic energy formula is improved and proposed to overcome the shortcomings of cumbersome parameter determination and strong subjectivity in the traditional wavelet packet energy formula, improve the recognition of high-frequency faults and the distinction of low-frequency fault categories, so as to fully extract the initial time-frequency domain features; secondly, the Gram angle and field idea is used to realize the conversion from one-dimensional features to two-dimensional image features, so as to construct the logarithmic energy map feature based on wavelet packet, which further considers the spatial information between adjacent features, thereby optimizing the initial time-frequency domain features and improving the significance of the obtained features. On this basis, the residual network is used to improve the accuracy of fault diagnosis classification results. Finally, through the simulation verification of the standard rolling bearing data set of Case Western Reserve University, it can be seen that the fault diagnosis model constructed by the proposed method has high diagnostic accuracy and strong generalization ability.

Text-aware small sample remote sensing image classification based on contrastive learning

In view of the fact that existing methods mainly use a single modality of remote sensing images to solve the problem of low similarity of the same category, a remote sensing image classification method based on multimodal learning is proposed. Firstly, the spatial features of the image are corrected and the image encoder is pre-trained using contrastive learning to generate image features, and the text encoder is used to generate text features. Secondly, a feature decoder is introduced to obtain text-aware visual features, and a new attention mechanism method is proposed in the feature fusion stage. Then, a new image encoder is designed to improve the classification accuracy. Finally, the similarity between the support set and the query set is calculated to further predict the category. Experiments are conducted on the NWPU-RESISC45, AID, and UC Merced datasets. Its 5-way 5-shot accuracy reaches 86.46%、85.89%and 80.32%outperforms the existing small-sample remote sensing image classification methods, respectively.

An Improved YOLOv8-Based Foreign Detection Algorithm for Transmission Lines

This research aims to overcome three major challenges in foreign object detection on power transmission lines: data scarcity, background noise, and high computational costs. In the improved YOLOv8 algorithm, the newly introduced lightweight GSCDown (Ghost Shuffle Channel Downsampling) module effectively captures subtle image features by combining 1 × 1 convolution and GSConv technology, thereby enhancing detection accuracy. CSPBlock (Cross-Stage Partial Block) fusion enhances the model’s accuracy and stability by strengthening feature expression and spatial perception while maintaining the algorithm’s lightweight nature and effectively mitigating the issue of vanishing gradients, making it suitable for efficient foreign object detection in complex power line environments. Additionally, PAM (pooling attention mechanism) effectively distinguishes between background and target without adding extra parameters, maintaining high accuracy even in the presence of background noise. Furthermore, AIGC (AI-generated content) technology is leveraged to produce high-quality images for training data augmentation, and lossless feature distillation ensures higher detection accuracy and reduces false positives. In conclusion, the improved architecture reduces the parameter count by 18% while improving the mAP@0.5 metric by a margin of 5.5 points when compared to YOLOv8n. Compared to state-of-the-art real-time object detection frameworks, our research demonstrates significant advantages in both model accuracy and parameter size.

A Cubical Persistent Homology-Based Technique for Image Denoising with Topological Feature Preservation

Image denoising is a fundamental challenge in image processing, where the objective is to remove noise while preserving critical image features. Traditional denoising methods, such as Wavelet, Total Variation (TV) minimization, and Non-Local Means (NLM), often struggle to maintain the topological integrity of image features, leading to the loss of essential structures. This study proposes a Cubical Persistent Homology-Based Technique (CPHBT) that leverages persistence barcodes to identify significant topological features and reduce noise. The method selects filtration levels that preserve important features like loops and connected components. Applied to digit images, our method demonstrates superior performance, achieving a Peak Signal-to-Noise Ratio (PSNR) of 46.88 and a Structural Similarity Index Measure (SSIM) of 0.99, outperforming TV (PSNR: 21.52, SSIM: 0.9812) and NLM (PSNR: 22.09, SSIM: 0.9822). These results confirm that cubical persistent homology offers an effective solution for image denoising by balancing noise reduction and preserving critical topological features, thus enhancing overall image quality.

A Scaled Monocular 3D Reconstruction Based on Structure from Motion and Multi-View Stereo

Three-dimensional digital modeling at actual scales is essential for digitally preserving cultural relics. While 3D reconstruction using a monocular camera offers a cost-effective solution, the lack of scale information in the resulting models limits their suitability for geometric measurements. Objects with monotonous textures, such as batteries, pose additional challenges due to insufficient feature points, increasing positional uncertainty. This article proposes a method incorporating point and line features to address the scale ambiguity in multi-view 3D reconstruction using monocular cameras. By pre-measuring the lengths of multiple sets of real line segments, building a lookup table, and associating the line features in different images, the table was input into the improved reconstruction algorithm to further optimize the scale information. Experimental results on real datasets showed that the proposed method outperformed the COLMAP method by 70.82% in reconstruction accuracy, with a scale recovery reaching millimeter-level accuracy. This method is highly generalizable, cost-effective, and supports lightweight computation, making it suitable for real-time operation on a CPU.

Traumatic Brain Injury Structure Detection Using Advanced Wavelet Transformation Fusion Algorithm with Proposed CNN-ViT

Detecting Traumatic Brain Injuries (TBI) through imaging remains challenging due to limited sensitivity in current methods. This study addresses the gap by proposing a novel approach integrating deep-learning algorithms and advanced image-fusion techniques to enhance detection accuracy. The method combines contextual and visual models to effectively assess injury status. Using a dataset of repeat mild TBI (mTBI) cases, we compared various image-fusion algorithms: PCA (89.5%), SWT (89.69%), DCT (89.08%), HIS (83.3%), and averaging (80.99%). Our proposed hybrid model achieved a significantly higher accuracy of 98.78%, demonstrating superior performance. Metrics including Dice coefficient (98%), sensitivity (97%), and specificity (98%) verified that the strategy is efficient in improving image quality and feature extraction. Additional validations with “entropy”, “average pixel intensity”, “standard deviation”, “correlation coefficient”, and “edge similarity measure” confirmed the robustness of the fused images. The hybrid CNN-ViT model, integrating curvelet transform features, was trained and validated on a comprehensive dataset of 24 types of brain injuries. The overall accuracy was 99.8%, with precision, recall, and F1-score of 99.8%. The “average PSNR” was 39.0 dB, “SSIM” was 0.99, and MI was 1.0. Cross-validation across five folds proved the model’s “dependability” and “generalizability”. In conclusion, this study introduces a promising method for TBI detection, leveraging advanced image-fusion and deep-learning techniques, significantly enhancing medical imaging and diagnostic capabilities for brain injuries.

Image-based assessment of seismic damage in RC exterior beam-column joints

Seismic damage to reinforced concrete (RC) beam-column joints in reinforced concrete (RC) structures significantly impacts their stability and safety after an earthquake. Cracks caused by earthquakes weaken these joints, reducing their ductility, strength, and stiffness. Therefore, a systematic method for assessing damage in RC beam-column joints is crucial. This study introduces a new method that uses image analysis, along with ranking algorithms and machine learning, to assess seismic damage in RC exterior beam-column joints. The study identified three key indicators of severe damage in joints: drift ratio, strength, and stiffness. The method uses image analysis to extract features from preprocessed, binary images of cracks. These features capture both the texture and geometry of the cracks. The chosen features, including crack area, aspect ratio, and distribution of line widths, along with structural parameters like geometry and bond index, were selected using F-test and MRMR algorithms. Seismic damage assessments were conducted on 115 images from 37 specimens using four machine learning models (Regression Trees, Support Vector Machine, Gaussian Process Regression, and Gradient Boosting). The study achieved a high R-squared value of 0.80, indicating strong accuracy, for assessing seismic damage based on drift ratio using the image-based method. This demonstrates that image analysis techniques can effectively link surface crack patterns to quantifiable image features, leading to a more precise assessment of seismic damage.

High-Precision Heterogeneous Satellite Image Manipulation Localization: Feature Point Rules and Semantic Similarity Measurement

Misusing image tampering software makes it easier to manipulate satellite images, leading to a crisis of trust and security concerns in society. This study compares the inconsistencies between heterogeneous images to locate tampered areas and proposes a high-precision heterogeneous satellite image manipulation localization (HSIML) framework to distinguish tampered from real landcover changes, such as artificial constructions, and pseudo-changes, such as seasonal variations. The model operates at the patch level and comprises three modules: The heterogeneous image preprocessing module aligns heterogeneous images and filters noisy data. The feature point constraint module mitigates the effects of lighting and seasonal variations in the images by performing feature point matching, applying filtering rules to conduct an initial screening to identify candidate tampered patches. The semantic similarity measurement module designs a classification network to assess RS image feature saliency. It determines image consistency based on the similarity of semantic features and implements IML using predefined classification rules. Additionally, a dataset for IML is constructed based on satellite images. Extensive experiments compared with existing SOTA models demonstrate that our method achieved the highest F1 score in both localization accuracy and robustness tests and demonstrates the capability for handling large-scale areas.

K-fold matching model for crowd behavioral anomaly detection from discontinuous inputs

Image and associated features detect behavioural anomalies in crowd scenes through matching. Existingmethods use continuous data inputs to track crowd behaviour. As a result, the systemmistakenly assumes normal behaviour during data gaps, leading to false positives or missing detections of small abnormalities. The design of precision-focused matching requires simplified yet robust validation for any number of crowd elements. This article presents a K-fold Matching Model (KFMM) with edge-to-edge correlation. This proposed model identifies the region edges of an input crowd image sequentially. The difference in edges due to crowd misbehaviour activities is validated using random and continuous image features in K number of steps. Considering the complexity of multiple K-steps, the confinement is performed using a neural sigmoid function where the K × K edge matching is reduced. This reduction is based on activity classification i.e. minimum and maximum between two consecutive input sequences. Therefore, as the classification increases, the K is halted with the maximum correlation; contrarily for a low number of classifications, the manifold matching is pursued until the maximum is reached. This correlation count is defined using the neural sigmoid with a linear function for the edges. For the maximum features, this proposed model achieves an 11.21 % high matching ratio, 8.15 % high classifications, 9.71 % high precision, 9.61 % less complexity, and 8.9 % less linear error.