Generalization Capability Of Model Research Articles

Research on bearing fault diagnosis based on novel MRSVD-CWT and improved CNN-LSTM

As a critical component in mechanical equipment, rolling bearings play a vital role in industrial production. Effective bearing fault diagnosis provides a more reliable guarantee for the safe operation of the industrial output. Traditional data-driven bearing fault diagnosis methods often have problems such as insufficient fault feature extraction and poor model generalization capabilities, resulting in reduced diagnostic accuracy. To solve these problems and significantly improve the diagnosis accuracy, this paper proposes a novel fault diagnosis method based on multi-resolution singular value decomposition (MRSVD), continuous wavelet transform (CWT), improved convolutional neural network (CNN) enhanced by convolutional block attention module, and long short-term memory (LSTM). Through MRSVD, the vibration signal is decomposed layer by layer into multiple denoised signals, thus signal noise can be eliminated to the greatest extent to gain the optimal denoised signals; then through CWT, the optimal denoised signals are converted into two-dimensional time-frequency images so that the local and global characteristic information can be fully captured. Finally, through improved CNN-LSTM, feature extraction is greatly enhanced, resulting in high accuracy of fault diagnosis. Lots of experiments are organized to test the performance, and the experimental results show that the proposed method on various datasets has better diagnosis accuracy and generalization ability under different working conditions than other methods.

Augmentation blending with clustering-aware outlier factor: An outlier-driven perspective for enhanced contrastive learning

Data augmentation is an effective strategy to improve model performance and generalization capabilities by expanding both the size and diversity of the original dataset via subtle modifications to the original data. In mainstream contrastive learning frameworks, data augmentation is leveraged by default to compose positive and negative pairs. However, selecting optimal augmentations that consistently preserve the semantics of the original samples poses challenges owing to variations in the quality of different augmentation transformations. To address this challenge, we provide a novel perspective and formulate the data augmentation optimization problem as an outlier-driven augmentation blending problem. Specifically, we design an innovative metric named Clustering-Aware Outlier Factor (CAOF), to quantify the semantic inconsistency between the augmented samples and original samples. CAOF is capable of identifying semantically inconsistent outliers in augmented samples that are generated by various transformations, thereby offering better context-aware density assessments by considering the intra-cluster neighbors for individual samples. Each augmentation transformation is evaluated using the proposed CAOF, which reflects the likelihood of producing semantically inconsistent augmented samples. The likelihood determines the importance of the transformation in generating a refined blended augmentation, which is subsequently fed into the contrastive learning framework. We conduct empirical evaluations on six time series datasets. We compare our method with three state-of-the-art augmentation selection methods on five contrastive learning models. The results demonstrate the superiority of our proposed approach in discovering outliers and refining augmentations in contrastive learning for time series classification tasks.

Two-dimensional hybrid incremental learning (2DHIL) framework for semantic segmentation of skin tissues

This study aims to enhance the robustness and generalization capability of a deep learning transformer model used for segmenting skin carcinomas and tissues through the introduction of incremental learning. Deep learning AI models demonstrate their claimed performance only for tasks and data types for which they are specifically trained. Their performance is severely challenged for the test cases which are not similar to training data thus questioning their robustness and ability to generalize. Moreover, these models require an enormous amount of annotated data for training to achieve desired performance. The availability of large annotated data, particularly for medical applications, is itself a challenge. Despite efforts to alleviate this limitation through techniques like data augmentation, transfer learning, and few-shot training, the challenge persists. To address this, we propose refining the models incrementally as new classes are discovered and more data becomes available, emulating the human learning process. However, deep learning models face the challenge of catastrophic forgetting during incremental training. Therefore, we introduce a two-dimensional hybrid incremental learning framework for segmenting non-melanoma skin cancers and tissues from histopathology images. Our approach involves progressively adding new classes and introducing data of varying specifications to introduce adaptability in the models. We also employ a combination of loss functions to facilitate new learning and mitigate catastrophic forgetting. Our extended experiments demonstrate significant improvements, with an F1 score reaching 91.78, mIoU of 93.00, and an average accuracy of 95%. These findings highlight the effectiveness of our incremental learning strategy in enhancing the robustness and generalization of deep learning segmentation models while mitigating catastrophic forgetting.

An improved convolutional neural network for predicting porous media permeability from rock thin sections

Permeability prediction is a crucial aspect of investigating fluid flow capacity in porous media, and rapidly predicting the permeability of rock thin sections aids in reservoir assessment. In recent years, significant progress has been made regarding the use of deep learning for predicting porous media permeability, effectively overcoming the limitations associated with time-consuming conventional permeability determination methods. To address the issues of low prediction accuracy and insufficient generalization capability of previous permeability prediction models, this study proposes an improved convolutional neural network for porous media permeability and applies it to predict the permeability of rock thin sections. Given the difficulty of obtaining a large amount of rock thin section data, we synthetically generated 1000 binary images of porous media and calculated the corresponding permeability labels using computational fluid dynamics. These data were used as foundational data for training the model. The proposed model achieved accurate and efficient permeability prediction of porous media with a correlation of 0.9667 on testing set. Simultaneously, we employed class activation mapping technology to visualize the permeability prediction process of the neural network, thereby elucidating the working principles of the neural network during porous media permeability prediction. Subsequently, based on an optimally pretrained neural network, transfer learning was utilized to predict the permeability of rock thin sections, which achieved a correlation of 0.9032. Our study extends the rock thin section applications and provides technical support for reservoir evaluation.

Construction and application of a novel WGAN-CNN-based predicting approach for dust concentration at underground coal mine working faces.

To enhance the real-time monitoring and early-warning capabilities for dust disasters in underground coal mine, this paper presents a novel WGAN-CNN-based prediction approach to predict the dust concentration at underground coal mine working faces. Dust concentration, wind speed, temperature, and methane concentration were collected as the original data due to their nonlinear relationship. The consistency between the generated and original data distributions was verified through PCA dimensionality reduction analysis. The predictive performance of this approach was assessed using five metrics (R2, EVS, MSE, RMSE, and MAE) and compared with three other algorithms (Random Forest Regressor, MLP Regressor, and LinearSVR). The findings indicate that a majority of the generated data falls within the distribution range of the real dataset, exhibiting reduced levels of volatility and dispersion. The R2 values of prediction results are all above 98%, and the MSE values are between 0.0007 and 0.0106. The proposed approach exhibits superior predictive accuracy and robust model generalization capabilities compared to alternative algorithms, thereby enhancing the real-time monitoring and early-warning level of dust disasters in underground coal mine. This will facilitate the realization of advanced prevention and control measures for dust disasters, showcasing a wide range of potential applications.

Prediction of Protein-Protein Interactions Based on Integrating Deep Learning and Feature Fusion.

Understanding protein-protein interactions (PPIs) helps to identify protein functions and develop other important applications such as drug preparation and protein-disease relationship identification. Deep-learning-based approaches are being intensely researched for PPI determination to reduce the cost and time of previous testing methods. In this work, we integrate deep learning with feature fusion, harnessing the strengths of both approaches, handcrafted features, and protein sequence embedding. The accuracies of the proposed model using five-fold cross-validation on Yeast core and Human datasets are 96.34% and 99.30%, respectively. In the task of predicting interactions in important PPI networks, our model correctly predicted all interactions in one-core, Wnt-related, and cancer-specific networks. The experimental results on cross-species datasets, including Caenorhabditis elegans, Helicobacter pylori, Homo sapiens, Mus musculus, and Escherichia coli, also show that our feature fusion method helps increase the generalization capability of the PPI prediction model.

Challenges in multi-centric generalization: phase and step recognition in Roux-en-Y gastric bypass surgery

PurposeMost studies on surgical activity recognition utilizing artificial intelligence (AI) have focused mainly on recognizing one type of activity from small and mono-centric surgical video datasets. It remains speculative whether those models would generalize to other centers.MethodsIn this work, we introduce a large multi-centric multi-activity dataset consisting of 140 surgical videos (MultiBypass140) of laparoscopic Roux-en-Y gastric bypass (LRYGB) surgeries performed at two medical centers, i.e., the University Hospital of Strasbourg, France (StrasBypass70) and Inselspital, Bern University Hospital, Switzerland (BernBypass70). The dataset has been fully annotated with phases and steps by two board-certified surgeons. Furthermore, we assess the generalizability and benchmark different deep learning models for the task of phase and step recognition in 7 experimental studies: (1) Training and evaluation on BernBypass70; (2) Training and evaluation on StrasBypass70; (3) Training and evaluation on the joint MultiBypass140 dataset; (4) Training on BernBypass70, evaluation on StrasBypass70; (5) Training on StrasBypass70, evaluation on BernBypass70; Training on MultiBypass140, (6) evaluation on BernBypass70 and (7) evaluation on StrasBypass70.ResultsThe model’s performance is markedly influenced by the training data. The worst results were obtained in experiments (4) and (5) confirming the limited generalization capabilities of models trained on mono-centric data. The use of multi-centric training data, experiments (6) and (7), improves the generalization capabilities of the models, bringing them beyond the level of independent mono-centric training and validation (experiments (1) and (2)).ConclusionMultiBypass140 shows considerable variation in surgical technique and workflow of LRYGB procedures between centers. Therefore, generalization experiments demonstrate a remarkable difference in model performance. These results highlight the importance of multi-centric datasets for AI model generalization to account for variance in surgical technique and workflows. The dataset and code are publicly available at https://github.com/CAMMA-public/MultiBypass140.

SURVEY ON WBC CLASSIFICATION AND DETECTION USING YOLO

Our heart pumps red blood constantly, carrying waste products, hormones, nutrition, oxygen, and other essential health markers. Blood cells in this fluid are made up of many components, including platelets, RBCs, and WBCs. Neutrophils, Lymphocytes, Monocytes, Eosinophils, and Basophils are further subdivided into WBCs. To precisely identify and treat numerous kinds of blood-related illnesses, the detection and analysis of these blood cells is necessary for advanced diagnostics in medicine. Convolutional neural networks (CNNs), for example, are highly relied upon in modern medical diagnostics for the examination of blood cells. The precision and potency of blood cell identification procedures have been greatly improved by CNNs and Additional approaches to deep learning like RNNs and YOLO. The persistence of this research is to list challenges in White Blood cell detection and classification problem. Deep learning-based blood cell identification and classification approaches based on Single Stage approaches. Single Stage Approach involve You only look Once (YOLO). It explores the various architectures for feature selection and classification starting from YoloV1 toV5 and it’s various modifications. In this paper would be looking at things like network parameters, training procedure, and transfer learning application for each variation. It also assesses model complexity, accuracy, performance, generalization, computational efficiency, and transfer learning capabilities, in addition to variables like data amount and source.

AMFNet: Attention-Guided Multi-Scale Fusion Network for Bi-Temporal Change Detection in Remote Sensing Images

Change detection is crucial for evaluating land use, land cover changes, and sustainable development, constituting a significant component of Earth observation tasks. The difficulty in extracting features from high-resolution images, coupled with the complexity of image content, poses challenges for traditional change detection algorithms in terms of accuracy and applicability. The recent emergence of deep learning methods has led to substantial progress in the field of change detection. However, existing frameworks often involve the simplistic integration of bi-temporal features in specific areas, lacking the fusion of temporal information and semantic details in the images. In this paper, we propose an attention-guided multi-scale fusion network (AMFNet), which effectively integrates bi-temporal image features and diverse semantics at both the encoding and decoding stages. AMFNet utilizes a unique attention-guided mechanism to dynamically adjust feature fusion, enhancing adaptability and accuracy in change detection tasks. Our method intelligently incorporates temporal information into the deep learning model, considering the temporal dependency inherent in these tasks. We decode based on an interactive feature map, which improves the model’s understanding of evolving patterns over time. Additionally, we introduce multi-level supervised training to facilitate the learning of fused features across multiple scales. In comparison with different algorithms, our proposed method achieves F1 values of 0.9079, 0.8225, and 0.8809 in the LEVIR-CD, GZ-CD, and SYSU-CD datasets, respectively. Our model outperforms the SOTA model, SAGNet, by 0.69% in terms of F1 and 1.15% in terms of IoU on the LEVIR-CD dataset, by 2.8% in terms of F1 and 1.79% in terms of IoU on the GZ-CD dataset, and by 0.54% in terms of F1 and 0.38% in terms of IoU on the SYSU-CD dataset. The method proposed in this study can be applied to various complex scenarios, establishing a change detection method with strong model generalization capabilities.

Integrative BNN-LHS Surrogate Modeling and Thermo-Mechanical-EM Analysis for Enhanced Characterization of High-Frequency Low-Pass Filters in COMSOL.

This paper pioneers a novel approach in electromagnetic (EM) system analysis by synergistically combining Bayesian Neural Networks (BNNs) informed by Latin Hypercube Sampling (LHS) with advanced thermal-mechanical surrogate modeling within COMSOL simulations for high-frequency low-pass filter modeling. Our methodology transcends traditional EM characterization by integrating physical dimension variability, thermal effects, mechanical deformation, and real-world operational conditions, thereby achieving a significant leap in predictive modeling fidelity. Through rigorous evaluation using Mean Squared Error (MSE), Maximum Learning Error (MLE), and Maximum Test Error (MTE) metrics, as well as comprehensive validation on unseen data, the model's robustness and generalization capability is demonstrated. This research challenges conventional methods, offering a nuanced understanding of multiphysical phenomena to enhance reliability and resilience in electronic component design and optimization. The integration of thermal variables alongside dimensional parameters marks a novel paradigm in filter performance analysis, significantly improving simulation accuracy. Our findings not only contribute to the body of knowledge in EM diagnostics and complex-environment analysis but also pave the way for future investigations into the fusion of machine learning with computational physics, promising transformative impacts across various applications, from telecommunications to medical devices.

Forecasting cryptocurrency's buy signal with a bagged tree learning approach to enhance purchase decisions.

The cryptocurrency market is captivating the attention of both retail and institutional investors. While this highly volatile market offers investors substantial profit opportunities, it also entails risks due to its sensitivity to speculative news and the erratic behavior of major investors, both of which can provoke unexpected price fluctuations. In this study, we contend that extreme and sudden price changes and atypical patterns might compromise the performance of technical signals utilized as the basis for feature extraction in a machine learning-based trading system by either augmenting or diminishing the model's generalization capability. To address this issue, this research uses a bagged tree (BT) model to forecast the buy signal for the cryptocurrency market. To achieve this, traders must acquire knowledge about the cryptocurrency market and modify their strategies accordingly. To make an informed decision, we depended on the most prevalently utilized oscillators, namely, the buy signal in the cryptocurrency market, comprising the Relative Strength Index (RSI), Bollinger Bands (BB), and the Moving Average Convergence/Divergence (MACD) indicator. Also, the research evaluates how accurately a model can predict the performance of different cryptocurrencies such as Bitcoin (BTC), Ethereum (ETH), Cardano (ADA), and Binance Coin (BNB). Furthermore, the efficacy of the most popular machine learning model in precisely forecasting outcomes within the cryptocurrency market is examined. Notably, predicting buy signal values using a BT model provides promising results.

Application of Artificial Intelligence-based Technology in College Archives Management

This study looks into the use of artificial intelligence (AI)-based technologies, notably Convolutional Neural Network (CNN) models and data augmentation approaches, in college archives management. With the rapid expansion of digital information, archive organizations have enormous issues in maintaining, organizing, and giving access to their vast collections of historical documents and scholarly resources. AI solutions present possible solutions to these difficulties by automating labor-intensive operations and improving the efficiency and accuracy of preservation workflows. In this study, they investigate the transformational potential of CNN models in digitization activities, utilizing their visual data processing skills to automate and enhance the digitization of visual resources within college archives. In addition, they look into how data augmentation techniques might improve the resilience and generalization capabilities of AI models, reducing biases and improving performance across a variety of archive collections. Using empirical research, theoretical analysis, and case studies, they present insights into the opportunities and obstacles of implementing AI-based technology in college archive management. Furthermore, they discuss ethical implications for the deployment of AI solutions, emphasizing the significance of transparency, accountability, and stakeholder participation. This study aims to inform archival practitioners, technologists, and stakeholders about the effective and responsible integration of AI technologies in cultural heritage preservation and promotion within academic institutions by elucidating the practical applications and implications of CNN models and data augmentation techniques in archival contexts.

Topology optimization based on improved DoubleU-Net using four boundary condition datasets

Topology optimization is extensively employed in engineering design. However, applying deep learning to solve topology optimization problems faces challenges owing to limited training data and model adaptability to various boundary conditions. To address these challenges, this research has employed a solid isotropic material with a penalization method to produce a dataset of 400,000 2D samples covering four boundary conditions. Each boundary condition includes two resolution datasets. Moreover, an improved DoubleU-Net model is proposed for real-time topology optimization, ensuring high-accuracy predictions. On the test dataset, the average Intersection over Union (IoU) accuracies of the proposed model for the four boundary conditions above are 93.26%, 96.71%, 96.35% and 97.38%. This research also investigated the impact of different structural datasets on the model's generalization capability. The experimental results indicate that the model trained on random structures exhibits excellent testing performance and demonstrates robust generalization capability.

YOLOv8-MU: An Improved YOLOv8 Underwater Detector Based on a Large Kernel Block and a Multi-Branch Reparameterization Module.

Underwater visual detection technology is crucial for marine exploration and monitoring. Given the growing demand for accurate underwater target recognition, this study introduces an innovative architecture, YOLOv8-MU, which significantly enhances the detection accuracy. This model incorporates the large kernel block (LarK block) from UniRepLKNet to optimize the backbone network, achieving a broader receptive field without increasing the model's depth. Additionally, the integration of C2fSTR, which combines the Swin transformer with the C2f module, and the SPPFCSPC_EMA module, which blends Cross-Stage Partial Fast Spatial Pyramid Pooling (SPPFCSPC) with attention mechanisms, notably improves the detection accuracy and robustness for various biological targets. A fusion block from DAMO-YOLO further enhances the multi-scale feature extraction capabilities in the model's neck. Moreover, the adoption of the MPDIoU loss function, designed around the vertex distance, effectively addresses the challenges of localization accuracy and boundary clarity in underwater organism detection. The experimental results on the URPC2019 dataset indicate that YOLOv8-MU achieves an mAP@0.5 of 78.4%, showing an improvement of 4.0% over the original YOLOv8 model. Additionally, on the URPC2020 dataset, it achieves 80.9%, and, on the Aquarium dataset, it reaches 75.5%, surpassing other models, including YOLOv5 and YOLOv8n, thus confirming the wide applicability and generalization capabilities of our proposed improved model architecture. Furthermore, an evaluation on the improved URPC2019 dataset demonstrates leading performance (SOTA), with an mAP@0.5 of 88.1%, further verifying its superiority on this dataset. These results highlight the model's broad applicability and generalization capabilities across various underwater datasets.

Research on Complex Data Mining Analysis and Pattern Recognition Based on Deep Learning

This paper systematically investigates and discusses the application of deep learning in complex data mining analysis and pattern recognition. Firstly, it introduces the basic concepts of deep learning and commonly used models, including artificial neural networks, convolutional neural networks, and recurrent neural networks. Then, it elaborates on the application methods and techniques of deep learning in mining different types of complex data (such as images, text, time series, etc.), and explores the latest research progress in the field of pattern recognition. Furthermore, it analyzes the challenges faced by deep learning in practical applications, such as data scarcity and model generalization capabilities, and proposes future development trends and research directions. Finally, it summarizes the research content and significance of this paper, emphasizing the importance and application prospects of deep learning in the field of complex data mining and pattern recognition.

MFNet: Meta-learning based on frequency-space mix for MRI segmentation in nasopharyngeal carcinoma.

Deep learning techniques have been applied to medical image segmentation and demonstrated expert-level performance. Due to the poor generalization abilities of the models in the deployment in different centres, common solutions, such as transfer learning and domain adaptation techniques, have been proposed to mitigate this issue. However, these solutions necessitate retraining the models with target domain data and annotations, which limits their deployment in clinical settings in unseen domains. We evaluated the performance of domain generalization methods on the task of MRI segmentation of nasopharyngeal carcinoma (NPC) by collecting a new dataset of 321 patients with manually annotated MRIs from two hospitals. We transformed the modalities of MRI, including T1WI, T2WI and CE-T1WI, from the spatial domain to the frequency domain using Fourier transform. To address the bottleneck of domain generalization in MRI segmentation of NPC, we propose a meta-learning approach based on frequency domain feature mixing. We evaluated the performance of MFNet against existing techniques for generalizing NPC segmentation in terms of Dice and MIoU. Our method evidently outperforms the baseline in handling the generalization of NPC segmentation. The MF-Net clearly demonstrates its effectiveness for generalizing NPC MRI segmentation to unseen domains (Dice = 67.59%, MIoU = 75.74% T1W1). MFNet enhances the model's generalization capabilities by incorporating mixed-feature meta-learning. Our approach offers a novel perspective to tackle the domain generalization problem in the field of medical imaging by effectively exploiting the unique characteristics of medical images.

ContourTL-Net: Contour-Based Transfer Learning Algorithm for Early-Stage Brain Tumor Detection.

Brain tumors are critical neurological ailments caused by uncontrolled cell growth in the brain or skull, often leading to death. An increasing patient longevity rate requires prompt detection; however, the complexities of brain tissue make early diagnosis challenging. Hence, automated tools are necessary to aid healthcare professionals. This study is particularly aimed at improving the efficacy of computerized brain tumor detection in a clinical setting through a deep learning model. Hence, a novel thresholding-based MRI image segmentation approach with a transfer learning model based on contour (ContourTL-Net) is suggested to facilitate the clinical detection of brain malignancies at an initial phase. The model utilizes contour-based analysis, which is critical for object detection, precise segmentation, and capturing subtle variations in tumor morphology. The model employs a VGG-16 architecture priorly trained on the "ImageNet" collection for feature extraction and categorization. The model is designed to utilize its ten nontrainable and three trainable convolutional layers and three dropout layers. The proposed ContourTL-Net model is evaluated on two benchmark datasets in four ways, among which an unseen case is considered as the clinical aspect. Validating a deep learning model on unseen data is crucial to determine the model's generalization capability, domain adaptation, robustness, and real-world applicability. Here, the presented model's outcomes demonstrate a highly accurate classification of the unseen data, achieving a perfect sensitivity and negative predictive value (NPV) of 100%, 98.60% specificity, 99.12% precision, 99.56% F1-score, and 99.46% accuracy. Additionally, the outcomes of the suggested model are compared with state-of-the-art methodologies to further enhance its effectiveness. The proposed solution outperforms the existing solutions in both seen and unseen data, with the potential to significantly improve brain tumor detection efficiency and accuracy, leading to earlier diagnoses and improved patient outcomes.

Masked autoencoders with generalizable self-distillation for skin lesion segmentation.

In the field of skin lesion image segmentation, accurate identification and partitioning of diseased regions is of vital importance for in-depth analysis of skin cancer. Self-supervised learning, i.e., MAE, has emerged as a potent force in the medical imaging domain, which autonomously learns and extracts latent features from unlabeled data, thereby yielding pre-trained models that greatly assist downstream tasks. To encourage pre-trained models to more comprehensively learn the global structural and local detail information inherent in dermoscopy images, we introduce a Teacher-Student architecture, named TEDMAE, by incorporating a self-distillation mechanism, it learns holistic image feature information to improve the generalizable global knowledge learning of the student MAE model. To make the image features learned by the model suitable for unknown test images, two optimization strategies are, Exterior Conversion Augmentation (EC) utilizes random convolutional kernels and linear interpolation to effectively transform the input image into one with the same shape but altered intensities and textures, while Dynamic Feature Generation (DF) employs a nonlinear attention mechanism for feature merging, enhancing the expressive power of the features, are proposed to enhance the generalizability of global features learned by the teacher model, thereby improving the overall generalization capability of the pre-trained models. Experimental results from the three public skin disease datasets, ISIC2019, ISIC2017, and PH indicate that our proposed TEDMAE method outperforms several similar approaches. Specifically, TEDMAE demonstrated optimal segmentation and generalization performance on the ISIC2017 and PH datasets, with Dice scores reaching 82.1% and 91.2%, respectively. The best Jaccard values were 72.6% and 84.5%, while the optimal HD95% values were 13.0% and 8.9%, respectively.

A method for quantifying the generalization capabilities of generative models for solving Ising models

For Ising models with complex energy landscapes, whether the ground state can be found by neural networks depends heavily on the Hamming distance between the training datasets and the ground state. Despite the fact that various recently proposed generative models have shown good performance in solving Ising models, there is no adequate discussion on how to quantify their generalization capabilities. Here we design a Hamming distance regularizer in the framework of a class of generative models, variational autoregressive networks (VANs), to quantify the generalization capabilities of various network architectures combined with VAN. The regularizer can control the size of the overlaps between the ground state and the training datasets generated by networks, which, together with the success rates of finding the ground state, form a quantitative metric to quantify their generalization capabilities. We conduct numerical experiments on several prototypical network architectures combined with VAN, including feed-forward neural networks, recurrent neural networks, and graph neural networks, to quantify their generalization capabilities when solving Ising models. Moreover, considering the fact that the quantification of the generalization capabilities of networks on small-scale problems can be used to predict their relative performance on large-scale problems, our method is of great significance for assisting in the Neural Architecture Search field of searching for the optimal network architectures when solving large-scale Ising models.

High generalization identification method based on MI-SI distributed optical fiber sensor and video signals

A pattern recognition method for intrusion signals is introduced, leveraging distributed optical fiber sensors and convolutional neural networks. To enhance the model's generalization capabilities, two strategies are employed. Firstly, the sensor structure is refined, incorporating the strengths of both the Sagnac and Michelson interferometers to create a hybrid design with a wide frequency response. Comparative experiments confirm that this exceptional frequency response significantly boosts the model's generalization power. Secondly, to address the limitations of distributed fiber optic sensors, a multimodal approach is proposed, integrating video frame difference and fiber optic pattern recognition. The trained convolutional neural network model exhibits low computational overhead, robust generalization, and practical applicability. When applied to a dataset collected in diverse scenarios not included in the model training, the model achieved a CNR of 0% and a FPR of only 0.26% for the intrusion behavior of climbing fences.