Proxy Task Research Articles

Robot imitation from multimodal observation with unsupervised cross-modal representation

Abstract Imitation from Observation (IfO) prompts the robot to imitate tasks from unlabeled videos via reinforcement learning (RL). The performance of the IfO algorithm depends on its ability to extract task-relevant representations since images are informative. Existing IfO algorithms extract image representations by using a simple encoding network or pre-trained network. Due to the lack of action labels, it is challenging to design a supervised task-relevant proxy task to train the simple encoding network. Representations extracted by a pre-trained network such as Resnet are often task-irrelevant. In this article, we propose a new approach for robot IfO via multimodal observations. Different modalities describe the same information from different sides, which can be used to design an unsupervised proxy task. Our approach contains two modules: the unsupervised cross-modal representation (UCMR) module and a self-behavioral cloning (self-BC)-based RL module. The UCMR module learns to extract task-relevant representations via a multimodal unsupervised proxy task. The Self-BC for further offline policy optimization collects successful experiences during the RL training. We evaluate our approach on the real robot pouring water task, quantitative pouring task, and pouring sand task. The robot achieves state-of-the-art performance.

GCLmf: A Novel Molecular Graph Contrastive Learning Framework Based on Hard Negatives and Application in Toxicity Prediction.

In silico methods for prediction of chemical toxicity can decrease the cost and increase the efficiency in the early stage of drug discovery. However, due to low accessibility of sufficient and reliable toxicity data, constructing robust and accurate prediction models is challenging. Contrastive learning, a type of self-supervised learning, leverages large unlabeled data to obtain more expressive molecular representations, which can boost the prediction performance on downstream tasks. While molecular graph contrastive learning has gathered growing attentions, current models neglect the quality of negative data set. Here, we proposed a self-supervised pretraining deep learning framework named GCLmf. We first utilized molecular fragments that meet specific conditions as hard negative samples to boost the quality of the negative set and thus increase the difficulty of the proxy tasks during pre-training to learn informative representations. GCLmf has shown excellent predictive power on various molecular property benchmarks and demonstrates high performance in 33 toxicity tasks in comparison with multiple baselines. In addition, we further investigated the necessity of introducing hard negatives in model building and the impact of the proportion of hard negatives on the model.

Geometry-semantic aware for monocular 3D Semantic Scene Completion

Monocular Semantic Scene Completion (SSC) empowers intelligent devices to comprehend voxel occupancy (geometry) and semantics in 3D scenes, attracting significant attention in indoor and autonomous driving scenarios. However, existing monocular SSC models primarily map 2D images into 3D space, neglecting the potential benefits of leveraging semantic and geometric understanding in 2D. To address this, we propose the Proxy-embedding Parallel Multi-task Network (PPMNet), which aims to perceive the geometry and semantics of 3D space through depth estimation and semantic segmentation proxy tasks on the 2D perspective plane. Moreover, 2D plane features can be inversely projected into 3D space and subsequently processed using the 3D network. In addition, we enhance contextual awareness in both perspective planes and voxel grids through parallel 2D and 3D decoders. Furthermore, we employ Dual-Head Pyramid Pooling (DHPP) to aggregate information from these two representations. Finally, considering the class imbalance and label incompleteness in practical data, we design a local-to-global loss to prioritize challenging categories. Extensive experiments validate our superiority over state-of-the-art methods on the NYUv2 and SemanticKITTI datasets. The code is available at: https://github.com/luzonghao1/PPMNet.

Video Anomaly Detection via self-supervised and spatio-temporal proxy tasks learning

Video Anomaly Detection (VAD) aims to identify events in videos that deviate from typical patterns. Given the scarcity of anomalous samples, previous research has primarily focused on learning regular patterns from datasets exclusively containing normal behaviors, and treating deviations from these patterns as anomalies. However, most of these methods are constrained by coarse-grained modeling approaches that renders them incapable of learning highly-discriminative features, which are necessary to effectively distinguish between the subtle differences between normal and abnormal behaviors. To better capture these features, we propose an innovative method. Initially, pseudo-anomalous samples for appearance and motion are generated through geometric transformations (2D rotations) and the scrambling of video sequences. Subsequently, a dual-branch network featuring spatio-temporal decoupling is proposed, in which the spatial and temporal branches each handle a specific proxy task. These tasks are designed to distinguish between normal and pseudo-anomalous samples, involving operations such as predicting patch-based 2D rotation angles and classifying video frame triplets as total-anomaly, left-anomaly, right-anomaly, and non-anomaly. Our approach employs an end-to-end training methodology, without relying on pre-trained models (except for the object detector). Evaluations on the UCSD Ped2, Avenue, and ShanghaiTech datasets show that our method achieved AUC scores of 99.1%, 91.9%, and 81.1%, respectively, demonstrating its effectiveness. The code is publicly accessible at the following link: https://spatio-temporal-tasks.

A self-supervised learning method for fault detection of wind turbines

Abstract As promising solutions to condition-based maintenance of wind turbines, artificial intelligence-based techniques have drawn extensive attention in the era of industry 4.0. However, accurate fault detection is still challenging owing to volatile operating conditions in real-world settings. To handle this problem, a novel method is proposed for fault detection of wind turbines. Specifically, a data augmentation scheme is developed to simulate the effects of time-varying environments and noise. Then, a self-supervised proxy task of variant prediction is designed and conducted. In this way, valid data representations can be extracted to represent the health status of wind turbines. Additionally, the compactness of data representations is guaranteed by the directional evolution, which can relieve the confusion of health conditions. The effectiveness of the proposed method is verified with actual measurements. Using the proposed method, several faults can be detected more than 10 d earlier, and blade breakage can be identified more than 22 h earlier. Furthermore, the developed method outperforms several benchmark approaches.

Graph and text multi-modal representation learning with momentum distillation on Electronic Health Records

The emergence and widespread adoption of electronic health records (EHR) in modern healthcare systems has generated a large amount of data with the potential to significantly improve patient outcomes. However, extracting meaningful insights from EHR is challenging due to their extensive volume and inherent complexity. Leveraging diverse modalities of data enhances the exploration of patient data representation. Nevertheless, current research on multi-modal relationships between concealed graph structures within medical codes and unstructured text overlooks inherent disparities and inconsistencies. To address the significant gap, this study introduces a pretraining approach named graph and text multi-modal representation learning with momentum distillation on Electronic Health Records (GTMMRL). This approach tackles the challenge of noisy and unreliable labels using a large open-source EHR dataset, MIMIC-III, for pretraining. Five carefully selected proxy tasks are employed, each guiding the student model’s learning through pseudo-targets generated by the teacher model, which is an exponential moving average of the student model, thereby mitigating overfitting tendencies. We evaluate the performance of our model in five downstream tasks, each addressing real-world challenges in EHR data analysis. Results showcase that our method achieves state-of-the-art performance in various downstream tasks, highlighting the model’s critical role in enhancing the quality of insights extracted from complex EHR data. The code is available at https://github.com/deepEMR/GTMMRL.

Self‐supervised multi‐view clustering in computer vision: A survey

AbstractIn recent years, multi‐view clustering (MVC) has had significant implications in the fields of cross‐modal representation learning and data‐driven decision‐making. Its main objective is to cluster samples into distinct groups by leveraging consistency and complementary information among multiple views. However, the field of computer vision has witnessed the evolution of contrastive learning, and self‐supervised learning has made substantial research progress. Consequently, self‐supervised learning is progressively becoming dominant in MVC methods. It involves designing proxy tasks to extract supervisory information from image and video data, thereby guiding the clustering process. Despite the rapid development of self‐supervised MVC, there is currently no comprehensive survey analysing and summarising the current state of research progress. Hence, the authors aim to explore the emergence of self‐supervised MVC by discussing the reasons and advantages behind it. Additionally, the internal connections and classifications of common datasets, data issues, representation learning methods, and self‐supervised learning methods are investigated. The authors not only introduce the mechanisms for each category of methods, but also provide illustrative examples of their applications. Finally, some open problems are identified for further investigation and development.

Self Supervised Progressive Network for High Performance Video Object Segmentation.

Recently, self-supervised video object segmentation (VOS) has attracted much interest. However, most proxy tasks are proposed to train only a single backbone, which relies on a point-to-point correspondence strategy to propagate masks through a video sequence. Due to its simple pipeline, the performance of the single backbone paradigm is still unsatisfactory. Instead of following the previous literature, we propose our self-supervised progressive network (SSPNet) which consists of a memory retrieval module (MRM) and collaborative refinement module (CRM). The MRM can perform point-to-point correspondence and produce a propagated coarse mask for a query frame through self-supervised pixel-level and frame-level similarity learning. The CRM, which is trained via cycle consistency region tracking, aggregates the reference & query information and learns the collaborative relationship among them implicitly to refine the coarse mask. Furthermore, to learn semantic knowledge from unlabeled data, we also design two novel mask-generation strategies to provide the training data with meaningful semantic information for the CRM. Extensive experiments conducted on DAVIS-17, YouTube- VOS and SegTrack v2 demonstrate that our method surpasses the state-of-the-art self-supervised methods and narrows the gap with the fully supervised methods.

GA-GGD: Improving semantic discriminability in graph contrastive learning via Generative Adversarial Network

Graph contrastive learning has garnered considerable research interest due to its ability to effectively embed graph data without manual labels. Among them, methods based on Deep Graph Infomax (DGI) have been widely studied and favored in the industry because of their fast training speed, applicability to large-scale data. DGI-based methods usually obtain a noise graph through node shuffling. The proxy task of these methods encourages the encoder to distinguish whether the nodes come from the original graph or the noise graph, thereby maximizing the mutual information between the node representation and the graph it belongs to, while also maximizing the Jenson–Shannon divergence between the nodes of original graph and noise graph. However, we argue that these approaches only enable the encoder to differentiate between semantically meaningful graphs and noise graphs, but not to effectively identify different semantic graphs. This leads to the inability of the encoder to effectively embed information between different semantics, significantly reducing the robustness and affecting the performance of downstream tasks. In addition, this training mode makes the model more sensitive to attacks. To improve their semantic discriminability, we take advantage of the natural ability of generative adversarial networks to generate semantic data, proposing a method called Generative Adversarial Graph Group Discrimination (GA-GGD). Specifically, it consists of a graph group discriminator and a semantic attack generator. The discriminator aims to encode the graph and identify whether nodes originate from the original graph. The goal of the generator is to use random features and graph structure to find vulnerabilities of discriminator and generate node representations with similar but wrong semantic to confuse the discriminator. GA-GGD can improve the model’s semantic information embedding without significantly increasing computational overhead and memory occupancy. We test the effectiveness of the proposed model on commonly used data sets and large-scale datasets, as well as in various downstream tasks such as classification, clustering, and adversarial attacks defence. A wealth of experimental results confirm the efficacy of the proposed model.

Aligning Human and Computational Coherence Evaluations

Abstract Automated coherence metrics constitute an efficient and popular way to evaluate topic models. Previous works present a mixed picture of their presumed correlation with human judgment. This work proposes a novel sampling approach to mine topic representations at a large-scale while seeking to mitigate bias from sampling, enabling the investigation of widely-used automated coherence metrics via large corpora. Additionally, this article proposes a novel user study design, an amalgamation of different proxy tasks, to derive a finer insight into the human decision-making processes. This design subsumes the purpose of simple rating and outlier-detection user studies. Similar to the sampling approach, the user study conducted is very extensive, comprising forty study participants split into eight different study groups tasked with evaluating their respective set of one hundred topic representations. Usually, when substantiating the use of these metrics, human responses are treated as the golden standard. This article further investigates the reliability of human judgment by flipping the comparison and conducting a novel extended analysis of human response at the group and individual level against a generic corpus. The investigation results show a moderate to good correlation between these metrics and human judgment, especially for generic corpora, and derive further insights into the human perception of coherence. Analysing inter-metric correlations across corpora shows moderate to good correlation amongst these metrics. As these metrics depend on corpus statistics, this article further investigates the topical differences between corpora revealing nuances in applications of these metrics.

Innovative methods for microplastic characterization and detection: Deep learning supported by photoacoustic imaging and automated pre-processing data

Plastic products' widespread applications and their non-biodegradable nature have resulted in the continuous accumulation of microplastic waste, emerging as a significant component of ecological environmental issues. In the field of microplastic detection, the intricate morphology poses challenges in achieving rapid visual characterization of microplastics. In this study, photoacoustic imaging technology is initially employed to capture high-resolution images of diverse microplastic samples. To address the limited dataset issue, an automated data processing pipeline is designed to obtain sample masks while effectively expanding the dataset size. Additionally, we propose Vqdp2, a generative deep learning model with multiple proxy tasks, for predicting six forms of microplastics data. By simultaneously constraining model parameters through two training modes, outstanding morphological category representations are achieved. The results demonstrate Vqdp2's excellent performance in classification accuracy and feature extraction by leveraging the advantages of multi-task training. This research is expected to be attractive for the detection classification and visual characterization of microplastics.

Connectional-style-guided contextual representation learning for brain disease diagnosis

Structural magnetic resonance imaging (sMRI) has shown great clinical value and has been widely used in deep learning (DL) based computer-aided brain disease diagnosis. Previous DL-based approaches focused on local shapes and textures in brain sMRI that may be significant only within a particular domain. The learned representations are likely to contain spurious information and have poor generalization ability in other diseases and datasets. To facilitate capturing meaningful and robust features, it is necessary to first comprehensively understand the intrinsic pattern of the brain that is not restricted within a single data/task domain. Considering that the brain is a complex connectome of interlinked neurons, the connectional properties in the brain have strong biological significance, which is shared across multiple domains and covers most pathological information. In this work, we propose a connectional style contextual representation learning model (CS-CRL) to capture the intrinsic pattern of the brain, used for multiple brain disease diagnosis. Specifically, it has a vision transformer (ViT) encoder and leverages mask reconstruction as the proxy task and Gram matrices to guide the representation of connectional information. It facilitates the capture of global context and the aggregation of features with biological plausibility. The results indicate that CS-CRL achieves superior accuracy in multiple brain disease diagnosis tasks across six datasets and three diseases and outperforms state-of-the-art models. Furthermore, we demonstrate that CS-CRL captures more brain-network-like properties, and better aggregates features, is easier to optimize, and is more robust to noise, which explains its superiority in theory.

Advancing microplastic surveillance through photoacoustic imaging and deep learning techniques

Microplastic contamination presents a significant global environmental threat, yet scientific understanding of its morphological distribution within ecosystems remains limited. This study introduces a pioneering method for comprehensive microplastic assessment and environmental monitoring, integrating photoacoustic imaging and advanced deep learning techniques. Rigorous curation of diverse microplastic datasets enhances model training, yielding a high-resolution imaging dataset focused on shape-based discrimination. The introduction of the Vector-Quantized Variational Auto Encoder (VQVAE2) deep learning model signifies a substantial advancement, demonstrating exceptional proficiency in image dimensionality reduction and clustering. Furthermore, the utilization of Vector Quantization Microplastic Photoacoustic imaging (VQMPA) with a proxy task before decoding enhances feature extraction, enabling simultaneous microplastic analysis and discrimination. Despite inherent limitations, this study lays a robust foundation for future research, suggesting avenues for enhancing microplastic identification precision through expanded sample sizes and complementary methodologies like spectroscopy. In conclusion, this innovative approach not only advances microplastic monitoring but also provides valuable insights for future environmental investigations, highlighting the potential of photoacoustic imaging and deep learning in bolstering sustainable environmental monitoring efforts.

Predicting Age from White Matter Diffusivity with Residual Learning.

Imaging findings inconsistent with those expected at specific chronological age ranges may serve as early indicators of neurological disorders and increased mortality risk. Estimation of chronological age, and deviations from expected results, from structural magnetic resonance imaging (MRI) data has become an important proxy task for developing biomarkers that are sensitive to such deviations. Complementary to structural analysis, diffusion tensor imaging (DTI) has proven effective in identifying age-related microstructural changes within the brain white matter, thereby presenting itself as a promising additional modality for brain age prediction. Although early studies have sought to harness DTI's advantages for age estimation, there is no evidence that the success of this prediction is owed to the unique microstructural and diffusivity features that DTI provides, rather than the macrostructural features that are also available in DTI data. Therefore, we seek to develop white-matter-specific age estimation to capture deviations from normal white matter aging. Specifically, we deliberately disregard the macrostructural information when predicting age from DTI scalar images, using two distinct methods. The first method relies on extracting only microstructural features from regions of interest (ROIs). The second applies 3D residual neural networks (ResNets) to learn features directly from the images, which are non-linearly registered and warped to a template to minimize macrostructural variations. When tested on unseen data, the first method yields mean absolute error (MAE) of 6.11 ± 0.19 years for cognitively normal participants and MAE of 6.62 ± 0.30 years for cognitively impaired participants, while the second method achieves MAE of 4.69 ± 0.23 years for cognitively normal participants and MAE of 4.96 ± 0.28 years for cognitively impaired participants. We find that the ResNet model captures subtler, non-macrostructural features for brain age prediction.

Superresolution of GOES-16 ABI Bands to a Common High Resolution with a Convolutional Neural Network

Abstract Superresolution is the general task of artificially increasing the spatial resolution of an image. The recent surge in machine learning (ML) research has yielded many promising ML-based approaches for performing single-image superresolution including applications to satellite remote sensing. We develop a convolutional neural network (CNN) to superresolve the 1- and 2-km bands on the GOES-R series Advanced Baseline Imager (ABI) to a common high resolution of 0.5 km. Access to 0.5-km imagery from ABI band 2 enables the CNN to realistically sharpen lower-resolution bands without significant blurring. We first train the CNN on a proxy task, which allows us to only use ABI imagery, namely, degrading the resolution of ABI bands and training the CNN to restore the original imagery. Comparisons at reduced resolution and at full resolution with Landsat-8/Landsat-9 observations illustrate that the CNN produces images with realistic high-frequency detail that is not present in a bicubic interpolation baseline. Estimating all ABI bands at 0.5-km resolution allows for more easily combining information across bands without reconciling differences in spatial resolution. However, more analysis is needed to determine impacts on derived products or multispectral imagery that use superresolved bands. This approach is extensible to other remote sensing instruments that have bands with different spatial resolutions and requires only a small amount of data and knowledge of each channel’s modulation transfer function. Significance Statement Satellite remote sensing instruments often have bands with different spatial resolutions. This work shows that we can artificially increase the resolution of some lower-resolution bands by taking advantage of the texture of higher-resolution bands on the GOES-16 ABI instrument using a convolutional neural network. This may help reconcile differences in spatial resolution when combining information across bands, but future analysis is needed to precisely determine impacts on derived products that might use superresolved bands.

Efficient Supervised Pretraining of Swin-Transformer for Virtual Staining of Microscopy Images.

Fluorescence staining is an important technique in life science for labeling cellular constituents. However, it also suffers from being time-consuming, having difficulty in simultaneous labeling, etc. Thus, virtual staining, which does not rely on chemical labeling, has been introduced. Recently, deep learning models such as transformers have been applied to virtual staining tasks. However, their performance relies on large-scale pretraining, hindering their development in the field. To reduce the reliance on large amounts of computation and data, we construct a Swin-transformer model and propose an efficient supervised pretraining method based on the masked autoencoder (MAE). Specifically, we adopt downsampling and grid sampling to mask 75% of pixels and reduce the number of tokens. The pretraining time of our method is only 1/16 compared with the original MAE. We also design a supervised proxy task to predict stained images with multiple styles instead of masked pixels. Additionally, most virtual staining approaches are based on private datasets and evaluated by different metrics, making a fair comparison difficult. Therefore, we develop a standard benchmark based on three public datasets and build a baseline for the convenience of future researchers. We conduct extensive experiments on three benchmark datasets, and the experimental results show the proposed method achieves the best performance both quantitatively and qualitatively. In addition, ablation studies are conducted, and experimental results illustrate the effectiveness of the proposed pretraining method. The benchmark and code are available at https://github.com/birkhoffkiki/CAS-Transformer.

FaultSSL: Seismic fault detection via semisupervised learning

The prevailing methodology in data-driven fault detection leverages synthetic data for training neural networks. However, it grapples with challenges when it comes to generalization in surveys exhibiting complex structures. To enhance the generalization of models trained on limited synthetic data sets to a broader range of real-world data, we introduce FaultSSL, a semisupervised fault detection framework. This method is based on the classical mean teacher structure, in which its supervised part uses synthetic data and a few 2D labels. The unsupervised component relies on two meticulously devised proxy tasks, allowing it to incorporate vast, unlabeled field data into the training process. The two proxy tasks are panning consistency (PNC) and patching consistency (PTC). PNC emphasizes feature consistency in overlapping regions between two adjacent views in predicting the model. This allows for the extension of 2D slice labels to the global seismic volume. PTC emphasizes the spatially consistent nature of faults. It ensures that the predictions for the seismic data, whether made on the entire volume or individual patches, exhibit coherence without any noticeable artifacts at the patch boundaries. Although the two proxy tasks serve different objectives, they uniformly contribute to the enhancement of performance. Experiments showcase the exceptional performance of FaultSSL. In surveys wherein other mainstream methods fail to deliver, we present reliable, continuous, and clear detection results. FaultSSL reveals a promising approach for incorporating large volumes of field data into the training and promoting model generalization across broader surveys.

Vision-Language Pre-training with Object Contrastive Learning for 3D Scene Understanding

In recent years, vision language pre-training frameworks have made significant progress in natural language processing and computer vision, achieving remarkable performance improvement on various downstream tasks. However, when extended to point cloud data, existing works mainly focus on building task-specific models, and fail to extract universal 3D vision-language embedding that generalize well. We carefully investigate three common tasks in semantic 3D scene understanding, and derive key insights into the development of a pre-training model. Motivated by these observations, we propose a vision-language pre-training framework 3DVLP (3D vision-language pre-training with object contrastive learning), which transfers flexibly on 3D vision-language downstream tasks. 3DVLP takes visual grounding as the proxy task and introduces Object-level IoU-guided Detection (OID) loss to obtain high-quality proposals in the scene. Moreover, we design Object-level Cross-Contrastive alignment (OCC) task and Object-level Self-Contrastive learning (OSC) task to align the objects with descriptions and distinguish different objects in the scene, respectively. Extensive experiments verify the excellent performance of 3DVLP on three 3D vision-language tasks, reflecting its superiority in semantic 3D scene understanding. Code is available at https://github.com/iridescentttt/3DVLP.

VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation

Outdoor Vision-and-Language Navigation (VLN) requires an agent to navigate through realistic 3D outdoor environments based on natural language instructions. The performance of existing VLN methods is limited by insufficient diversity in navigation environments and limited training data. To address these issues, we propose VLN-Video, which utilizes the diverse outdoor environments present in driving videos in multiple cities in the U.S. augmented with automatically generated navigation instructions and actions to improve outdoor VLN performance. VLN-Video combines the best of intuitive classical approaches and modern deep learning techniques, using template infilling to generate grounded non-repetitive navigation instructions, combined with an image rotation similarity based navigation action predictor to obtain VLN style data from driving videos for pretraining deep learning VLN models. We pre-train the model on the Touchdown dataset and our video-augmented dataset created from driving videos with three proxy tasks: Masked Language Modeling, Instruction and Trajectory Matching, and Next Action Prediction, so as to learn temporally-aware and visually-aligned instruction representations. The learned instruction representation is adapted to the state-of-the-art navigation agent when fine-tuning on the Touchdown dataset. Empirical results demonstrate that VLN-Video significantly outperforms previous state-of-the-art models by 2.1% in task completion rate, achieving a new state-of-the-art on the Touchdown dataset.

3D seismic Fault Detection via Contrastive-Reconstruction Representation Learning

Fault detection is a critical step in structural modeling and characterizing reservoirs. 3D seismic fault labeling is almost impossible to obtain, while networks trained on synthetic fault data have limited generalization to real data. We use self-supervised representation learning to enable networks to learn seismic field data features during pre-training, improving generalization. However, widely popular ViT/SwinViT-based methods cannot capture low-level fault features well. CNN-based have limited capability in transferring to downstream tasks. Tackle this, we designed the Tiny Self-Attention and extensively embedded it into the HRNet. It merges the advantages of convolutional and self-attention, allowing for in-depth learning of seismic representation information during the representation learning phase, thus achieving better inter-class separation in downstream tasks. We crafted two proxy tasks. The contrastive task aims to minimize the projected feature distance of overlapping areas from two distinct views. To tackle the issue of memory overflow and training suspension caused by the high spatial and temporal complexity of 3D high-resolution feature matching, we introduced sparse distance matching and an adaptive feature aggregation. In reconstruction task, we designed a masking strategy tailored to the unique attributes of 3D seismic data. It process named “Fault Detection via Contrast-Reconstruction Representation Learning” (FaultCRL). Experimentally, we compared the latest fault detection methods, and representation learning techniques like MAE and SwinUNETR, showcasing the notable advantage of FaultCRL in fault detection tasks. The appendix provides all qualitative results from mainstream geophysical journals regarding The Netherlands-F3 data in recent years, indicating that our approach has reached the current state-of-the-art level.