Missing Regions Research Articles

Adjoint method in PDE-based image compression

We consider a shape optimization based method for finding the best interpolation data in the compression of images with noise. The aim is to reconstruct missing regions by means of minimizing a data fitting term in an L p -norm, for 1 ⩽ p < + ∞, between original images and their reconstructed counterparts using linear diffusion PDE-based inpainting. Reformulating the problem as a constrained optimization over sets (shapes), we derive the topological asymptotic expansion of the considered shape functionals with respect to the insertion of small ball (a single pixel) using the adjoint method. Based on the achieved distributed topological shape derivatives, we propose a numerical approach to determine the optimal set and present numerical experiments showing the efficiency of our method. Numerical computations are presented that confirm the usefulness of our theoretical findings for PDE-based image compression.

Ancient Painting Inpainting with Regional Attention-Style Transfer and Global Context Perception

Ancient paintings, as a vital component of cultural heritage, encapsulate a profound depth of cultural significance. Over time, they often suffer from different degradation conditions, leading to damage. Existing ancient painting inpainting methods struggle with semantic discontinuities, blurred textures, and details in missing areas. To address these issues, this paper proposes a generative adversarial network (GAN)-based ancient painting inpainting method named RG-GAN. Firstly, to address the inconsistency between the styles of missing and non-missing areas, this paper proposes a Regional Attention-Style Transfer Module (RASTM) to achieve complex style transfer while maintaining the authenticity of the content. Meanwhile, a multi-scale fusion generator (MFG) is proposed to use the multi-scale residual downsampling module to reduce the size of the feature map and effectively extract and integrate the features of different scales. Secondly, a multi-scale fusion mechanism leverages the Multi-scale Cross-layer Perception Module (MCPM) to enhance feature representation of filled areas to solve the semantic incoherence of the missing region of the image. Finally, the Global Context Perception Discriminator (GCPD) is proposed for the deficiencies in capturing detailed information, which enhances the information interaction across dimensions and improves the discriminator’s ability to identify specific spatial areas and extract critical detail information. Experiments on the ancient painting and ancient Huaniao++ datasets demonstrate that our method achieves the highest PSNR values of 34.62 and 23.46 and the lowest LPIPS values of 0.0507 and 0.0938, respectively.

Image inpainting algorithm based on inference attention module and two-stage network

Current image inpainting techniques often yield distorted structures or blurred textures that clash with the surrounding context, particularly when addressing extensive missing regions or highly textured images. These methods often struggle to reconstruct realistic and coherent image structures. To address this challenge, we introduce a two-stage network image restoration approach that leverages an inferential attention mechanism. In the first stage, an edge generation network is employed to produce plausible phantom edge information. Subsequently, an image complementation network is utilized to complete the image restoration process. To enhance the visual realism and restoration accuracy of the generated images, we incorporate an inferential attention mechanism within the image complementation network. This mechanism effectively mitigates inconsistencies in the generated features, leading to the production of more meaningful and effective information. We evaluate our proposed method on benchmark datasets, including Places2 dataset, CelebFaces Attributes dataset, and Paris StreetView dataset. The experimental results can demonstrate that the proposed method achieves better Structural Similarity Index and Peak Signal-to-noise Ratio than others. These metrics indicate superior performance compared to existing image inpainting methods, delivering higher image inpainting accuracy and more realistic image reconstruction effect.

Evaluation of mandibular trabecular bone by fractal analysis in pediatric patients with hypodontia of the mandibular second premolar tooth

BackgroundIt is still unclear whether the trabecular structure of the jaw is different in individuals with hypodontia than in those without hypodontia; this is important for clinicians. The aim was to determine whether the mandibular trabecular bone structure of children and adolescents with hypodontia differs from the control group by using the fractal analysis (FA) method in this study.MethodsA total of 138 panoramic radiographs of 69 cases and 69 control subjects (mean age 13.2 ± 10.1) were evaluated. The age and gender of subjects in the case and control groups were matched. Three regions of interest (ROIs) were selected from the panoramic radiographs. ROI1 refers to the center of the ramus rising above the mandibular foramen. ROI2 refers to the area between the apical level of the mandibular molar and the upper border of the mandibular canal. ROI3, the missing tooth region, refers to the apical third of the mesial side of the erupting or fully erupted permanent mandibular first molar. Mann-Whitney U and Wilcoxon tests were used. p < 0.05 was accepted for the significance value.ResultsThe mean fractal dimension (FD) values of ROI1, ROI2, and ROI3 were 1,25, 1,20, and 1,13, respectively. The means FD values obtained from the ramus region were higher than the other regions (p < 0.05). The FD values did not differ significantly according to gender and age (p > 0.05). The FD values of the case group were lower than the control group for ROI3 (p < 0.05).ConclusionThe results of this study showed that the mandibular trabecular bone quality of pediatric patients with one missing tooth was different from the healthy group. The difference in the mean FD values from the ROIs indicates that the ramus has a denser structure than the mandibular corpus. Clinicians should factor this into their dental treatment planning process.

Bridging spatio-temporal discontinuities in global soil moisture mapping by coupling physics in deep learning

The launch of Soil Moisture Active Passive (SMAP) satellite in 2015 has resulted in significant achievements in global soil moisture mapping. Nonetheless, spatiotemporal discontinuities in the soil moisture products have arisen due to the limitations of its orbit scanning gap and retrieval algorithms. To address these issues, this paper presents a physics-constrained gap-filling method, PhyFill for short. The PhyFill method employs a partial convolutional neural network technique to explore spatial domain features of the original SMAP soil moisture data. Then, it incorporates variations in soil moisture induced by precipitation events and dry-down events as penalty terms in the loss function, thereby accounting for monotonicity and boundary constraints in the physical processes governing the dynamic fluctuations of soil moisture. The PhyFill model was applied to SMAP soil moisture data, resulting in continuous spatially daily soil moisture data on a global scale. Three validation strategies are employed: visual inspection through global pattern, simulated missing-region validation, and soil moisture validation with in situ measurements. The results indicated that the reconstructed soil moisture achieved a higher spatial coverage with satisfactory spatial continuity with neighbouring pixels. The simulated validation of the missing regions revealed that the averaged unbiased root mean square difference (ubRMSD) and correlation coefficient (R) were 0.01 m3/m3 and 0.99, respectively versus the gap filled SMAP product. The core validation sites demonstrated that the reconstructed soil moisture data has a consistent ubRMSD compared with the original SMAP soil moisture data (0.04 m3/m3vs. 0.04 m3/m3). The PhyFill method can generate globally continuous, high accurate soil moisture estimates, providing remarkable support for advanced hydrological applications, e.g., global soil moisture dry-down events and patterns.

Reduction of Ribosomal Expansion Segments in Yeast Species of the Magnusiomyces/Saprochaete Clade.

Ribosomes are ribonucleoprotein complexes highly conserved across all domains of life. The size differences of ribosomal RNAs (rRNAs) can be mainly attributed to variable regions termed expansion segments (ESs) protruding out from the ribosomal surface. The ESs were found to be involved in a range of processes including ribosome biogenesis and maturation, translation, and co-translational protein modification. Here, we analyze the rRNAs of the yeasts from the Magnusiomyces/Saprochaete clade belonging to the basal lineages of the subphylum Saccharomycotina. We find that these yeasts are missing more than 400 nt from the 25S rRNA and 150 nt from the 18S rRNAs when compared to their canonical counterparts in Saccharomyces cerevisiae. The missing regions mostly map to ESs, thus representing a shift toward a minimal rRNA structure. Despite the structural changes in rRNAs, we did not identify dramatic alterations in the ribosomal protein inventories. We also show that the size-reduced rRNAs are not limited to the species of the Magnusiomyces/Saprochaete clade, indicating that the shortening of ESs happened independently in several other lineages of the subphylum Saccharomycotina.

Evaluating Activation Functions in GAN Models for Virtual Inpainting: A Path to Architectural Heritage Restoration

Computer vision has advanced much in recent years. Several tasks, such as image recognition, classification, or image restoration, are regularly solved with applications using artificial intelligence techniques. Image restoration comprises different use cases such as style transferring, improvement of quality resolution, or completing missing parts. The latter is also known as image inpainting, virtual image inpainting in this case, which consists of reconstructing missing regions or elements. This paper explores how to evaluate the performance of a deep learning method to do virtual image inpainting to reconstruct missing architectonical elements in images of ruined Greek temples to measure the performance of different activation functions. Unlike a previous study related to this work, a direct reconstruction process without segmented images was used. Then, two evaluation methods are presented: the objective one (mathematical metrics) and an expert (visual perception) evaluation to measure the performance of the different approaches. Results conclude that ReLU outperforms other activation functions, while Mish and Leaky ReLU perform poorly, and Swish’s professional evaluations highlight a gap between mathematical metrics and human visual perception.

CSDN: Cross-Modal Shape-Transfer Dual-Refinement Network for Point Cloud Completion.

How will you repair a physical object with some missings? You may imagine its original shape from previously captured images, recover its overall (global) but coarse shape first, and then refine its local details. We are motivated to imitate the physical repair procedure to address point cloud completion. To this end, we propose a cross-modal shape-transfer dual-refinement network (termed CSDN), a coarse-to-fine paradigm with images of full-cycle participation, for quality point cloud completion. CSDN mainly consists of "shape fusion" and "dual-refinement" modules to tackle the cross-modal challenge. The first module transfers the intrinsic shape characteristics from single images to guide the geometry generation of the missing regions of point clouds, in which we propose IPAdaIN to embed the global features of both the image and the partial point cloud into completion. The second module refines the coarse output by adjusting the positions of the generated points, where the local refinement unit exploits the geometric relation between the novel and the input points by graph convolution, and the global constraint unit utilizes the input image to fine-tune the generated offset. Different from most existing approaches, CSDN not only explores the complementary information from images but also effectively exploits cross-modal data in the whole coarse-to-fine completion procedure. Experimental results indicate that CSDN performs favorably against twelve competitors on the cross-modal benchmark.

RectanglingGAN: Deep rectangling for stitched image via image inpainting

The deep rectangling task aims to transform edge-irregular stitched images into standardised rectangular formats using deep learning. Existing deep rectangling solutions rely on mesh-based segmentation and deformation, which introduce global distortions detrimental to subsequent analysis and processing. Therefore, we propose RectanglingGAN to handle missing regions in a distortion-free manner via image inpainting. Unlike generic inpainting models, RectanglingGAN focuses on preserving the quality of edge regions. In particular, we present an adaptive distance transform module to improve the attention of the feature maps to the mask boundaries. The module dynamically selects the appropriate distance transformation scheme according to the image content. Moreover, we introduce the distance-weighted decaying reconstruction loss into the pixel-wise reconstruction, which introduces the spatial location information between the inpainting pixels and the mask boundaries by inverting the distance-transformed mask. By incorporating this loss, the model pays more attention to the quality of generation pixels far from the mask boundary. Extensive experiments validate the effectiveness of RectanglingGAN compared to state-of-the-art methods, highlighting its significant advantages in terms of both the quality and the fidelity of the edge region in generation images.

An alignment-free method for detection of missing regions for phylogenetic analysis

Phylogenetic tree estimation using conventional approaches usually requires pairwise or multiple sequence alignment. However, sequence alignment has difficulties related to scalability and accuracy in case of long sequences such as whole genomes, low sequence identity, and in presence of genomic rearrangements. To address these issues, alignment-free approaches have been proposed. While these methods have demonstrated promising results, many of these lead to errors when regions are missing from the sequences of one or more species that are trivially detected in alignment-based methods. Here, we present an alignment-free method for detecting missing regions in sequences of species for which phylogeny is to be estimated. It is based on counts of k-mers and can be used to filter out k-mers belonging to regions in one species that are missing in one or more of the other species. We perform experiments with real and simulated datasets containing missing regions and find that it can successfully detect a large fraction of such k-mers and can lead to improvements in the estimated phylogenies. Our method can be used in k-mer based alignment-free phylogeny estimation methods to filter out k-mers corresponding to missing regions.

Robust Semi-Supervised 3D Medical Image Segmentation With Diverse Joint-Task Learning and Decoupled Inter-Student Learning.

Semi-supervised segmentation is highly significant in 3D medical image segmentation. The typical solutions adopt a teacher-student dual-model architecture, and they constrain the two models' decision consistency on the same segmentation task. However, the scarcity of medical samples can lower the diversity of tasks, reducing the effectiveness of consistency constraint. The issue can further worsen as the weights of the models gradually become synchronized. In this work, we have proposed to construct diverse joint-tasks using masked image modelling for enhancing the reliability of the consistency constraint, and develop a novel architecture consisting of a single teacher but multiple students to enjoy the additional knowledge decoupled from the synchronized weights. Specifically, the teacher and student models 'see' varied randomly-masked versions of an input, and are trained to segment the same targets but reconstruct different missing regions concurrently. Such joint-task of segmentation and reconstruction can have the two learners capture related but complementary features to derive instructive knowledge when constraining their consistency. Moreover, two extra students join the original one to perform an inter-student learning. The three students share the same encoding but different decoding designs, and learn decoupled knowledge by constraining their mutual consistencies, preventing themselves from suboptimally converging to the biased predictions of the dictatorial teacher. Experimental on four medical datasets show that our approach performs better than six mainstream semi-supervised methods. Particularly, our approach achieves at least 0.61% and 0.36% higher Dice and Jaccard values, respectively, than the most competitive approach on our in-house dataset. The code will be released at https://github.com/zxmboshi/DDL.

Multi-view 3D reconstruction of seedling using 2D image contour

3D reconstruction of seedling can provide comprehensive and quantitative spatial structure information, offering an effective digital tool for breeding research. However, accurate and efficient reconstruction of seedling is still a challenging work due to limited performance of depth sensor for seedling with small-size stem and unavoidable error for multi-view point cloud registration. Therefore, in this paper, we propose an accurate multi-view 3D reconstruction method for seedling using 2D image contour to constrain 3D point cloud. The rotation axis is calibrated and optimised by minimising point-to-contour distance between 2D image contour and projected exterior points from 3D point cloud. Then, to remove outliers and noise, we introduce the seedling mask of 2D image to constrained and delete projected outlier points of 3D model from corresponding view. Furthermore, we propose a residual-guided method to recognise missing region for 3D model and complete 3D model of small-size stem. Finally, we can obtain an accurate 3D model of seedling. The reconstruction accuracy is evaluated by average distance between projected contour of 3D model and 2D image contour of all views (0.3185 mm). Then, the phenotypic parameters were calculated from 3D model and the results are close to manual measurements (Plant height: R2 = 0.98, RMSE = 2.3 mm, rRMSE = 1.52%; Petioles inclination angle: R2 = 0.99, RMSE = 0.73°, rRMSE = 1.41%; Leaf area: R2 = 0.66, RMSE = 1.05 cm2, rRMSE = 7.63%; Leaf inclination angle: R2 = 0.99, RMSE = 1.01°, rRMSE = 1.72%; Stem diameter: R2 = 0.95, RMSE = 0.12 mm, rRMSE = 5.43%). Breeders can improve the selection of more resilient varieties and cultivars to different growing conditions starting from the dynamic analysis of their phenotype.

Image inpainting based on GAN-driven structure- and texture-aware learning with application to object removal

In this paper, a novel deep learning-based image inpainting framework consisting of restoring image structure and reconstructing image details from corrupted images is proposed. Most image inpainting methods in the literature aim at restoring image details, outlines, and colors, simultaneously, which may suffer from blurring, deformation, and unreasonable content recovery due to interference among various information. To solve these problems, a two-stage image inpainting deep neural network based on GAN (generative adversarial network) architecture is proposed. The proposed inpainting framework consists of two modules: (1) the first stage, called the structure-aware learning stage, aims at learning a GAN-based structure restoration network, focusing on recovering the low-frequency image component, including colors and outlines of the missing regions of the input corrupted image; and (2) the second stage, called the texture-aware learning stage, aims at learning a GAN-based detail refinement network, focusing on rebuilding the high-frequency image details and texture information. In particular, we also propose to remove details from the training images to better train the structure restoration network to avoid inadequate image structure recovery induced by richer image textures, where the detail reconstruction task is left to the second stage. This strategy achieves to balance the workload between the two stages and the image quality can be progressively enhanced through the two stages. Experimental results have shown that the proposed deep inpainting framework quantitatively and qualitatively achieves state-of-the-art performance on the well-known datasets, including the CelebA, Places2, and ImageNet datasets, compared with existing deep learning-based image inpainting approaches. More specifically, in terms of the two well-known image quality assessment metrics, PSNR (peak signal-to-noise ratio) and SSIM (structural similarity), the improvement percentage of the proposed method, compared with the baseline approach, respectively, ranges from 3.23 % to 11.12 %, and 1.95 % to 13.39 %. The improvements have been shown to stably and significantly outperform the compared state-of-the-art methods in most types of inpainting mask. We also show that the proposed method is applicable to image editing in object removal from a single image.

Image inpainting via modified exemplar‐based inpainting with two‐stage structure tensor and image sparse representation

The approach described in this research is an exemplar‐based inpainting problem that combines a two‐stage structure tensor and image sparse representation to fill in any missing pixels. An important step is to select the filling order and local intensity smoothness, as well as to ensure that the structure is not destroyed. We employ a two‐stage structure tensor‐based priority for the filling order: finding the candidate patches and determining the appropriate weight of each candidate patch under the constraint of local patch consistency, then applying a blend of a sparse linear combination of candidate patches to fill in the missing region of the image. In addition, this technique may also be used for object removal. The proposed method yields results that are visually natural and qualitative.

WaveFormer: Wavelet Transformer for Noise-Robust Video Inpainting

Video inpainting aims to fill in the missing regions of the video frames with plausible content. Benefiting from the outstanding long-range modeling capacity, the transformer-based models have achieved unprecedented performance regarding inpainting quality. Essentially, coherent contents from all the frames along both spatial and temporal dimensions are concerned by a patch-wise attention module, and then the missing contents are generated based on the attention-weighted summation. In this way, attention retrieval accuracy has become the main bottleneck to improve the video inpainting performance, where the factors affecting attention calculation should be explored to maximize the advantages of transformer. Towards this end, in this paper, we theoretically certificate that noise is the culprit that entangles the process of attention calculation. Meanwhile, we propose a novel wavelet transformer network with noise robustness for video inpainting, named WaveFormer. Unlike existing transformer-based methods that utilize the whole embeddings to calculate the attention, our WaveFormer first separates the noise existing in the embedding into high-frequency components by introducing the Discrete Wavelet Transform (DWT), and then adopts clean low-frequency components to calculate the attention. In this way, the impact of noise on attention computation can be greatly mitigated and the missing content regarding different frequencies can be generated by sharing the calculated attention. Extensive experiments validate the superior performance of our method over state-of-the-art baselines both qualitatively and quantitatively.

Orthogonal Dictionary Guided Shape Completion Network for Point Cloud

Point cloud shape completion, which aims to reconstruct the missing regions of the incomplete point clouds with plausible shapes, is an ill-posed and challenging task that benefits many downstream 3D applications. Prior approaches achieve this goal by employing a two-stage completion framework, generating a coarse yet complete seed point cloud through an encoder-decoder network, followed by refinement and upsampling. However, the encoded features suffer from information loss of the missing portion, leading to an inability of the decoder to reconstruct seed points with detailed geometric clues. To tackle this issue, we propose a novel Orthogonal Dictionary Guided Shape Completion Network (ODGNet). The proposed ODGNet consists of a Seed Generation U-Net, which leverages multi-level feature extraction and concatenation to significantly enhance the representation capability of seed points, and Orthogonal Dictionaries that can learn shape priors from training samples and thus compensate for the information loss of the missing portions during inference. Our design is simple but to the point, extensive experiment results indicate that the proposed method can reconstruct point clouds with more details and outperform previous state-of-the-art counterparts. The implementation code is available at https://github.com/corecai163/ODGNet.

Deep learning model for human-intuitive shoeprint reconstruction

Shoeprint reconstruction is essential in forensic science, but it is also challenging due to various inconsistencies in the patterns, textures, sizes, abrasions, etc. of shoeprints. The computational reconstruction of sharper and more complete shoeprints is conventionally conducted using handcrafted features, and it often requires human intervention. Prior studies using end-to-end machine learning approaches are limited in number and have not achieved a high level of performance. In this paper, we propose a model named ShoeRec, which employs variational autoencoder (VAE) as a component in a U-Net-like architecture to reconstruct missing regions and borders in shoeprint images. ShoeRec incorporates skip connections to preserve key patterns and employs VAE in the bottleneck to facilitate the reconstruction of desired shoeprints with the restoration of detail as perceived by humans. As a U-Net, the model skips the contextual information from the encoder to the decoder, and the compressed features in the latent space via VAE optimize the probabilistic distribution for reconstructing complete shoeprints. The reconstruction operation is automatically tuned according to the objective function, so as to reduce the structural correlation between the original and projected shoeprint and restore the absent information in the desired shoeprints. To the best of our knowledge, ShoeRec is the first deep learning infusion model that specializes in shoeprint reconstruction. The shoeprints reconstructed by ShoeRec have a close match with the originals in terms of both structures and patterns, and ShoeRec outperforms state-of-the-art generative models in human evaluation.

E2F-Net: Eyes-to-face inpainting via StyleGAN latent space

Face inpainting, the technique of restoring missing or damaged regions in facial images, is pivotal for applications like face recognition in occluded scenarios and image analysis with poor-quality captures. This process not only needs to produce realistic visuals but also preserve individual identity characteristics. The aim of this paper is to inpaint a face given periocular region (eyes-to-face) through a proposed new Generative Adversarial Network (GAN)-based model called Eyes-to-Face Network (E2F-Net). The proposed approach extracts identity and non-identity features from the periocular region using two dedicated encoders have been used. The extracted features are then mapped to the latent space of a pre-trained StyleGAN generator to benefit from its state-of-the-art performance and its rich, diverse and expressive latent space without any additional training. We further improve the StyleGAN's output to find the optimal code in the latent space using a new optimization for GAN inversion technique. Our E2F-Net requires a minimum training process reducing the computational complexity as a secondary benefit. Through extensive experiments, we show that our method successfully reconstructs the whole face with high quality, surpassing current techniques, despite significantly less training and supervision efforts. We have generated seven eyes-to-face datasets based on well-known public face datasets for training and verifying our proposed methods. The code and datasets are publicly available.11https://github.com/fatemejamalii/E2F-Net

Video Inpainting with Local and Global Refinement

Video inpainting is a crucial task in computer vision and video editing, involving in removing unnecessary objects and restoration of missing or corrupted regions within a video sequence. One approach that has gained prominence in recent years is the combination of local and global refinement techniques. This innovative strategy leverages the strengths of both local and global information to produce high-quality inpainted videos. In the context of video inpainting, local refinement focuses on accurately restoring missing or damaged regions by considering nearby pixels or frames. Encoder-decoder network can be employed to fill in gaps with content that seamlessly blends with the surrounding context. On the other hand, global refinement seeks to ensure temporal consistency and smooth transitions between frames, preventing noticeable artifacts or jittering in the inpainted video. In conclusion, by seamlessly blending local and global inpainting strategies, these methods can effectively remove unwanted elements from videos while preserving both spatial and temporal coherence. This technology finds applications in video editing, restoration of damaged archival footage, and even in the entertainment industry for special effects and scene corrections, ultimately contributing to the improvement of video quality and aesthetics. Keywords: Video Inpainting, Local and Global Refinement, Encoder-Decoder network, Recurrent Flow Completion, mask-guided sparse video Transformer, dual-domain propagation.

Weighted Similarity-Confidence Laplacian Synthesis for High-Resolution Art Painting Completion

Artistic image completion assumes a significant role in the preservation and restoration of invaluable art paintings, marking notable advancements through the adoption of deep learning methodologies. Despite progress, challenges persist, particularly in achieving optimal results for high-resolution paintings. The intricacies of complex structures and textures in art paintings pose difficulties for sophisticated approaches like Generative Adversarial Networks (GANs), leading to issues such as small-scale texture synthesis and the inference of missing information, resulting in distortions in lines and unnatural colors. Simultaneously, patch-based image synthesis, augmented with global optimization on the image pyramid, has evolved to enhance structural coherence and details. However, gradient-based synthesis methods face obstacles related to directionality, inconsistency, and the computational burdens associated with solving the Poisson equation in non-integrable gradient fields. This paper introduces a pioneering approach, integrating Weighted Similarity-Confidence Laplacian Synthesis to comprehensively address these challenges and advance the field of artistic image completion. Experimental results affirm the effectiveness of our approach, offering promising outcomes for the preservation and restoration of art paintings with intricate details and irregular missing regions. The integration of weighted Laplacian synthesis and patch-based completion across multi-regions ensures precise and targeted completion, outperforming existing methods. A comparative analysis underscores our method’s superiority in artifact reduction and minimizing blurriness, particularly addressing challenges related to color discrepancies in texture areas. Additionally, the incorporation of pyramid blending proves advantageous, ensuring smoother transitions and preventing noticeable seams or artifacts in blended results. Based on empirical results, our method consistently outperforms previous methods across both high and low resolutions. Responding to these insights, our approach emerges as an invaluable guide for both curators and artists. The algorithm’s performance yields insights that underscore the central role of thoughtful decision making in the creation of art paintings. This guidance extends to informing choices related to color selection, brushstrokes, and various other elements integral to the artistic process. During the creation phase, employing these insights enables artists and curators to optimize not only the digitization but also the subsequent restoration process. This proves especially vital when dealing with the intricacies involved in physically restoring damaged original art paintings. Importantly, our approach not only streamlines the restoration process but also contributes significantly to the preservation and enhancement of the digital representations of these distinctive and often intricate works of art.