Block Matching 3D Research Articles

BM3D-based total variation algorithm for speckle removal with structure-preserving in OCT images.

In this paper, we propose a total variation based on block matching 3D (BM3D-TV method), which includes the total variation regular term, the data fidelity term, and the block matching term. In addition, we also propose a fast numerical algorithm based on the split Bregman iteration for the proposed method. By assigning suitable weights to the data fidelity term and block matching term, the image noise reduction and the image structural characteristics can be matched optimally. We test the proposed method on six human retinal and one mouse skin optical coherence tomography (OCT) images respectively, and also compare it with total variation (TV) and BM3D, which were proved to be effective in denoising. The performances of these methods are quantitatively evaluated in terms of the signal-to-noise ratio, the contrast-to-noise ratio, and the averaged equivalent number of homogeneous areas at the aspects of speckle reduction and structure protection. Vast experiments show that the BM3D-TV method can effectively reduce speckle noise in OCT images, protect important structural information and improve image quality, compared with the BM3D and TV methods.

Denoising Method for Passive Photon Counting Images Based on Block-Matching 3D Filter and Non-Subsampled Contourlet Transform.

Multi-pixel photon counting detectors can produce images in low-light environments based on passive photon counting technology. However, the resulting images suffer from problems such as low contrast, low brightness, and some unknown noise distribution. To achieve a better visual effect, this paper describes a denoising and enhancement method based on a block-matching 3D filter and a non-subsampled contourlet transform (NSCT). First, the NSCT was applied to the original image and histogram-equalized image to obtain the sub-band low- and high-frequency coefficients. Regional energy and scale correlation rules were used to determine the respective coefficients. Adaptive single-scale retinex enhancement was applied to the low-frequency components to improve the image quality. The high-frequency sub-bands whose line features were best preserved were selected and processed using a symbol function and the Bayes-shrink threshold. After applying the inverse transform, the fused photon counting image was subjected to an improved block-matching 3D filter, significantly reducing the operation time. The final result from the proposed method was superior to those of comparative methods in terms of several objective evaluation indices and exhibited good visual effects and details from the objective impression.

Comparative study of multi-look processing for phase map de-noising in digital Fresnel holographic interferometry.

This paper presents a comparative study of multi-look approaches for de-noising phase maps from digital holographic interferometry. A database of 160 simulated phase fringe patterns with eight different phase fringe patterns with fringe diversity was computed. For each fringe pattern, 20 realistic noise realizations are generated in order to simulate a multi-look process with 20 inputs. A set of 22 de-noising algorithms was selected and processed for each simulation. Three approaches for multi-look processing are evaluated. Quantitative appraisal is obtained using two metrics. The results show good agreement for algorithm rankings obtained with both metrics. One singular and highly practical result of the study is that a multi-look approach with average looks before noise processing performs better than averaging computed with all de-noised looks. The results also demonstrate that the two-dimensional windowed Fourier transform filtering exhibits the best performance in all cases and that the block-matching 3D (BM3D) algorithm is second in the ranking.

A Direct Material Reconstruction Method for DECT Based on Total Variation and BM3D Frame

Dual-energy computed tomography (DECT) has attracted the attention of clinical researchers because of its outstanding capabilities to identify and decompose materials. Considering that material decomposition is unstable, reconstructed material images experience severe noise magnification resulting from the measurement data. To alleviate this problem, we propose a direct material reconstruction method by establishing a novel constrained reconstruction model based on total variation (TV) and block matching 3D (BM3D) frame regularization. TV regularization preserves the sparsity in the gradient domain of material maps and helps to preserve the image edges. BM3D frame is applied to depict the similarities among various patches in reconstructed images by grouping similar 2D image blocks into 3D data arrays combined with sparse transforms. To solve the program efficiently, a practical algorithm based on alternating direction method is developed. A modified strategy of block matching denoising is designed by incorporating the polychromatic reconstructed image into the problem solution. Digital and real data phantom studies are performed to validate the performance of the proposed method. The proposed method reduces the standard deviation on the selected region of interests by an average of 95.02% and 89.03% for the digital phantom and 95.21% and 84.19% for the real data compared with the extended simultaneous algebraic reconstruction technique and TV-based method, respectively. The reconstruction results demonstrate that the proposed method has promising capabilities in direct material reconstruction and superiority over its counterparts.

Video denoising algorithm based on improved dual‐domain filtering and 3D block matching

This study introduces an algorithm for video denoising based on improved dual-domain filtering and 3D block matching. The wavelet thresholding based on 3D block matching is introduced to make full use of the correlation of video sequence in order to apply dual-domain filtering to the video. A layered approach is used that attempts denoising in both a base layer and a detail layer. The result of wavelet thresholding based on 3D block matching is used as a guide image to make the base layer smoother. Shrinkage of short-time Fourier transform coefficients further decreases the noise in the detail layer. Experimental results show that the authors' algorithm generates a better base layer and detail layer than the traditional dual-domain filtering algorithms. The subjective and objective comparisons of different algorithms also prove that the proposed algorithm performs better for video denoising.

Additive Spatially Correlated Noise Suppression by Robust Block Matching and Adaptive 3D Filtering

The evolution of modern sensors for image acquisition brings as much obstacles as many possibilities to obtain multidimensional data with high resolution and rich information. One of the most perceptible destructive factors in visual data is noise. Due to complexity of modern sensors and approaches to signal collecting or preprocessing, noise model becomes complicated. The article’s goal is to introduce and solve a problem of suppressing additive spatially correlated noise (ASCN) which is present in images due to different sources and has various levels of correlation. It is shown that even modern filters attempting to suppress correlated noise often demonstrate unsatisfactory efficiency. Here we propose and analyze two modifications of 2D discrete cosine transform (DCT) based filter and the state-of-the-art BM3D technique. Both are based on accounting spatial spectrum of the noise by setting frequency-dependent thresholds. Furthermore, the modified BM3D filter exploits a similarity measure robust to noise spectrum in block matching.

InSAR-BM3D: A Nonlocal Filter for SAR Interferometric Phase Restoration

The block-matching 3-D (BM3D) algorithm, based on the nonlocal approach, is one of the most effective methods to date for additive white Gaussian noise image denoising. Likewise, its extension to synthetic aperture radar (SAR) amplitude images, SAR-BM3D, is a state-of-the-art SAR despeckling algorithm. In this paper, we further extend BM3D to address the restoration of SAR interferometric phase images. While keeping the general structure of BM3D, its processing steps are modified to take into account the peculiarities of the SAR interferometry signal. Experiments on simulated and real-world Tandem-X SAR interferometric pairs prove the effectiveness of the proposed method.

Multiwavelength Absolute Phase Retrieval from Noisy Diffractive Patterns: Wavelength Multiplexing Algorithm

We study the problem of multiwavelength absolute phase retrieval from noisy diffraction patterns. The system is lensless with multiwavelength coherent input light beams and random phase masks applied for wavefront modulation. The light beams are formed by light sources radiating all wavelengths simultaneously. A sensor equipped by a Color Filter Array (CFA) is used for spectral measurement registration. The developed algorithm targeted on optimal phase retrieval from noisy observations is based on maximum likelihood technique. The algorithm is specified for Poissonian and Gaussian noise distributions. One of the key elements of the algorithm is an original sparse modeling of the multiwavelength complex-valued wavefronts based on the complex-domain block-matching 3D filtering. Presented numerical experiments are restricted to noisy Poissonian observations. They demonstrate that the developed algorithm leads to effective solutions explicitly using the sparsity for noise suppression and enabling accurate reconstruction of absolute phase of high-dynamic range.

Image artifacts and noise reduction algorithm for cone-beam computed tomography with low-signal projections

This study aims to investigate and test a new image reconstruction algorithm applying to the low-signal projections to generate high quality images by reducing the artifacts and noise in the cone-beam computed tomography (CBCT). For the low-signal and noisy projections, a multiple sampling method is first utilized in projection domain to suppress environmental noise, which guarantees the accuracy of the data for reconstruction, simultaneously. Next, a fuzzy entropy based method with block matching 3D (BM3D) filtering algorithm is employed to improve the image quality to reduce artifacts and noise in image domain. Then, simulation studies on polychromatic spectrum were performed to evaluate the performance of the proposed new algorithm. Study results demonstrated significant improvement in the signal-to-noise ratios (SNRs) and contrast-to-noise ratios (CNRs) of the images reconstructed using the new algorithm. SNRs and CNRs of the new images were averagely 40% and 20% higher than those of the previous images reconstructed using the traditional algorithms, respectively. As a result, since the new image reconstruction algorithm effectively reduced the artifacts and noise, and produced images with better contour and grayscale distribution, it has the potential to improve image quality using the original CBCT data with the low and missing signals.

Low-dose CT restoration via stacked sparse denoising autoencoders

Abstract To improve the imaging quality of low-dose computed tomography (CT) images, a deep learning based method for low-dose CT restoration is presented in this paper. Stacked sparse denoising autoencoders, which were designed originally for training noisy samples, are adopted to construct the architecture. Experimental results demonstrate that the proposed model outperforms several state-of-the-art methods, including total variation based projection on convex sets (TV-POCS), dictionary learning, block-matching 3D (BM3D), convolutional denoising autoencoders (CDA) and U-Net based residual convolutional neural network (KAIST-Net), both qualitatively and quantitatively. The proposed method is not only capable of suppressing noise but also recovering structural details. Furthermore, once the network is trained offline, the processing speed for target low-dose images is much faster than other methods.

Learnable despeckling framework for optical coherence tomography images.

Optical coherence tomography (OCT) is a prevalent, interferometric, high-resolution imaging method with broad biomedical applications. Nonetheless, OCT images suffer from an artifact called speckle, which degrades the image quality. Digital filters offer an opportunity for image improvement in clinical OCT devices, where hardware modification to enhance images is expensive. To reduce speckle, a wide variety of digital filters have been proposed; selecting the most appropriate filter for an OCT image/image set is a challenging decision, especially in dermatology applications of OCT where a different variety of tissues are imaged. To tackle this challenge, we propose an expandable learnable despeckling framework, we call LDF. LDF decides which speckle reduction algorithm is most effective on a given image by learning a figure of merit (FOM) as a single quantitative image assessment measure. LDF is learnable, which means when implemented on an OCT machine, each given image/image set is retrained and its performance is improved. Also, LDF is expandable, meaning that any despeckling algorithm can easily be added to it. The architecture of LDF includes two main parts: (i)an autoencoder neural network and (ii)filter classifier. The autoencoder learns the FOM based on several quality assessment measures obtained from the OCT image including signal-to-noise ratio, contrast-to-noise ratio, equivalent number of looks, edge preservation index, and mean structural similarity index. Subsequently, the filter classifier identifies the most efficient filter from the following categories: (a)sliding window filters including median, mean, and symmetric nearest neighborhood, (b)adaptive statistical-based filters including Wiener, homomorphic Lee, and Kuwahara, and (c)edge preserved patch or pixel correlation-based filters including nonlocal mean, total variation, and block matching three-dimensional filtering.

Incomplete projection reconstruction of computed tomography based on the modified discrete algebraic reconstruction technique

Based on the discrete algebraic reconstruction technique (DART), this study aims to address and test a new improved algorithm applied to incomplete projection data to generate a high quality reconstruction image by reducing the artifacts and noise in computed tomography. For the incomplete projections, an augmented Lagrangian based on compressed sensing is first used in the initial reconstruction for segmentation of the DART to get higher contrast graphics for boundary and non-boundary pixels. Then, the block matching 3D filtering operator was used to suppress the noise and to improve the gray distribution of the reconstructed image. Finally, simulation studies on the polychromatic spectrum were performed to test the performance of the new algorithm. Study results show a significant improvement in the signal-to-noise ratios (SNRs) and average gradients (AGs) of the images reconstructed from incomplete data. The SNRs and AGs of the new images reconstructed by DART-ALBM were on average 30%–40% and 10% higher than the images reconstructed by DART algorithms. Since the improved DART-ALBM algorithm has a better robustness to limited-view reconstruction, which not only makes the edge of the image clear but also makes the gray distribution of non-boundary pixels better, it has the potential to improve image quality from incomplete projections or sparse projections.

A Novel Total Variation Model for Low-Dose CT Image Denoising

Low-dose computed tomography (LDCT) images are polluted by mottle noise and streak artifacts. To improve LDCT images quality, this paper proposes a novel total variation (NTV) model. A weighted coefficient of the regularization term of NTV model is constructed by standard deviation, gray-level probability and gradient magnitude to smooth LDCT images adaptively, since the standard deviation and the gray-level probability of detail region are higher than that of the noisy background, and the gradient magnitude of edges is higher than that of the noisy background. Besides, to preserve details and edges effectively, the fidelity term of the proposed NTV model is constructed by the block-matching 3d filter because it performs well in details and edges preservation. The experiments are performed on the computer simulated phantom and the actual phantom. Compared with several other competitive methods, both subjective visual effect and objective evaluation criteria show that the proposed NTV model can improve LDCT images quality more effectively such as noise and artifacts suppression, details, and edges preservation.

A POCS super resolution restoration algorithm based on BM3D

The inherent shortcoming of POCS (Projection Onto Convex Sets) is its sensitiveness to noise. The restoration quality of POCS based super resolution will severely decline when the noise is larger. In practical applications, the low resolution images generally include some kinds of noise, such as camera internal noise, transmission system noise and coherent noise. Therefore POCS cannot be used directly in super-resolution restoration for observed low resolution images. In order to solve the noise sensitive problem of the traditional POCS restoration algorithm, we firstly propose to optimize the BM3D (Block-Matching 3D) filtering by mean pre-screening of image blocks and limiting the number of image blocks. Then we combine the optimized BM3D filtering with POCS restoration in this paper. Experimental results show that the proposed POCS super resolution restoration algorithm based on BM3D can achieve better restoration effect when the low resolution images contain noise. Furthermore no noise can be perceived in the restored high resolution image basically.

Improved BM3D denoising method

Block matching 3D denoising (BM3D) is an excellent single-image denoising method. However, it still needs to be improved for solving practical problems. In this study, the authors attempt to improve the method of BM3D. First, one of the problems of BM3D is that some of its references cannot perform self-adaption when the noise intensity of the images is changed. Therefore, they propose a method using total variation (TV) to calculate the image noise intensity and make the references perform self-adaption. Second, finding similar blocks in the BM3D method is a time-consuming procedure. To solve this problem, they analyse the relationship between the numbers of similar blocks and denoising effect, improve the process of searching for similar blocks, and reduce the running time. Third, through the experiment they find that the denoising effect of BM3D method in the domain of complex texture is unsatisfactory. Thus, they proposed a hybrid denoising method for the complex texture area, using the new TV model and BM3D method together to restore the image. Their experimental results show that the improved BM3D method performs better than the original BM3D method.

Sparse approximations in complex domain based on BM3D modeling

In this paper the concept of sparsity for complex-valued variables is introduced in the following three types: directly in complex domain and for two real-valued pairs phase/amplitude and real/imaginary parts of complex variables. The nonlocal block-matching technique is used for sparsity implementation and filter design for each type of sparsity. These filters are complex domain generalizations of the Block Matching 3D collaborative (BM3D) filter based on the high-order singular value decomposition (HOSVD) in order to generate group-wise adaptive analysis/synthesis transforms. Complex domain denoising is developed and studied as a test-problem for comparison of the designed filters as well as the different types of sparsity modeling.

A multichannel block-matching denoising algorithm for spectral photon-counting CT images.

We present a denoising algorithm designed for a whole-body prototype photon-counting computed tomography (PCCT) scanner with up to 4 energy thresholds and associated energy-binned images. Spectral PCCT images can exhibit low signal to noise ratios (SNRs) due to the limited photon counts in each simultaneously-acquired energy bin. To help address this, our denoising method exploits the correlation and exact alignment between energy bins, adapting the highly-effective block-matching 3D (BM3D) denoising algorithm for PCCT. The original single-channel BM3D algorithm operates patch-by-patch. For each small patch in the image, a patch grouping action collects similar patches from the rest of the image, which are then collaboratively filtered together. The resulting performance hinges on accurate patch grouping. Our improved multi-channel version, called BM3D_PCCT, incorporates two improvements. First, BM3D_PCCT uses a more accurate shared patch grouping based on the image reconstructed from photons detected in all 4 energy bins. Second, BM3D_PCCT performs a cross-channel decorrelation, adding a further dimension to the collaborative filtering process. These two improvements produce a more effective algorithm for PCCT denoising. Preliminary results compare BM3D_PCCT against BM3D_Naive, which denoises each energy bin independently. Experiments use a three-contrast PCCT image of a canine abdomen. Within five regions of interest, selected from paraspinal muscle, liver, and visceral fat, BM3D_PCCT reduces the noise standard deviation by 65.0%, compared to 40.4% for BM3D_Naive. Attenuation values of the contrast agents in calibration vials also cluster much tighter to their respective lines of best fit. Mean angular differences (in degrees) for the original, BM3D_Naive, and BM3D_PCCT images, respectively, were 15.61, 7.34, and 4.45 (iodine); 12.17, 7.17, and 4.39 (galodinium); and 12.86, 6.33, and 3.96 (bismuth). We outline a multi-channel denoising algorithm tailored for spectral PCCT images, demonstrating improved performance over an independent, yet state-of-the-art, single-channel approach.

COMPARISON OF IMAGE ENHANCEMENT METHODS FOR CHROMOSOME KARYOTYPE IMAGE ENHANCEMENT

The chromosome is a set of DNA structure that carry information about our life. The information can be obtained through Karyotyping. The process requires a clear image so the chromosome can be evaluate well. Preprocessing have to be done on chromosome images that is image enhancement. The process starts with image background removing. The image will be cleaned background color. The next step is image enhancement. This paper compares several methods for image enhancement. We evaluate some method in image enhancement like Histogram Equalization (HE), Contrast-limiting Adaptive Histogram Equalization (CLAHE), Histogram Equalization with 3D Block Matching (HE+BM3D), and basic image enhancement, unsharp masking. We examine and discuss the best method for enhancing chromosome image. Therefore, to evaluate the methods, the original image was manipulated by the addition of some noise and blur. Peak Signal-to-noise Ratio (PSNR) and Structural Similarity Index (SSIM) are used to examine method performance. The output of enhancement method will be compared with result of Professional software for karyotyping analysis named Ikaros MetasystemT M . Based on experimental results, HE+BM3D method gets a stable result on both scenario noised and blur image.

Sensitivity Analysis of the Scattering-Based SARBM3D Despeckling Algorithm.

Synthetic Aperture Radar (SAR) imagery greatly suffers from multiplicative speckle noise, typical of coherent image acquisition sensors, such as SAR systems. Therefore, a proper and accurate despeckling preprocessing step is almost mandatory to aid the interpretation and processing of SAR data by human users and computer algorithms, respectively. Very recently, a scattering-oriented version of the popular SAR Block-Matching 3D (SARBM3D) despeckling filter, named Scattering-Based (SB)-SARBM3D, was proposed. The new filter is based on the a priori knowledge of the local topography of the scene. In this paper, an experimental sensitivity analysis of the above-mentioned despeckling algorithm is carried out, and the main results are shown and discussed. In particular, the role of both electromagnetic and geometrical parameters of the surface and the impact of its scattering behavior are investigated. Furthermore, a comprehensive sensitivity analysis of the SB-SARBM3D filter against the Digital Elevation Model (DEM) resolution and the SAR image-DEM coregistration step is also provided. The sensitivity analysis shows a significant robustness of the algorithm against most of the surface parameters, while the DEM resolution plays a key role in the despeckling process. Furthermore, the SB-SARBM3D algorithm outperforms the original SARBM3D in the presence of the most realistic scattering behaviors of the surface. An actual scenario is also presented to assess the DEM role in real-life conditions.

Scattering-Based SARBM3D

Interpreting synthetic aperture radar (SAR) images may be a very challenging task, even for expert users. One of the main reasons is the multiplicative speckle noise typical of coherent acquisition systems. Therefore, despeckling can be expected to play a key role in the full exploitation of SAR imagery potential. However, even state-of-the-art despeckling algorithms neglect the physical phenomena hidden behind SAR imagery. Image acquisition depends on electromagnetic scattering, which is also at the basis of speckle noise. Taking into account scattering issues into more physical-based despeckling algorithms may only benefit the overall performance. In this paper, we propose a scattering-based (SB) version of the SAR block-matching 3D (BM3D) filter, named SB-SARBM3D. SARBM3D can be arguably considered as one of the most promising and accurate despeckling algorithms, providing a good compromise between speckle reduction and detail preservation. We modify the original algorithm so as to exploit the prior information available on the imaged scene, taken into account based on scattering concepts. The new algorithm is tested in a variety of different and complementary simulated scenarios, and its performance is assessed objectively by means of numerous synthetic parameters. Moreover, comparison with different state-of-the-art despeckling algorithms is performed on some actual SAR images, both inherent to natural and urbanized areas, for subjective evaluation. Thanks to the prior information, SB-SARBM3D outperforms the original algorithm in terms of both speckle reduction and detail preservation. Moreover, it reduces the annoying artifacts introduced sometimes by SARBM3D in homogeneous areas of the image.