Image Reconstruction Method Research Articles

Reconstruction method for gamma-ray coded-aperture imaging based on mask and anti-mask functions

Gamma-ray coded-aperture imaging technology plays an important role in nuclear security, decommissioning of nuclear facilities, and nuclear medicine diagnosis. However, under near-field imaging condition, artifacts in the reconstructed image can interfere with identifying the shape and position of the radioactive source. In this paper, a gamma-ray coded-aperture imaging method based on mask and anti-mask functions was proposed to suppress imaging artifacts and speed up the acquisition of low-noise reconstructed images. Through simulation, the effects of the number of iterations and the thickness of the coded-aperture collimator on the imaging quality were studied, and the range of the optimal correction factor in the method was determined. Imaging experiments were conducted using a compact coded-aperture gamma camera based on CdZnTe detector to verify the applicability of the optimal correction factor range. The limitations of the proposed method were analyzed through complex-shaped source imaging simulations and multi-source imaging experiments. This method has an insufficient suppression effect on random artifacts and requires further improvement in imaging irregular radioactive sources. However, it has good imaging performance for single-point source and multi-point sources, effectively reducing regular cross-shaped and stripe-like artifacts. In the non-uniform radioactive background, it can eliminate a part of artifacts, significantly improving imaging quality. Therefore, this method has potential applications in complex radioactive environments.

Sensitivity-matrix-independent electrical impedance tomography: Damage detection for composite materials

Carbon fiber reinforced polymer (CFRP) is widely utilized due to their superior properties. The structural health monitoring (SHM) for composite materials is crucial to prevent catastrophic failures. Electrical impedance tomography (EIT), which allows for the visualization of the conductivity distribution through the measurement of electrical parameters on the boundary, presents a potential solution for SHM. Existing studies applying EIT to CFRP concentrate on traditional linearization methods that rely on sensitivity matrix, which ignore challenges posed by non-uniform sensitivity. This paper introduces an EIT image reconstruction method that is independent of the sensitivity matrix, offering a novel way for rapid damage detection and real-time SHM. Furthermore, the domain shape transformation is achieved by conformal mapping. Simulations and experiments indicate that the sensitivity-matrix-independent EIT can avoid issues such as blurring in the central region and artifacts near the boundary caused by non-uniform distribution of the sensitivity in the CFRP damage detection.

Evaluating Machine Learning-Based MRI Reconstruction Using Digital Image Quality Phantoms.

Quantitative and objective evaluation tools are essential for assessing the performance of machine learning (ML)-based magnetic resonance imaging (MRI) reconstruction methods. However, the commonly used fidelity metrics, such as mean squared error (MSE), structural similarity (SSIM), and peak signal-to-noise ratio (PSNR), often fail to capture fundamental and clinically relevant MR image quality aspects. To address this, we propose evaluation of ML-based MRI reconstruction using digital image quality phantoms and automated evaluation methods. Our phantoms are based upon the American College of Radiology (ACR) large physical phantom but created in k-space to simulate their MR images, and they can vary in object size, signal-to-noise ratio, resolution, and image contrast. Our evaluation pipeline incorporates evaluation metrics of geometric accuracy, intensity uniformity, percentage ghosting, sharpness, signal-to-noise ratio, resolution, and low-contrast detectability. We demonstrate the utility of our proposed pipeline by assessing an example ML-based reconstruction model across various training and testing scenarios. The performance results indicate that training data acquired with a lower undersampling factor and coils of larger anatomical coverage yield a better performing model. The comprehensive and standardized pipeline introduced in this study can help to facilitate a better understanding of the performance and guide future development and advancement of ML-based reconstruction algorithms.

Real-Time Synthetic Aperture Radar Imaging with Random Sampling Employing Scattered Power Mapping.

A novel image-reconstruction method is proposed for the processing of data acquired at random spatial positions. The images are reconstructed and updated in real time concurrently with the measurements to produce an evolving image, the quality of which is continuously improving and converging as the number of data points increases with the stream of additional measurements. It is shown that the images converge to those obtained with data acquired on a uniformly sampled surface, where the sampling density satisfies the Nyquist limit. The image reconstruction employs a new formulation of the method of scattered power mapping (SPM), which first maps the data into a three-dimensional (3D) preliminary image of the target on a uniform spatial grid, followed by fast Fourier space image deconvolution that provides the high-quality 3D image.

Super-Resolution Image Reconstruction Method between Sentinel-2 and Gaofen-2 Based on Cascaded Generative Adversarial Networks

Due to the multi-scale and spectral features of remote sensing images compared to natural images, there are significant challenges in super-resolution reconstruction (SR) tasks. Networks trained on simulated data often exhibit poor reconstruction performance on real low-resolution (LR) images. Additionally, compared to natural images, remote sensing imagery involves fewer high-frequency components in network construction. To address the above issues, we introduce a new high–low-resolution dataset GF_Sen based on GaoFen-2 and Sentinel-2 images and propose a cascaded network CSWGAN combined with spatial–frequency features. Firstly, based on the proposed self-attention GAN (SGAN) and wavelet-based GAN (WGAN) in this study, the CSWGAN combines the strengths of both networks. It not only models long-range dependencies and better utilizes global feature information, but also extracts frequency content differences between different images, enhancing the learning of high-frequency information. Experiments have shown that the networks trained based on the GF_Sen can achieve better performance than those trained on simulated data. The reconstructed images from the CSWGAN demonstrate improvements in the PSNR and SSIM by 4.375 and 4.877, respectively, compared to the relatively optimal performance of the ESRGAN. The CSWGAN can reflect the reconstruction advantages of a high-frequency scene and provides a working foundation for fine-scale applications in remote sensing.

Fourier Domain Robust Denoising Decomposition and Adaptive Patch MRI Reconstruction.

The sparsity of the Fourier transform domain has been applied to magnetic resonance imaging (MRI) reconstruction in k -space. Although unsupervised adaptive patch optimization methods have shown promise compared to data-driven-based supervised methods, the following challenges exist in MRI reconstruction: 1) in previous k -space MRI reconstruction tasks, MRI with noise interference in the acquisition process is rarely considered. 2) Differences in transform domains should be resolved to achieve the high-quality reconstruction of low undersampled MRI data. 3) Robust patch dictionary learning problems are usually nonconvex and NP-hard, and alternate minimization methods are often computationally expensive. In this article, we propose a method for Fourier domain robust denoising decomposition and adaptive patch MRI reconstruction (DDAPR). DDAPR is a two-step optimization method for MRI reconstruction in the presence of noise and low undersampled data. It includes the low-rank and sparse denoising reconstruction model (LSDRM) and the robust dictionary learning reconstruction model (RDLRM). In the first step, we propose LSDRM for different domains. For the optimization solution, the proximal gradient method is used to optimize LSDRM by singular value decomposition and soft threshold algorithms. In the second step, we propose RDLRM, which is an effective adaptive patch method by introducing a low-rank and sparse penalty adaptive patch dictionary and using a sparse rank-one matrix to approximate the undersampled data. Then, the block coordinate descent (BCD) method is used to optimize the variables. The BCD optimization process involves valid closed-form solutions. Extensive numerical experiments show that the proposed method has a better performance than previous methods in image reconstruction based on compressed sensing or deep learning.

51‐2: Invited Paper: Foveated Image Transmission with Anti‐Aliasing Image Reconstruction

This paper introduces an anti‐aliasing image reconstruction method in the optical coordinate domain for point‐to‐point transmission in AR/VR headset displays, employing variable downsampling ratios across different image areas to reduce transmission bandwidth and corresponding upscaling ratios at the receiver. Filter parameters for anti‐aliasing calculations at each pixel position are determined based on optical coordinates distorted by the lens, enhancing detail in areas with significant image deformation. Image quality is evaluated using MSSSIM and supported by experimental evidence.

SPLIT: Statistical Positronium Lifetime Image Reconstruction via Time-Thresholding.

Positron emission tomography (PET) is a widely utilized medical imaging modality that uses positron-emitting radiotracers to visualize biochemical processes in a living body. The spatiotemporal distribution of a radiotracer is estimated by detecting the coincidence photon pairs generated through positron annihilations. In human tissue, about 40% of the positrons form positroniums prior to the annihilation. The lifetime of these positroniums is influenced by the microenvironment in the tissue and could provide valuable information for better understanding of disease progression and treatment response. Currently, there are few methods available for reconstructing high-resolution lifetime images in practical applications. This paper presents an efficient statistical image reconstruction method for positronium lifetime imaging (PLI). We also analyze the random triple-coincidence events in PLI and propose a correction method for random events, which is essential for real applications. Both simulation and experimental studies demonstrate that the proposed method can produce lifetime images with high numerical accuracy, low variance, and resolution comparable to that of the activity images generated by a PET scanner with currently available time-of-flight resolution.

Image reconstruction of multispectral sparse sampling photoacoustic tomography based on deep algorithm unrolling

Photoacoustic tomography (PAT), as a novel medical imaging technology, provides structural, functional, and metabolism information of biological tissue in vivo. Sparse Sampling PAT, or SS-PAT, generates images with a smaller number of detectors, yet its image reconstruction is inherently ill-posed. Model-based methods are the state-of-the-art method for SS-PAT image reconstruction, but they require design of complex handcrafted prior. Owing to their ability to derive robust prior from labeled datasets, deep-learning-based methods have achieved great success in solving inverse problems, yet their interpretability is poor. Herein, we propose a novel SS-PAT image reconstruction method based on deep algorithm unrolling (DAU), which integrates the advantages of model-based and deep-learning-based methods. We firstly provide a thorough analysis of DAU for PAT reconstruction. Then, in order to incorporate the structural prior constraint, we propose a nested DAU framework based on plug-and-play Alternating Direction Method of Multipliers (PnP-ADMM) to deal with the sparse sampling problem. Experimental results on numerical simulation, in vivo animal imaging, and multispectral un-mixing demonstrate that the proposed DAU image reconstruction framework outperforms state-of-the-art model-based and deep-learning-based methods.

Large‐Scale Lensless Microscopy with Fast Acquisition and Region‐Wise Focusing

AbstractLensless microscopy provides a wide field of view (FOV) determined by the image sensor size, allowing visualization of large sample areas. Coupled with advanced and even pixel super‐resolution phase retrieval algorithms, it can achieve resolutions up to the sub‐micron level, enabling both large‐FOV and high‐resolution imaging. However, high‐throughput lensless imaging encounters challenges in rapid data acquisition and large‐scale phase retrieval. Furthermore, when examining biological samples over a large FOV, focal plane inconsistencies often emerge among distinct regions. This study introduces a fast acquisition and efficient reconstruction method for coherent lensless imaging. Multiple measurements are manually modulated using an axial translation stage and sequentially captured by an image sensor, requiring no hardware synchronization. Optical parameter calibration, region‐wise auto‐focusing, and region‐wise phase retrieval algorithms are integrated to establish a general parallel computing framework for rapid, efficient, and high‐throughput lensless imaging. Experimental results demonstrate a 7.4 mm × 5.5 mm FOV and 1.38 µm half‐pitch resolution imaging of human skin and lung tumor sections with region‐wise focusing, requiring ≈0.5‐s acquisition time and 17‐s reconstruction time. By incorporating pixel super‐resolution, a 0.98 µm half‐pitch resolution is achieved in full‐FOV peripheral blood smears without additional data required, advantageous for discerning hollow shapes and segmenting blood cells.

Super resolution deep learning reconstruction for coronary CT angiography: A structured phantom study

PurposeSuper-resolution deep-learning-based reconstruction: SR-DLR is a newly developed and clinically available deep-learning-based image reconstruction method that can improve the spatial resolution of CT images. The image quality of the output from non-linear image reconstructions, such as DLR, is known to vary depending on the structure of the object being scanned, and a simple phantom cannot explicitly evaluate the clinical performance of SR-DLR. This study aims to accurately investigate the quality of the images reconstructed by SR-DLR by utilizing a structured phantom that simulates the human anatomy in coronary CT angiography. MethodsThe structural phantom had ribs and vertebrae made of plaster, a left ventricle filled with dilute contrast medium, a coronary artery with simulated stenosis, and an implanted stent graft. By scanning the structured phantom, we evaluated noise and spatial resolution on the images reconstructed with SR-DLR and conventional reconstructions. ResultsThe spatial resolution of SR-DLR was higher than conventional reconstructions; the 10 % modulation transfer function of hybrid IR (HIR), DLR, and SR-DLR were 0.792-, 0.976-, and 1.379 cycle/mm, respectively. At the same time, image noise was lowest (HIR: 21.1-, DLR: 19.0-, and SR-DLR: 13.1 HU). SR-DLR could accurately assess coronary artery stenosis and the lumen of the implanted stent graft. ConclusionsSR-DLR can obtain CT images with high spatial resolution and lower noise without special CT equipments, and will help diagnose coronary artery disease in CCTA and other CT examinations that require high spatial resolution.

Digital reference object toolkit of breast DCE MRI for quantitative evaluation of image reconstruction and analysis methods.

To develop a digital reference object (DRO) toolkit to generate realistic breast DCE-MRI data for quantitative assessment of image reconstruction and data analysis methods. A simulation framework in a form of DRO toolkit has been developed using the ultrafast and conventional breast DCE-MRI data of 53 women with malignant (n = 25) or benign (n = 28) lesions. We segmented five anatomical regions and performed pharmacokinetic analysis to determine the ranges of pharmacokinetic parameters for each segmented region. A database of the segmentations and their pharmacokinetic parameters is included in the DRO toolkit that can generate a large number of realistic breast DCE-MRI data. We provide two potential examples for our DRO toolkit: assessing the accuracy of an image reconstruction method using undersampled simulated radial k-space data and assessing the impact of the field inhomogeneity on estimated parameters. The estimated pharmacokinetic parameters for each region showed agreement with previously reported values. For the assessment of the reconstruction method, it was found that the temporal regularization resulted in significant underestimation of estimated parameters by up to 57% and 10% with the weighting factor λ = 0.1 and 0.01, respectively. We also demonstrated that spatial discrepancy of and increase to about 33% and 51% without correction for field. We have developed a DRO toolkit that includes realistic morphology of tumor lesions along with the expected pharmacokinetic parameter ranges. This simulation framework can generate many images for quantitative assessment of DCE-MRI reconstruction and analysis methods.

Modified tuna swarm optimization algorithm for brain stroke imaging with electrical impedance tomography

Stroke is a common disease characterized by high disability rate and high mortality rate. Accurate detection and continuous monitoring are vital for the treatment of stroke. As a promising medical imaging technique, electrical impedance tomography (EIT) is able to provide an alternative for brain imaging. With this technique, conductivity distribution variation caused by pathological change can be visualized. However, image reconstruction is a severely ill-posed inverse problem. Particularly in brain imaging, irregular and multi-layered head structure along with low-conductivity skull further aggravate the challenge for accurate reconstruction. To solve this problem, a novel image-reconstruction method based on modified tuna swarm optimization is proposed for visualizing the conductivity distribution in brain EIT. To evaluate the performance of the proposed method, extensive simulations are carried out on a three-layer head model. The anti-noise performance of the proposed method is estimated by considering noise with different signal-to-noise ratios. In addition to simulation, phantom experiments are conducted to further verify the effectiveness of the proposed method. Both reconstructed images and quantitative evaluations demonstrate that the proposed approach performs well in the reconstruction of simulated intracerebral hemorrhage and secondary ischemia. This work would offer an alternative for accurate reconstruction in medical imaging based on EIT.

Imaging extended single crystal lattice distortion fields with multi-peak Bragg ptychography

Recent advances in phase-retrieval-based x-ray imaging methods have demonstrated the ability to reconstruct 3D distortion vector fields within a nanocrystal by using coherent diffraction information from multiple crystal Bragg reflections. However, these works do not provide a solution to the challenges encountered in imaging lattice distortions in crystals with significant defect content that result in phase wrapping. Moreover, these methods only apply to isolated crystals smaller than the x-ray illumination, and therefore cannot be used for imaging of distortions in extended crystals. We introduce multi-peak Bragg ptychography which addresses both challenges via an optimization framework that combines stochastic gradient descent and phase unwrapping methods for robust image reconstruction of lattice distortions and defects in extended crystals. Our work uses modern automatic differentiation toolsets so that the method is easy to extend to other settings and easy to implement in high-performance computers. This work is particularly timely given the broad interest in using the increased coherent flux in fourth-generation synchrotrons for innovative material research.

Large-scale 3D non-Cartesian coronary MRI reconstruction using distributed memory-efficient physics-guided deep learning with limited training data.

To enable high-quality physics-guided deep learning (PG-DL) reconstruction of large-scale 3D non-Cartesian coronary MRI by overcoming challenges of hardware limitations and limited training data availability. While PG-DL has emerged as a powerful image reconstruction method, its application to large-scale 3D non-Cartesian MRI is hindered by hardware limitations and limited availability of training data. We combine several recent advances in deep learning and MRI reconstruction to tackle the former challenge, and we further propose a 2.5D reconstruction using 2D convolutional neural networks, which treat 3D volumes as batches of 2D images to train the network with a limited amount of training data. Both 3D and 2.5D variants of the PG-DL networks were compared to conventional methods for high-resolution 3D kooshball coronary MRI. Proposed PG-DL reconstructions of 3D non-Cartesian coronary MRI with 3D and 2.5D processing outperformed all conventional methods both quantitatively and qualitatively in terms of image assessment by an experienced cardiologist. The 2.5D variant further improved vessel sharpness compared to 3D processing, and scored higher in terms of qualitative image quality. PG-DL reconstruction of large-scale 3D non-Cartesian MRI without compromising image size or network complexity is achieved, and the proposed 2.5D processing enables high-quality reconstruction with limited training data.

Dynamics of Vortex Structures: From Planets to Black Hole Accretion Disks

Thermo-vortices (bright spots, blobs, swirls) in cosmic fluids (planetary atmospheres, or even black hole accretion disks) are sometimes observed as clustered into quasi-symmetrical quasi-stationary groups but conceptualized in models as autonomous items. We demonstrate—using the (analytical) Sharp Boundaries Evolution Method and a generic model of a thermo-vorticial field in a rotating “thin” fluid layer in a spacetime that may be curved or flat—that these thermo-vortices may be not independent but represent interlinked parts of a single, coherent, multi-petal macro-structure. This alternative conceptualization may influence the designs of numerical models and image-reconstruction methods.

Image fast reconstruction for sparse view computed tomography with reduced sampling integration time

Industrial computed tomography (CT) can detect the internal structure of objects nondestructively. Its scanning and image reconstruction are time-consuming, which limits its application in the fast detection field. In this work, we reduce the sampling integration time in sparse view CT to achieve ultra-fast scanning in only 5 s. However, this ultra-fast scanning method produces more noise and streak artifacts in the reconstructed CT images. The existing reconstruction methods cannot effectively reconstruct high quality CT images under this ultra-fast scanning. To solve this issue, a faster and higher quality CT image reconstruction method is proposed in this paper. We construct a novel objective function using multi-directional TV and adaptive non-local means (ANLM), and design a solution algorithm to solve the objective function. The multi-directional TV-norm takes into account the differences in horizontal, vertical, and 45° directional gradients to obtain more image detail information, while the ANLM-norm focuses on noise suppression. Simulation and practical experiments show that the proposed method can reconstruct higher quality CT images under faster CT scanning strategy, and the peak signal to noise ratio (PSNR) is 1.3 dB higher than the optimal baseline algorithm. On the other hand, our method converges faster and achieves a shorter CT image reconstruction time, which is 47 s shorter than the current popular iterative reconstruction methods. This reconstruction method provides a reliable scheme for faster CT scanning and image reconstruction.

Joint reconstruction and segmentation in undersampled 3D knee MRI combining shape knowledge and deep learning

Objective. Task-adapted image reconstruction methods using end-to-end trainable neural networks (NNs) have been proposed to optimize reconstruction for subsequent processing tasks, such as segmentation. However, their training typically requires considerable hardware resources and thus, only relatively simple building blocks, e.g. U-Nets, are typically used, which, albeit powerful, do not integrate model-specific knowledge. Approach. In this work, we extend an end-to-end trainable task-adapted image reconstruction method for a clinically realistic reconstruction and segmentation problem of bone and cartilage in 3D knee MRI by incorporating statistical shape models (SSMs). The SSMs model the prior information and help to regularize the segmentation maps as a final post-processing step. We compare the proposed method to a simultaneous multitask learning approach for image reconstruction and segmentation (MTL) and to a complex SSMs-informed segmentation pipeline (SIS). Main results. Our experiments show that the combination of joint end-to-end training and SSMs to further regularize the segmentation maps obtained by MTL highly improves the results, especially in terms of mean and maximal surface errors. In particular, we achieve the segmentation quality of SIS and, at the same time, a substantial model reduction that yields a five-fold decimation in model parameters and a computational speedup of an order of magnitude. Significance. Remarkably, even for undersampling factors of up to R = 8, the obtained segmentation maps are of comparable quality to those obtained by SIS from ground-truth images.

Moment preserving tomographic image reconstruction model

Shape descriptors provide valuable prior information in many tomographic image reconstruction methods. Such descriptors include, among others, centroid, circularity, orientation, and elongation. Shape descriptor measures are often analytically expressed as a composition of certain geometric moments. Building upon this fact, this paper suggests preserving the values of a specific geometric moment in the reconstruction process, instead of preserving entire descriptors, as it has been suggested so far. Reconstructions from two natural projection directions (vertical and horizontal) are considered with special attention. The provided theoretical analysis demonstrates that preserving the value of a specific geometric moment, provided as prior information for the reconstruction process, simultaneously ensures the preservation of the true measures of all four abovementioned descriptors. Based on this result, a novel regularized energy minimization reconstruction model is proposed. The minimization task of the new model is solved using gradient-based optimization algorithm. Performance evaluation of the proposed method is supported by experimental results obtained through comparisons with other well-known reconstruction methods.

Effect of MR head coil geometry on deep-learning-based MR image reconstruction.

To investigate whether parallel imaging-imposed geometric coil constraints can be relaxed when using a deep learning (DL)-based image reconstruction method as opposed to a traditional non-DL method. Traditional and DL-based MR image reconstruction approaches operate in fundamentally different ways: Traditional methods solve a system of equations derived from the image data whereas DL methods use data/target pairs to learn a generalizable reconstruction model. Two sets of head coil profiles were evaluated: (1) 8-channel and (2) 32-channel geometries. A DL model was compared to conjugate gradient SENSE (CG-SENSE) and L1-wavelet compressed sensing (CS) through quantitative metrics and visual assessment as coil overlap was increased. Results were generally consistent between experiments. As coil overlap increased, there was a significant (p < 0.001) decrease in performance in most cases for all methods. The decrease was most pronounced for CG-SENSE, and the DL models significantly outperformed (p < 0.001) their non-DL counterparts in all scenarios. CS showed improved robustness to coil overlap and signal-to-noise ratio (SNR) versus CG-SENSE, but had quantitatively and visually poorer reconstructions characterized by blurriness as compared to DL. DL showed virtually no change in performance across SNR and very small changes across coil overlap. The DL image reconstruction method produced images that were robust to coil overlap and of higher quality than CG-SENSE and CS. This suggests that geometric coil design constraints can be relaxed when using DL reconstruction methods.