Structured Low-rank Matrix Research Articles

Efficient Image Classification via Structured Low-Rank Matrix Factorization Regression

Efficient Image Classification via Structured Low-Rank Matrix Factorization Regression

High-fidelity, high-spatial-resolution diffusion magnetic resonance imaging of ex vivo whole human brain at ultra-high gradient strength with structured low-rank echo-planar imaging ghost correction.

Diffusion magnetic resonance imaging (dMRI) of whole ex vivo human brain specimens enables three-dimensional (3D) mapping of structural connectivity at the mesoscopic scale, providing detailed evaluation of fiber architecture and tissue microstructure at a spatial resolution that is difficult to access in vivo. To account for the short T2 and low diffusivity of fixed tissue, ex vivo dMRI is often acquired using strong diffusion-sensitizing gradients and multishot/segmented 3D echo-planar imaging (EPI) sequences to achieve high spatial resolution. However, the combination of strong diffusion-sensitizing gradients and multishot/segmented EPI readout can result in pronounced ghosting artifacts incurred by nonlinear spatiotemporal variations in the magnetic field produced by eddy currents. Such ghosting artifacts cannot be corrected with conventional correction solutions and pose a significant roadblock to leveraging human MRI scanners with ultrahigh gradients for ex vivo whole-brain dMRI. Here, we show that ghosting-correction approaches that correct for either polarity-related ghosting or shot-to-shot variations in a separate manner are suboptimal for 3D multishot diffusion-weighted EPI experiments in fixed human brain specimens using strong diffusion-sensitizing gradients on the 3-T Connectom MRI scanner, resulting in orientationally biased dMRI estimates. We apply a recently developed advanced k-space reconstruction method based on structured low-rank matrix (SLM) modeling that handles both polarity-related ghosting and shot-to-shot variation simultaneously, to mitigate artifacts in high-angular resolution multishot dMRI data acquired in several fixed human brain specimens at 0.7-0.8-mm isotropic spatial resolution using b-values up to 10,000 s/mm2 and gradient strengths up to 280 mT/m. We demonstrate the improved mapping of diffusion tensor imaging and fiber orientation distribution functions in key neuroanatomical areas distributed across the whole brain using SLM-based EPI ghost correction compared with alternative techniques.

High-Quality MR Fingerprinting Reconstruction Using Structured Low-Rank Matrix Completion and Subspace Projection.

Due to the capability of fast multiparametric quantitative imaging, magnetic resonance fingerprinting (MRF) is becoming a promising quantitative magnetic resonance imaging approach. However, the artifacts caused by the highly undersampled data acquisition lead to inaccurate estimation of the tissue parameter maps. Based on the assumption that the 3-D MRF data can be modeled as a piecewise smooth signal, with the discontinuities localized to the zero sets of a bandlimited function, we exploit the low-rank property of the structured Toeplitz matrix constructed from the Fourier measurements. In addition, we adopt the subspace projection scheme to improve the accuracy of parameter estimation. In order to efficiently solve the regularized problem, we propose an iterative two-stage algorithm, which alternately updates the k -space data and projects the space-time matrix into the dictionary space. Numerical experiments demonstrate that the proposed algorithm shows significant improvement in MRF time-series images reconstruction and can provide more accurate parameter maps over the state-of-the-art algorithms.

Image restoration: Structured low rank matrix framework for piecewise smooth functions and beyond

Recently, mapping a signal/image into a low rank Hankel/Toeplitz matrix has become an emerging alternative to the traditional sparse regularization, due to its ability to alleviate the basis mismatch between the true support in the continuous domain and the discrete grid. In this paper, we introduce a novel structured low rank matrix framework to restore piecewise smooth functions. Inspired by the total generalized variation to use sparse higher order derivatives, we derive that the Fourier samples of higher order derivatives satisfy an annihilation relation, resulting in a low rank multi-fold Hankel matrix. We further observe that the SVD of a low rank Hankel matrix corresponds to a tight wavelet frame system which can represent the image with sparse coefficients. Based on this observation, we also propose a wavelet frame analysis approach based continuous domain regularization model for the piecewise smooth image restoration. Finally, numerical results on image restoration tasks are presented as a proof-of-concept study to demonstrate that the proposed approach is compared favorably against several popular discrete regularization approaches and structured low rank matrix approaches.

Modal-Regression-Based Structured Low-Rank Matrix Recovery for Multiview Learning.

Low-rank Multiview Subspace Learning (LMvSL) has shown great potential in cross-view classification in recent years. Despite their empirical success, existing LMvSL-based methods are incapable of handling well view discrepancy and discriminancy simultaneously, which, thus, leads to performance degradation when there is a large discrepancy among multiview data. To circumvent this drawback, motivated by the block-diagonal representation learning, we propose structured low-rank matrix recovery (SLMR), a unique method of effectively removing view discrepancy and improving discriminancy through the recovery of the structured low-rank matrix. Furthermore, recent low-rank modeling provides a satisfactory solution to address the data contaminated by the predefined assumptions of noise distribution, such as Gaussian or Laplacian distribution. However, these models are not practical, since complicated noise in practice may violate those assumptions and the distribution is generally unknown in advance. To alleviate such a limitation, modal regression is elegantly incorporated into the framework of SLMR (termed MR-SLMR). Different from previous LMvSL-based methods, our MR-SLMR can handle any zero-mode noise variable that contains a wide range of noise, such as Gaussian noise, random noise, and outliers. The alternating direction method of multipliers (ADMM) framework and half-quadratic theory are used to optimize efficiently MR-SLMR. Experimental results on four public databases demonstrate the superiority of MR-SLMR and its robustness to complicated noise.

Autoregression and Structured Low-Rank Modeling of Sinogram Neighborhoods.

Sinograms are commonly used to represent the raw data from tomographic imaging experiments. Although it is already well-known that sinograms posess some amount of redundancy, in this work, we present novel theory suggesting that sinograms will often possess substantial additional redundancies that have not been explicitly exploited by previous methods. Specifically, we derive that sinograms will often satisfy multiple simple data-dependent autoregression relationships. This kind of autoregressive structure enables missing/degraded sinogram samples to be linearly predicted using a simple shift-invariant linear combination of neighboring samples. Our theory also further implies that if sinogram samples are assembled into a structured Hankel/Toeplitz matrix, then the matrix will be expected to have low-rank characteristics. As a result, sinogram restoration problems can be formulated as structured low-rank matrix recovery problems. Illustrations of this approach are provided using several different (real and simulated) X-ray imaging datasets, including comparisons against a state-of-the-art deep learning approach. Results suggest that structured low-rank matrix methods for sinogram recovery can have comparable performance to state-of-the-art approaches. Although our evaluation focuses on competitive comparisons against other approaches, we believe that autoregressive constraints are actually complementary to existing approaches with strong potential synergies.

On Low-Rank Hankel Matrix Denoising

The low-complexity assumption in linear systems can often be expressed as rank deficiency in data matrices with generalized Hankel structure. This makes it possible to denoise the data by estimating the underlying structured low-rank matrix. However, standard low-rank approximation approaches are not guaranteed to perform well in estimating the noise-free matrix. In this paper, recent results in matrix denoising by singular value shrinkage are reviewed. A novel approach is proposed to solve the low-rank Hankel matrix denoising problem by using an iterative algorithm in structured low-rank approximation modified with data-driven singular value shrinkage. It is shown numerically in both the input-output trajectory denoising and the impulse response denoising problems, that the proposed method performs the best in terms of estimating the noise-free matrix among existing algorithms of low-rank matrix approximation and denoising.

A multi-stage convex relaxation approach to noisy structured low-rank matrix recovery

This paper concerns with a noisy structured low-rank matrix recovery problem which can be modeled as a structured rank minimization problem. We reformulate this problem as a mathematical program with a generalized complementarity constraint (MPGCC), and show that its penalty version, yielded by moving the generalized complementarity constraint to the objective, has the same global optimal solution set as the MPGCC does whenever the penalty parameter is over a threshold. Then, by solving the exact penalty problem in an alternating way, we obtain a multi-stage convex relaxation approach. We provide theoretical guarantees for our approach under a mild restricted eigenvalue condition, by quantifying the reduction of the error and approximate rank bounds of the first stage convex relaxation (which is exactly the nuclear norm relaxation) in the subsequent stages and establishing the geometric convergence of the error sequence in a statistical sense. Numerical experiments are conducted for some structured low-rank matrix recovery examples to confirm our theoretical findings.

Structured Low-Rank Algorithms: Theory, Magnetic Resonance Applications, and Links to Machine Learning.

In this survey, we provide a detailed review of recent advances in the recovery of continuous domain multidimensional signals from their few non-uniform (multichannel) measurements using structured low-rank matrix completion formulation. This framework is centered on the fundamental duality between the compactness (e.g., sparsity) of the continuous signal and the rank of a structured matrix, whose entries are functions of the signal. This property enables the reformulation of the signal recovery as a low-rank structured matrix completion, which comes with performance guarantees. We will also review fast algorithms that are comparable in complexity to current compressed sensing methods, which enables the application of the framework to large-scale magnetic resonance (MR) recovery problems. The remarkable flexibility of the formulation can be used to exploit signal properties that are difficult to capture by current sparse and low-rank optimization strategies. We demonstrate the utility of the framework in a wide range of MR imaging (MRI) applications, including highly accelerated imaging, calibration-free acquisition, MR artifact correction, and ungated dynamic MRI.

K-Space deep learning for reference-free EPI ghost correction.

Nyquist ghost artifacts in echo planar imaging (EPI) are originated from phase mismatch between the even and odd echoes. However, conventional correction methods using reference scans often produce erroneous results especially in high-field MRI due to the nonlinear and time-varying local magnetic field changes. Recently, it was shown that the problem of ghost correction can be reformulated as k-space interpolation problem that can be solved using structured low-rank Hankel matrix approaches. Another recent work showed that data driven Hankel matrix decomposition can be reformulated to exhibit similar structures as deep convolutional neural network. By synergistically combining these findings, we propose a k-space deep learning approach that immediately corrects the phase mismatch without a reference scan in both accelerated and non-accelerated EPI acquisitions. To take advantage of the even and odd-phase directional redundancy, the k-space data are divided into 2 channels configured with even and odd phase encodings. The redundancies between coils are also exploited by stacking the multi-coil k-space data into additional input channels. Then, our k-space ghost correction network is trained to learn the interpolation kernel to estimate the missing virtual k-space data. For the accelerated EPI data, the same neural network is trained to directly estimate the interpolation kernels for missing k-space data from both ghost and subsampling. Reconstruction results using 3T and 7T in vivo data showed that the proposed method outperformed the image quality compared to the existing methods, and the computing time is much faster. The proposed k-space deep learning for EPI ghost correction is highly robust and fast, and can be combined with acceleration, so that it can be used as a promising correction tool for high-field MRI without changing the current acquisition protocol.

Intracluster Structured Low-Rank Matrix Analysis Method for Hyperspectral Denoising

Hyperspectral images (HSIs) denoising aims at eliminating the noise generated during the acquisition and transmission of HSIs. Since denoising is an ill-posed problem, utilizing proper knowledge of HSIs as regularization is essential for a good denoiser. Many HSI denoising methods have been proposed to leverage various prior knowledge, e.g., total variation, sparsity, and so on. Among those knowledge, a low-rank property has been shown to be effective for HSI denoising since it has the ability to deal with the missing values. However, most existing low-rank methods seldom consider mining the useful structures inside the low-rank matrix for a better denoising result. In addition, the rank number needs to be assigned manually. To address these problems, we propose an intracluster structured low-rank matrix analysis method for HSI denoising. First, we divide the original HSI into some clusters by taking advantages of both local similarity and nonlocal similarity structures, with which the resulted clusters are simpler and show more obvious low-rank property. Second, with singular value decomposition on the low-rank matrix in each cluster, the structured sparsity is modeled among the singular values to capture the structure of the low-rank matrix. Finally, an efficient optimization method is proposed to learn the structured sparsity adaptively from the data, as well as to inversely estimate the latent clean HSI from the noisy counterpart. The proposed method can not only obtain better denoising results compared with the-state-of-the-art methods but also automatically determine the rank number. Extensive experimental results demonstrate the effectiveness of the proposed method.

A Generalized Structured Low-Rank Matrix Completion Algorithm for MR Image Recovery.

Recent theory of mapping an image into a structured low-rank Toeplitz or Hankel matrix has become an effective method to restore images. In this paper, we introduce a generalized structured low-rank algorithm to recover images from their undersampled Fourier coefficients using infimal convolution regularizations. The image is modeled as the superposition of a piecewise constant component and a piecewise linear component. The Fourier coefficients of each component satisfy an annihilation relation, which results in a structured Toeplitz matrix. We exploit the low-rank property of the matrices to formulate a combined regularized optimization problem. In order to solve the problem efficiently and to avoid the high-memory demand resulting from the large-scale Toeplitz matrices, we introduce a fast and a memory-efficient algorithm based on the half-circulant approximation of the Toeplitz matrix. We demonstrate our algorithm in the context of single and multi-channel MR images recovery. Numerical experiments indicate that the proposed algorithm provides improved recovery performance over the state-of-the-art approaches.

ROBUST AUTOCALIBRATED LORAKS FOR EPI GHOST CORRECTION.

Nyquist ghosts are a longstanding problem in a variety of fast MRI experiments that use echo-planar imaging (EPI). Recently, several structured low-rank matrix modeling approaches have been proposed that achieve state-of-the-art ghost-elimination, although the performance of these approaches is still inadequate in several important scenarios. We present a new structured low-rank matrix recovery ghost correction method that we call Robust Autocalibrated LORAKS (RAC-LORAKS). RAC-LORAKS incorporates constraints from autocalibration data to avoid ill-posedness, but allows adaptation of these constraints to gain robustness against possible autocalibration imperfections. RAC-LORAKS is tested in two challenging scenarios: highly-undersampled multi-channel EPI of the brain, and cardiac EPI with a double-oblique slice orientation. Results show that RAC-LORAKS can provide substantial improvements over existing ghost correction methods, and potentially enables new imaging applications that were previously confounded by ghost artifacts.

DENOISING AND DEINTERLEAVING OF EPSI DATA USING STRUCTURED LOW-RANK MATRIX RECOVERY.

Echo-planar spectroscopic imaging (EPSI) sequence with spectrally interleaving is often used to rapidly collect metabolic MRI data. The main problem in using it on high field scanners is the presence of spurious peaks resulting from phase distortions between interleaves as well as the low signal to noise ratio. We introduce a novel structured low-rank framework for the simultaneous denoising and deinterleaving of spectrally interleaved EPSI data. The proposed algorithm exploits annihilation relations resulting from the linear predicability of exponential signals as well as due to uncorrected phase relations between interleaves. The algorithm is formulated as a structured nuclear norm minimization of a block Hankel matrix, derived from the interleaves. Experiments using hyperpolarized 13 C mouse kidney EPSI data demonstrate the ability of the algorithm to remove ghost peaks from EPSI data collected using bipolar readout gradients.

Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization.

Multiview data clustering attracts more attention than their single-view counterparts due to the fact that leveraging multiple independent and complementary information from multiview feature spaces outperforms the single one. Multiview spectral clustering aims at yielding the data partition agreement over their local manifold structures by seeking eigenvalue-eigenvector decompositions. Among all the methods, low-rank representation (LRR) is effective, by exploring the multiview consensus structures beyond the low rankness to boost the clustering performance. However, as we observed, such classical paradigm still suffers from the following stand-out limitations for multiview spectral clustering of overlooking the flexible local manifold structure, caused by aggressively enforcing the low-rank data correlation agreement among all views, and such a strategy, therefore, cannot achieve the satisfied between-views agreement; worse still, LRR is not intuitively flexible to capture the latent data clustering structures. In this paper, first, we present the structured LRR by factorizing into the latent low-dimensional data-cluster representations, which characterize the data clustering structure for each view. Upon such representation, second, the Laplacian regularizer is imposed to be capable of preserving the flexible local manifold structure for each view. Third, we present an iterative multiview agreement strategy by minimizing the divergence objective among all factorized latent data-cluster representations during each iteration of optimization process, where such latent representation from each view serves to regulate those from other views, and such an intuitive process iteratively coordinates all views to be agreeable. Fourth, we remark that such data-cluster representation can flexibly encode the data clustering structure from any view with an adaptive input cluster number. To this end, finally, a novel nonconvex objective function is proposed via the efficient alternating minimization strategy. The complexity analysis is also presented. The extensive experiments conducted against the real-world multiview data sets demonstrate the superiority over the state of the arts.

Recovery of Damped Exponentials Using Structured Low Rank Matrix Completion.

We introduce a structured low rank matrix completion algorithm to recover a series of images from their under-sampled measurements, where the signal along the parameter dimension at every pixel is described by a linear combination of exponentials. We exploit the exponential behavior of the signal at every pixel, along with the spatial smoothness of the exponential parameters to derive an annihilation relation in the Fourier domain. This relation translates to a low-rank property on a structured matrix constructed from the Fourier samples. We enforce the low-rank property of the structured matrix as a regularization prior to recover the images. Since the direct use of current low rank matrix recovery schemes to this problem is associated with high computational complexity and memory demand, we adopt an iterative re-weighted least squares algorithm, which facilitates the exploitation of the convolutional structure of the matrix. Novel approximations involving 2-D fast Fourier transforms are introduced to drastically reduce the memory demand and computational complexity, which facilitates the extension of structured low-rank methods to large scale 3-D problems. We demonstrate our algorithm in the MR parameter mapping setting and show improvement over the state-of-the-art methods.

RGBD Salient Object Detection by Structured Low-Rank Matrix Recovery and Laplacian Constraint

A structured low-rank matrix recovery model for RGBD salient object detection is proposed. Firstly, the problem is described by a low-rank matrix recovery, and the hierarchical structure of RGB image is added to the sparsity term. Secondly, the depth information is fused into the model by a Laplacian regularization term to ensure that the image regions which share similar depth value will be allocated to similar saliency value. Thirdly, a variation of alternating direction method is proposed to solve the proposed model. Finally, both quantitative and qualitative experimental results on NLPR1000 and NJU400 show the advantage of the proposed RGBD salient object detection model.

A Fast Algorithm for Convolutional Structured Low-rank Matrix Recovery.

Fourier domain structured low-rank matrix priors are emerging as powerful alternatives to traditional image recovery methods such as total variation (TV) and wavelet regularization. These priors specify that a convolutional structured matrix, i.e., Toeplitz, Hankel, or their multi-level generalizations, built from Fourier data of the image should be low-rank. The main challenge in applying these schemes to large-scale problems is the computational complexity and memory demand resulting from a lifting the image data to a large scale matrix. We introduce a fast and memory efficient approach called the Generic Iterative Reweighted Annihilation Filter (GIRAF) algorithm that exploits the convolutional structure of the lifted matrix to work in the original un-lifted domain, thus considerably reducing the complexity. Our experiments on the recovery of images from undersampled Fourier measurements show that the resulting algorithm is considerably faster than previously proposed algorithms, and can accommodate much larger problem sizes than previously studied.

Semidefinite Representations of Gauge Functions for Structured Low-Rank Matrix Decomposition

This paper presents generalizations of semidefinite programming formulations of 1-norm optimization problems over infinite dictionaries of vectors of complex exponentials, which were recently proposed for superresolution, gridless compressed sensing, and other applications in signal processing. Results related to the generalized Kalman--Yakubovich--Popov lemma in linear system theory provide simple, constructive proofs of the semidefinite representations of the penalty functions used in these applications. The connection leads to several extensions to gauge functions and atomic norms for sets of vectors parameterized via the nullspace of matrix pencils. The techniques are illustrated with examples of low-rank matrix approximation problems arising in spectral estimation and array processing.

Multi-shot sensitivity-encoded diffusion data recovery using structured low-rank matrix completion (MUSSELS).

To introduce a novel method for the recovery of multi-shot diffusion weighted (MS-DW) images from echo-planar imaging (EPI) acquisitions. Current EPI-based MS-DW reconstruction methods rely on the explicit estimation of the motion-induced phase maps to recover artifact-free images. In the new formulation, the k-space data of the artifact-free DWI is recovered using a structured low-rank matrix completion scheme, which does not require explicit estimation of the phase maps. The structured matrix is obtained as the lifting of the multi-shot data. The smooth phase-modulations between shots manifest as null-space vectors of this matrix, which implies that the structured matrix is low-rank. The missing entries of the structured matrix are filled in using a nuclear-norm minimization algorithm subject to the data-consistency. The formulation enables the natural introduction of smoothness regularization, thus enabling implicit motion-compensated recovery of the MS-DW data. Our experiments on in-vivo data show effective removal of artifacts arising from inter-shot motion using the proposed method. The method is shown to achieve better reconstruction than the conventional phase-based methods. We demonstrate the utility of the proposed method to effectively recover artifact-free images from Cartesian fully/under-sampled and partial Fourier acquired data without the use of explicit phase estimates. Magn Reson Med 78:494-507, 2017. © 2016 International Society for Magnetic Resonance in Medicine.