Tensor CP Decomposition With Structured Factor Matrices: Algorithms and Performance

Abstract

The canonical polyadic decomposition (CPD) of high-order tensors, also known as Candecomp/Parafac, is very useful for representing and analyzing multidimensional data. This paper considers a CPD model having structured matrix factors, as e.g. Toeplitz, Hankel or circulant matrices, and studies its associated estimation problem. This model arises in signal processing applications such as Wiener-Hammerstein system identification and cumulant-based wireless communication channel estimation. After introducing a general formulation of the considered structured CPD (SCPD), we derive closed-form expressions for the Cramer-Rao bound (CRB) of its parameters under the presence of additive white Gaussian noise. Formulas for special cases of interest, as when the CPD contains identical factors, are also provided. Aiming at a more relevant statistical evaluation from a practical standpoint, we discuss the application of our formulas in a Bayesian context, where prior distributions are assigned to the model parameters. Three existing algorithms for computing SCPDs are then described: a constrained alternating least squares (CALS) algorithm, a subspace-based solution and an algebraic solution for SCPDs with circulant factors. Subsequently, we present three numerical simulation scenarios, in which several specialized estimators based on these algorithms are proposed for concrete examples of SCPD involving circulant factors. In particular, the third scenario concerns the identification of a Wiener-Hammerstein system via the SCPD of an associated Volterra kernel. The statistical performance of the proposed estimators is assessed via Monte Carlo simulations, by comparing their Bayesian mean-square error with the expected CRB.