Tensor Manifold with Tucker Rank Constraints

Abstract

Low-rank tensor approximation plays a crucial role in various tensor analysis tasks ranging from science to engineering applications. There are several important problems facing low-rank tensor approximation. First, the rank of an approximating tensor is given without checking feasibility. Second, even such approximating tensors exist, however, current proposed algorithms cannot provide global optimality guarantees. In this work, we define the low-rank tensor set (LRTS) for Tucker rank which is a union of manifolds of tensors with specific Tucker rank. We propose a procedure to describe LRTS semi-algebraically and characterize the properties of this LRTS, e.g., feasibility of tensors manifold, the equations/inequations size of LRTS, algebraic dimensions, etc. Furthermore, if the cost function for tensor approximation is polynomial type, e.g., Frobenius norm, we propose an algorithm to approximate a given tensor with Tucker rank constraints and prove the global optimality of the proposed algorithm through critical sets determined by the semi-algebraic characterization of LRTS.