Maximum Block Improvement Research Articles

Generalized MBI Algorithm for Designing Sequence Set and Mismatched Filter Bank With Ambiguity Function Constraints

A sequence set with ambiguity function (AF) specifications is frequently required in multi-transmit active sensing systems which exploit waveform diversity. This paper formulates a new model to jointly design sequence set and mismatched filter bank with AF requirements, which is a generalization of the auto-AF and cross-AF adopted in the matched filter scheme to attain lower AF sidelobe levels with an increased degree-of-freedom. The aforementioned designs result in nonconvex and nonlinear high-order polynomial (HOP) optimization problems with HOP constraints. Although the maximum block improvement (MBI) method has exhibited the powerful HOP optimization ability to design a short sequence with slow-time AF, it cannot tackle HOP constraints and involves high-complexity tensor operations. To address these issues, we develop a generalized MBI method for the HOP constrained optimization formulations. In addition, the proposed algorithm significantly reduces the computational complexity via designing an equivalent polynomial function for the original multi-linear tensor function. Numerical results demonstrate the excellent performance of our design solutions.

One-Bit Symbol-Level Precoding for MU-MISO Downlink With Intelligent Reflecting Surface

This paper considers symbol-level precoding (SLP) for multiuser multi-input single-output (MISO) downlink transmission with the aid of intelligent reflecting surface (IRS). Specifically, by assuming one-bit transmitted signals at the base station (BS), which arises from the use of low-resolution DACs in the regime of massive transmit antennas, a joint design of one-bit SLP at the BS and the phase shifts at the IRS is proposed with a goal of minimizing the worst-case symbol error probability (SEP) of the users under the PSK modulation. This joint design problem is essentially a mixed integer nonlinear program (MINLP). To tackle it, we alternately optimize the one-bit signal and the phase shifts. For the former, a dual of the relaxed one-bit SLP problem is solved by the mirror descent (MD) method with the maximum block improvement (MBI) heuristics. For the latter, the accelerated projected gradient (APG) method is employed to optimize the phases. Numerical results demonstrate that the proposed joint design can attain better SEP performance than the conventional linear precoding and one-bit SLP.

A New Sequential Optimization Procedure and Its Applications to Resource Allocation for Wireless Systems

A novel optimization framework for resource allocation in wireless networks and radar systems is proposed, which merges the methods of maximum block improvement (MBI) and of sequential optimization. A detailed convergence proof is provided, showing that the proposed algorithm is able to monotonically increase the objective value while ensuring that every limit point of the generated variable sequence fulfills the problem first-order optimality conditions under very mild hypothesis. These results extend available convergence results on MBI and sequential optimization, significantly widening the range of applications that can be handled by the proposed framework compared to available approaches. This point is illustrated in detail presenting relevant applications from both the cellular and radar context, which fall under the umbrella of the developed optimization method.

Multilayer tensor factorization with applications to recommender systems

Recommender systems have been widely adopted by electronic commerce and entertainment industries for individualized prediction and recommendation, which benefit consumers and improve business intelligence. In this article, we propose an innovative method, namely the recommendation engine of multilayers (REM), for tensor recommender systems. The proposed method utilizes the structure of a tensor response to integrate information from multiple modes, and creates an additional layer of nested latent factors to accommodate between-subjects dependency. One major advantage is that the proposed method is able to address the “cold-start” issue in the absence of information from new customers, new products or new contexts. Specifically, it provides more effective recommendations through sub-group information. To achieve scalable computation, we develop a new algorithm for the proposed method, which incorporates a maximum block improvement strategy into the cyclic blockwise-coordinate-descent algorithm. In theory, we investigate algorithmic properties for convergence from an arbitrary initial point and local convergence, along with the asymptotic consistency of estimated parameters. Finally, the proposed method is applied in simulations and IRI marketing data with 116 million observations of product sales. Numerical studies demonstrate that the proposed method outperforms existing competitors in the literature.

Energy-Delay Efficient Power Control in Wireless Networks

This work aims at developing a power control framework to jointly optimize energy efficiency (measured in bit/Joule) and delay in wireless networks. A multi-objective approach is taken to deal with both performance metrics, while ensuring a minimum quality-of-service to each user in the network. Each user in the network is modeled as a rational agent that engages in a generalized non-cooperative game. Feasibility conditions are derived for the existence of each player's best response, and used to show that if these conditions are met, the game best response dynamics will converge to a unique Nash equilibrium. Based on these results, a convergent power control algorithm is derived, which can be implemented in a fully decentralized fashion. Next, a centralized power control algorithm is proposed, which also serves as a benchmark for the proposed decentralized solution. Due to the non-convexity of the centralized problem, the tool of maximum block improvement is used, to trade-off complexity with optimality.

Discrete Sum Rate Maximization for MISO Interference Broadcast Channels: Convex Approximations and Efficient Algorithms

This paper considers the discrete sum rate maximization (DSRM) problem for beamformer optimization in multi-input single-output interference broadcast channels. In this problem, the achievable rates of the receivers are restricted to be taken from a set of finite discrete rate values, and such constraints arise from practical limitations with the modulation and coding schemes. Many existing studies consider sum rate maximization without the discrete rate constraints, and that may result in performance loss. In this paper, the DSRM problem is tackled via a convex approximation approach. Due to the discrete rate constraints, DSRM is a mixed-integer program. The idea of the proposed approach is to reformulate DSRM as a continuous, but still nonconvex, optimization problem. Then, appropriate convex approximations are applied. The advantage of the proposed approach is that the resulting approximate problems can be easily decomposed from a first-order optimization viewpoint. Utilizing this special feature, low-complexity and decentralized algorithms based on projected gradient are derived. Numerical results are used to show the efficiencies of the proposed algorithms in a multicell coordinated beamforming scenario. Also, this paper provides a proof for the convergence guarantee of one decentralized optimization strategy, namely, inexact maximum block improvement.

SPARCoC: a new framework for molecular pattern discovery and cancer gene identification.

It is challenging to cluster cancer patients of a certain histopathological type into molecular subtypes of clinical importance and identify gene signatures directly relevant to the subtypes. Current clustering approaches have inherent limitations, which prevent them from gauging the subtle heterogeneity of the molecular subtypes. In this paper we present a new framework: SPARCoC (Sparse-CoClust), which is based on a novel Common-background and Sparse-foreground Decomposition (CSD) model and the Maximum Block Improvement (MBI) co-clustering technique. SPARCoC has clear advantages compared with widely-used alternative approaches: hierarchical clustering (Hclust) and nonnegative matrix factorization (NMF). We apply SPARCoC to the study of lung adenocarcinoma (ADCA), an extremely heterogeneous histological type, and a significant challenge for molecular subtyping. For testing and verification, we use high quality gene expression profiling data of lung ADCA patients, and identify prognostic gene signatures which could cluster patients into subgroups that are significantly different in their overall survival (with p-values < 0.05). Our results are only based on gene expression profiling data analysis, without incorporating any other feature selection or clinical information; we are able to replicate our findings with completely independent datasets. SPARCoC is broadly applicable to large-scale genomic data to empower pattern discovery and cancer gene identification.

On Convergence of the Maximum Block Improvement Method

The MBI (maximum block improvement) method is a greedy approach to solving optimization problems where the decision variables can be grouped into a finite number of blocks. Assuming that optimizing over one block of variables while fixing all others is relatively easy, the MBI method updates the block of variables corresponding to the maximally improving block at each iteration, which is arguably a most natural and simple process to tackle block-structured problems with great potentials for engineering applications. In this paper we establish global and local linear convergence results for this method. The global convergence is established under the Łojasiewicz inequality assumption, while the local analysis invokes second-order assumptions. We study in particular the tensor optimization model with spherical constraints. Conditions for linear convergence of the famous power method for computing the maximum eigenvalue of a matrix follow in this framework as a special case. The condition is interpreted in various other forms for the rank-one tensor optimization model under spherical constraints. Numerical experiments are shown to support the convergence property of the MBI method.

On optimal low rank Tucker approximation for tensors: the case for an adjustable core size

Approximating high order tensors by low Tucker-rank tensors have applications in psychometrics, chemometrics, computer vision, biomedical informatics, among others. Traditionally, solution methods for finding a low Tucker-rank approximation presume that the size of the core tensor is specified in advance, which may not be a realistic assumption in many applications. In this paper we propose a new computational model where the configuration and the size of the core become a part of the decisions to be optimized. Our approach is based on the so-called maximum block improvement method for non-convex block optimization. Numerical tests on various real data sets from gene expression analysis and image compression are reported, which show promising performances of the proposed algorithms.

EMBI: Boosting Gene Expression-based Clustering for Cancer Subtypes.

Identifying clinically relevant subtypes of a cancer using gene expression data is a challenging and important problem in medicine, and is a necessary premise to provide specific and efficient treatments for patients of different subtypes. Matrix factorization provides a solution by finding checker-board patterns in the matrices of gene expression data. In the context of gene expression profiles of cancer patients, these checkerboard patterns correspond to genes that are up- or down-regulated in patients with particular cancer subtypes. Recently, a new matrix factorization framework for biclustering called Maximum Block Improvement (MBI) is proposed; however, it still suffers several problems when applied to cancer gene expression data analysis. In this study, we developed many effective strategies to improve MBI and designed a new program called enhanced MBI (eMBI), which is more effective and efficient to identify cancer subtypes. Our tests on several gene expression profiling datasets of cancer patients consistently indicate that eMBI achieves significant improvements in comparison with MBI, in terms of cancer subtype prediction accuracy, robustness, and running time. In addition, the performance of eMBI is much better than another widely used matrix factorization method called nonnegative matrix factorization (NMF) and the method of hierarchical clustering, which is often the first choice of clinical analysts in practice.

Ambiguity Function Shaping for Cognitive Radar Via Complex Quartic Optimization

In this paper, we propose a cognitive approach to design phase-only modulated waveforms sharing a desired range-Doppler response. The idea is to minimize the average value of the ambiguity function of the transmitted signal over some range-Doppler bins, which are identified exploiting a plurality of knowledge sources. From a technical point of view, this is tantamount to optimizing a real and homogeneous complex quartic order polynomial with a constant modulus constraint on each optimization variable. After proving some interesting properties of the considered problem, we devise a polynomial-time waveform optimization procedure based on the Maximum Block Improvement (MBI) method and the theory of conjugate-partial-symmetric/conjugate-super-symmetric fourth order tensors. At the analysis stage, we assess the performance of the proposed technique showing its capability to properly shape the range-Doppler response of the transmitted waveform.

Maximum Block Improvement and Polynomial Optimization

In this paper we propose an efficient method for solving the spherically constrained homogeneous polynomial optimization problem. The new approach has the following three main ingredients. First, we establish a block coordinate descent type search method for nonlinear optimization, with the novelty being that we accept only a block update that achieves the maximum improvement, hence the name of our new search method: maximum block improvement (MBI). Convergence of the sequence produced by the MBI method to a stationary point is proved. Second, we establish that maximizing a homogeneous polynomial over a sphere is equivalent to its tensor relaxation problem; thus we can maximize a homogeneous polynomial function over a sphere by its tensor relaxation via the MBI approach. Third, we propose a scheme to reach a KKT point of the polynomial optimization, provided that a stationary solution for the relaxed tensor problem is available. Numerical experiments have shown that our new method works very efficiently: for a majority of the test instances that we have experimented with, the method finds the global optimal solution at a low computational cost.