Efficient Alternating Optimization Algorithm Research Articles

A new adaptive elastic loss for robust unsupervised feature selection

The sparse-based unsupervised dimension reduction technique has been demonstrated to be an effective tool for dealing with high-dimensional data. Among them, the sparse regularization technique is used to introduce the prior knowledge of the model and helps unsupervised dimension reduction algorithms to complete the feature selection. However, the sparse regularization only considers the sparsity of representation. It ignores the group effect of variables among which the pairwise correlations are very high. To solve these issues, we present a novel regularization approach based on adaptive elastic loss in this study. Then, utilizing the regularization method, an efficient unsupervised feature selection methodology is given. Additionally, we devise an efficient alternative optimization algorithm to resolve the complex optimization issue of our proposed method and conduct a theoretical analysis of its computational complexity and convergence. Eventually, we conduct comprehensive experiments to test the validity of our proposed method, and real-world data and a simulation study demonstrate that our proposed method outperforms many state-of-the-art unsupervised feature selection methods in terms of clustering and classification.

Multi-view and Multi-order Graph Clustering via Constrained [formula omitted]-norm

The graph-based multi-view clustering algorithms achieve decent clustering performance by consensus graph learning of the first-order graphs from different views. However, the first-order graphs are often sparse, lacking essential must-link information, which leads to suboptimal consensus graph. While high-order graphs can address this issue, a two-step strategy involving the selection of a fixed number of high-order graphs followed by their fusion may result in information loss or redundancy, restricting the exploration of high-order information. To address these challenges, we propose Multi-view and Multi-order Graph Clustering via Constrained l1,2-norm (MoMvGC), which mitigates the impact of graph sparsity on multi-view clustering. By innovatively designing constrained l1,2-norm, the model ingeniously integrates the selection of multi-order graphs and corresponding weight learning into a unified framework. Furthermore, MoMvGC not only enable sparse selection of multi-order graphs but also simultaneous selection of views. Afterwards, we design an efficient alternative optimization algorithm to solve the optimization problems in MoMvGC. The proposed model achieves state-of-the-art clustering performance on nine real-world datasets, with particularly notable improvements observed on the MSRC dataset, where the clustering accuracy is increased by 5.24% compared to the best baseline. Comprehensive experiments demonstrate the effectiveness and superiority of our model. The code is available at https://github.com/haonanxin/MoMvGC_code.

Accurate Complementarity Learning for Graph-Based Multiview Clustering.

In real scenarios, graph-based multiview clustering has clearly shown popularity owing to the high efficiency in fusing the information from multiple views. Practically, the multiview graphs offer both consistent and inconsistent cues as they usually come from heterogeneous sources. Previous methods illustrated the importance of leveraging the multiview consistency and inconsistency for accurate modeling. However, when fusing the graphs, the inconsistent parts are generally ignored and hence the valued view-specific attributes are lost. To solve this problem, we propose an accurate complementarity learning (ACL) model for graph-based multiview clustering. ACL clearly distinguishes the consistent, complementary, and noise and corruption terms from the initial multiview graphs. In contrast to existing models that overlooked the complementary information, we argue that the view-specific characteristics extracted from the complementary terms are beneficial for affinity learning. In addition, ACL exploits only the positive parts of the complementary information for preserving the evidence on the positive sample relationship, and ignores the negative cues to avoid the vanishing of effective affinity strengths. This way, the learned affinity matrix is able to properly balance the consistent and complementary information. To solve the ACL model, we introduce an efficient alternating optimization algorithm with a varying penalty parameter. Experiments on synthetic and real-world databases clearly demonstrated the superiority of ACL.

Beamforming Design and Trajectory Optimization for UAV-Empowered Adaptable Integrated Sensing and Communication

Unmanned aerial vehicle (UAV) has high flexibility and controllable mobility, therefore it is considered as a promising enabler for future integrated sensing and communication (ISAC). In this paper, we propose a novel adaptable ISAC (AISAC) mechanism in the UAV-empowered system, where the UAV performs sensing on demand during communication and the sensing duration is flexibly configured according to the application requirements rather than keeping the same with the communication duration. Our designed mechanism avoids the excessive sensing and waste of radio resources, therefore improving the resource utilization and system performance. In the UAV-empowered AISAC system, we aim at maximizing the average system throughput by optimizing the communication and sensing beamforming as well as the UAV trajectory while guaranteeing the quality-of-service requirements of communication and sensing. To efficiently solve the considered non-convex optimization problem, we propose an efficient alternating optimization algorithm to alternately optimize the communication and sensing beamforming as well as the UAV trajectory to obtain a suboptimal solution. Numerical results validate the superiority of the proposed adaptable mechanism and the effectiveness of the designed algorithm.

Double RIS-Assisted MIMO Systems Over Spatially Correlated Rician Fading Channels and Finite Scatterers

This paper investigates double RIS-assisted MIMO communication systems over Rician fading channels with finite scatterers, spatial correlation, and the existence of a double-scattering link between the transceiver. First, the statistical information is driven in closed form for the aggregated channels, unveiling various influences of the system and environment on the average channel power gains. Next, we study two active and passive beamforming designs corresponding to two objectives. The first problem maximizes channel capacity by jointly optimizing the active precoding and combining matrices at the transceivers and passive beamforming at the double RISs subject to the transmitting power constraint. In order to tackle the inherently non-convex issue, we propose an efficient alternating optimization algorithm (AO) based on the alternating direction method of multipliers (ADMM). The second problem enhances communication reliability by jointly training the encoder and decoder at the transceivers and the phase shifters at the RISs. Each neural network representing a system entity in an end-to-end learning framework is proposed to minimize the symbol error rate of the detected symbols by controlling the transceiver and the RISs’ phase shifts. Numerical results verify our analysis and demonstrate the superior improvements of phase shift designs to boost system performance.

RIS-Aided Integrated Sensing and Communication: Joint Beamforming and Reflection Design

Integrated sensing and communication (ISAC) has been envisioned as a promising technique to alleviate the spectrum congestion problem. Inspired by the applications of reconfigurable intelligent surface (RIS) in dynamically manipulating wireless propagation environment, in this paper, we investigate to deploy a RIS in an ISAC system to pursue performance improvement. Particularly, we consider a RIS-assisted ISAC system where a multi-antenna base station (BS) performs multi-target detection and multi-user communication with the assistance of a RIS. Our goal is maximizing the weighted summation of target detection signal-to-noise ratios (SNRs) by jointly optimizing the transmit beamforming and the RIS reflection coefficients, while satisfying the communication quality-of-service (QoS) requirement, the total transmit power budget, and the restriction of RIS phase-shift. An efficient alternating optimization algorithm combining the majorization-minimization (MM), penalty-based, and manifold optimization methods is developed to solve the resulting complicated non-convex optimization problem. Simulation results illustrate the advantages of deploying RIS in ISAC systems and the effectiveness of our proposed algorithm.

Secrecy Energy Efficiency Maximization for Distributed Intelligent-Reflecting-Surface-Assisted MISO Secure Communications

This article investigates energy-efficient secure communication design with the help of multiple phase-adjustable intelligent reflecting surfaces (IRSs). By creating desirable radiation patterns of wireless environment, the IRSs are used to significantly improve the number of bits securely delivered to the destination per energy consumption in Joule, also known as the secrecy energy efficiency (SEE). By manipulating the discrete reflecting coefficients of multiple IRSs and taking advantage of the active beamforming, this article develops an efficient alternating optimization algorithm based on successive convex approximation and penalty-based techniques to effectively fight against multiple eavesdroppers. Simulation results characterize the graceful tradeoff between conflicting performance metrics, i.e., total power consumption and secrecy rate in the multi-IRS-aided secure communication system, and corroborate that incorporating multiple IRSs is beneficial to both the SEE and secrecy rate enhancement compared to existing related benchmarks.

Beamforming Design for Active IOS Aided NOMA Networks

This letter investigates a new active intelligent omni-surface (IOS) aided non-orthogonal multiple access (NOMA) network. In particular, simple active devices are introduced into the IOS to overcome the “double-fading” effect. A sum achievable rate optimization problem is formulated, where the beamforming vector at the base station and the active IOS coefficients are jointly optimized while satisfying the quality of service requirements of the users. Then, an efficient alternating optimization algorithm is developed to obtain the stationary point solution. Numerical results demonstrate the performance advantage of the proposed active IOS aided NOMA design.

Bi-Nuclear Tensor Schatten-p Norm Minimization for Multi-View Subspace Clustering.

Multi-view subspace clustering aims to integrate the complementary information contained in different views to facilitate data representation. Currently, low-rank representation (LRR) serves as a benchmark method. However, we observe that these LRR-based methods would suffer from two issues: limited clustering performance and high computational cost since (1) they usually adopt the nuclear norm with biased estimation to explore the low-rank structures; (2) the singular value decomposition of large-scale matrices is inevitably involved. Moreover, LRR may not achieve low-rank properties in both intra-views and inter-views simultaneously. To address the above issues, this paper proposes the Bi-nuclear tensor Schatten- p norm minimization for multi-view subspace clustering (BTMSC). Specifically, BTMSC constructs a third-order tensor from the view dimension to explore the high-order correlation and the subspace structures of multi-view features. The Bi-Nuclear Quasi-Norm (BiN) factorization form of the Schatten- p norm is utilized to factorize the third-order tensor as the product of two small-scale third-order tensors, which not only captures the low-rank property of the third-order tensor but also improves the computational efficiency. Finally, an efficient alternating optimization algorithm is designed to solve the BTMSC model. Extensive experiments with ten datasets of texts and images illustrate the performance superiority of the proposed BTMSC method over state-of-the-art methods.

Unsupervised Feature Selection via Orthogonal Basis Clustering and Local Structure Preserving.

Due to the "curse of dimensionality" issue, how to discard redundant features and select informative features in high-dimensional data has become a critical problem, hence there are many research studies dedicated to solving this problem. Unsupervised feature selection technique, which does not require any prior category information to conduct with, has gained a prominent place in preprocessing high-dimensional data among all feature selection techniques, and it has been applied to many neural networks and learning systems related applications, e.g., pattern classification. In this article, we propose an efficient method for unsupervised feature selection via orthogonal basis clustering and reliable local structure preserving, which is referred to as OCLSP briefly. Our OCLSP method consists of an orthogonal basis clustering together with an adaptive graph regularization, which realizes the functionality of simultaneously achieving excellent cluster separation and preserving the local information of data. Besides, we exploit an efficient alternative optimization algorithm to solve the challenging optimization problem of our proposed OCLSP method, and we perform a theoretical analysis of its computational complexity and convergence. Eventually, we conduct comprehensive experiments on nine real-world datasets to test the validity of our proposed OCLSP method, and the experimental results demonstrate that our proposed OCLSP method outperforms many state-of-the-art unsupervised feature selection methods in terms of clustering accuracy and normalized mutual information, which indicates that our proposed OCLSP method has a strong ability in identifying more important features.

Mobile jammer enabled secure UAV communication with short packet transmission

This paper studies a mobile jammer enabled secure unmanned aerial vehicle (UAV) communication network in the finite packet length scenario, where the external friendly jammer UAV will transmit jamming signal to deteriorate the quality of eavesdropping channel, and help to improve the secure communication performance of the source UAV. Specifically, an average effective secrecy rate (AESR) maximization problem is formulated by jointly designing the trajectories and transmit power of the source/jammer UAV subject to the UAVs’ mobility constraints and power constraints. It is also verified that there exists a unique optimal packet error rate to maximize the AESR. The formulated problem is mathematically intractable, as it is nonconvex and involves coupled optimization variables. Therefore, we first decompose the trajectories and power optimization problem into four non-convex subproblems, and then transform them into standard convex problems by applying first-order Taylor expansion. Then, an efficient alternating optimization algorithm for AESR problem based on Bisection method and successive convex approximation (SCA) technology is presented by addressing the five subproblems iteratively. Simulation results are provided to verify that our proposed scheme can obtain considerable better AESR gain compared to other four benchmark schemes.

Robust Secure Transmission Design for IRS-Assisted mmWave Cognitive Radio Networks

Cognitive radio networks (CRNs) and millimeter wave (mmWave) communications are two major technologies to enhance the spectrum efficiency (SE). Considering that the SE improvement in the CRNs is limited due to the interference temperature imposed on the primary user (PU), and the severe path loss and high directivity in mmWave communications make it vulnerable to blockage events, we introduce an intelligent reflecting surface (IRS) into mmWave CRNs. Due to the estimation mismatch and the passivity of Eavesdroppers (Eves), perfect channel state information (CSI) of wiretap links is challenging to obtain, which promotes our research on robust secure beamforming (BF) design in the IRS-assisted mmWave CRNs. This paper considers the collaborate scenario of Eves, which allows us to investigate the BF design in the harsh eavesdropping environment. Specifically, by using a uniform linear array (ULA) at the cognitive base station (CBS) and a uniform planar array (UPA) at the IRS, and supposing that imperfect CSIs of angle-of-departures for wiretap links are known, we formulate a constrained problem to maximize the worst-case achievable secrecy rate (ASR) of the secondary user (SU) by jointly designing the transmit BF at the CBS and reflect BF at the IRS. To solve the non-convex problem with coupled variables, an efficient alternating optimization algorithm is proposed. Finally, simulation results indicate that the ASR performance of our proposed algorithm has a small gap with that of the optimal solution with perfect CSI compared with the other benchmarks.

Stochastic gradient line Bayesian optimization for efficient noise-robust optimization of parameterized quantum circuits

Optimizing parameterized quantum circuits is a key routine in using near-term quantum devices. However, the existing algorithms for such optimization require an excessive number of quantum-measurement shots for estimating expectation values of observables and repeating many iterations, whose cost has been a critical obstacle for practical use. We develop an efficient alternative optimization algorithm, stochastic gradient line Bayesian optimization (SGLBO), to address this problem. SGLBO reduces the measurement-shot cost by estimating an appropriate direction of updating circuit parameters based on stochastic gradient descent (SGD) and further utilizing Bayesian optimization (BO) to estimate the optimal step size for each iteration in SGD. In addition, we formulate an adaptive measurement-shot strategy and introduce a technique of suffix averaging to reduce the effect of statistical and hardware noise. Our numerical simulation demonstrates that the SGLBO augmented with these techniques can drastically reduce the measurement-shot cost, improve the accuracy, and make the optimization noise-robust.

Energy-Efficient Massive MIMO SWIPT-Enabled Systems

This study focuses on the downlink (DL) transmission of massive multiple-input-multiple-output (MIMO) with the support of simultaneous wireless information and power transfer (SWIPT) system based on a power-splitting (PS) scheme. To reach the green design target in the concept of wireless communication networks, this paper maximizes the system’s energy efficiency (EE) using joint system-level optimization. First, the closed-form expressions of the harvested energy and achievable data rate are first derived. Then, we formulated the EE maximization problem by jointly optimizing user equipment (UE) pilot transmission time allocation, the received PS ratios, a base station (BS) transmit power allocation, and a number of BS antennas while considering the minimum data rate as user’s quality-of-service (QoS) requirement and the maximum BS power transmission constraint. However, the formulated EE maximization problem is non-convex and non-linear which is difficult to solve. Hence, we propose an efficient low-complex alternative optimization (LCAO) algorithm to solve the non-convex problem iteratively with an acceptable computational complexity level. Simulation results are provided to evaluate the derived closed-form expressions and validate the proposed LCAO algorithm’s efficiency. The optimality, convergence, and complexity of the LCAO algorithm are analytically investigated. Results indicate that the proposed LCAO algorithm outperforms the equal power allocation (EPA) scheme by 15% better EE gain and 4% better than the max-min fairness scheme when the BS power transmission capacity is higher than 3 (Watt).

Joint Task Offloading and Caching for Massive MIMO-Aided Multi-Tier Computing Networks

In this paper, a massive multiple-input multiple-output (MIMO) relay assisted multi-tier computing (MC) system is employed to enhance the task computation. We investigate the joint design of the task scheduling, service caching and power allocation to minimize the total task scheduling delay. To this end, we formulate a robust non-convex optimization problem taking into account the impact of imperfect channel state information (CSI). In particular, multiple task nodes (TNs) offload their computational tasks either to computing and caching nodes (CCN) constituted by nearby massive MIMO-aided relay nodes (MRN) or alternatively to the cloud constituted by nearby fog access nodes (FAN). To address the non-convexity of the optimization problem, an efficient alternating optimization algorithm is developed. First, we solve the non-convex power allocation optimization problem by transforming it into a linear optimization problem for a given task offloading and service caching result. Then, we use the classic Lagrange partial relaxation for relaxing the binary task offloading as well as caching constraints and formulate the dual problem to obtain the task allocation and software caching results. Given both the power allocation, as well as the task offloading and caching result, we propose an iterative optimization algorithm for finding the jointly optimized results. The simulation results demonstrate that the proposed scheme outperforms the benchmark schemes, where the power allocation may be controlled by the asymptotic form of the effective signal-to-interference-plus-noise ratio (SINR).

Active Reconfigurable Intelligent Surface Aided Secure Transmission

Reconfigurable Intelligent Surface (RIS) draws great attentions in academic and industry due to its passive and low power consumption nature, and has currently been used in physical layer security to enhance the secure transmission. However, due to the existence of “double fading” effect on the reflecting channel link between transmitter and user, RIS helps achieve limited secrecy performance gain compared with the case without RIS. In this correspondence, we propose a novel active RIS design to enhance the secure wireless transmission, where the reflecting elements in RIS not only adjust the phase shift but also amplify the amplitude of signals. To solve the non-convex secrecy rate optimization based on this design, an efficient alternating optimization algorithm is proposed to jointly optimize the beamformer at transmitter and reflecting coefficient matrix at RIS. Simulation results show that with the aid of active RIS design, the impact of “double fading” effect can be effectively relieved, resulting in a significantly higher secrecy performance gain compared with existing solutions with passive RIS and without RIS design.

Hyperspectral Denoising Using Unsupervised Disentangled Spatiospectral Deep Priors

Image denoising is often empowered by accurate prior information. In recent years, data-driven neural network priors have shown promising performance for RGB natural image denoising. Compared to classic handcrafted priors (e.g., sparsity and total variation), the "deep priors" are learned using a large number of training samples -- which can accurately model the complex image generating process. However, data-driven priors are hard to acquire for hyperspectral images (HSIs) due to the lack of training data. A remedy is to use the so-called unsupervised deep image prior (DIP). Under the unsupervised DIP framework, it is hypothesized and empirically demonstrated that proper neural network structures are reasonable priors of certain types of images, and the network weights can be learned without training data. Nonetheless, the most effective unsupervised DIP structures were proposed for natural images instead of HSIs. The performance of unsupervised DIP-based HSI denoising is limited by a couple of serious challenges, namely, network structure design and network complexity. This work puts forth an unsupervised DIP framework that is based on the classic spatio-spectral decomposition of HSIs. Utilizing the so-called linear mixture model of HSIs, two types of unsupervised DIPs, i.e., U-Net-like network and fully-connected networks, are employed to model the abundance maps and endmembers contained in the HSIs, respectively. This way, empirically validated unsupervised DIP structures for natural images can be easily incorporated for HSI denoising. Besides, the decomposition also substantially reduces network complexity. An efficient alternating optimization algorithm is proposed to handle the formulated denoising problem. Semi-real and real data experiments are employed to showcase the effectiveness of the proposed approach.

Generalized Tensor Decomposition With Features on Multiple Modes

Higher-order tensors have received increased attention across science and engineering. While most tensor decomposition methods are developed for a single tensor observation, scientific studies often collect side information, in the form of node features and interactions thereof, together with the tensor data. Such data problems are common in neuroimaging, network analysis, and spatial-temporal modeling. Identifying the relationship between a high-dimensional tensor and side information is important yet challenging. Here, we develop a tensor decomposition method that incorporates multiple feature matrices as side information. Unlike unsupervised tensor decomposition, our supervised decomposition captures the effective dimension reduction of the data tensor confined to feature space of interest. An efficient alternating optimization algorithm with provable spectral initialization is further developed. Our proposal handles a broad range of data types, including continuous, count, and binary observations. We apply the method to diffusion tensor imaging data from human connectome project and multi-relational political network data. We identify the key global connectivity pattern and pinpoint the local regions that are associated with available features. The package and data used are available at https://CRAN.R-project.org/package=tensorregress. Supplementary materials for this article are available online.

Towards Compact Broad Learning System by Combined Sparse Regularization

Broad Learning System (BLS) has been proven to be one of the most important techniques for classification and regression in machine learning and data mining. BLS directly collects all the features from feature and enhancement nodes as input of the output layer, which neglects vast amounts of redundant information. It usually leads to be inefficient and overfitting. To resolve this issue, we propose sparse regularization-based compact broad learning system (CBLS) framework, which can simultaneously remove redundant nodes and weights. To be more specific, we use group sparse regularization based on [Formula: see text] norm to promote the competition between different nodes and then remove redundant nodes, and a class of nonconvex sparsity regularization to promote the competition between different weights and then remove redundant weights. To optimize the resulting problem of the proposed CBLS, we exploit an efficient alternative optimization algorithm based on proximal gradient method together with computational complexity. Finally, extensive experiments on the classification task are conducted on public benchmark datasets to verify the effectiveness and superiority of the proposed CBLS.

Speech Emotion Recognition Based on Robust Discriminative Sparse Regression

Speech emotion recognition has recently attracted much interest due to the widespread of multimedia data. It generally involves two basic problems: 1) feature extraction and 2) emotion classification. Most previous algorithms just focus on solving one of these two problems. In this article, we aim to deal with these two problems in a joint learning framework, and present a novel regression algorithm, namely, robust discriminative sparse regression (RDSR). In RDSR, we propose a sparse regression algorithm to make our model robust to outliers and noises, and introduce a feature selection regularization constraint simultaneously to select the most discriminative and relevant features. In addition, to well predict the labels, we exploit the local and global consistency over labels, and incorporate it into the proposed framework. To solve the objective function of RDSR, we design an efficient alternative optimization algorithm. Finally, experimental results on several public emotion data sets verify the effectiveness and the superiority of our proposed method.