Dimensionality Reduction Network Research Articles

Deep Neural Networks With Data Rate Model: Learning Power Allocation Efficiently

Learning-based resource allocation can be implemented in real-time, but deep neural networks (DNNs) developed in other fields such as computer vision are with high training complexity and weak generalizability. Leveraging domain knowledge in communications is promising for learning wireless policies efficiently. In this paper, we propose a framework of integrating the Shannon formula with DNNs, and derive a data rate-based DNN (DRNN), for learning resource allocation by taking power allocation as an example. The DRNN is with an iterative structure with multiple update layers, each consisting of a pre-determined model function, an update network, and a dimension reduction network. To justify the iterative structure, we prove the existence of an iteration function that converges to the optimal policy for the update layer to learn. To justify the structure of each update layer, we provide the conditions for the iteration function to be a composite function of the model function. We further incorporate permutation equivariance properties into the DRNN. Simulation results show that the numbers of training samples and free parameters, and the training time to achieve a desired system performance can be reduced remarkably by harnessing the data rate model and PE prior.

Accurate image super-resolution using dense connections and dimension reduction network

Recently, the convolution neural network (CNN) has achieved significant performance improvements toward the image Super-Resolution (SR) problems. Yet, the existing benchmark arts exist multiple limitations, including make use of the feature information deficiently, accompany with the gradient disappearance phenomenon and have serious time consumption. The paper utilizes a newly designed fully convolutional neural network named Accurate Image Super-resolution Using Dense Connections and Dimension Reduction Network (DCDRN) to fully exploit the image features. Contextual information of image regions utilizes efficiently and accurately through uniting dense connections and cascading small filters multiple times. And such implementation can be regarded as feature extractors to fuse local and global image features. We newly introduce 1 × 1 CNNs parallelization structure in the image reconstruction section to reduce data dimensions of the previous layers, which alleviates the computational burden effectively while avoiding the context info losing. The calculation becomes more complex and the convergence becomes slower during training because of the pre-processed images. The proposed DCDRN invents a simple and effective method which processes the original image directly and the optimization of layers and filters of CNNs shorten the cost of training significantly. Experiments on benchmark datasets with different methods show that DCDRN achieves gratifying performance against state-of-the-art methods. Code is available at .