Layered Coding Research Articles

新型层间迹正交码可见光双层成像通信系统

新型层间迹正交码可见光双层成像通信系统

Inter-layer Texture and Syntax Prediction for Scalable Video Coding

In this paper, we demonstrate inter-layer prediction tools for scalable video coders. The proposed scalable coder is designed to support not only spatial, quality and temporal scalabilities, but also view scalability. In addition, we propose quad-tree inter-layer prediction tools to improve coding efficiency at enhancement layers. The proposed inter-layer prediction tools generate texture prediction signal with exploiting texture, syntaxes, and residual information from a reference layer. Furthermore, the tools can be used with inter and intra prediction blocks within a large coding unit. The proposed framework guarantees the rate distortion performance for a base layer because it does not have any compulsion such as constraint intra prediction. According to experiments, the framework supports the spatial scalable functionality with about 18.6%, 18.5% and 25.2% overhead bits against to the single layer coding. The proposed inter-layer prediction tool in multiloop decoding design framework enables to achieve coding gains of 14.0%, 5.1%, and 12.1% in BD-Bitrate at the enhancement layer, compared to a single layer HEVC for all-intra, low-delay, and random access cases, respectively. For the single-loop decoding design, the proposed quad-tree inter-layer prediction can achieve 14.0%, 3.7%, and 9.8% bit saving.

3D Shape Matching via Two Layer Coding.

View-based 3D shape retrieval is a popular branch in 3D shape analysis owing to the high discriminative property of 2D views. However, many previous works do not scale up to large 3D shape databases. We propose a two layer coding (TLC) framework to conduct shape matching much more efficiently. The first layer coding is applied to pairs of views represented as depth images. The spatial relationship of each view pair is captured with so-called eigen-angle, which is the planar angle between the two views measured at the center of the 3D shape. Prior to the second layer coding, the view pairs are divided into subsets according to their eigen-angles. Consequently, view pairs that differ significantly in their eigen-angles are encoded with different codewords, which implies that spatial arrangement of views is preserved in the second layer coding. The final feature vector of a 3D shape is the concatenation of all the encoded features from different subsets, which is used for efficient indexing directly. TLC is not limited to encode the local features from 2D views, but can be also applied to encoding 3D features. Exhaustive experimental results confirm that TLC achieves state-of-the-art performance in both retrieval accuracy and efficiency.

Layered Soft Video Broadcast for Heterogeneous Receivers

Wireless video broadcast poses a challenge to the conventional visual communication in providing simultaneously each receiver the best video quality under its channel condition. Soft video broadcast, as a newly emerged wireless video broadcast scheme, is able to accommodate multiple receivers of different channel SNRs. However, the current soft video broadcast frameworks such as SoftCast require the bandwidth of the wireless channel to match the number of video coefficients per second. When the channel bandwidth is larger, the existing frameworks become not very efficient in bandwidth expansion. More importantly, it is possible that the users in broadcast applications have different bandwidths. However, none of the existing soft video broadcast frameworks considers bandwidth heterogeneity. In this paper, we propose a soft video broadcast framework, called LayerCast, which can simultaneously accommodate heterogeneous users with diverse SNRs and diverse bandwidths. The bandwidth expansion problem is solved by applying layered coset coding. More importantly, we derive a globally optimal power allocation between layers and, within each layer, between each DCT chunk. In simulations, the proposed framework outperforms SoftCast of up to 4 dB in video PSNR, and outperforms H.264-based framework up to 8 dB in broadcast.

HDR와 SDR 비디오의 스케일러블 부호화를 위한 계층 압축 기법

In this paper, we propose a scalable coding method for high dynamic range (HDR) and standard dynamic range (SDR) videos based on Scalable High Efficiency Video Coding (SHVC). The proposed method has multi-layer coding architecture that consists of base layer for SDR videos and enhancement layer for HDR videos to support the backward compatibility with legacy codec and display devices. Also, to improve coding efficiency of enhancement layers, a global inverse tone mapping is applied to the reconstructed SDR video and the compensated frames are referred for coding of the enhancement layer. The proposed method is found to achieve BD-Rate gain of 43.0% on average (maximum 76.3%) for the enhancement layer and 15.7% on average (maximum 31%) for dual-layer against the SHM 7.0 reference software.

Combining Layer Coding and Bandwidth Allocation for Video Distribution on Content Delivery Networks

In current heterogeneous networks, video can be transmitted using different bit rates and delivered to various end devices with different resolutions and computing power. Single-layer coded video does not meet all of the bandwidth and device requirements. Scalable video coding (SVC) facilitates the transmission of once-encoded video at a target bit rate and the rendering of the video with specified quality. This study investigated methods for distributing and transmitting H.264 SVC-coded videos through content delivery networks (CDNs). The bit-rate allocation of the SVC quality layers with three different ratios (constant, Fibonacci, and exponential) was examined. Three bandwidth allocation strategies for CDN surrogate servers managing the outgoing traffic (stop and wait, stationary quality, and quasi-equal quality) were also evaluated. The use of layer coding in CDNs improves the video service quality in heterogeneous networks. Furthermore, simulation results show that the quasi-equal-quality bandwidth allocation strategy with the SVC layer sizes forming a Fibonacci sequence generally achieves the highest peak-signal-to-noise ratio and shortest waiting time of end users.

QoS-aware scalable video streaming using data distribution service

Enabling Real-Time video streaming over wireless networks is a challenging task due to the time-varying channel conditions and the limited network resources. The instability of wireless networks leads to problems such as limited and time-varying bandwidth, and unexpected traffic congestion when transmitting a burst of video streams. In Real-Time video streaming, each frame must be delivered and decoded by its playback time. Recently, layer coding (LC) has enabled Real-Time and scalable video streaming to clients of heterogeneous capabilities by dropping upper enhancement layers without the need of re-encoding and with much less bit rate. However, layer coding still facing unfair layer protection problem in which packets from the base or lower layers might be dropped while there is a chance to drop packets from the upper enhancement layers. Losing packets from the base layer can significantly affect the delivered video quality and sometimes lead to an interruption especially in error-prone networks as wireless networks. Architectural solutions at the middleware level introduce higher flexibility, more efficiency in development time and more QoS control. This work investigates the behavior of video streaming over Real-Time publish-subscribe based middleware. We propose and develop an unequal layer protection mechanism for Real-Time video streaming based on the Data Distribution Service (DDS) middleware. A combination of video quality of service (QoS) is proposed to adapt the video transmission to the time-varying network changes. The performance of Real-Time video streaming is measured over IEEE 802.11 g WLAN network. The results show a graceful degradation of video quality while maintaining a robust video streaming free of visible error or interruptions. This is due to the intentionally dropping of some enhancement video stream layers in order to protect lower layers, and therefore maintain a continuous video flow of acceptable quality. Numerical results indicate that the proposed scheme is able to achieve higher throughput and improve the average received video quality especially in a large number of video subscribers.

Scene text recognition by learning co‐occurrence of strokes based on spatiality embedded dictionary

Text information contained in scene images is very helpful for high-level image understanding. In this study, the authors propose to learn co-occurrence of local strokes for scene text recognition by using a spatiality embedded dictionary (SED). Unlike spatial pyramid partitioning images into grids to incorporate spatial information, the authors SED associates every codeword with a particular response region and introduces more precise spatial information for robust character recognition. After localised soft coding and max pooling of the first layer, a sparse dictionary is learned to model co-occurrence of several local strokes, which further improves classification performance. Experimental results on two scene character recognition datasets ICDAR2003 and CHARS74 K demonstrate that their character recognition method outperforms state-of-the-art methods. Besides, competitive word recognition results are also reported for four benchmark word recognition datasets ICDAR2003, ICDAR2011, ICDAR2013 and street view text when combining their character recognition method with a conditional random field language model.

On the Optimum Packet Power Distribution for Spread Aloha Packet Detectors With Iterative Successive Interference Cancelation

Recent work has been stimulated by the need to enhance the satellite networks' Random Access (RA) performance. Results have shown that large performance improvement is possible by exploiting Iterative Successive Interference Cancelation (I-SIC) at the demodulator side. Coded spread spectrum Aloha (SSA) is a particularly suitable access technique for RA satellite networks due to its inherent asynchronous access nature and its high multiple access Achievable Sum Rate (ASR). Moreover, the adoption of I-SIC allows further boosting of the SSA sum rate and its robustness to the packet power unbalance. In this paper, we derive an analytical approach to the optimal packet power distribution that maximizes the performance of SSA RA exploiting I-SIC at the demodulator. The proposed approach takes into account the physical layer coding and modulation together with the number of demodulator iterations and the non-ideal cancelation effects. The analytical findings are successfully compared with the simulation and measurement results. Finally, a practical algorithm that approximates the optimum incoming power packet distribution in a realistic multi-beam satellite broadband network with open-loop power control is proposed and validated in a study case.

A Layer Segmentation Based Compression Algorithm

In this paper, we proposed a layer segmentation based compression algorithm for gray images. Image textures and some high frequency noise are described in a high frequency layer while the coarse part of the image is included in the low frequency layer. A mixed dictionary and sparse coding is applied for high frequency layer coding and the low frequency layer is coded using the traditional wavelets based coding system. The results show that the proposed scheme achieves better rate-distortion performance compared with several competing compression system. Furthermore, in the sparse coding part, some edge-related atoms are added in the dictionary and a high sparseness factor is set for the edge blocks, making more accurate approximations for edges. We avoid further degradation of edges caused by compression.

LDPC Coded Combined with Space-Time Codes in Cooperative MIMO System

This paper proposes a method of LDPC coded combined with space-time codes using in the cooperative MIMO system. An algorithm is introduced that the joint iterative detection algorithm based on Fincke-pohst (sphere detecting) maximum a-posteriori (MAP). theoretical analysis and derivation shown that the performance of LDPC cascading space-time codes (STBC) system is slightly better than that of LDPC coded cascading vertical layered space-time codes (VBLAST) in cooperative MIMO systems. And the FP-MAP detection algorithm compares with the detection algorithm----zero forcing sort plus interference cancellation(ZF-OSIC) and the recursive least squares decision feedback equalization(RLS-DFE) algorithm, its performance is improved by about 0. 6dB and 0. 3dB respectively, its performance is closest to the ML detection

Layered Coding for the Interference Channel With a Relay

This paper studies and derives new results for the interference channel with a relay (ICR). Three inner bounds for the discrete memoryless ICR are proposed, based on three coding strategies that employ layered code at the relay. The first scheme is inspired by layered noisy network coding, proposed by Lim et al. for the two-way relay channel, the second and the third schemes rely on simpler encoding and decoding processes, dubbed layered quantize-forward. Performance of the proposed schemes is investigated for two classes of channels with Gaussian noise: the interference channel with in-band relay reception/out-of-band relay transmission and the interference with in-band relay reception/in-band relay transmission. For the former class of channels, it is shown that the first proposed scheme achieves the same inner bound as the generalized hash-forward scheme with incremental binning. In addition, the inner bound is within 0.5 bit of the capacity region under certain conditions on the channel parameters. For the latter class of channels, new upper bounds on sum-rate are established by extending known upper bounds for symmetric channels. The first inner bound is shown to be within 0.5 bit of the capacity region if the relay's power exceeds a certain threshold, which depends on channel parameters. Numerical examples show that the proposed schemes can achieve significantly higher sum-rates when compared with other compress-forward schemes. Analysis also reveals a tradeoff between achievable rates, coding delay, and complexity of the proposed schemes. Results in this paper provide a better understanding of coding for the ICR, in particular, they show that layered coding is a beneficial element in multiuser networks with relays.

An Efficient Hierarchical Video Coding Scheme Combining Visual Perception Characteristics

Different visual perception characteristic saliencies are the key to constitute the low-complexity video coding framework. A hierarchical video coding scheme based on human visual systems (HVS) is proposed in this paper. The proposed scheme uses a joint video coding framework consisting of visual perception analysis layer (VPAL) and video coding layer (VCL). In VPAL, effective visual perception characteristics detection algorithm is proposed to achieve visual region of interest (VROI) based on the correlation between coding information (such as motion vector, prediction mode, etc.) and visual attention. Then, the interest priority setting for VROI according to visual perception characteristics is completed. In VCL, the optional encoding method is developed utilizing the visual interested priority setting results from VPAL. As a result, the proposed scheme achieves information reuse and complementary between visual perception analysis and video coding. Experimental results show that the proposed hierarchical video coding scheme effectively alleviates the contradiction between complexity and accuracy. Compared with H.264/AVC (JM17.0), the proposed scheme reduces 80% video coding time approximately and maintains a good video image quality as well. It improves video coding performance significantly.

Research on the Strategy of Nodes Cooperative Transmission in Wireless Sensor Networks

The correlation techniques of nodes cooperative transmission strategy in wireless sensor networks with virtual MIMO are presented. A communication model between clusters is proposed. From it, we can see the correlation techniques include coding, forwarding, combining and decoding. The coding is generally divided into three categories: Layered Space-Time Coding, Space-Time Trellis Coding and Space-Time Block Coding. Forwarding can be broken down into Amplifying Forwarding, Decode Forwarding, and Selecting Dynamic Relay. Select combining, equal gain combining and maximum ratio combining are the common combine methods. The decode method is maximum likelihood algorithm.

High Efficiency 3D Video Coding Using New Tools Based on View Synthesis

We propose a new coding technology for 3D video represented by multiple views and the respective depth maps. The proposed technology is demonstrated as an extension of the recently developed high efficiency video coding (HEVC). One base views are compressed into a standard bitstream (like in HEVC). The remaining views and the depth maps are compressed using new coding tools that mostly rely on view synthesis. In the decoder, those views and the depth maps are derived via synthesis in the 3D space from the decoded baseview and from data corresponding to small disoccluded regions. The shapes and locations of those disoccluded regions can be derived by the decoder without any side information transmitted. To achieve high compression efficiency, we propose several new tools such as depth-based motion prediction, joint high frequency layer coding, consistent depth representation, and nonlinear depth representation. The experiments show high compression efficiency of the proposed technology. The bitrate needed for transmission of two side views with depth maps is mostly less than 50% than that of the bitrate for a single-view video.

Joint energy-distortion aware algorithms for cooperative video streaming over LTE networks

Real-time video streaming over long-term evolution (LTE) networks is investigated in the presence of mobile-to-mobile collaboration. A multi-objective problem for energy and distortion minimization is formulated and an energy-efficient, quality of service (QoS) aware suboptimal approach is presented for collaborative video transmission. In the proposed approach, mobiles are grouped into collaborative clusters using a low-complexity clustering algorithm. In each cluster, collaboration is implemented by having a cluster head send the content to other cluster members using a short-range wireless communications technology. The cluster heads receive the data on the long-range LTE links, either via unicasting or multicasting. LTE scheduling is taken into account on the long range transmissions. Videos with single description coding (SDC), multiple description coding (MDC), and scalable video coding (SVC) are considered. Results show that the proposed approach leads to significant energy savings and enhanced QoS compared to the non-collaborative scenario. Furthermore, MDC is shown to outperform SDC in terms of QoS, at the cost of a slight increase in energy consumption. The same conclusions were reached with respect to SVC compared to single layer coding.

Resource Allocation with Limited Feedback and Joint Coding Scheme for Wireless Multi-antenna Multicast System

In conventional multicast scheme (CMS), the total throughput of multicast group is constrained by the user with the worst channel quality. In order to overcome this problem of limited throughput, we introduce a resource allocation algorithm by exploiting layered coding combined with erasure correction coding for multicast services in the downlink of OFDMA-based multi-antenna system. To reduce the feedback overhead of uplink, we design a novel transmission scheme with limited feedback. Then, we formulate the joint subcarrier and power allocation problem for the data of base layer and enhancement layers, which is shown to be NP hard. Hence, in order to reduce the computational complexity, we propose a three-phase suboptimal algorithm. The algorithm is designed to maximize the system throughput while at the same time guarantee the quality of services (QoS) requirements of all multicast groups. It is composed of precoding scheme, proportional fairness subcarrier allocation algorithm and modified water-filling power allocation algorithm with QoS guarantees (MWF-Q). To further decrease the complexity of MWF-Q, a power allocation algorithm with increased fixed power allocation algorithm with QoS guarantees is introduced. Simulation results show that the proposed algorithms based on limited feedback scheme significantly outperform CMS and any other existing algorithm with full feedback. Moreover, the proposed scheme can efficiently reduce 50 % of the full feedback overhead.

Dynamic resource allocation with precoding and joint coding scheme for limited feedback‐based wireless multi‐antenna multicast system

In conventional multicast scheme (CMS), the total throughput of multicast group is constrained by the user with the worst channel quality. In order to overcome this problem of limited throughput, the authors introduce a resource allocation algorithm by exploiting layered coding combined with erasure correction coding for multicast services in the downlink of orthogonal frequency-division multiple access-based multi-antenna system. To reduce the feedback overhead of uplink, the authors design a novel transmission scheme with limited feedback. Then, the joint subcarrier and power allocation problem for the data of base layer and enhancement layers are formulated, which is shown to be non-deterministic polynomial- hard. Hence, in order to reduce the computational complexity, they propose a three-phase suboptimal algorithm. The algorithm is designed to maximise the system throughput, whereas at the same time guarantee the quality of services (QoS) requirements of all multicast groups. It is composed of precoding scheme, proportional fairness subcarrier allocation algorithm and modified water-filling power allocation algorithm with QoS guarantees (MWF-Q). To further decrease the complexity of MWF-Q, a power allocation algorithm with increased fixed power allocation algorithm with QoS guarantees is introduced. Simulation results show that the proposed algorithms based on limited feedback scheme significantly outperform CMS and any other existing algorithm with full feedback. Moreover, the proposed scheme can efficiently reduce 50% of the full feedback overhead.

주파수 비선택적 SIMO 페이딩 채널에서 단일 송신 안테나 및 시간 다이버시티를 이용한 두 사용자의 동시 전송 기법

A dual-user multiplexing scheme for a pair of mobiles equipped with single antenna is proposed which incorporates time-delay diversity employing a rotation-based D-BLAST-like layered code. A low-dimension equivalent of the existing partial interference cancellation based group decoder is also proposed for the corresponding receiver. The BER performances of the proposed scheme and those of the ideal scheme are studied comparatively through Monte Carlo simulations.

Scalable Video Broadcast Over Downlink MIMO–OFDM Systems

We propose a cross-layer design framework for efficient broadcasting scalable H.264 videos over the downlink multiple-input multiple-output (MIMO) orthogonal frequency-division multiplexing systems. The objective is to maximize the average peak signal-to-noise ratio of the received video streams by jointly optimizing video layer extraction, subcarrier allocation, modulation and coding, and transmit precoding, considering the heterogeneity of video sources and channel conditions. Specifically, to exploit the MIMO channel, we employ a codebook-based linear transmit precoding strategy with limited feedback. Given the fact that different quality layers of the video have different importance, we propose an adaptive modulation and coding scheme, where a fixed coding rate is used for each quality layer and unequal error protection is implemented for different layers. We further propose a subcarrier allocation strategy to assign transmission channels for different layers of different users' videos, to satisfy the decoding dependence constraints among the video layers and to maximize the reconstructed video quality. The proposed scalable video broadcast solution has a low complexity and low signaling overhead, which makes it suitable for practical implementations. We provide experimental results to demonstrate the effectiveness of the proposed solution, using both model-based simulations and an end-to-end software simulation testbed.