Error-resilient Video Transmission Research Articles

Error-resilient surveillance video transmission based on a practical joint source-channel distortion computing model

In recent years, IP (Internet Protocol)-based video surveillance has widely been useful for post-event analysis and assisting the work of privacy protection and public safety. To support high-quality IP video surveillance, error-resilience techniques are important for surveillance system design, because video has more stringent requirements than general video transmission for packet loss, latency, and jitter. The optimal FEC (forward error correction) code rate decision is a crucial procedure to determine the optimal source and channel coding rates to minimize the overall picture distortion when transporting video packets over packet loss channels. The conventional FEC code rate decision schemes using an analytical source-coding distortion model and a channel-induced distortion model are usually complex and typically employ the process of model parameter training, which involves potentially high computational complexity and implementation cost. To avoid the complex modeling procedure, we propose a simple but accurate joint source-channel distortion model to estimate the channel-loss threshold set for optimal FEC code rate decision. Since the proposed model is expressed as a simple closed form and has a small number of scene-dependent model parameters, a video sender of the surveillance system using the model can be easily implemented. For training the scene-dependent model parameters in real time, we propose a practical test-run procedure. This method accelerates the test-run while maintaining its accuracy for training the scene-dependent model parameters. Using the proposed simple model and practical test-run method, the video sender can find the optimal code rate for on-the-fly joint source-channel coding whenever there is a change in the packet-loss condition in the channel. Simulations show that the proposed method can accurately estimate the channel loss threshold set, resulting in an optimal FEC code rate with low computational complexity.

Error resilient video transmission in ad hoc networks using layered and multiple description coding

The mesh structure of ad hoc networks, provides the possibility of establishing two disjoint paths from a sender to a receiver. Transmission of video over such networks due to their unpredictability and difficulty in securing reliable channels is challenging. Layered Coding (LC) and Multiple Description Coding (MDC) are two different techniques which can benefit from path diversity for robust video communication and also to adapt with preferences of users\network. This paper presents an approach to provide error resilient video transmission over a variety of network conditions and applications needs using combined LC and MDC schemes. In the proposed method two descriptions of each layer are generated in the FMO format of the H.264/AVC standard. Unlike the conventional approaches, in our work macroblocks of each layer are divided into two paths. Hence, in the bursty error conditions the error will be smoothly spread in all layers. For better protection and more network compatibility, the base layer is data partitioned and its important part (DP_A) is repeated in both paths. Simulation results show transmission of duplicated DP_A and the non-corresponding descriptions of two layers together on disjoint paths, can improve the error concealment of the decoder and consequently enhance video quality by up to 2 dB.

Growth Codes: Intermediate Performance Analysis and Application to Video

Growth codes are a subclass of Rateless codes that have found interesting applications in data dissemination problems. Compared to other Rateless and conventional channel codes, Growth codes show improved intermediate performance which is particularly useful in applications where partial data presents some utility. In this paper, we investigate the asymptotic performance of Growth codes using the Wormald method, which was proposed for studying the Peeling Decoder of LDPC and LDGM codes. Compared to previous works, the Wormald differential equations are set on nodes' perspective which enables a numerical solution to the computation of the expected asymptotic decoding performance of Growth codes. Our framework is appropriate for any class of Rateless codes that does not include a precoding step. We further study the performance of Growth codes with moderate and large size codeblocks through simulations and we use the generalized logistic function to model the decoding probability. We then exploit the decoding probability model in an illustrative application of Growth codes to error resilient video transmission. The video transmission problem is cast as a joint source and channel rate allocation problem that is shown to be convex with respect to the channel rate. This illustrative application permits to highlight the main advantage of Growth codes, namely improved performance in the intermediate loss region.

Forward Error Correction-Based 2-D Layered Multiple Description Coding for Error-Resilient H.264 SVC Video Transmission

In this paper, we propose a novel 2-D layered multiple description coding (2DL-MDC) for error-resilient video transmission over unreliable networks. The proposed 2DL-MDC scheme allocates multiple description sub-bitstreams of a 2-D scalable bitstream to two network paths with unequal loss rates. We formulate the 2-D scalable rate-distortion problem and derive the expected distortion for the proposed scheme. To minimize the end-to-end distortion given the total rate budget and packet loss probabilities, we need to optimally allocate source and channel rates for each hierarchical sublayer of the scalable bitstream. The conventional Lagrangian multiplier method can be utilized to solve this problem but with overwhelming computational complexity. Therefore, we consider the use of the genetic algorithm to solve the rate-distortion optimization problem. The simulation results verify that the proposed method is able to achieve significant performance gain as opposed to the conventional equal rate allocation method.

Error Resilient Video Transmission over Wireless Networks Based on Wyner-Ziv Coding of Motion Regions

The multipath fading and shading of the wireless networks usually lead to the loss or error of video packets which results in significant video quality degradation. Existing approaches with forward error correction (FEC) or error concealment are unable to provide the desired robustness in video transmission. In this work, we develop a novel motion-based Wyner-Ziv coding (MWZC) scheme by leveraging distributed source coding (DSC) ideas for error robustness. The MWZC scheme is based on the fact that motion regions of a given video frame are particularly important to both objective and perceptual video quality and hence should be given preferential Wyner-Ziv coding based embedded protection. To achieve high coding efficiency, we determine the underlining motion regions based on a rate-distortion model. Within the framework of H.264/AVC specification, motion region determination can be efficiently implemented using Flexible Macroblock Ordering (FMO) and Data Partitioning (DP). The bit stream consists of two parts: the systematic portion generated from conventional H.264/AVC bit stream and the supplementary bit stream generated by the proposed feedback free rate allocation algorithm for Wyner-Ziv coding of motion regions. Experimental results demonstrate that the proposed scheme significantly outperforms both decoder-based error concealment (DBEC) and conventional FEC with DBEC approaches.

An error resilient video coding and transmission solution over error-prone channels

With the rapid development of network and multimedia technology, the error control in video coding and video transmission over error-prone channels has become increasingly important. The DCT based predictive coding and VLC based entropy coding greatly increase the coding efficiency, but make the compressed video stream very sensitive to transmission errors. Therefore, this paper proposes a reliable error resilient video coding and video transmission framework. In order to improve the robustness to packet loss errors, an error resilient video coding algorithm named Z-FMO is proposed. Some channel may bring random bit errors, an adaptive error concealment algorithm based on macroblock boundary gradient namely ECMBG is proposed aiming at such problem. As the indispensable part of a video transmission system, we implement an adaptive video transmission control algorithm JCBAF. Experimental results show that the proposed framework performs well both in R-D performance and subjective quality.

A Robust Resolution-Enhancement Scheme for Video Transmission Over Mobile Ad-Hoc Networks

Historically, Error-Resilient (ER) video transmission and Super-Resolution (SR) image reconstruction techniques have evolved separately. In this paper, we propose a coordinated application of ER and SR to enhance the resolution of image transmitted over mobile ad-hoc networks. In order to combat error propagation, a flexible multiple description coding method based on shifted 3-D SPIHT (3-D Set Partitioning In Hierarchical Trees) algorithm is presented to generate variable independent descriptions (substreams) according to the network condition. And then, a novel unequal error protection strategy based on the priority level is provided to assign a higher level of error protection to more important parts of bitstream. Moreover, a robust SR algorithm is proposed in the presence of different kinds of packet loss rate to enhance the image resolution. Experimental results indicate that the proposed robust resolution-enhancement scheme outperforms the competing methods from the aspects of PSNR (Peak-Signal-to-Noise Ratio) and visual quality under different packet loss rates.

MPEG video markup language and its applications to robust video transmission

In this research, we develop the MPEG video markup language (MPML) to describe MPEG-4 video contents. As an XML designed specifically for MPEG-4 bitstreams, MPML provides a friendly support for random access, portability, interoperability, flexibility, and extendibility. We propose an efficient compression algorithm to reduce the amount of storage space for MPML documents. Then, as two applications, we show how to use MPML for error-resilient video transmission over wireless channels and video multicast over Internet. It is demonstrated that the MPML-based decoding algorithm can protect image quality effectively against transmission errors over noisy channels by using the random access support of MPML.

Error-resilient video transmission using long-term memory motion-compensated prediction

Long-term memory prediction extends the spatial displacement vector utilized in hybrid video coding by a variable time delay, permitting the use of more than one reference frame for motion compensation. This extension leads to improved rate-distortion performance. However, motion compensation in combination with transmission errors leads to temporal error propagation that occurs when the reference frames at the coder and decoder differ. In this paper, we present a framework that incorporates an estimated error into rate-constrained motion estimation and mode decision. Experimental results with a Rayleigh fading channel show that long-term memory prediction significantly outperforms the single-frame prediction H.263-based anchor. When a feedback channel is available, the decoder can inform the encoder about successful or unsuccessful transmission events by sending positive (ACK) or negative (NACK) acknowledgments. This information is utilized for updating the error estimates at the encoder. Similar concepts, such as the ACK and NACK mode known from the H.263 standard, are unified into a general framework providing superior transmission performance.

Error resilient video transmission over ATM networks

In the transmission process of a variable bit rate video signal over an ATM network, cells are inevitably exposed to delays and losses due to the statistical multiplexing used in these networks. These phenomena affect the quality of the video signal, and without adequate measures to control the propagation of impairments, the quality of service may fall below acceptable levels. We introduce a set of control mechanisms at different levels of the protocol architecture to support MPEG-2 based video communications systems using ATM networks as their underlying transmission mechanism. We argue that in order to be able to create video systems able to cope with cell losses encountered in computer communications systems, a structured set of protocol mechanisms is required. Our results show the effectiveness of the proposed set of mechanisms in improving the robustness of the video delivery system.

Extensions of ITU-T recommendation H.324 for error-resilient video transmission

The authors provide an overview of techniques that enable the use of ITU-T recommendation H.324 with error-prone transmission channels. H.324 covers the overall architecture, algorithms, and syntax for low-bit-rate multimedia terminals. This overview focuses on extensions for error-resilient video transmission that are related to the H.263 video codec and H.223 multiplex. The latter is responsible for reliable delivery of data to each terminal component and is therefore of major importance to the overall system. In particular, the discussed approaches to robust video transmission require reliable performance of the multiplex scheme. The considered techniques for video coding are either compatible with the baseline mode of H.263 or part of new extensions recently devised by Study Group 16 as part of the H.263+ effort. This overview includes "error tracking" (Appendix II). "reference picture selection" (Annex N), and "independent segment decoding" (Annex R). Whenever appropriate, the description of those video extensions and multiplex schemes is complemented with simulation results for transmission over Rayleigh fading channels.