Wireless Video Communication Research Articles

Error resilient wireless video transmission via parallel processing using puncturing rule enabled coding and decoding

The innovation in wireless video transmission lies in the methodology's holistic approach, which combines parallel processing, puncturing rule-enabled coding, comprehensive error correction, and focused video frame reconstruction. The methodology includes several stages, including video frame processing, channel coding, error simulation, and Viterbi decoding, all of which are optimized for improved performance. Parallel processing is used at each stage to improve computational efficiency. Convolutional encoding is used concurrently, with a puncturing rule to tailor the encoding process for individual packets. Following that, a binary symmetric channel model is used to simulate bit errors, allowing the system's error-resilient characteristics to be evaluated. Beyond the analysis performed on previously studied videos, the proposed approach is thoroughly evaluated across three distinct video datasets. Furthermore, the study delves into BER analysis, encompassing various error probabilities and employing incremental redundancy. This investigation sheds light on the system's robustness in correcting errors in a variety of error scenarios. Throughput measurements provide important information about the achieved data transmission rate during successful receptions, whereas the elapsed time metric measures the overall efficiency of the transmission process. Furthermore, the proposed method assesses Mean Squared Error (MSE) at 0.48 and Peak Signal-to-Noise Ratio (PSNR) at 51.30 dB across the entire operational process. The combined findings highlight the proposed approach's superiority, positioning it as a promising solution for robust and efficient wireless video communication. This results in a more stable and efficient gearbox system, distinguishing it from existing system.

SP-DSTS-MIMO Scheme-Aided H.266 for Reliable High Data Rate Mobile Video Communication

With the ever growth of Internet users, video applications, and massive data traffic across the network, there is a higher need for reliable bandwidth-efficient multimedia communication. Versatile Video Coding (VVC/H.266) is finalized in September 2020 providing significantly greater compression efficiency compared to Highest Efficient Video Coding (HEVC) while providing versatile effective use for Ultra-High Definition (HD) videos. This article analyzes the quality performance of convolutional codes, turbo codes and self-concatenated convolutional (SCC) codes based on performance metrics for reliable future video communication. The advent of turbo codes was a significant achievement ever in the era of wireless communication approaching nearly the Shannon limit. Turbo codes are operated by the deployment of an interleaver between two Recursive Systematic Convolutional (RSC) encoders in a parallel fashion. Constituent RSC encoders may be operating on the same or different architectures and code rates. The proposed work utilizes the latest source compression standards H.266 and H.265 encoded standards and Sphere Packing modulation aided differential Space Time Spreading (SP-DSTS) for video transmission in order to provide bandwidth-efficient wireless video communication. Moreover, simulation results show that turbo codes defeat convolutional codes with an averaged Eb/N0 gain of 1.5 dB while convolutional codes outperform compared to SCC codes with an Eb/N0 gain of 3.5 dB at Bit Error Rate (BER) of . The Peak Signal to Noise Ratio (PSNR) results of convolutional codes with the latest source coding standard of H.266 is plotted against convolutional codes with H.265 and it was concluded H.266 outperform with about 6 dB PSNR gain at Eb/N0 value of 4.5 dB.

High-sensitive and ultra-wide spectrum multifunctional triboelectric acoustic sensor for broad scenario applications

Based on the unique capacitance model of triboelectric technology, here, a novel self-powered triboelectric acoustic sensor (T-MIC) was fabricated, which is capable of simultaneously sensing acoustic waves not only covering the full frequency range of human hearing from 20 to 20,000 Hz, but also possessing higher frequency resolution (accuracy 1 Hz) and higher sensitivity (21.50 times) than the best reported triboelectric acoustic sensor. The T-MIC is faultless competent for commercial applications in high-quality music recording, wireless video communication, voice content inputting and human-robot interaction. Furthermore, based on the principle of acoustics, a theoretical model of T-MIC is proposed. Considering a broad selection of materials and the simpler preparation process of T-MIC, it has great advantages than that of many commercial acoustic wave sensors in performance and cost. So, the T-MIC can provide a feasible low-cost option for perception and detection of the acoustic waves in the commercial applications.

Coexistence of light emission and detection in a III-nitride quantum well diode.

The demand for on-chip multifunctional optoelectronic systems is increasing in today's Internet of Things era. III-nitride quantum well diodes (QWDs) can transmit and receive information through visible light and can be used as both light-emitting diodes (LEDs) and photodetectors (PDs). Spectral emission-detection overlap gives the III-nitride QWD an intriguing capability to detect and modulate light emitted by itself. In this paper, the coexistence of light emission and detection in a III-nitride QWD is experimentally demonstrated, and a wireless video communication system through light is established. When approximately biasing and illuminating at the same time, the III-nitride QWD can achieve light emission and detection simultaneously. This work provides a foundation for the development of multifunctional III-nitride QWDs and the realization of device-to-device data communication.

Enhanced CRC-based correction of multiple errors with candidate validation

Cyclic redundancy checks (CRC) are widely used in transmission protocols to detect whether errors have altered a transmitted packet. It has been demonstrated in the literature that CRC can also be used to correct transmission errors. In this paper, we propose an improvement of the state-of-the-art CRC-based error correction method. The proposed approach is designed to significantly increase the error correction capabilities of the previous method, by handling a greater part of error cases through the management of candidate lists and using additional validations. Simulations and results for wireless video communications over 802.11p and Bluetooth Low Energy illustrate the Peak Signal-to-Noise Ratio (PSNR) and visual quality gains achieved with the proposed approach versus the state-of-the-art and traditional approaches. These gains range on average from 1.6 dB to 7.3dB over Bluetooth Low Energy channels with Eb/No ratio of 10 dB and 8 dB, respectively.

Design of high-order QAM modem algorithm

More and more attention has been paid on the issue of bandwidth utilization. Nowadays, with limited frequency spectrum resources, the capacity of traditional communication system has not been able to meet the demands of users. Quadrature Amplitude Modulation (QAM) has become a critical technical solution for broadband wireless access and wireless video communication due to its advantages of high frequency spectrum utilization and high-power spectrum density. In order to further improve the control information transmission performance of high-order QAM, we propose a high-order QAM modulation and demodulation algorithm, which is designed from the aspects of interleave between channels, leading sequence, constellation modulation, frequency domain sampling and (Orthogonal Frequency Division Multiplexing) OFDM generation, etc. The simulation results demonstrate that the algorithm can ensure the reliable reception of control information.

Media motion-based resource distribution for mobile video networking

Wireless video communication is challenging due to vulnerability of media bitstreams to channel distortions. Investigation has been carried out on wireless video channel under tight networking resource budget. One of the challenges is the impact of channel errors on the quality of media streams with high motion activity. Motion activity in this context defines the magnitude of activity displacement in video sequence. Based on the analysis, Media Motion-based Resource Distribution (MRD) is proposed to maximize the average received video quality over wireless system, by regulating the resource distribution of the media streams based on their motion activity characteristics. Experimental results demonstrate that the proposed scheme can improve the average received video quality performance under tight resource constraints budget.
 Keywords: Wireless video communication, resource constraints, received video performance, media motion

On the Performance of Wireless Video Communication Using Iterative Joint Source Channel Decoding and Transmitter Diversity Gain Technique

In this research work, we have presented an iterative joint source channel decoding- (IJSCD-) based wireless video communication system. The anticipated transmission system is using the sphere packing (SP) modulation assisted differential space-time spreading (DSTS) multiple input-multiple output (MIMO) scheme. SP modulation-aided DSTS transmission mechanism results in achieving high diversity gain by keeping the maximum possible Euclidean distance between the modulated symbols. Furthermore, the proposed DSTS scheme results in a low-complexity MIMO scheme, due to nonemployment of any channel estimation mechanism. Various combinations of source bit coding- (SBC-) aided IJSCD error protection scheme has been used, while considering their identical overall bit rate budget. Artificial redundancy is incorporated in the source-coded stream for the proposed SBC scheme. The motive of adding artificial redundancy is to increase the iterative decoding performance. The performance of diverse SBC schemes is investigated for identical overall code rate. SBC schemes are employed with different combinations of inner recursive systematic convolutional (RSC) codes and outer SBC codes. Furthermore, the convergence behaviour of the employed error protection schemes is investigated using extrinsic information transfer (EXIT) charts. The results of experiments show that our proposed R a t e − 2 / 3 SBC-assisted error protection scheme with high redundancy incorporation and convergence capability gives better performance. The proposed R a t e − 2 / 3 SBC gives about 1.5 dB E b / N 0 gain at the PSNR degradation point of 1 dB as compared to R a t e − 6 / 7 SBC-assisted error protection scheme, while sustaining the overall bit rate budget. Furthermore, it is also concluded that the proposed R a t e − 2 / 3 SBC-assisted scheme results in E b / N 0 gain of 24 dB at the PSNR degradation point of 1 dB with reference to R a t e − 1 SBC benchmarker scheme.

An application layer forward error correction method of wireless network broadcasting communication for smart video surveillance system

Aiming at the wireless channel in which the state of video surveillance communication network changes dramatically, to ensure the video impact under a restricted channel bandwidth condition, an application layer forward error correction system for wireless video communication is proposed. This scheme is an improved forward error correction algorithm. The most appropriate redundancy amount is implemented for each FEC block by constantly altering the redundancy in FEC blocks. Firstly, the system describes and implements the optimum video transmission. Then, the RCPC code and Raptor code are used as forward error correction codes in physical layer and application layer respectively, in this way, the optimal system solution can be acquired. In the forward error correction technology, a feedback mechanism is then developed between the receiver and the sender, which will acknowledge that the receiver can extract the packet loss rate from the received speech signal in the current network state in real time, and then the packet loss rate will be transferred back to the sender by the feedback mechanism. The sender can modify the forward packet loss rate according to the packet loss rate. The error-correcting schema can help the next speech signal have the most appropriate forward error-correcting redundancy, reducing bandwidth waste, significantly improving the adaptability and efficiency of forward error-correcting technology in the wireless network. The simulation results show that the average video quality of the proposed scheme is 0.5–4 dB higher than that of the equal error protection scheme and the extended window unequal error protection scheme.

Reliable and Robust Unmanned Aerial Vehicle Wireless Video Transmission

The wireless video transmission environment of unmanned aerial vehicles (UAVs) is complex and unstable given the high mobility and changeable working conditions of UAVs, which lead to burst and consecutive errors and high error rates. A compressed video stream is extremely sensitive to transmission errors, such that even a single bit error sharply degrades the video quality. Hence, we propose an intraframe pixel-row-interleaved error concealment algorithm that interleaves pixel rows to generate high similarity in different parts of a frame, thereby achieving intraframe error resilience. Subsequently, we suggest an interframe time-field-interleaved alternative motion-compensated prediction that allows for automatic error elimination and recovers at least four consecutive frames in wireless video communications. The experiments demonstrate that the proposed algorithms recover frames with excellent subjective and objective effects. Moreover, these algorithms can provide reliable and robust video transmission for UAVs.

Design of Low-Power Non-Binary LDPC Decoder Exploiting DRAM Refresh Rate Over-Scaling

This brief presents a low-power non-binary low density parity-check decoder design exploiting domain specific information for high-throughput wireless video communication applications. The proposed technique can dynamically scale the refresh rate of DRAM according to channel conditions as well as decoding states, hence to greatly reduce the DRAM power as well as the decoder power with lower refresh overhead. Evaluation results show that the proposed technique can achieve significant decoder power saving than conventional techniques.

QoE-Aware wireless video communications for emotion-aware intelligent systems: A multi-layered collaboration approach

With the ever increasing demand on high-quality visual information for emotion-aware intelligent systems, wireless video traffic explosively grows and causes great energy consumption. Therefore, providing high quality of experience (QoE) for connected users becomes increasingly important. Aiming to establish a new paradigm to solve this challenging problem, in this article we propose a multi-layered collaboration approach to provide energy-efficient QoE-aware wireless video communications by efficiently utilizing the limited transmission resources of wireless networks for 5G. We first investigate the emotion-aware intelligent system QoE measurement based on objective metrics of quality of service (QoS). Then, we utilize the multi-layered collaborations of physical, network and application layers among the connected users to achieve energy-efficient QoE-aware video communications. By developing a profound understanding of the interplay between the video applications and wireless networks, we qualitatively analyze how QoE can benefit from the multi-layered collaborations, and quantitatively assess the achievable gains in a typical wireless-connected emotion-aware application scenario.

Optimal HEVC Configuration for Wireless Video Communication Under Energy Constraints

High Efficiency Video Coding (HEVC) provides a doubling in coding efficiency compared with the H.264/AVC at the expense of increased computational complexity. However, mobile devices that perform video encoding and communication over wireless networks have limited energy supply. A video encoding system which has the ability to adjust its computational complexity and power consumption could be used to prolong the lifetime of these devices. In this paper, we develop a framework, which selects the optimal HEVC encoding configuration in order to optimize the performance of the wireless video communication system under energy constraints. More specifically, in this paper, we develop an analytic HEVC encoder behavior model based on the extensive analysis of key HEVC encoding tools. We use the developed model for the performance optimization of the HEVC encoder under energy constraints. We propose an adaptive algorithm to estimate the HEVC encoder model parameters and perform online encoder coding configuration optimization. We show that using the proposed framework, the video encoder is able to select appropriate coding tools to automatically adjust its coding efficiency and complexity to match the available power budget with the maximum possible video quality. The proposed HEVC encoder model provides a guideline for optimized tool selection in the energy constrained wireless video communication.

Quality-Aware Energy Optimization in Wireless Video Communication With Multipath TCP

The advancements in wireless communication technologies prompt the bandwidth aggregation for mobile video delivery over heterogeneous access networks. Multipath TCP (MPTCP) is the transport protocol recommended by IETF for concurrent data transmission to multihomed terminals. However, it still remains challenging to deliver user-satisfied video services with the existing MPTCP schemes because of the contradiction between energy consumption and received video quality in mobile devices. To enable the energy-efficient and quality-guaranteed video streaming, this paper presents an energy-distortion-aware MPTCP (EDAM) solution. First, we develop an analytical framework to characterize the energy-distortion tradeoff for multipath video transmission over heterogeneous wireless networks. Second, we propose a video flow rate allocation algorithm to minimize the energy consumption while achieving target video quality based on utility maximization theory. The performance of the proposed EDAM is evaluated through both experiments in real wireless networks and extensive emulations in exata. Experimental results show that EDAM exhibits performance advantages over existing MPTCP schemes in energy conservation and video quality.

A Decision-Tree-Based Perceptual Video Quality Prediction Model and Its Application in FEC for Wireless Multimedia Communications

With the exponential growth of video traffic over wireless networked and embedded devices, mechanisms are needed to predict and control perceptual video quality to meet the quality of experience (QoE) requirements in an energy-efficient way. This paper proposes an energy-efficient QoE support framework for wireless video communications. It consists of two components: 1) a perceptual video quality model that allows the prediction of video quality in real-time and with low complexity, and 2) an application layer energy-efficient and content-aware forward error correction (FEC) scheme for preventing quality degradation caused by network packet losses. The perceptual video quality model characterizes factors related to video content as well as distortion caused by compression and transmission. Prediction of perceptual quality is achieved through a decision tree using a set of observable features from the compressed bitstream and the network. The proposed model can achieve prediction accuracy of 88.9% and 90.5% on two distinct testing sets. Based on the proposed quality model, a novel FEC scheme is introduced to protect video packets from losses during transmission. Given a user-defined perceptual quality requirement, the FEC scheme adjusts the level of protection for different components in a video stream to minimize network overhead. Simulation results show that the proposed FEC scheme can enhance the perceptual quality of videos. Compared to conventional FEC methods for video communications, the proposed FEC scheme can reduce network overhead by 41% on average.

Optimization of Outdoor Video Surveillance

Video surveillance has a growing importance in public safety services. Departments and organizations delivering public safety and security services often need to resort to covertness in their activities. They usually compromise on distance, lens size and light to insure secrecy; these compromises present challenges on the quality and usefulness of the captured video. Moreover, outdoor surveillance systems, especially over long distances, are often constrained to wireless networks to transport the video back to the monitoring offices. The design of such application is multi-faceted and covers both video processing and the delivery network. In this paper, we study the challenges of video surveillance, covering most of the phases of a typical surveillance system, and present a roadmap to render the surveillance video, collected over long distances, useful in the pursuit of investigations and responsive to the requirements of different target recognition levels. Keywords: Outdoor surveillance systems, quality of service, subject recognition, wireless video communications, video surveillance, typical surveillance system.

Delay–Rate–Distortion Optimized Rate Control for End-to-End Video Communication Over Wireless Channels

In addition to the rate-distortion (R-D) behavior, in a real-time wireless video communication system, the end-to-end delay would also significantly affect the overall video reception quality. To analyze, control, and optimize the R-D behavior under the end-to-end delay constraint, in this paper we extend the traditional R-D optimization (RDO) for the wireless video communication system and formulate a novel delay-RDO-based rate control problem, by investigating the allocation of end-to-end delay to different delay components. It aims at minimizing the average total end-to-end distortion under the transmission rate and end-to-end delay constraints, by a joint selection of both the source coding and the channel coding parameters. The wireless channel is represented by a finite-state Markov channel model characterizing the time-varying process and predicting the future channel condition. As applicable solutions, a practical algorithm based on the Lagrange multiplier approaches, Karush-Kuhn-Tucker conditions, and sequential quadratic programming methods is developed. The experimental results demonstrate the superiority of the proposed algorithm over the existing schemes.

HEVC in wireless environments

The increasing demand for real-time applications with high and ultra-high-definition video urged the ITU-T and the ISO/IEC to join their forces to develop the next-generation video coding standard. The new coding standard that has been produced is known as High-Efficiency Video Coding (HEVC). The proposed HEVC standard fulfilled its target to achieve more than 50 % improvement in video compression over the existing H.264 Advanced Video Coding standard, keeping comparable image quality, at the expense of increased computational complexity. Advances in wireless communications and mobile networking have dramatically increased the popularity of video services for mobile users, with video delivery at their fingertips. Delivering high perceptual quality video over wireless environments is challenging due to the changing channel quality and the variations in the importance of one source packet to the next for the end user's quality of experience. The main objective of this paper is to provide an overview over the new characteristics which are likely to be used in HEVC in wireless environments and discusses several research challenges. Experimental results demonstrate that for low-delay wireless video communications, the HEVC codec is more effective compare to previous H.264 codec and shows better overall performance. Both subjective and objective visual quality comparative study has been also carried out to validate the proposed approach.

Subjective and objective quality assessment of videos in error-prone network environments

Compression and transmission are two fundamental stages involved in wireless video communications, each of which may cause degradation of the quality of experience (QoE) of end users by producing compression artifacts and packet loss artifacts, respectively. They have their own unique perceptual influences. To provide insight for designing QoE-aware content delivery applications, this paper studies subjective and objective quality of videos containing both types of artifacts. First, subjective quality assessment is conducted, from which interaction between the two types of artifacts during quality perception is investigated. Second, using the subjective data, the performance of the state-of-the-art objective quality metrics is evaluated, with the aim of examining suitability of the existing metrics for their use in error-prone video communication applications. Finally, the developed data set is made publicly available for the community.

Model-based low bit-rate video coding for resource-deficient wireless visual communication

In this paper, an effective low bit-rate video coding scheme is developed to realize state-of-the-art video coding efficiency with lower encoder complexity, while supporting standard compliance and error resilience. Such an architecture is particularly attractive for application scenarios involving resource-deficient wireless video communications. At the encoder, in order to increase resilience to channel error, multiple descriptions of a video sequence are generated in the spatio-temporal domain by temporal multiplexing and spatial adaptive downsampling. The resulting side descriptions are interleaved with each other in temporal domain, while still with conventional square sample grids in spatial domain. As such, each side description can be compressed without any change to existing video coding standards. At the decoder, each side description is first decompressed, and then reconstructed to the original resolution with the help of the other side description. In this procedure, the decoder recovers the original video sequence in a constrained least squares regression process, in which 2D or 3D piecewise autoregressive model is adaptively chosen according to different predictive modes. In this way, the spatial and temporal correlation is sufficiently explored to achieve superior quality. Experimental results demonstrate that the proposed video coding scheme outperforms H.264/AVC and other state-of-the-art methods in rate–distortion performance at low bit-rates and achieves superior visual quality at medium bit rates as well, while with lower encoding computational complexity.