Video Coding Technology Research Articles

Research on the Innovation and Implementation of Interactive Teaching Content of Civic and Political Education in Colleges and Universities under the Digital Transformation of the Academic Style Building

Abstract The construction of ideological and political education and the construction of academic style are complementary to each other and jointly committed to the good development of education and teaching in colleges and universities. This paper starts from the relationship between the two, discusses the interaction between ideological and political education and the construction of academic style in colleges and universities, and draws out the methodological path of ideological and political education in colleges and universities to lead the construction of academic style. It proposes interactive teaching methods to strengthen the construction of ideological and political education by utilizing the interactive teaching process between teachers and students. It points out that the digital video coding technology (H.265/HEVC intra-frame coding technology and H.265/HEVC rate-distortion optimization technology) and the video encryption mechanism based on H.265/HEVC optimize the processing of interactive video to enhance the interactive performance of ideological and political academic style. By comparing the coding performance of H.264 and H.265, as well as the PNSR and SSIM evaluation indices, the rationality of the proposed digital video coding and encryption technology is verified. A survey on the academic style construction of different majors and grades, as well as an analysis of the attitude of Civics academic style construction, is conducted in the sample schools to find out what can be optimized in the academic style construction of Civics education in colleges and universities. In all five schools, 4.76% of students believe that the academic culture situation is not conducive to the current learning culture. However, 58.96% and 14.46% of the groups think that learning is something that has to be done and something that is not interesting, indicating that there is still a lack of interest in the teaching interaction of Civics and Political Science style, and schools should make full use of digital technology to attract students to carry out teaching interaction.

Remote ultrasound real‐time consultation and quality control system

AbstractUltrasound examination is widely used, but there are problems such as difficulties in quality control and unbalanced distribution of ultrasound resources in primary hospitals. In this article, a novel remote ultrasound real‐time consultation and quality control system was developed. The system uses advanced information science technology, medical image acquisition equipment, audio and video coding and decoding technology, combined User Datagram Protocol (UDP) and Transmission Control Protocol (TCP) transfer protocols, server cluster design technology. It realizes remote real‐time medical consultation and quality control between the doctors in the consulation center and doctors in the ultrasound examination room. The image similarity, transmission delay, and efficiency of ultrasound treatment were tested. System test data show that the quality of ultrasound images transmitted to the consultation center is the same as the quality of the original ultrasound images, the distortion is less than 1%, and the audio and video transmission delay is less than 0.2 s. The system significantly improves the efficiency and quality of ultrasound diagnosis and treatment through its high interactivity, and can also help improve the level of ultrasound diagnosis and treatment in primary hospitals.

Analysis of the Limitations of Further Improvement of the Efficiency of VVC-CABAC

Hybrid video compression plays an invaluable role in digital video transmission and storage services and systems. It performs several-hundred-fold reduction in the amount of video data, which makes these systems much more efficient. An important element of hybrid video compression is entropy coding of the data. The state-of-the-art in this field is the newest variant of the Context-based Adaptive Binary Arithmetic Coding (CABAC) entropy compression algorithm which recently became part of the new Versatile Video Coding (VVC) technology. This work is a part of research that is currently underway to further improve the CABAC technique. This paper provides analysis of the potential for further improvement of the CABAC by more accurate calculation of probabilities of data symbols. The CABAC technique calculates those probabilities by the use of idea of the two-parameters hypothesis. For the needs of analysis presented in this paper, an extension of the aforementioned idea was proposed which consists of three- and four-parameters hypothesis. In addition, the paper shows the importance of proper calibration of parameter values of the method on efficiency of data compression. Results of experiments show that for the considered in the paper variants of the algorithm improvement the possible efficiency gain is at levels 0.11% and 0.167%, for the three- and four-parameter hypothesis, respectively.

Rate Control Technology for Next Generation Video Coding Overview and Future Perspective

Video data have become the main data traffic on the Internet, and their traffic is increasing explosively every year, thus increasing the pressure of video transmission. Video coding technology has become the key to compressing original videos. As an indispensable technology, rate control plays an important role in stabilizing video stream transmission. Rate control (RC) is part of rate distortion optimization (RDO) whose job is to find the optimal solution based on balancing rate and distortion. It not only needs to consider the buffer and network status but also adjust the corresponding bit rate according to the video content. This paper reviews the related technologies of rate control under high efficiency video coding (HEVC) and versatile video coding (VVC) standards so that subsequent researchers can quickly understand the field and promote the development of rate control algorithms. Firstly, the paper summarizes the various aspects of RC, including basic principles, rate-distortion models, major processes, and performance criteria. Secondly, the paper surveys, in detail, the research progress in the field of rate control and analyzes several mainstream research directions. Thirdly, we carry out relevant experiments on the standard reference software and analyze and discuss the experimental results of the existing studies. Finally, we look ahead to the future trends of rate control and provide feasible improvement suggestions.

Communication Audio and Video Coding and Decoding Methods in Wireless Cooperative Communication Network

Wireless communication is ubiquitous in people’s daily life. As people’s requirements for wireless communication continue to increase, how to improve system performance has become a core issue that communication researchers pay attention to. Wireless cooperative communication is considered to be a key technology in the future communication system because it can provide better communication quality, higher system capacity, wider communication coverage, richer services, and high spectrum utilization efficiency. The proposed network coding can effectively eliminate the transmission bottleneck problem faced by wireless cooperative communication. The development of audio and video communication coding technology has increased the demand for audio and video communication services. The goal of audio and video coding is shifting from traditional storage applications to network transmission. Therefore, the audio and video coding technology for network transmission is being affected by academia and industry. The purpose of this paper is to study the communication audio and video codec methods in wireless cooperative communication networks and to understand the development status of audio and video codec by reading a large number of related documents. On the basis of the problem, relevant experiments are designed to conduct in-depth research. Experimental results show that this scheme can simplify the implementation of scalable coding, improve the coding efficiency of the enhancement layer, and improve the quality of the reconstructed video when the audio and video streams are truncated.

Image Compression Using Neural Networks: A Review

Computer images consist of huge data and thus require more memory space. The compressed image requires less memory space and less transmission time. Imaging and video coding technology in recent years has evolved steadily. However, the image data growth rate is far above the compression ratio growth, Considering image and video acquisition system popularization. It is generally accepted, in particular that further improvement of coding efficiency within the conventional hybrid coding system is increasingly challenged. A new and exciting image compression solution is also offered by the deep convolution neural network (CNN), which in recent years has resumed the neural network and achieved significant success both in artificial intelligent fields and in signal processing. In this paper we include a systematic, detailed and current analysis of image compression techniques based on the neural network. Images are applied to the evolution and growth of compression methods based on the neural networks. In particular, the end-to-end frames based on neural networks are reviewed, revealing fascinating explorations of frameworks/standards for next-generation image coding. The most important studies are highlighted and future trends even envisaged in relation to image coding topics using neural networks.

V2V-CoVAD: A vehicle-to-vehicle cooperative video alert dissemination mechanism for Internet of Vehicles in a highway environment

Nowadays, traffics on the roads are getting more and more congested due to the fast-rising number of vehicles and the increasing need of citizens for mobility. Accidents happen frequently and result great loss of lives and properties. Internet of Vehicles (IoVs), as an important part of Internet of Things (IoTs), is placed high hope for enhancing traffic safety and controlling the damage caused by traffic accidents. According to statistics, most accidents can be avoided if drivers can be notified of a danger timely, so the key to minimize the damage introduced by road traffic accidents is the realization of fast and efficient data dissemination. However, great challenges exist due to the transmission characteristics of IoVs, such as high-speed movement of vehicles and dynamic changing network topologies. In this paper, we propose a vehicle-to-vehicle cooperative video alert dissemination mechanism for transmitting accident video in the highway scenario of IoVs. A two-way cooperative transmission strategy is designed. Vehicles in the same direction of accident vehicle are formed into clusters and communicate within clusters, while vehicles in the opposite direction select relay vehicles to help spreading video fast and reliably. The difficulties brought in by the characteristics of IoVs are solved through careful considerations of multiple factors such as vehicles' speeds, locations, distances, channel conditions and data receiving statuses in the design of the mechanism. Moreover, Scalable Video Coding (SVC) technology is used for encoding the original accident video, to take care of the performance degradation caused by the heterogeneity of vehicles in different locations. Instantly Decodable Network Coding (IDNC) technology is adopted during the cooperative transmission to further improve the transmission efficiency and reliability. Simulation results justify the proposed mechanism that it effectively shortens the accident video transmission delay, increases the success warning ratio, enhances the reconstructed video quality and improves the user satisfaction.

A Novel Channel Attention Mechanism for Human Action Recognition Based on Convolutional Kernel

With the improvements of computer performance, deep learning has gradually expanded from 2D image tasks to 3D video tasks. Human action recognition is a typical 3D video task, which can achieve category classification by capturing human action characteristics. However, most of the videos are processed by encoding and decoding technology at current, thus the motion details are blurry, which makes it difficult for human action recognition. To solve this problem, we utilize the attention mechanism to “ignore” the blurred feature caused by video coding and decoding technology. Therefore, we hope to embed the attention mechanism in 3D spatiotemporal CNN to overcome this problem. Compared with 3D CNN, the effectiveness of our method is verified on UCF101 and HMDB51 dataset. And our method also proves the convolutional kernel implies channel-wise dependence. Although the improvement of the proposed method is limited, we hope the channel attention mechanism can help people to study neural network.

Research on the Trend of UAV Communication Signal Indication System

In recent years, with the application of high-definition video coding and decoding technology, high-precision satellite navigation technology, mobile base station positioning technology and wireless UAV wireless communication technology, the performance indicators and application scope of UA have been significantly improved. Whether it is industrial applications or specific applications, drones play an important role. With the continuous improvement of technical indicators, UAV wireless transmission technology needs further exploration and development. Although there is a lot of research on UAVs, there are still some shortcomings. Based on the AD9361 + ZYNQ7045 platform, this paper has completed the design and implementation of the UAV wireless transmission system. Although there are various integrated UAV wireless solutions on the market, the UAV communication frequency can be allocated to non-fixed frequency points that still do not meet the requirements, such as frequency band L, frequency band S or frequency band C. The design proposed in this paper is that the adjustable radio frequency range is 70MHz to 6GHz, which is sufficient to meet the application requirements of multiple communication frequency points. The UAV wireless transmission system proposed in this paper has strong scalability, wide application range and high integration, which has special reference significance for the design of UAV wireless transmission system. This article uses the flight control algorithm and PID control to analyze the signal range of the UAV communication signal indicating system and explore the future development trend. Through the method in this article, the UAV communication signal increased by 15%.

Precise Probability Estimation of Symbols in VVC CABAC Entropy Encoder

The new version of the Context-based Adaptive Binary Arithmetic Coding (CABAC) that is used in the latest Versatile Video Coding (VVC) technology is the state-of-the-art in the field of entropy compression of video data. This paper gives an in-depth analysis of possible, further extensions of the CABAC technique for even more accurate estimation of the probabilities of coded data symbols. The paper considers four author’s examples of such extensions. With respect to these examples, the paper shows the practical limitations of further increasing the efficiency of the newest version of CABAC used in VVC. Results show that for the considered methods of improvements the limit of gain in compression is up to 0.2073% on average, when compressing the VVC video data.

Precise Estimation of Probabilities in CABAC Using the Cauchy Optimization Method

The algorithm of entropy coding that is now widely used in video compression is the Context-based Adaptive Binary Arithmetic Coding (CABAC). This paper presents a modified, improved version of CABAC, called the CABAC+. The author's idea for the improvement is to use in CABAC a more accurate estimation of probabilities of data symbols. The basis of the proposal is to use the Cauchy optimization method, in order to minimize the number of bits that are produced by the entropy encoder. The application of the CABAC improvement in the High Efficiency Video Coding (HEVC) technology increased the compression efficiency of entropy coding by 0.6% to 1.2%, depending on the parameters of the method and scenario of experiments. The use of the proposed solution increases the decoding time of a video, but the method virtually does not change the complexity of a video encoder.

Omnidirectional 360° Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC

Augmented reality (AR) and virtual reality (VR) applications have seen rising popularity in recent years. Omnidirectional 360° video is a video format often used in AR and VR applications. To address the industry needs, a new HEVC edition recently published includes several supplemental enhancement information (SEI) messages to enable the carriage of omnidirectional video using HEVC. However, further improvement in 360° video compression efficiency is needed. In order to address this challenge, the Joint Video Exploration Team (JVET) of ITU-T VCEG and ISO/IEC MPEG has been investigating 360° video coding technologies, including projection formats, pre- and post-processing technologies, as well as 360°-video-specific coding tools since 2016. The joint call for proposals (CfP) recently issued by ITU-T VCEG and ISO/IEC MPEG on video compression technologies beyond HEVC included a category on 360° video. Twelve CfP responses in the 360° video category were received. This paper describes technologies relevant to 360° video for VVC. A summary of projection formats, pre- and post-processing methods, and 360°-video specific coding tool modifications in these proposals is provided.

General Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC

After the development of the High-Efficiency Video Coding Standard (HEVC), ITU-T VCEG and ISO/IEC MPEG formed the Joint Video Exploration Team (JVET), which started exploring video coding technology with higher coding efficiency, including development of a Joint Exploration Model (JEM) algorithm and a corresponding software implementation. The technology explored in the last version of the JEM further increases the compression capabilities of the hybrid video coding approach by adding new tools, reaching up to 30% bit rate reduction compared to HEVC based on the Bjontegaard delta bit rate (BD-rate) metric, and further improvement beyond that in terms of subjective visual quality. This provided enough evidence to issue a joint Call for Proposals (CfP) for a new standardization activity now known as Versatile Video Coding (VVC). All technology proposed in the responses to the CfP was based on the classic block-based hybrid video coding design, extending it by new elements of partitioning, intra- and inter-picture prediction, prediction signal filtering, transforms, quantization/scaling, entropy coding, and in-loop filtering. This article provides an overview of technology that was proposed in the responses to the CfP, with a focus on techniques that were not already explored in the JEM context.

High Dynamic Range Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC

The ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group issued a Call for Proposals (CfP) on video compression with capability beyond HEVC in October 2017. The CfP considered three categories of content – Standard Dynamic Range, High Dynamic Range and Wide Colour Gamut (HDR/WCG), and 360° Omni-directional video. As a result of the CfP process, the development of a new video coding standard, named Versatile Video Coding (VVC), was initiated. The goal of this paper is to provide an overview of the CfP responses for the HDR/WCG category. The paper includes a summary of work leading to the development of the CfP, a presentation of the CfP results for the HDR/WCG category, and a description of the specific HDR/WCG technologies submitted to the CfP.

Image and Video Compression With Neural Networks: A Review

In recent years, the image and video coding technologies have advanced by leaps and bounds. However, due to the popularization of image and video acquisition devices, the growth rate of image and video data is far beyond the improvement of the compression ratio. In particular, it has been widely recognized that there are increasing challenges of pursuing further coding performance improvement within the traditional hybrid coding framework. Deep convolution neural network (CNN) which makes the neural network resurge in recent years and has achieved great success in both artificial intelligent and signal processing fields, also provides a novel and promising solution for image and video compression. In this paper, we provide a systematic, comprehensive and up-to-date review of neural network based image and video compression techniques. The evolution and development of neural network based compression methodologies are introduced for images and video respectively. More specifically, the cutting-edge video coding techniques by leveraging deep learning and HEVC framework are presented and discussed, which promote the state-of-the-art video coding performance substantially. Moreover, the end-to-end image and video coding frameworks based on neural networks are also reviewed, revealing interesting explorations on next generation image and video coding frameworks/standards. The most significant research works on the image and video coding related topics using neural networks are highlighted, and future trends are also envisioned. In particular, the joint compression on semantic and visual information is tentatively explored to formulate high efficiency signal representation structure for both human vision and machine vision, which are the two dominant signal receptor in the age of artificial intelligence.

A Review on Motion Estimation and Compensation for Versatile Video Coding Technology (VVC)

A Review on Motion Estimation and Compensation for Versatile Video Coding Technology (VVC)

Study of 3D Video Compression Using Nonlinear Depth Representation

The extensions of Advanced Video Coding (AVC) and High-Efficiency Video Coding (HEVC) for multiview video plus depth allow for the coding of 3D video scenes. During the standardization of these extensions, it was demonstrated that compression performance can often be improved by the application of nonlinear depth transformation prior to the compression and applying the respective backward nonlinear depth transformation after decompression. Such an approach is referred to as the compression of nonlinear depth representation (NDR). In this paper, a survey of the NDR technology is provided, but a large part of this survey comprises yet unpublished results. First, the motivation and rationale behind the idea of NDR are discussed. The options for the choice of nonlinear transformation are provided with the respective formulations. Also, the standardization of 3D video coding with NDR within ISO/IEC and ITU is discussed along with the experimental results that demonstrate benefits related to the application of NDR in 3D-AVC and 3D-HEVC. Furthermore, the experimental comparisons are provided for simulcast coding of multiview plus depth video using AVC and HEVC technology with and without the NDR. The similar experimental results are also provided for simulcast coding using the current version of Versatile Video Coding technology that is under development for the forthcoming standard of ISO/IEC (MPEG-I) and ITU. All of the experimental results have been obtained for the standard JVC-3V video test sequences under common test conditions for 3D video coding.

Efficient Multiview Video Coding Using 3-D Coding and Saliency-Based Bit Allocation

Capturing a scene using multiple cameras from different angles is expected to provide the necessary interactivity in the 3-D space to satisfy end-users’ demands for observing objects and actions from different angles and depths. Existing multiview video coding (MVC) technologies face tradeoff among rate-distortion performance, random access frame delay, i.e., interactivity, and computational time. To address above mentioned tradeoffs, a novel cuboid MVC strategy is proposed with 3-D frame referencing structure to improve interactivity and computational time, an additional reference frame to improve rate-distortion performance for occluded areas, and visual attention-based bit allocation to provide better perceptual video quality. The experimental results reveal that the proposed scheme provides better interactivity, reduced computational time, and better perceptual quality compared to the 3D-HEVC implementation, HTM 15.0.

User-perceived quality aware adaptive streaming of 3D multi-view video plus depth over the internet

Video streaming is a foremost and growing contributor in the ever increasing Internet traffic. Since last two decades, due to the enhancement in cameras and image processing technology, we have seen a shift towards multi-view plus depth (MVD) technology from traditional 2D and 3D video technology. This growth comes with deep changes in the Internet bandwidth, video coding and network technologies, which smoothed the mode for delivery of MVD content to end-users over the Internet. Since, MVD contains large amounts of data than single view video, it requires more bandwidth. It is a challenging task for network service provider to deliver such views with the best user’s Quality of Experience(QoE) in dynamic network condition. Also, Internet is known to be prone to packet loss, bandwidth variation, delay and network congestion, which may prevent video packets from being delivered on time. Besides that, different capabilities of end user’s devices in terms of computing power, display, and access link capacity are other challenges. As consequences, the viewing experiences of 3D videos may well degrade, if the quality-aware adaptation techniques are not deployed. In this article, our work concentrates to present a comprehensive analysis of a dynamic network environment for streaming of 3D MVD over Internet (HTTP). We analyzed the effect of different adaptation of decision strategies and formulated a new quality-aware adaptation technique. The proposed technique is promoting from layer based video coding in terms of transmitted views scalability. The results of MVD streaming experiment, using the proposed approach have shown that the video quality of perceptual 3D improves significantly, as an effect of proposed quality aware adaptation even in adverse network conditions.

Video Coding Standards and Technologies

Video Coding Standards and Technologies