Video Encoder Research Articles

A Hierarchical Multiscenario H.265/HEVC Video Encryption Scheme

With the pervasive application of video streaming, the security of streaming media information continually faces new challenges. Most existing encryption methods employ uniform criteria for encrypting all scenarios, leading to unnecessary mutual inhibition of algorithm security and coding efficiency. Furthermore, several encryption algorithms are inadequate for high-resolution videos. A novel, independently hierarchical video cryptosystem for H.265/high efficiency video coding (HEVC) is proposed that develops a scene-adaptive encryption strategy tailored for multiscenario videos. Additionally, we fully consider the seeds of pseudo-random number generators, syntax components in compressed codes, and scenario indicators. We analyze the visibility of encrypted videos in different scenarios and the encryption performance of various syntax parameters based on the integration of encryption for three distinct scenario categories to further enhance encryption efficiency and security. The method’s versatility is demonstrated using a diverse array of videos with significant and insignificant inter-frame motion information across varying resolutions. The experimental results from the video datasets indicate that our scheme effectively balances security and coding efficiency. Furthermore, the scene-adaptive approach can be tailored flexibly according to subscriber needs.

Video encryption algorithm based on the fractional order chaos system

Video encryption algorithm based on the fractional order chaos system

Caregiver-child interaction as an effective tool for identifying autism spectrum disorder: evidence from EEG analysis

BackgroundAutism Spectrum Disorder (ASD) is a complex neurodevelopmental disorder that affects individuals across their lifespan. Early diagnosis and intervention are crucial for improving outcomes. However, current diagnostic methods are often time-consuming, and costly, making them inaccessible to many families. In the current study, we aim to test caregiver-child interaction as a potential tool for screening children with ASD in clinic.MethodsWe enrolled 85 preschool children (Mean age: 4.90 ± 0.65 years, 70.6% male), including ASD children with or without developmental delay (DD), and typical development (TD) children, along with their caregivers. ASD core symptoms were evaluated by Childhood Autism Rating Scale (CARS) and Autism Diagnostic Observation Schedule-Calibrated Severity Scores (ADOS-CSS). Behavioral indicators were derived from video encoding of caregiver-child interaction, including social involvement of children (SIC), interaction time (IT), response of children to social cues (RSC), time for caregiver initiated social interactions (GIS) and time for children initiated social interactions (CIS)). Power spectral density (PSD) values were calculated by EEG signals simultaneously recorded. Partial Pearson correlation analysis was used in both ASD groups to investigate the correlation among behavioral indicators scores and ASD symptom severity and PSD values. Receiver operating characteristic (ROC) analysis was used to describe the discrimination accuracy of behavioral indicators.ResultsCompared to TD group, both ASD groups demonstrated significant lower scores of SIC, IT, RSC, CIS (all p values < 0.05), and significant higher time for GIS (all p values < 0.01). SIC scores negatively correlated with CARS (p = 0.006) and ADOS-CSS (p = 0.023) in the ASD with DD group. Compared to TD group, PSD values elevated in ASD groups (all p values < 0.05), and was associated with SIC (theta band: p = 0.005; alpha band: p = 0.003) but not IQ levels. SIC was effective in identifying both ASD groups (sensitivity/specificity: ASD children with DD, 76.5%/66.7%; ASD children without DD, 82.6%/82.2%).ConclusionOur results verified the behavioral paradigm of caregiver-child interaction as an efficient tool for early ASD screening.

Preliminary study of cine-MRI compression in MR-guided radiotherapy.

Cine-magnetic resonance imaging (MRI) is currently used in real-time tumor tracking during magnetic resonance (MR)-guided radiotherapy. As a type of MRI specified for motion tracking, a few minutes' acquisition results in thousands of 2-dimensional (2D) images. For MR-guided radiotherapy consisting of multiple treatment fractions, the large number of cine-MRI images would be disproportionate to the tight clinical data storage available. To alleviate this issue, the feasibility of compression of cine-MRI via video encoders was investigated in this study. The cine-MRI images were first sorted into 3 sequences according to their plane orientations. Then, each sequence was reordered according to their acquisition times [time-based (TB)] or content similarities [similarity-based (SB)]. As a result, 3 sequences were obtained for 3 plan orientations. Next, the obtained sequences were processed by a video encoder and the corresponding 3 video files were achieved. We employed 3 popular video encoders: Motion JPEG (M-JPEG), Advanced Video Coding (AVC), and High Efficiency Video Coding (HEVC). The performances of the sequence reordering methods and video encoders were evaluated based on a total of 150 image sets. The mean correlation quantities for SB sequences were higher than those for TB sequences by 3% (sagittal), 2% (coronal), and 1% (transverse), respectively. The average compression ratio (CR) yielded by the SB sequences was higher than that achieved by the TB sequences. Comparing with M-JPEG, the CRs obtained by AVC and HEVC were increased by 58% and 62% (sagittal), 16% and 23% (coronal), and 48% and 56% (transverse), respectively. Among the 3 video encoders, the highest CRs and restoration accuracy were achieved by HEVC. HEVC with inter-frame coding is more effective in reducing the redundant information in consecutive images. It is feasible to implement the video encoder for high-performance cine-MRI compression.

Optimal coding unit decision for early termination in high efficiency video coding using enhanced whale optimization algorithm

Video compression is an emerging research topic in the field of block based video encoders. Due to the growth of video coding technologies, high efficiency video coding (HEVC) delivers superior coding performance. With the increased encoding complexity, the HEVC enhances the rate-distortion (RD) performance. In the video compression, the out-sized coding units (CUs) have higher encoding complexity. Therefore, the computational encoding cost and complexity remain vital concerns, which need to be considered as an optimization task. In this manuscript, an enhanced whale optimization algorithm (EWOA) is implemented to reduce the computational time and complexity of the HEVC. In the EWOA, a cosine function is incorporated with the controlling parameter A and two correlation factors are included in the WOA for controlling the position of whales and regulating the movement of search mechanism during the optimization and search processes. The bit streams in the Luma-coding tree block are selected using EWOA that defines the CU neighbors and is used in the HEVC. The results indicate that the EWOA achieves best bit rate (BR), time saving, and peak signal to noise ratio (PSNR). The EWOA showed 0.006-0.012 dB higher PSNR than the existing models in the real-time videos.

RESEARCH OF AUDIO AND VIDEO TRAFFIC THE CHARACTERISTICS IN LOW-BANDWIDTH RADIO COMMUNICATION NETWORKS

The construction of mass service systems, namely automated control systems, requires preliminary analysis and modeling of traffic in their communication networks. Mathematical models of various types of traffic have been developed for public networks, which allows to estimate the necessary functional characteristics of equipment for building a communication network, depending on the number of users. Low-bandwidth communication networks, which are built on the basis of ultra high frequency and very high frequency (UHF/VHF) radio stations, are distinguished by low speed, high delay and jitter of data transmission. To work in such communication networks, special data transmission protocols are adapted and developed. In this paper, a study of the characteristics of audio and video traffic in low-bandwidth communication networks is carried out, which are built on the basis of UHF/VHF radio stations, which will allow creating a software implementation of simulated traffic modeling for the further determination of the services availability at the stage of planning and designing the communication system. Two personal computers and two modern RF‑7850M-HH UHF/VHF radio stations were used to study the characteristics of audio traffic. The radio stations worked in three operating modes: narrowband mode with a fixed carrier frequency FF, narrowband mode with pseudo-random adjustment of the operating frequency QL1A, and wideband mode ANW2C. The voice was transmitted in digital mode using the built-in MELP 2400 codec, and the "iperf-v2.0.5" software was used to determine the characteristics of the audio traffic on personal computers connected to these radio stations. Two personal computers, two modern RF‑7850M‑HH UHF/VHF radio stations, a video encoder and a video camera were used to study video traffic characteristics. The radio stations operated in ANW2C broadband mode. To evaluate the characteristics of the video traffic, the Wireshark software was used on a personal computer, with the help of which the video broadcast from the video encoder was presented. It was found that voice transmission in low-speed communication networks based on UHF/VHF radio stations occupies a bandwidth of 2 Kbit/s - 2.5 Kbit/s, and when voice and data are simultaneously transmitted in radio stations, data buffering and jitter increase. The resolution, bitrate, FPS, and necessary bandwidth of video traffic that can be transmitted via UHF/VHF radio communication channels are determined. Based on the conducted research, recommendations are provided for the transmission of video traffic through low-bandwidth communication channels.

Deepfake Forensics: Identifying Real Regions in Altered Videos with Digital Watermarking

This paper describes a method for detecting Deepfake videos using a lightweight yet secure video encryption algorithm. With the increasing use of digital media, transferring data via the Internet or other mediums requires protection. In the proposed method a digital signature is generated and encrypted using Asymmetric Encryption (RSA). This encrypted signature is then used as a blind watermark for the video. This technique aims to detect “face swap” type of Deepfake videos. It is an efficient algorithm and has minimal impact on the perceptibility of the video quality.

An efficient hardware architecture of integer motion estimation based on early termination and data reuse for Versatile video coding

The integer motion estimation (IME) involves high computational complexity and large amount of computation data due to the variable block sizes, and it is one of the most critical bottlenecks in video coding. The traditional algorithm for integer motion estimation loses search accuracy when simplifying the motion search process, or it becomes complex to pursue search accuracy, which is not conducive to video encoding and transmission. This paper presents a data reuse algorithm based on search window division, block splitting, the arrangement of search points in the Test Zone (TZ) search algorithm and block division. which divides pixel blocks of different sizes into several 8x8 pixel blocks and then reuses the overlapping 8x8 pixel blocks between adjacent search points of the Test Zone (TZ) search algorithm to reduce hardware resource consumption. By comparing the Sum of Absolute Differences (SAD) values of left and top pixel blocks with current pixel block, the integer motion estimation (IME) can be terminated in advance, reducing the computation complexity of integer motion estimation by over 70 %. Furthermore, the paper also presents a hardware architecture based on the data reuse algorithm, which can process 7680 × 4320@60fps videos at an operating clock frequency of 182.99 MHz, with lower resource consumption compared to similar hardware designs.

Low-complexity enhancement VVC encoder for vehicular networks

In intelligent transportation systems, real-time video streaming via vehicle networks has been seen as a vital difficulty. The goal of this paper is to decrease the computational complexity of the versatile video coding (VVC) encoder for VANETs. In this paper, a low-complexity enhancement VVC encoder is designed for vehicular communication. First, a fast coding unit (CU) partitioning scheme based on CU texture features is proposed in VVC, which aims to decide the final type of CU partition by calculating CU texture complexity and gray-level co-occurrence matrix (GLCM). Second, to reduce the number of candidate prediction mode types in advance, a fast chroma intra-prediction mode optimization technique based on CU texture complexity aims to combine intra-prediction mode features. Moreover, the simulation outcomes demonstrate that the overall approach may substantially reduce encoding time, while the loss of coding efficiency is reasonably low. The encoding time can be reduced by up to 53.29% when compared to the VVC reference model, although the average BD rate is only raised by 1.26%. The suggested VVC encoder is also hardware-friendly and has a minimal level of complexity for video encoders used in connected vehicle applications.

Optimization of the Generative Multi-Symbol Architecture of the Binary Arithmetic Coder for UHDTV Video Encoders

Previous studies have shown that the application of the M-coder in the H.264/AVC and H.265/HEVC video coding standards allows for highly parallel implementations without decreasing maximal frequencies. Although the primary limitation on throughput, originating from the range register update, can be eliminated, other limitations are associated with low register processing. Their negative impact is revealed at higher degrees of parallelism, leading to a gradual throughput saturation. This paper presents optimizations introduced to the generative hardware architecture to increase throughputs and hardware efficiencies. Firstly, it can process more than one bypass-mode subseries in one clock cycle. Secondly, aggregated contributions to the codestream are buffered before the low register update. Thirdly, the number of contributions used to update the low register in one clock cycle is decreased to save resources. Fourthly, the maximal one-clock-cycle renormalization shift of the low register is increased from 32 to 64 bit positions. As a result of these optimizations, the binary arithmetic coder, configured for series lengths of 27 and 2 symbols, increases the throughput from 18.37 to 37.42 symbols per clock cycle for high-quality H.265/HEVC compression. The logic consumption increases from 205.6k to 246.1k gates when synthesized on 90 nm TSMC technology. The design can operate at 570 MHz.

Dynamics, circuit design, feedback control of a new hyperchaotic system and its application in audio encryption

In this study, a 4D hyperchaotic system is constructed based on the foundation of a 3D Lü chaotic system. The newly devised hyperchaotic system possesses a sole equilibrium point, showcasing a simplified system structure that reduces complexity. This simplification offers a clearer opportunity for in-depth analysis of dynamic behaviors in the realm of scientific research. The proposed hyperchaotic system undergoes an in-depth examination of its dynamical characteristics, including chaotic attractors, equilibrium point stability, Lyapunov exponents’ spectrum, and bifurcation diagram. Numerical analysis results reveal that the attractor of this hyperchaotic system exhibits highly complex, non-periodic, and fractal structural dynamics. Its motion demonstrates extreme sensitivity and randomness, even within a wide range of variations in parameter d, affirming its hyperchaotic properties with two positive Lyapunov exponents. Hyperchaotic bifurcation diagrams typically exhibit highly intricate structures, such as fractals, branches, and period doubling characteristics, signifying that even minor parameter adjustments can lead to significant changes in system behavior, presenting diversity and unpredictability. Subsequently, to further investigate the practical utility of this hyperchaotic system, a linear feedback control strategy is implemented. Through linear feedback control, the hyperchaotic system is stabilized at its unique equilibrium point. Experimental validation is conducted using both computer software simulation Matlab, electronic circuit simulation Multisim, and embedded hardware STM32. The results of these experiments consistently align, providing theoretical support for the application of this hyperchaotic system in practical domains. Finally, leveraging the hyperchaotic keys generated by this hyperchaotic system, audio encryption is achieved using a cross-XOR algorithm, which is then realized on the embedded hardware platform STM32. The results show that the audio encryption scheme based on the hyperchaotic system is feasible, and the method is simple to implement, has nonlinear characteristics and certain algorithm complexity, which can be applied to audio encryption, image encryption, video encryption, and more.

Contrastive Video Question Answering via Video Graph Transformer.

We propose to perform video question answering (VideoQA) in a Contrastive manner via a Video Graph Transformer model (CoVGT). CoVGT's uniqueness and superiority are three-fold: 1) It proposes a dynamic graph transformer module which encodes video by explicitly capturing the visual objects, their relations and dynamics, for complex spatio-temporal reasoning. 2) It designs separate video and text transformers for contrastive learning between the video and text to perform QA, instead of multi-modal transformer for answer classification. Fine-grained video-text communication is done by additional cross-modal interaction modules. 3) It is optimized by the joint fully- and self-supervised contrastive objectives between the correct and incorrect answers, as well as the relevant and irrelevant questions respectively. With superior video encoding and QA solution, we show that CoVGT can achieve much better performances than previous arts on video reasoning tasks. Its performances even surpass those models that are pretrained with millions of external data. We further show that CoVGT can also benefit from cross-modal pretraining, yet with orders of magnitude smaller data. The results demonstrate the effectiveness and superiority of CoVGT, and additionally reveal its potential for more data-efficient pretraining.

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Deepfake detection in high-resolution videos has made significant progress in recent years, but detecting high-compressed deepfake videos remains challenging due to the low quality of synthesized videos. Existing video-level approaches fail to fully exploit the spatiotemporal inconsistencies in low-quality high-compressed deepfake videos, leading to poor generalization and robustness. In this work, we propose a Contrastive Spatio-Temporal Distilling (CSTD) approach that leverages spatial-frequency cues and temporal-contrastive alignment to improve high-compressed deepfake video detection. Our approach employs a two-stage spatiotemporal video encoder to fully exploit spatiotemporal inconsistency information. A fine-grained spatial-frequency distillation module is used to retrieve invariant forgery cues in spatial and frequency domains in high-compressed deepfake videos. Additionally, a mutual-information temporal-contrastive distillation module is introduced to enhance the temporal correlated information and transfer the temporal structural knowledge from the teacher model to the student model. We demonstrate the effectiveness and robustness of our method on low-quality high-compressed deepfake videos on public benchmarks against state-of-the-art competitors using extensive experiments and visualizations.

Video perception enhancement using effective encoding optimization in future generation wireless network

&lt;span&gt;The cumulative effects of network transmission link imperfections and real-time limitations of video data result in multiple challenges for video transmission in massive millimeter wave (mmwave) network. The challenges, together with the increasing expectations of users for good-quality videos, further extend the complexity particularly in dense areas. To address the issues this work proposes perceptual quality aware video encoding (PQAVE) scheme in two phases: in phase 1 an effective perceptual quality encoding method leveraging low-rank approximation to reduce overall video size is done. In phase 2, a novel bitstream optimization technique is introduced to improve perceptual quality of videos. Experiment are conducted using standard video dataset show the proposed PQAVE model attain better bit error rate (BER), symbol error rate (SER), error vector magnitude (EVM), and coding gain in comparison with existing perceptual video encoding scheme.&lt;/span&gt;

Heuristic-Based Algorithms for Low-Complexity AV1 Intraprediction

Modern video encoders, such as the state-of-the-art AOMedia Video 1 (AV1) and Versatile Video Coding (VVC), offer significant compression gains at the cost of an increase in computational effort. This is partially because of the novel intra prediction techniques, including an increased number of prediction modes and block sizes supported by the codecs. To reduce this computational effort, this work proposes two heuristic-based algorithms for AV1 intra prediction: a fast mode decision that reduces the number of intra candidates with a low-cost direction detection method, and a mode-adaptive subsampling algorithm that significantly reduces the number of Sum of Squared Errors (SSE) operations after prediction. On average, a notable encoding time reduction of 29.8% was achieved, at the cost of a compression efficiency loss of 1.28%.

Medical video encryption using novel 2D Cosine-Sine map and dynamic DNA coding.

Modern healthcare systems contain a large amount of sensitive information related to a patient in textual and visual form. Surgical videos and diagnosis data such as ultrasound, Computed Tomography (CT) scan, and Magnetic Resonance Imaging (MRI) are examples of healthcare video data. The secure storage and transmission of medical data have become an important issue in medical applications. To handle this challenge, chaos based cryptosystems are widely used these days. The work in this paper proposes a novel 2D Cosine-Sine map that exploits the existing Sine map and cosine transformation in its mathematical computation. The performance assessment of the suggested map indicates that it possesses a broader chaotic range, more dynamic and hyperchaotic nature when compared to existing chaotic maps. The proposed work, also, combines this novel 2D Cosine-Sine map with dynamic DNA encoding to propose a new scheme to encrypt medical videos. The approach consists primarily of four distinct phases. In the initial stage, the video is divided into frames, and for each frame, a chaotic sequence is generated using a 2D Cosine-sine map. During the second stage, we proceed to pixel permutation for each frame by utilizing the chaotic sequence. The third step is diffusion, in this, we integrate the 2D Cosine-Sine map with dynamic DNA encoding and apply double DNA operations to substitute the pixel values. The last step is DNA decoding to get the frames back in binary format. DNA encoding/decoding rules and operands of DNA operations are not fixed. They are selected dynamically using a random key for each frame. The dynamic selection of encoding/decoding rules and operands is a unique feature that enhances the scheme's security. Simulation results and security analysis proves that the proposed medical video encryption scheme can resist different types of attacks.

A robust VVC video encryption scheme based on the dynamical chaotification model

With the considerable surge of video assets, the demand for video content security has undergone substantial growth. Since the advent of H.264/AVC and H.265/HEVC, selective encryption algorithms (SEAs) have become a focus. However, there is little research based on the H.266/VVC. To fill the gap, a VVC encryption scheme is proposed in this paper. Considering that most existing SEAs are easily cracked under cryptographic attacks, a dynamical chaotification model (DCM) is designed to resist chosen-plaintext attack (CPA). Additionally, given that a majority of existing SEAs are incapable of decrypting correctly in the case of packet loss, each slice is encrypted independently to enhance robustness. Firstly, the three-dimensional (3D) DCM is designed based on the exponential feedback and the boundary function. Secondly, the dynamical parameter in the 3D-DCM is updated by the encoding parameters in the VVC encoder. Then the initial values and other model parameters of the 3D-DCM are scrambled by the hash values of the slice headers (SHs). Finally, the texture, motion, and structure information of VVC videos are encrypted using the iterative output of the 3D-DCM. In particular, three exclusive elements in H.266/VVC are selected in the RSES, including matrix-based intra prediction (MIP), cross-component linear model prediction (CCLM), and multiple transform selection (MTS). Experimental results demonstrate the outstanding performance of the proposed RSES in robustness and resistance to CPA, while gratifying bit rate and real-time requirements. Therefore, it is a promising encryption scheme in cryptographic applications.

Chaos-based block permutation and dynamic sequence multiplexing for video encryption

This paper proposes a video security transmission enhancement algorithm based on block permutation and dynamic multiplexing sequences encryption based on 4D autonomous hyperchaotic system. Firstly, we employ the block permutation encryption and diffusion confusion encryption module, which is based on dynamic multiplexing chaotic sequences, to encrypt the plaintext and obtain the ciphertext. Subsequently, the hash value of this round’s ciphertext is utilized to generate the chaotic key, produced by the multiplexing sequence of this round after mathematical processing. Then, the key is used to generate the chaotic sequence to confuse the N-th of the multiplexed sequence, and the next round of multiplexed sequence is obtained. If the current round of chaotic sequence has been completely confused, the chaotic sequence is re-generated to generate a new multiplex sequence by using the key generated by the current round key and the initial key. Finally, the above steps are repeated for the encryption of each frame of the video. Compared with the traditional permutation coding algorithm, it increases the difficulty of estimation or recognition while ensuring efficiency, and effectively improves the avalanche effect of the algorithm. Through frame by frame ciphertext closed-loop feedback, it has the ability to resist known plaintext attack and selected plaintext attack. The results show that the scheme has high security and significant diffusion characteristics, and can effectively resist various common cryptographic attacks.

Video encryption via synchronization of a fractional order T-S fuzzy memristive hyperchaotic system

Video encryption via synchronization of a fractional order T-S fuzzy memristive hyperchaotic system

A systematic review on video encryption algorithms: A future research

&lt;p&gt;Video Encryption is widely used in many real-time applications today. Despite numerous video encryption techniques that are available today, the challenges such as time and space complexity, real time latency, scalability and vulnerability towards few attacks still exist in the research domain, however few algorithms have achieved acceptable computational complexity, but in such cases vulnerability to certain attacks (differential, statistical, plain text attack, and cipher text attacks) are still a threat to secure video transmission. To the best of our knowledge, a comprehensive but detailed systematic literature review on video encryption is needed for the researchers in the scientific community. This paper, therefore, presents a systematic literature review of 30 scientific documents extracted from platforms like scopus and web of science. The paper, comprehensively addresses, various techniques of video encryption and encoding, different evaluation parameters to testify the performance of the algorithms and discusses the challenges of the existing video encryption algorithms. After careful investigation, it has been observed the approaches which involve encryption of the video data post the same has been encoded is the most efficient and scalable approach towards video encryption. In addition, it also implies that in near future, the proposed algorithms, must be evaluated based on the various categorization of parameters illustrated in this paper.&lt;/p&gt;