Intra Frame Research Articles

Fuzzy-based video compression using bilinear fuzzy relation equations

We present a novel color video compression method using the greatest solution of a system of bilinear fuzzy relation equations to assess the similarity between frames. The frames in each band are treated separately and each frame is classified as an Intra frame or a Predictive frame. A frame is labelled as Predictive frame, and compressed more than an Intra-frame, if the similarity value with the previous Intra frame is higher than a selected threshold; A pre-processing activity is performed to select the optimal threshold value of the similarity between frames. The proposed method allows to supply a high quality of the reconstructed frames and has the advantage of not requiring high CPU time and memory storage for its execution; it was tested on color videos of the Fast-Moving Objects dataset; the results show that it produces better performances than the Lukasiewicz similarity-based video compression method and comparable with those achieved by MPEG-4 and the deep learning video compression method DVC_pro. The results show that the quality of the reconstructed frames obtained with BFRE is comparable with that of DVC Pro, but has a lower computational complexity, providing better performances in terms of video encoding speed.

Video Forgery Detection: A Comprehensive Study of Inter and Intra Frame Forgery With Comparison of State-Of-Art

Video Forgery Detection: A Comprehensive Study of Inter and Intra Frame Forgery With Comparison of State-Of-Art

Fast CU Partition Algorithm for Intra Frame Coding Based on Joint Texture Classification and CNN.

High-efficiency video coding (HEVC/H.265) is one of the most widely used video coding standards. HEVC introduces a quad-tree coding unit (CU) partition structure to improve video compression efficiency. The determination of the optimal CU partition is achieved through the brute-force search rate-distortion optimization method, which may result in high encoding complexity and hardware implementation challenges. To address this problem, this paper proposes a method that combines convolutional neural networks (CNN) with joint texture recognition to reduce encoding complexity. First, a classification decision method based on the global and local texture features of the CU is proposed, efficiently dividing the CU into smooth and complex texture regions. Second, for the CUs in smooth texture regions, the partition is determined by terminating early. For the CUs in complex texture regions, a proposed CNN is used for predictive partitioning, thus avoiding the traditional recursive approach. Finally, combined with texture classification, the proposed CNN achieves a good balance between the coding complexity and the coding performance. The experimental results demonstrate that the proposed algorithm reduces computational complexity by 61.23%, while only increasing BD-BR by 1.86% and decreasing BD-PSNR by just 0.09 dB.

Efficient Depth Intra Frame Coding in 3D-HEVC by Corner Points.

To improve the coding performance of depth maps, 3D-HEVC includes several new depth intra coding tools at the expense of increased complexity due to a flexible quadtree Coding Unit/Prediction Unit (CU/PU) partitioning structure and a huge number of intra mode candidates. Compared to natural images, depth maps contain large plain regions surrounded by sharp edges at the object boundaries. Our observation finds that the features proposed in the literature either speed up the CU/PU size decision or intra mode decision and they are also difficult to make proper predictions for CUs/PUs with the multi-directional edges in depth maps. In this work, we reveal that the CUs with multi-directional edges are highly correlated with the distribution of corner points (CPs) in the depth map. CP is proposed as a good feature that can guide to split the CUs with multi-directional edges into smaller units until only single directional edge remains. This smaller unit can then be well predicted by the conventional intra mode. Besides, a fast intra mode decision is also proposed for non-CP PUs, which prunes the conventional HEVC intra modes, skips the depth modeling mode decision, and early determines segment-wise depth coding. Furthermore, a two-step adaptive corner point selection technique is designed to make the proposed algorithm adaptive to frame content and quantization parameters, with the capability of providing the flexible tradeoff between the synthesized view quality and complexity. Simulation results show that the proposed algorithm can provide about 66% time reduction of the 3D-HEVC intra encoder without incurring noticeable performance degradation for synthesized views and it also outperforms the previous state-of-the-art algorithms in term of time reduction and ∆ BDBR.

Quality enhancement with fault tolerant embedding in video transmission over WMSNs in 802.11e WLAN

With the ever-growing demand in video transmissions, it is essential to design an efficient compression and powerful transmission scheme to transmit a large volume of data in wireless multimedia sensor networks (WMSNs). The main objective of this work is to maximize the network throughput and to maintain/support a better visual experience to different end-users. In this paper, we propose a predictive compression with fault-tolerant embedding based multi-path routing and concealment process to maintain the Quality of Service (QoS) and Quality of Experience (QoE) in video transmission. In order to reduce the bit rate in high-efficiency videos, a Scalable High-efficiency Inter-layer Prediction based Video coding (SHIPVC) is proposed with two layer predictions such as texture color, and motion with different quantization parameters to attain the high coding efficiency. After compression, a multi-path genetic algorithm establishes a routing and fault tolerance embedding during transmission to maintain the QoS. In decoding side, QoE is maintained by concealing the Intra frame (I-frame) and Predicted frame (P-frame) separately using the motion vector estimation. Experimental results show better performances through bit rate reduction, maximum fault tolerance, and minimum delay parameters. The PSNR calculation for concealment technique shows the better result when compared to the previous standards. Hence, the proposed method performs the effective video transmission with acceptable quality measurements in WMSNs.

HSV, Edge Preserved and Huffman Coding based Intra Frame High Efficient video Compression for Multimedia Communication

High Efficiency Video Coding (HEVC) is another pressure standard for high resolution video content, which just needs 50% of the bit rate of H.264/Advanced Video Coding (AVC) at the same perceptual quality. Be that as it may, the computational intricacy is increments dramatically to adopt quad-tree organized Coding Unit (CU). In this document a new Hue Saturation Lightness (HSV), Edge Preserving and Huffman coding (HC) based intra frame high efficient video compression algorithm is introduced which is named as HSV-EPHC-IFHEVC. To increase the compression ratio of the video frames Huffman and Differential Pulse Code Modulation (DPCM) encodings are used. To improve the de-compressed frame quality in compression Sharpening filter based Edge preserving technique is used. This HSV-EPHC-IFHEVC algorithm provides much better performance compared to existing systems. The performance measurement is in the terms of MSE, PSNR, RMSE and Execution time.

Development of a fast transmission method for 3D point cloud

In this paper, a transmission method of the 3D point cloud data of the object upper body is proposed. The key idea of the method is to reduce the amount of transmission data in the condition of retaining the necessary information. In our system, the unnecessary information is removed by using filters and the segmentation algorithm. Three P frames (Predicted frame) are inserted between two I frames (Intra frame) to further improve the transmission rate. The I frame of large size includes all the vision information that is related to the object upper body, while the P frame includes only the information of the small change in the current frame, whose size is smaller than the former. In order to acquire the information of the P frame, first, a human face detection algorithm based on the machine learning technology is implemented. Then, a coarse-to-fine approach is used to detect the nose tip which helps to improve the precision of acquiring the human faces information. The experiment result demonstrates that the proposed method is able to reduce the time delay of processing and transmission and to lower the compression ratio with an allowable distortion rate.

Fast QTBT Partition Algorithm for Intra Frame Coding through Convolutional Neural Network

The latest Joint Video Exploration Team employs quad-tree plus binary-tree (QTBT) block partitioning structure, which can improve coding performance significantly than High Efficiency Video Coding with hugely increased encoding complexity. To address this issue, we propose a novel fast QTBT partition method through a convolutional neural network (CNN). Specifically, the proposed algorithm uses CNN to predict the QTBT partition depth range of $32\times32$ block directly according to the inherent texture richness of the image, rather than to judge split or not at each depth level. For training optimization, we introduce a misclassification penalty term combined with L2 HingeLoss function, which can further boost the classification accuracy. Experimental results demonstrate the effectiveness of our proposed method; our rate-distortion maintaining setting can achieve 42.33% complexity reduction with just 0.69% bitrate increase. Our low complexity setting can achieve 62.08% complexity reduction with 2.04% bitrate increase.

Intra Frame Coding In Advanced Video Coding Standard (H.264) to Obtain Consistent PSNR and Reduce Bit Rate for Diagonal Down Left Mode Using Gaussian Pulse

Intra prediction process of H.264 video coding standard used to code first frame i.e. Intra frame of video to obtain good coding efficiency compare to previous video coding standard series. More benefit of intra frame coding is to reduce spatial pixel redundancy with in current frame, reduces computational complexity and provides better rate distortion performance. To code Intra frame it use existing process Rate Distortion Optimization (RDO) method. This method increases computational complexity, increases in bit rate and reduces picture quality so it is difficult to implement in real time applications, so the many researcher has been developed fast mode decision algorithm for coding of intra frame. The previous work carried on Intra frame coding in H.264 standard using fast decision mode intra prediction algorithm based on different techniques was achieved increased in bit rate, degradation of picture quality(PSNR) for different quantization parameters. Many previous approaches of fast mode decision algorithms on intra frame coding achieved only reduction of computational complexity or it save encoding time and limitation was increase in bit rate with loss of quality of picture. In order to avoid increase in bit rate and loss of picture quality a better approach was developed. In this paper developed a better approach i.e. Gaussian pulse for Intra frame coding using diagonal down left intra prediction mode to achieve higher coding efficiency in terms of PSNR and bitrate. In proposed method Gaussian pulse is multiplied with each 4x4 frequency domain coefficients of 4x4 sub macro block of macro block of current frame before quantization process. Multiplication of Gaussian pulse for each 4x4 integer transformed coefficients at macro block levels scales the information of the coefficients in a reversible manner. The resulting signal would turn abstract. Frequency samples are abstract in a known and controllable manner without intermixing of coefficients, it avoids picture getting bad hit for higher values of quantization parameters. The proposed work was implemented using MATLAB and JM 18.6 reference software. The proposed work measure the performance parameters PSNR, bit rate and compression of intra frame of yuv video sequences in QCIF resolution under different values of quantization parameter with Gaussian value for diagonal down left intra prediction mode. The simulation results of proposed algorithm are tabulated and compared with previous algorithm i.e. Tian et al method. The proposed algorithm achieved reduced in bit rate averagely 30.98% and maintain consistent picture quality for QCIF sequences compared to previous algorithm i.e. Tian et al method.

Intra frame compression and video restoration based on conditional markov processes theory

Digital images and video have significant statistical redundancy due to high intra and inter-frame correlation. Modeling images and video using two-dimensional Markov processes with discrete states maximizes the use of images and video redundancy while processing. Intra-frame compression algorithm proposed below allows 2---3 times increase in processing speed for comparable compression ratios. Nonlinear filtering algorithm of video (distorted during transmission on a radio channel in terms of interference) allows effective video restoring even for negative signal/noise ratio unlike the known methods. A distinctive feature of this algorithm is ease of implementation with minimal computing resources.

A Novel Perceptual Intra Frame Rate Control for High Efficiency Video Coding

A Novel Perceptual Intra Frame Rate Control for High Efficiency Video Coding

Experimental Assessment of Power-Save Behavior of Commercial IEEE 802.16 Network

The mobility and portability of next-generation cellular devices must address limited accessibility to power; hence, power-saving techniques of mobile terminals are crucial. In this paper, we provide a comprehensive measurement study of power-save mechanisms implemented in current IEEE 802.16 (WiMAX) deployed networks. Particularly, we examine the power consumption of the various transmission and reception modes and compare them with the power consumption during Idle and Sleep modes. We show, both experimentally and analytically, that although theoretically, power consumption can be dramatically reduced by employing an efficient algorithm that alternates between power-save and active modes, lack of cross-layer coordination prevents efficient power-save implementation. We suggest and implement a simple proactive buffering solution that delays the sporadic traffic generated by the upper layers such as keep-alive messages, when the device is in Idle mode and show that such an enhancement can dramatically reduce the device's power consumption. In this paper, we discuss a strategy, termed Intra Frame Power-Save (IFPS), which, although not standardized by 802.16, is implemented by some leading vendors. IFPS does not require any cross-layer coordination, yet can dramatically reduce power consumption even while the device is in operational mode. We suggest ways for further reducing power consumption while performing the schedule by the base station utilizing the IFPS mechanism.

Modified Robust Technique for Intra and Inter Constraint based on Video Enhancement using Colour Modeling of Countable Frames

New trends are more essential in the area of video enhancement for various emerging needs. Hence, we proposed a novel technique which efficiently suited for various types videos. This paper discussed about the video enhancement aiming to achieve high intra frame and inter frame qualities in an entire video. We proposed and evaluated two parameters i.e., Intra frame quality (among the frames) of the entire video and inter frame quality (in between the frames) of the entire video. Such as multiple regions of interest that can be adaptively and simultaneously enhanced. Two steps were incorporated in to the proposed work for object quality retrieval. These are (i) ACB step improve intra frame analysis features for region-of-interest a global tone curve is created by fusing from other region and (ii) ECB step improve inter frame quality implement by histogram equalization method. We observed better improvement in PSNR values and considerable reduction in MSE values over the existing techniques. Thus, the modified technique improves the video enhancement with respect to the countable number of frames and valid better results at various levels of frames. We also evaluated the execution time in the process of video enhancement which is the ultimate parameter to discuss the power consumption. The observations of the proposed technique surpass the existing methods in the area of video enhancement in frame by frame procedure. The results of the proposed technique outperform present techniques and werre simulated using MATLAB.

Depth-Assisted Temporal Error Concealment for Intra Frame Slices in 3-D Video

We propose a depth-assisted error concealment method for slice losses in intra frames of 2-D+depth encoded 3-D video. Intra frames in the depth sequence are offset from intra frames in the 2-D view sequence, such that the corresponding frames in the other sequence are not also intra mode. For slice losses in an intra frame of the 2-D sequence, motion vector (MV) candidates to conceal the lost macroblocks come from the co-located MVs in the depth frame as well as from MVs in the previous 2-D frame chosen based on motion information from the depth frame. Then the temporal smoothness of the depth sequence is used to filter out MV candidates. Finally, an enhanced distortion criterion is used for MV selection, based on contour information in the depth frame and boundary matching. Experimental results show that the proposed method provides improved performance over existing methods.

Color video compression using color mapping into textured grayscale video frames

Color video compression has become a necessity in the advent of newer applications of color video and its increasing size for higher definitions. New approaches are used to achieve more compression over the traditional and standard compression techniques. Considerable progress has been made of color transfer-based compression techniques that do not modify standard encoders but add some pre-processing and post-processing steps. We present a novel, simple yet robust, color transfer-based compression technique that can be integrated with the standard encoders like MPEG-2, H.264/AVC, etc. We achieve the compression by discarding the color components from all frames in a video sequence except those of the Intra (I) frames. The colored intra frames are converted to gray-textured images. The method is developed based on embedding the colors of the intra frames to low visibility high frequency textures of its gray luminance image. This is achieved by decomposing the luminance of the intra frame using the non-decimated DWT or discrete wavelet frame transform and replacing the bandpass subbands by the chrominance signals. The lowpass band is same as that of the luminance signal. At the output of the decoder, the colored intra frames are recovered using the wavelet transform. Instead of calculating motion vectors, we identify and reuse the motion vectors present in the decoder. The remaining luminance frames of the video are colored with the help of identified motion vectors and the color information of the preceding frames. The proposed codec considerably improves the compression ratio achievable by the standard codec, at the cost of slight increase in computation time at the decoder end.

SELECTIN OF INTRA PREDICTION MODES FOR INTRA FRAME CODING IN ADVANCED VIDEO CODING STANDARD

This paper proposes selection of Intra prediction m odes for Intra frame coding in Advanced Video Codin g Standard using Matlab. The proposed algorithm selects prediction modes for intra frame coding. There are nine prediction mode s are there to predict the intra frame in AVC using Intra prediction,but all t he prediction modes are not required for all the ap plications. Intra prediction is the first process of advanced video coding standard. It predicts a macro block by referring to its previou s macro blocks to reduce spatial redundancy,appling all the prediction modes to pred ict intra frame it leads to more computational comp lexity is increased at the encoder of AVC. In the proposed algoriyhm, applied all the prediction modes(0-8) for prediction of int ra frame but only few modes such as mode0, mode1, mode2,mode4,mode6 gives good PSNR, high comprssion ratio and low bit rate. Out o f these modes mode2 gives good PSNR, compression ratio and redced bit rate, mode5, mode7 and mode8 gives lower PSNR, low compression ratio and increased bitrate compared to mode0,mode1, mode2, m ode4 and mode6. The simulation results are presente d using Matlab. The PSNR , compressed ratio and bit rate achived for di fferent quantization parameters of mother daughter frames , foreman frames was presented.

Intra mode decision and frame layer Lagrange multiplier adjustment scheme for H.264 based on structural similarity

H.264 takes rate distortion optimisation (RDO) technique to perform intra and inter mode decision and achieves higher coding efficiency, but the objective distortion metric such as mean square error (MSE) is employed in traditional RDO framework, which cannot acquire optimal subjective quality. In this paper, structural similarity (SSIM)-based subjective distortion is applied to RDO-based intra mode decision in H.264 I frame video coding, and a linear SSIM distortion model is firstly proposed and SSIM-based rate distortion cost function for intra mode decision is defined. Furthermore, a content adaptive frame layer Lagrange multiplier adjustment scheme is proposed to balance the tradeoff between rate and SSIM distortion better. Experimental results show that, the proposed method encodes image structural information more effectively and thus acquires better perceptual quality and subjective RDO performance compared with objective distortion-based RDO method. Under the same perceptual quality, our scheme achieves about 8·03% I frame bit rate reduction on average for various sequences over MSE-based RDO employed in JM reference software.

Error Concealment Scheme for Intra Frames Based on Spatial and Temporal Interpolation

The lost of a block in an intra frame will damage the video quality extremely. In this paper, an efficient concealment for intra frame is proposed based on the spatial and temporal domain interpolation. For spatial domain concealment, the weighted interpolation (WI) and texture prediction (TP) are adopted according to the blocks surrounding the damaged macroblock (MB). If the blocks surrounding the damaged MB are all available, the TP method will be used. Otherwise the WI method will be used. For temporal domain, motion vector copy (MVC) is adopted for the interpolation. Simulation results have shown that the proposed method can significantly improve the quality of the video.

Efficient 45nm ASIC Architecture for Full-Search Free Intra Prediction in Real-Time H.264/AVC Decoder

The standard H.264/AVC Intra frame encoding process has several data dependent and computational intensive coding methodologies that limit the overall encoding speed. It causes not only a high degree of computational complexity but also an unacceptable delay especially for the real-time video applications. Based on DCT properties and spatial activity analysis, low power hardware architecture for high throughput Full-Search Free (FSF) Intra mode selection and direction prediction algorithm is proposed. The FSF Intra prediction Algorithm significantly reduces the computational complexity and the processing run-time required for the H.264/AVC Intra frame prediction process. The ASIC implementation for the proposed architecture is carried out and synthesizing results are obtained. The heavily tested 45nm ASIC design is able to achieve an operating frequency of 140 MHz while limiting the overall power consumption to 9.01 mW, which nominates our proposed FSF Intra prediction architecture for interactive real-time H.264/AVC mobile video decoders.

A Fast H.264 Intra Frame Encoder with Serialized Execution of 4 × 4 and 16 × 16 Predictions and Early Termination

This paper presents a fast H.264 intra frame encoder that processes a single macroblock of 1920 × 1080 size video in 334 cycles on average which is 20% faster than the previous best design. The speed-up is mainly achieved by early termination of either 4 × 4 intra prediction or 16 × 16 intra prediction. The executions of intra 4 × 4 and 16 × 16 predictions are serialized and the second prediction is terminated early by using the cost of the first prediction as the stop criterion. A simple and efficient algorithm by making use of spatial locality is proposed to select the mode that is processed first. To avoid the bubble cycles caused by this serialized execution of 4 × 4 and 16 × 16 predictions, the modified processing order presented in (Jung et al. 2008) is employed for intra 4 × 4 prediction in order to schedule dependent 4 × 4 blocks apart from each other. To further reduce the execution time of 4 × 4 prediction, neighboring pixels with the same value are grouped, and only one prediction mode in the group is evaluated. Experimental results show that the PSNR drop is 0.0619 dB and the bitrate increase is 0.842% when compared with the JM reference software. The additional hardware cost to support the proposed methods is less than eight thousand gates which are very small when compared with the hardware size of a whole intra frame encoder.