Abstract

In recent years, deep learning technologies have been actively used in various applications. In particular, networks trained using reinforcement learning (RL) are widely exploited for auxiliary tasks in various multimedia frameworks, including image restoration, image compression, and computer vision. Discrete wavelet transform (DWT) and set partitioning in hierarchical trees (SPIHT) are the representative lightweight compression methods that are most widely used for the purposes of frame memory compression and LCD overdrive. In precedent research, in order to improve the compression efficiency of DWT-SPIHT algorithms, the relative complexity of DWT coefficients is quantified, and when compressing DWT coefficients with the SPIHT algorithm, the compression ratio (CR) is adaptively allocated to the compression block according to the numerically expressed complexity. However, the SPIHT algorithm has the characteristic of resource limitation, resulting in the occurrence of remaining blocks, which cannot take advantage of allocating the adaptive CR. Moreover, since the equation expressing the block complexity that determines the CR of each block is obtained through machine learning-based linear regression, it lacks the capability to deal with a wide range of real-world images. To compensate for these drawbacks, this paper optimizes the compression efficiency of the 1-D DWT-SPIHT algorithm using the RL-based episodic auxiliary task. In detail, the proposed method optimally adjusts the proportion of CRs, which are adaptively selected for each block according to the DWT coefficient, through the episodic model trained with the RL algorithm. Consequently, the proposed method achieves an average improvement in peak signal to noise ratio (PSNR) of 2.18dB compared to the baseline 1-D DWT-SPIHT with the fixed compression ratio and 0.68dB compared to the precedent research.

Highlights

  • The use of various mobile multimedia devices supporting displays has increased along with the commercialization of media transmission services, such as web streaming [1]–[3]

  • This study proposes a technique that significantly improves the compression efficiency of the 1-D Discrete wavelet transform (DWT)-set partitioning in hierarchical trees (SPIHT) by adding an episodic auxiliary task that has been trained using reinforcement learning (RL) based on the distribution of the compression ratio (CR) adaptively selected in the previous study [21]

  • We verify the performance of the proposed 1-D DWT-SPIHT, which utilizes the CRs optimized with the proposed RL model

Read more

Summary

Introduction

The use of various mobile multimedia devices supporting displays has increased along with the commercialization of media transmission services, such as web streaming [1]–[3]. There are diverse methods for compressing DWT coefficients using SPIHT, the 1-D blockbased pass-parallel SPIHT (BPS), which has a hardwarefriendly structure and can achieve a high throughput, is used in this study [20]. As the BPS reconstructs these data structures as the insignificant set pass (ISP), the insignificant pixel pass (IPP), and the refinement pass (RP), both the encoder and decoder can achieve a high processing speed [20]. This type of 1-D DWT-SPIHT shows an excellent performance in terms of the trade-off between the compression efficiency and the computational complexity. It has the drawback of an inferior compression performance compared with that of 2-D DWT-SPIHT because it cannot utilize redundancy in the vertical direction

Methods
Results
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call