Image Compression Framework Research Articles

High-Quality Image Compression Algorithm Design Based on Unsupervised Learning.

Increasingly massive image data is restricted by conditions such as information transmission and reconstruction, and it is increasingly difficult to meet the requirements of speed and integrity in the information age. To solve the urgent problems faced by massive image data in information transmission, this paper proposes a high-quality image compression algorithm based on unsupervised learning. Among them, a content-weighted autoencoder network is proposed to achieve image compression coding on the basis of a smaller bit rate to solve the entropy rate optimization problem. Binary quantizers are used for coding quantization, and importance maps are used to achieve better bit allocation. The compression rate is further controlled and optimized. A multi-scale discriminator suitable for the generative adversarial network image compression framework is designed to solve the problem that the generated compressed image is prone to blurring and distortion. Finally, through training with different weights, the distortion of each scale is minimized, so that the image compression can achieve a higher quality compression and reconstruction effect. The experimental results show that the algorithm model can save the details of the image and greatly compress the memory of the image. Its advantage is that it can expand and compress a large number of images quickly and efficiently and realize the efficient processing of image compression.

Unified and Scalable Deep Image Compression Framework for Human and Machine

Image compression aims to minimize the amount of data in image representation while maintaining a certain visual quality for humans, which is an essential technique for storage and transmission. Recently, along with the development of computer vision, machines have become another primary receiver for images and require compressed images at a certain quality level, which may be different from that of human vision. In many scenarios, compressed images should serve both human and machine vision tasks, but few compression methods are designed for both goals simultaneously. In this paper, we propose a unified and scalable deep image compression (USDIC) framework that jointly optimizes the image quality according to human and machine vision in an end-to-end style. For the encoder, we propose an information splitting mechanism (ISM) to separate images into semantic and visual features, which mainly aims at machine analysis and human viewing tasks. For the decoder, we design a scalable decoding architecture. The encoded semantic feature is first decoded for machine analysis tasks, and the image is decoded and reconstructed further by leveraging the decoded semantic features. Herein, to further remove the redundancy between the semantic and visual features of images, we propose a scalable entropy model (SEM) with a joint optimization strategy to reconstruct the image using the two kinds of decoded features. Extensive experimental results show that the proposed USDIC achieves much better performance on the image analysis task while maintaining competitive performance on the traditional image reconstruction task compared with popular image compression methods.

Deep underwater image compression for enhanced machine vision applications

Underwater image compression is fundamental in underwater visual applications. The storage resources of autonomous underwater vehicles (AUVs) and underwater cameras are limited. By employing effective image compression methods, it is possible to optimize the resource utilization of these devices, thereby extending the operational time underwater. Current image compression methods neglect the unique characteristics of the underwater environment, thus failing to support downstream underwater visual tasks efficiently. We propose a novel underwater image compression framework that integrates frequency priors and feature decomposition fusion in response to these challenges. Our framework incorporates a task-driven feature decomposition fusion module (FDFM). This module enables the network to understand and preserve machine-friendly information during the compression process, prioritizing task relevance over human visual perception. Additionally, we propose a frequency-guided underwater image correction module (UICM) to address noise issues and accurately identify redundant information, enhancing the overall compression process. Our framework effectively preserves machine-friendly features at a low bit rate. Extensive experiments across various downstream visual tasks, including object detection, semantic segmentation, and saliency detection, consistently demonstrated significant improvements achieved by our approach.

Exploring AI-driven Innovations in Image Communication Systems for Enhanced Medical Imaging Applications

Artificial intelligence (AI) has emerged as a promising avenue for enhancing medical imaging systems and improving clinical workflows. This research explores innovative applications of AI and deep learning for image communication networks in healthcare. Specifically, we develop an intelligent image compression framework that optimizes data transmission and speeds interpretation of radiology scans. Our approach combines convolutional neural networks, generative adversarial networks, and specialized image filters to balance communication efficiency, diagnostic accuracy, and system latency. Rigorous experiments validate superior performance over traditional methods and commercial products across modalities including MRI, CT, and ultrasound. Crucially, the proposed methods demonstrate expert-level precision in anatomy labeling and pathology detection. By intelligently streamlining image transfer and analytics, this AI-powered system could facilitate ubiquitous, real-time diagnostics via telemedicine. Enhanced connectivity between imaging devices and clinical specialists can improve patient outcomes and reduce healthcare costs. Our solutions set the stage for more advanced AI integration in imaging networks and data-intensive medicine

End-to-End RGB-D Image Compression via Exploiting Channel-Modality Redundancy

As a kind of 3D data, RGB-D images have been extensively used in object tracking, 3D reconstruction, remote sensing mapping, and other tasks. In the realm of computer vision, the significance of RGB-D images is progressively growing. However, the existing learning-based image compression methods usually process RGB images and depth images separately, which cannot entirely exploit the redundant information between the modalities, limiting the further improvement of the Rate-Distortion performance. With the goal of overcoming the defect, in this paper, we propose a learning-based dual-branch RGB-D image compression framework. Compared with traditional RGB domain compression scheme, a YUV domain compression scheme is presented for spatial redundancy removal. In addition, Intra-Modality Attention (IMA) and Cross-Modality Attention (CMA) are introduced for modal redundancy removal. For the sake of benefiting from cross-modal prior information, Context Prediction Module (CPM) and Context Fusion Module (CFM) are raised in the conditional entropy model which makes the context probability prediction more accurate. The experimental results demonstrate our method outperforms existing image compression methods in two RGB-D image datasets. Compared with BPG, our proposed framework can achieve up to 15% bit rate saving for RGB images.

Graph Based Cross-Channel Transform for Color Image Compression

Adaptive transform coding is gaining more and more attention for better mining of image content over fixed transforms such as discrete cosine transform (DCT). As a special case, graph transform learning establishes a novel paradigm for the graph-based transforms. However, there still exists a challenge for graph transform learning-based image codecs design on natural image compression, and graph representation cannot describe regular image samples well over graph-structured data. Therefore, in this article, we propose a cross-channel graph-based transform (CCGBT) for natural color image compression. We observe that neighboring pixels having similar intensities should have similar values in the chroma channels, which means that the prominent structure of the luminance channel is related to the contours of the chrominance channels. A collaborative design of the learned graphs and their corresponding distinctive transforms lies in the assumption that a sufficiently small block can be considered smooth, meanwhile, guaranteeing the compression of the luma and chroma signals at the cost of a small overhead for coding the description of the designed luma graph. In addition, a color image compression framework based on the CCGBT is designed for comparing DCT on the classic JPEG codec. The proposed method benefits from its flexible transform block design on arbitrary sizes to exploit image content better than the fixed transform. The experimental results show that the unified graph-based transform outperforms conventional DCT, while close to discrete wavelet transform on JPEG2000 at high bit-rates.

Deep Learning-Based model for Medical Image Compression

Efficient compression algorithms are required to handle the growing amount of medical picture data, ensuring that storage and transmission requirements are met without compromising diagnostic quality. This research presents a hybrid image compression framework that integrates deep learning alongside standard lossless compression techniques. A convolutional autoencoder (CAE) learns a compact representation of medical images, which are subsequently compressed using the Brotli algorithm. Our technique beats conventional approaches, like JPEG, JPEG2000, and wavelet-based ones, according to an analysis of a brain MRI dataset. It maintains competitive compression ratios while producing higher (PSNR) and (MSE), indicating higher picture integrity and low information loss. To strike a good balance between the critical need for accurate diagnosis and the economical use of resources, this study offers a possible method for compressing medical images.

Learning-based Compression for Noisy Images in the Wild

Digital images in real world applications typically undergo a wide variety of quality degradations before compression or re-compression. Existing learning based codecs are typically data-driven, relying on the predefined compression pipeline with pristine or high quality images as the input. However, the images in the wild may exhibit the substantially different characteristics compared to the high quality images, casting major challenges to the learning based image coding. In this paper, we propose a robust noisy image compression framework with the blind assumption on the specific noise type and level. The specifically designed encoder decomposes the representation of visual content into two types of features, including the Features that represent the Intrinsic Content (FIC) and the Features that account for Additive Degradation (FAD). As such, beyond the philosophy of faithfully reconstructing the given image with high fidelity, only FIC needs to be compactly represented and conveyed. The principled disentanglement strategy facilitates the removal of the redundancy from multiple perspectives (e.g., spatial, channel and content), ensuring the handling of a wide variety of noisy images in the wild. Extensive experimental results show that our model can achieve superior performance in terms of the ultimate quality and exhibit the strong generalizability across images degraded by a variety of means. The proposed scheme also points out a new research avenue on learning based compression for images in the wild, which is technically challenging but desirable in practice.

Autoencoder-based joint image compression and encryption

Recently, learning-based methods have developed rapidly, with promising results in many areas. And deep learning models are expected to be the next-generation optimal image compression solutions. This paper proposes a new image compression and encryption framework that integrates encryption algorithms with a deep-learning compression network. Our work employs Auto-Encoder (AE) based compression network as the backbone. After extracting semantic features from the learning network, encryption layers are added to introduce end-to-end learning to image encryption. And for a higher level of visual security, the parameters of the synthesis network are replaced by a new parameter matrix based on a logistic map controlled by a secret key. The encryption key of the system is derived from the image content, which will be embedded in the deep feature vectors to save the cost of sending the key for different images. Another secret key, which will be shared among other images, is used for controlling the embedding process. And to learn the entropy model from the scrambled feature maps, an attention scheme is exploited in estimating parameters to achieve more effective compression. Experimental results and the security analysis using Kodak dataset show that the proposed scheme can achieve a sufficiently high-security level with high compression efficiency.

A unified efficient deep image compression framework and its application on human-centric Task

A unified efficient deep image compression framework and its application on human-centric Task

Priors Guided Extreme Underwater Image Compression for Machine Vision and Human Vision

A low bit-rate compression is required for underwater images due to the limited bandwidth in underwater acoustic communication, which limits performances of both machine analysis and human perception in most underwater applications. Few existing compression methods consider the unique characteristics of underwater images such as color shift and haze effect to better fulfill requirements of various applications under low bit-rates. To address this problem, we propose a novel extreme underwater image compression framework, which can provide scalability to support machine vision and human vision with the assistance of underwater priors. Specifically, the base layer is composed of a feature extractor and a generator, where global structural edges and high-level features of regions with a significant impact on machine analysis are extracted and used for reconstructing a feature-matching image for analysis purpose. Considering the negative influence of underwater imaging processes on machine vision, in this article, a feature degradation removal module guided by underwater priors is proposed to alleviate feature-level degradation via taking analysis-friendly enhanced images as auxiliary information. As for the enhancement layer aiming for human vision, the residual between the original image and the reconstruction from base layer is compressed. A feature attention block and a background light recovery block are designed utilizing features extracted from enhanced images and the underwater before further recovering the original scene with a good perception quality under low bit-rates. Experimental results demonstrate the superiority of our framework in both machine vision tasks and perception quality compared with traditional compression methods and learned-based methods.

A semantic segmentation-based underwater acoustic image transmission framework for cooperative SLAM

With the development of underwater sonar detection technology, simultaneous localization and mapping (SLAM) approach has attracted much attention in underwater navigation field in recent years. But the weak detection ability of a single vehicle limits the SLAM performance in wide areas. Thereby, cooperative SLAM using multiple vehicles has become an important research direction. The key factor of cooperative SLAM is timely and efficient sonar image transmission among underwater vehicles. However, the limited bandwidth of underwater acoustic channels contradicts a large amount of sonar image data. It is essential to compress the images before transmission. Recently, deep neural networks have great value in image compression by virtue of the powerful learning ability of neural networks, but the existing sonar image compression methods based on neural network usually focus on the pixel-level information without the semantic-level information. In this paper, we propose a novel underwater acoustic transmission scheme called UAT-SSIC that includes semantic segmentation-based sonar image compression (SSIC) framework and the joint source-channel codec, to improve the accuracy of the semantic information of the reconstructed sonar image at the receiver. The SSIC framework consists of Auto-Encoder structure-based sonar image compression network, which is measured by a semantic segmentation network's residual. Considering that sonar images have the characteristics of blurred target edges, the semantic segmentation network used a special dilated convolution neural network (DiCNN) to enhance segmentation accuracy by expanding the range of receptive fields. The joint source-channel codec with unequal error protection is proposed that adjusts the power level of the transmitted data, which deal with sonar image transmission error caused by the serious underwater acoustic channel. Experiment results demonstrate that our method preserves more semantic information, with advantages over existing methods at the same compression ratio. It also improves the error tolerance and packet loss resistance of transmission.

Remote Sensing Image Compression Based on the Multiple Prior Information

Learned image compression has achieved a series of breakthroughs for nature images, but there is little literature focusing on high-resolution remote sensing image (HRRSI) datasets. This paper focuses on designing a learned lossy image compression framework for compressing HRRSIs. Considering the local and non-local redundancy contained in HRRSI, a mixed hyperprior network is designed to explore both the local and non-local redundancy in order to improve the accuracy of entropy estimation. In detail, a transformer-based hyperprior and a CNN-based hyperprior are fused for entropy estimation. Furthermore, to reduce the mismatch between training and testing, a three-stage training strategy is introduced to refine the network. In this training strategy, the entire network is first trained, and then some sub-networks are fixed while the others are trained. To evaluate the effectiveness of the proposed compression algorithm, the experiments are conducted on an HRRSI dataset. The results show that the proposed algorithm achieves comparable or better compression performance than some traditional and learned image compression algorithms, such as Joint Photographic Experts Group (JPEG) and JPEG2000. At a similar or lower bitrate, the proposed algorithm is about 2 dB higher than the PSNR value of JPEG2000.

CBANet: Toward Complexity and Bitrate Adaptive Deep Image Compression Using a Single Network.

In this work, we propose a new deep image compression framework called Complexity and Bitrate Adaptive Network (CBANet) that aims to learn one single network to support variable bitrate coding under various computational complexity levels. In contrast to the existing state-of-the-art learning-based image compression frameworks that only consider the rate-distortion trade-off without introducing any constraint related to the computational complexity, our CBANet considers the complex rate-distortion-complexity trade-off when learning a single network to support multiple computational complexity levels and variable bitrates. Since it is a non-trivial task to solve such a rate-distortion-complexity related optimization problem, we propose a two-step approach to decouple this complex optimization task into a complexity-distortion optimization sub-task and a rate-distortion optimization sub-task, and additionally propose a new network design strategy by introducing a Complexity Adaptive Module (CAM) and a Bitrate Adaptive Module (BAM) to respectively achieve the complexity-distortion and rate-distortion trade-offs. As a general approach, our network design strategy can be readily incorporated into different deep image compression methods to achieve complexity and bitrate adaptive image compression by using a single network. Comprehensive experiments on two benchmark datasets demonstrate the effectiveness of our CBANet for deep image compression. Code is released at https://github.com/JinyangGuo/CBANet-release.

An overhead-free region-based JPEG framework for task-driven image compression

An overhead-free region-based JPEG framework for task-driven image compression

3D Holoscopic Image Compression Based on Gaussian Mixture Model

We introduce a Gaussian Mixture Model (GMM) framework for 3D holoscopic image compression in this paper. The elemental-images of the 3D holoscopic image are predicted using GMM and the parameters of GMM are estimated using the common Expectation-Maximization (EM) algorithm. GMM Model Optimization (GMO) is used in this framework to select the optimal number of distributions and avoid local optimum of EM at the same time. A three-dimensional distribution-rotation based decomposition is proposed to change covariance parameters to meaningful features and improve the coding efficiency. The features and the remaining parameters of the GMM are encoded using fixed-length bits. A feature-based dictionary is proposed in this framework to match the similar Gaussian distributions utilizing the similar GMM features. And the offsets of the matched distributions are recorded as motion vectors to replace the similar areas in the elemental-images of the 3D holoscopic image. The residual between the original image and the prediction is encoded using Screen Content Coding Extension of High Efficiency Video Coding (HEVC-SCC). Experimental results show that our method performs better than HEVC-SCC, two coding methods based on pseudo-sequences and a state-of-the-art content-based compression method with Gaussian process regression.

Light Field Compression With Graph Learning and Dictionary-Guided Sparse Coding

Light field (LF) data are widely used in the immersive representations of the 3D world. To record the light rays along with different directions, an LF requires much larger storage space and transmission bandwidth than a conventional 2D image with similar spatial dimension. In this paper, we propose a novel framework for light field image compression that leverages graph learning and dictionary learning to remove structural redundancies between different views. Specifically, to significantly reduce the bit-rates, only a few key views sampled and encoded, whereas the remaining non-key views are reconstructed via the graph adjacency matrix learned from the angular patch. Furthermore, dictionary-guided sparse coding is developed to compress the graph adjacency matrices and reduce the coding overheads. To the best of our knowledge, this paper is the first to achieve compact representation of cross-view structural information via adaptive learning on graphs. Experimental results demonstrate that the proposed framework achieves better performance than the standardized HEVC-based codec.

Learned Structure-Based Hybrid Framework for Martian Image Compression

Learned Structure-Based Hybrid Framework for Martian Image Compression

Learned image compression with generalized octave convolution and cross-resolution parameter estimation

Recently, image compression approaches based on deep learning have gradually outperformed existing image compression standards including BPG and VVC intra coding. In particular, the application of the context-adaptive entropy model significantly improves the rate-distortion (R-D) performance, in which hyperpriors and autoregressive models are jointly utilized to effectively capture the spatial redundancy of the latent representations. However, the latent representations still contain some spatial correlations. In addition, these methods based on the context-adaptive entropy model cannot be accelerated in the decoding process by parallel computing devices, e.g. FPGA or GPU. To alleviate these limitations, we propose a learned multi-resolution image compression framework, which exploits the recently developed octave convolutions to factorize the latent representations into the high-resolution (HR) and low-resolution (LR) parts, similar to wavelet transform, which further improves the R-D performance. To speed up the decoding, our scheme does not use context-adaptive entropy model. Instead, we exploit an additional hyper layer including hyper encoder and hyper decoder to further remove the spatial redundancy of the latent representation. Moreover, the cross-resolution parameter estimation (CRPE) is introduced into the proposed framework to enhance the flow of information and further improve the rate-distortion performance. An additional information-fidelity loss is proposed to the total loss function to adjust the contribution of the LR part to the final bit stream. Experimental results show that our method separately reduces the decoding time by approximately 73.35 and 93.44 % compared with that of state-of-the-art learned image compression methods, and the R-D performance is still better than H.266/VVC(4:2:0) and some learning-based methods on both PSNR and MS-SSIM metrics across a wide bit rates.

Joint image compression and denoising via latent-space scalability

When it comes to image compression in digital cameras, denoising is traditionally performed prior to compression. However, there are applications where image noise may be necessary to demonstrate the trustworthiness of the image, such as court evidence and image forensics. This means that noise itself needs to be coded, in addition to the clean image itself. In this paper, we present a learning-based image compression framework where image denoising and compression are performed jointly. The latent space of the image codec is organized in a scalable manner such that the clean image can be decoded from a subset of the latent space (the base layer), while the noisy image is decoded from the full latent space at a higher rate. Using a subset of the latent space for the denoised image allows denoising to be carried out at a lower rate. Besides providing a scalable representation of the noisy input image, performing denoising jointly with compression makes intuitive sense because noise is hard to compress; hence, compressibility is one of the criteria that may help distinguish noise from the signal. The proposed codec is compared against established compression and denoising benchmarks, and the experiments reveal considerable bitrate savings compared to a cascade combination of a state-of-the-art codec and a state-of-the-art denoiser.