利用语义与像素表示实现超低比特率图像压缩 / Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression
1️⃣ 一句话总结
本文提出了一种名为SPRDiff的扩散模型压缩方法,通过结合语义和像素级特征来提升超低比特率下图像压缩的重建质量,在保持视觉真实感的同时,显著减少了与原始图像之间的像素级差异。
Most existing extreme compression methods fail to achieve an optimal rate-distortion-perception trade-off, as they typically prioritize perceptual fidelity and visual realism over pixel-level accuracy. Consequently, the resulting reconstructions often deviate noticeably from the originals. Ultra-low bitrate image compression is therefore crucial-not only for producing extremely compact representations but also for ensuring that reconstructed images remain semantically coherent and faithful to the source at the pixel level. To this end, we propose SPRDiff, a diffusion-based compression method that fully leverages both semantic and pixel representations, thereby enhancing reconstruction fidelity under ultra-low bitrate constraints. Specifically, we develop a triple-encoder architecture that utilizes high-fidelity features from the pretrained distortion-oriented and semantic-oriented encoders to compensate for the limited representations extracted by the frozen VAE encoder, thereby improving latent compression and entropy modeling. To further enhance the reconstruction fidelity of diffusion models, we introduce a distortion-aware reconstruction module with dual feature extraction. This module not only generates a coarse reconstruction that preserves the main structures, but also provides practical and accurate semantic- and pixel-level conditional signals to guide the diffusion model. Extensive experiments on benchmark datasets demonstrate that our method outperforms state-of-the-art approaches in the rate-distortion-perception tradeoff at extremely low bitrates (below 0.03 bpp), effectively preserving both perceptual quality and pixel-wise fidelity in the reconstructed images. We will release the source code and trained models at this https URL.
利用语义与像素表示实现超低比特率图像压缩 / Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression
本文提出了一种名为SPRDiff的扩散模型压缩方法,通过结合语义和像素级特征来提升超低比特率下图像压缩的重建质量,在保持视觉真实感的同时,显著减少了与原始图像之间的像素级差异。
源自 arXiv: 2606.01608