菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-09
📄 Abstract - LUMI: Tokenizer-Agnostic LLM-Based Lossless Image Compression

Large language model (LLM)-based lossless image compression methods typically represent pixel data through the native text interface of a pretrained model, converting pixel values into token sequences that the LLM processes through its vocabulary head. This design shows that pretrained language models can provide probability estimates for image coding, but it also couples compression to tokenizer behavior, vocabulary-specific numeric tokens, and model-family-specific adaptation. In this paper, we present LUMI (LLM-based Unified Model-agnostic lossless Image compression), a tokenizer-agnostic framework for lossless RGB image compression with frozen LLM backbones. LUMI replaces pixel-as-text tokenization with a pixel embedding module that maps raw intensity and channel information into the continuous embedding space of the LLM. It further introduces intra-patch position encoding to retain two-dimensional spatial structure after flattening, and uses a 256-way prediction head to produce probabilities over the native pixel alphabet. Only the pixel embedding, position encoding, soft-prefix parameters, and prediction head are trained, while the LLM backbone remains fixed. Experiments on natural, medical, and remote-sensing image benchmarks with LLaMA, Qwen, and Gemma backbones show that LUMI provides a unified interface across tokenizer families, achieves competitive compression rates, and improves cross-domain robustness over tokenizer-based LLM compression baselines. These results formulate LLM-based lossless image compression as pixel-space adaptation of frozen foundation models rather than tokenizer-specific language-symbol modeling.

顶级标签: llm machine learning multi-modal
详细标签: lossless compression image compression frozen model pixel embedding unified framework 或 搜索:

LUMI:与分词器无关的基于大语言模型的无损图像压缩 / LUMI: Tokenizer-Agnostic LLM-Based Lossless Image Compression


1️⃣ 一句话总结

本文提出LUMI框架,通过将像素直接映射到大语言模型的嵌入空间而非依赖文本分词器,实现了无需微调模型主干即可高效、跨领域压缩图像的方法。

源自 arXiv: 2607.08221