Alterbute:编辑图像中物体的内在属性 / Alterbute: Editing Intrinsic Attributes of Objects in Images
1️⃣ 一句话总结
这篇论文提出了一个名为Alterbute的新方法,它能够像修图一样精准地改变图片中某个物体的颜色、材质甚至形状,同时还能保持这个物体本身的‘身份’(比如一辆特定的汽车型号)和周围场景不变,效果比现有技术更好。
We introduce Alterbute, a diffusion-based method for editing an object's intrinsic attributes in an image. We allow changing color, texture, material, and even the shape of an object, while preserving its perceived identity and scene context. Existing approaches either rely on unsupervised priors that often fail to preserve identity or use overly restrictive supervision that prevents meaningful intrinsic variations. Our method relies on: (i) a relaxed training objective that allows the model to change both intrinsic and extrinsic attributes conditioned on an identity reference image, a textual prompt describing the target intrinsic attributes, and a background image and object mask defining the extrinsic context. At inference, we restrict extrinsic changes by reusing the original background and object mask, thereby ensuring that only the desired intrinsic attributes are altered; (ii) Visual Named Entities (VNEs) - fine-grained visual identity categories (e.g., ''Porsche 911 Carrera'') that group objects sharing identity-defining features while allowing variation in intrinsic attributes. We use a vision-language model to automatically extract VNE labels and intrinsic attribute descriptions from a large public image dataset, enabling scalable, identity-preserving supervision. Alterbute outperforms existing methods on identity-preserving object intrinsic attribute editing.
Alterbute:编辑图像中物体的内在属性 / Alterbute: Editing Intrinsic Attributes of Objects in Images
这篇论文提出了一个名为Alterbute的新方法,它能够像修图一样精准地改变图片中某个物体的颜色、材质甚至形状,同时还能保持这个物体本身的‘身份’(比如一辆特定的汽车型号)和周围场景不变,效果比现有技术更好。
源自 arXiv: 2601.10714