AGMark:面向大型视觉语言模型的注意力引导动态水印技术 / AGMark: Attention-Guided Dynamic Watermarking for Large Vision-Language Models
1️⃣ 一句话总结
本文提出了一种名为AGMark的新型水印框架,它能够根据图像内容和生成过程的动态变化,智能地选择关键位置嵌入水印,从而在有效保护模型知识产权的同时,显著提升生成文本的质量和与图像的语义关联度。
Watermarking has emerged as a pivotal solution for content traceability and intellectual property protection in Large Vision-Language Models (LVLMs). However, vision-agnostic watermarks may introduce visually irrelevant tokens and disrupt visual grounding by enforcing indiscriminate pseudo-random biases. Additionally, current vision-specific watermarks rely on a static, one-time estimation of vision critical weights and ignore the weight distribution density when determining the proportion of protected tokens. This design fails to account for dynamic changes in visual dependence during generation and may introduce low-quality tokens in the long tail. To address these challenges, we propose Attention-Guided Dynamic Watermarking (AGMark), a novel framework that embeds detectable signals while strictly preserving visual fidelity. At each decoding step, AGMark first dynamically identifies semantic-critical evidence based on attention weights for visual relevance, together with context-aware coherence cues, resulting in a more adaptive and well-calibrated evidence-weight distribution. It then determines the proportion of semantic-critical tokens by jointly considering uncertainty awareness (token entropy) and evidence calibration (weight density), thereby enabling adaptive vocabulary partitioning to avoid irrelevant tokens. Empirical results confirm that AGMark outperforms conventional methods, observably improving generation quality and yielding particularly strong gains in visual semantic fidelity in the later stages of generation. The framework maintains highly competitive detection accuracy (at least 99.36\% AUC) and robust attack resilience (at least 88.61\% AUC) without sacrificing inference efficiency, effectively establishing a new standard for reliability-preserving multi-modal watermarking.
AGMark:面向大型视觉语言模型的注意力引导动态水印技术 / AGMark: Attention-Guided Dynamic Watermarking for Large Vision-Language Models
本文提出了一种名为AGMark的新型水印框架,它能够根据图像内容和生成过程的动态变化,智能地选择关键位置嵌入水印,从而在有效保护模型知识产权的同时,显著提升生成文本的质量和与图像的语义关联度。
源自 arXiv: 2602.09611