菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-14
📄 Abstract - Bridging the Micro--Macro Gap: Frequency-Aware Semantic Alignment for Image Manipulation Localization

As generative image editing advances, image manipulation localization (IML) must handle both traditional manipulations with conspicuous forensic artifacts and diffusion-generated edits that appear locally realistic. Existing methods typically rely on either low-level forensic cues or high-level semantics alone, leading to a fundamental micro--macro gap. To bridge this gap, we propose FASA, a unified framework for localizing both traditional and diffusion-generated manipulations. Specifically, we extract manipulation-sensitive frequency cues through an adaptive dual-band DCT module and learn manipulation-aware semantic priors via patch-level contrastive alignment on frozen CLIP representations. We then inject these priors into a hierarchical frequency pathway through a semantic-frequency side adapter for multi-scale feature interaction, and employ a prototype-guided, frequency-gated mask decoder to integrate semantic consistency with boundary-aware localization for tampered region prediction. Extensive experiments on OpenSDI and multiple traditional manipulation benchmarks demonstrate state-of-the-art localization performance, strong cross-generator and cross-dataset generalization, and robust performance under common image degradations.

顶级标签: computer vision model evaluation multi-modal
详细标签: image forensics manipulation localization frequency analysis semantic alignment diffusion detection 或 搜索:

弥合微观-宏观鸿沟:用于图像篡改定位的频率感知语义对齐方法 / Bridging the Micro--Macro Gap: Frequency-Aware Semantic Alignment for Image Manipulation Localization


1️⃣ 一句话总结

这篇论文提出了一个名为FASA的统一框架,通过结合图像的低频/高频篡改痕迹和高级语义信息,有效定位了传统修图工具和新兴AI扩散模型生成的各种图像篡改区域。

源自 arXiv: 2604.12341