事实还是伪造?评估深度伪造检测器在多模态虚假信息检测中的作用 / Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection
1️⃣ 一句话总结
这篇论文通过系统研究发现,在多模态虚假信息检测中,专注于像素级伪造的深度伪造检测器不仅作用有限,反而可能因误导性的真实性假设而降低事实核查系统的整体性能,而基于语义理解和外部证据的核查方法效果更好。
In multimodal misinformation, deception usually arises not just from pixel-level manipulations in an image, but from the semantic and contextual claim jointly expressed by the image-text pair. Yet most deepfake detectors, engineered to detect pixel-level forgeries, do not account for claim-level meaning, despite their growing integration in automated fact-checking (AFC) pipelines. This raises a central scientific and practical question: Do pixel-level detectors contribute useful signal for verifying image-text claims, or do they instead introduce misleading authenticity priors that undermine evidence-based reasoning? We provide the first systematic analysis of deepfake detectors in the context of multimodal misinformation detection. Using two complementary benchmarks, MMFakeBench and DGM4, we evaluate: (1) state-of-the-art image-only deepfake detectors, (2) an evidence-driven fact-checking system that performs tool-guided retrieval via Monte Carlo Tree Search (MCTS) and engages in deliberative inference through Multi-Agent Debate (MAD), and (3) a hybrid fact-checking system that injects detector outputs as auxiliary evidence. Results across both benchmark datasets show that deepfake detectors offer limited standalone value, achieving F1 scores in the range of 0.26-0.53 on MMFakeBench and 0.33-0.49 on DGM4, and that incorporating their predictions into fact-checking pipelines consistently reduces performance by 0.04-0.08 F1 due to non-causal authenticity assumptions. In contrast, the evidence-centric fact-checking system achieves the highest performance, reaching F1 scores of approximately 0.81 on MMFakeBench and 0.55 on DGM4. Overall, our findings demonstrate that multimodal claim verification is driven primarily by semantic understanding and external evidence, and that pixel-level artifact signals do not reliably enhance reasoning over real-world image-text misinformation.
事实还是伪造?评估深度伪造检测器在多模态虚假信息检测中的作用 / Fact or Fake? Assessing the Role of Deepfake Detectors in Multimodal Misinformation Detection
这篇论文通过系统研究发现,在多模态虚假信息检测中,专注于像素级伪造的深度伪造检测器不仅作用有限,反而可能因误导性的真实性假设而降低事实核查系统的整体性能,而基于语义理解和外部证据的核查方法效果更好。
源自 arXiv: 2602.01854