菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-15
📄 Abstract - VRAG-DFD: Verifiable Retrieval-Augmentation for MLLM-based Deepfake Detection

In Deepfake Detection (DFD) tasks, researchers proposed two types of MLLM-based methods: complementary combination with small DFD detectors, or static forgery knowledge this http URL lack of professional forgery knowledge hinders the performance of these this http URL solve this, we deeply considered two insightful issues: How to provide high-quality associated forgery knowledge for MLLMs? AND How to endow MLLMs with critical reasoning abilities given noisy reference information? Notably, we attempted to address above two questions with preliminary answers by leveraging the combination of Retrieval-Augmented Generation (RAG) and Reinforcement Learning (RL).Through RAG and RL techniques, we propose the VRAG-DFD framework with accurate dynamic forgery knowledge retrieval and powerful critical reasoning this http URL, in terms of data, we constructed two datasets with RAG: Forensic Knowledge Database (FKD) for DFD knowledge annotation, and Forensic Chain-of-Thought Dataset (F-CoT), for critical CoT this http URL terms of model training, we adopt a three-stage training method (Alignment->SFT->GRPO) to gradually cultivate the critical reasoning ability of the this http URL terms of performance, VRAG-DFD achieved SOTA and competitive performance on DFD generalization testing.

顶级标签: multi-modal model training machine learning
详细标签: deepfake detection retrieval-augmented generation reinforcement learning multimodal large language models forensic knowledge 或 搜索:

VRAG-DFD:基于多模态大语言模型的深度伪造检测的可验证检索增强框架 / VRAG-DFD: Verifiable Retrieval-Augmentation for MLLM-based Deepfake Detection


1️⃣ 一句话总结

这篇论文提出了一个名为VRAG-DFD的新框架,它通过结合检索增强生成和强化学习技术,为检测AI生成的虚假内容(深度伪造)的多模态大模型提供动态、高质量的专业知识,并训练其进行批判性推理,从而显著提升了检测的准确性和泛化能力。

源自 arXiv: 2604.13660