菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-03-16
📄 Abstract - Exposing Cross-Modal Consistency for Fake News Detection in Short-Form Videos

Short-form video platforms are major channels for news but also fertile ground for multimodal misinformation where each modality appears plausible alone yet cross-modal relationships are subtly inconsistent, like mismatched visuals and captions. On two benchmark datasets, FakeSV (Chinese) and FakeTT (English), we observe a clear asymmetry: real videos exhibit high text-visual but moderate text-audio consistency, while fake videos show the opposite pattern. Moreover, a single global consistency score forms an interpretable axis along which fake probability and prediction errors vary smoothly. Motivated by these observations, we present MAGIC3 (Modal-Adversarial Gated Interaction and Consistency-Centric Classifier), a detector that explicitly models and exposes cross-tri-modal consistency signals at multiple granularities. MAGIC3 combines explicit pairwise and global consistency modeling with token- and frame-level consistency signals derived from cross-modal attention, incorporates multi-style LLM rewrites to obtain style-robust text representations, and employs an uncertainty-aware classifier for selective VLM routing. Using pre-extracted features, MAGIC3 consistently outperforms the strongest non-VLM baselines on FakeSV and FakeTT. While matching VLM-level accuracy, the two-stage system achieves 18-27x higher throughput and 93% VRAM savings, offering a strong cost-performance tradeoff.

顶级标签: multi-modal natural language processing model evaluation
详细标签: fake news detection cross-modal consistency short-form video multimodal misinformation benchmark 或 搜索:

通过揭示跨模态一致性进行短视频假新闻检测 / Exposing Cross-Modal Consistency for Fake News Detection in Short-Form Videos


1️⃣ 一句话总结

这篇论文提出了一种名为MAGIC3的新方法,通过专门分析和暴露短视频中文字、画面和声音之间不一致的微妙关系来检测假新闻,在保持高精度的同时大幅提升了检测效率。

源自 arXiv: 2603.14992