菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-25
📄 Abstract - UniVBench: Towards Unified Evaluation for Video Foundation Models

Video foundation models aim to integrate video understanding, generation, editing, and instruction following within a single framework, making them a central direction for next-generation multimodal systems. However, existing evaluation benchmarks remain fragmented and limited in scope, as they each target a single task, rely on task-specific metrics, and typically use short or simple video clips. As a result, they do not capture the unified capabilities that these models are designed to deliver. To address this gap, we introduce UniVBench, a benchmark purpose-built for evaluating video foundation models across four core abilities: video understanding, video generation, video editing, and a newly proposed task, video reconstruction, which assesses how faithfully a model can reproduce video content it has encountered. Our benchmark substantially expands the complexity of evaluation by incorporating 200 high-quality, diverse and multi-shot videos, each paired with detailed captions, multi-format editing instructions, and reference images. All videos are human-created and carefully validated, offering richer cinematic information than prior benchmarks. In addition, we develop a unified agentic evaluation system (UniV-Eval) that standardizes prompting, instruction parsing, and scoring across all tasks, enabling fair, scalable, and reproducible comparisons of unified video models. By grounding evaluation in instruction-based multi-shot video tasks, UniVBench provides the first framework for measuring the integrated capabilities that video foundation models aim to achieve. Extensive human annotations ensure our evaluation aligns with human judgment, enabling rigorous assessment and accelerating progress toward robust video intelligence.

顶级标签: benchmark multi-modal model evaluation
详细标签: video foundation models unified evaluation video generation video understanding agentic evaluation 或 搜索:

UniVBench:面向视频基础模型的统一评估 / UniVBench: Towards Unified Evaluation for Video Foundation Models


1️⃣ 一句话总结

这篇论文提出了一个名为UniVBench的统一评估基准,它首次将视频理解、生成、编辑和重建四大核心能力整合到一个框架中进行综合测评,并引入了一个标准化的自动评估系统,旨在更全面、公平地衡量新一代视频基础模型的真实水平。

源自 arXiv: 2602.21835