递归上下文分配:面向多镜头长视频外推生成的方法 / ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocation
1️⃣ 一句话总结
本文提出一种名为 ReCA 的推理框架,通过将长视频生成任务递归分解为多个上下文可控的子问题,利用现有的短视频生成模型实现数分钟长的、具有电影感镜头结构且保持视觉连续性的视频扩展,在质量和一致性的评估上显著超过以往方法。
Minute-scale cinematic video generation is a central challenge for generative video models. Existing paradigms address only fragments of this challenge: single-shot extrapolation preserves an anchor but lacks cinematic structure, while multi-shot storytelling imposes structure yet remains free to invent its visual states rather than continue an observed one. We define Multi-Shot Video Extrapolation (MSVE), a task that extends an observed frame or clip into a sequence of cinematically structured shots while preserving anchor state and advancing narrative intent. This setting operates under the finite per-call generation budget of short-video models. We identify three coupled bottlenecks: (1) global planners over-specify unsupported details from full screenplays; (2) shot-level prompts dilute task-relevant state when carrying the complete story; and (3) temporal chaining turns generated frames into a lossy memory in which identity, scene, object, and action state decay. MSVE reveals that long-video failure is not merely a limitation of context length, but a failure of context allocation. We propose Recursive Context Allocation (ReCA), an inference-time framework that allocates context hierarchically across planning and generation. ReCA recursively decomposes MSVE into context-bounded subproblems, invokes frozen generators at leaf nodes, and propagates structured state updates across time. To evaluate this setting, we further propose MSVE-Bench and NB-Q, a source-grounded protocol with prompts purpose-built for 3 to 5 minute long-video generation, a regime not addressed by existing short-clip benchmarks. Compared to previous methods, ReCA improves average normalized score by 8 to 16 percent over the strongest competing controller and improves multi-shot consistency metrics by 28 to 43 percent. View the project page at this https URL.
递归上下文分配:面向多镜头长视频外推生成的方法 / ReCA: Multi-Shot Long Video Extrapolation via Recursive Context Allocation
本文提出一种名为 ReCA 的推理框架,通过将长视频生成任务递归分解为多个上下文可控的子问题,利用现有的短视频生成模型实现数分钟长的、具有电影感镜头结构且保持视觉连续性的视频扩展,在质量和一致性的评估上显著超过以往方法。
源自 arXiv: 2605.26525