StreamingClaw技术报告 / StreamingClaw Technical Report
1️⃣ 一句话总结
这篇论文提出了一个名为StreamingClaw的统一智能体框架,它能够实时处理视频流、进行主动推理和交互,并具备长期记忆能力,旨在解决现有系统在实时感知、决策和物理世界交互方面的瓶颈,以更好地支持具身智能等应用。
Applications such as embodied intelligence rely on a real-time perception-decision-action closed loop, posing stringent challenges for streaming video understanding. However, current agents suffer from fragmented capabilities, such as supporting only offline video understanding, lacking long-term multimodal memory mechanisms, or struggling to achieve real-time reasoning and proactive interaction under streaming inputs. These shortcomings have become a key bottleneck for preventing them from sustaining perception, making real-time decisions, and executing actions in real-world environments. To alleviate these issues, we propose StreamingClaw, a unified agent framework for streaming video understanding and embodied intelligence. It is also an OpenClaw-compatible framework that supports real-time, multimodal streaming interaction. StreamingClaw integrates five core capabilities: (1) It supports real-time streaming reasoning. (2) It supports reasoning about future events and proactive interaction under the online evolution of interaction objectives. (3) It supports multimodal long-term storage, hierarchical evolution, and efficient retrieval of shared memory across multiple agents. (4) It supports a closed-loop of perception-decision-action. In addition to conventional tools and skills, it also provides streaming tools and action-centric skills tailored for real-world physical environments. (5) It is compatible with the OpenClaw framework, allowing it to fully leverage the resources and support of the open-source community. With these designs, StreamingClaw integrates online real-time reasoning, multimodal long-term memory, and proactive interaction within a unified framework. Moreover, by translating decisions into executable actions, it enables direct control of the physical world, supporting practical deployment of embodied interaction.
StreamingClaw技术报告 / StreamingClaw Technical Report
这篇论文提出了一个名为StreamingClaw的统一智能体框架,它能够实时处理视频流、进行主动推理和交互,并具备长期记忆能力,旨在解决现有系统在实时感知、决策和物理世界交互方面的瓶颈,以更好地支持具身智能等应用。
源自 arXiv: 2603.22120