菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-29
📄 Abstract - Dynamo: Dynamic Skill-Tool Evolution for Vision-Language Agents

Improving vision-language models (VLMs) on visual reasoning typically requires retraining or hand-designed prompts and tools. We present Dynamo, a training-free framework that adapts a frozen VLM without any weight updates. On a small labeled training subset, the agent inspects its own correct and incorrect attempts and evolves two complementary capabilities: reusable reasoning skills for cognitive bottlenecks, and executable visual tools for perceptual ones. Each generated tool is paired with a skill that specifies when to invoke it, and both capability types accumulate in a persistent library. Across four visual reasoning benchmarks and five VLM backbones, Dynamo improves direct inference on all 20 model--benchmark settings (avg. +5.6 acc). When the tool set is given in advance, the framework learns when to call each tool, and per-step tool choice improves on every tested backbone. Against task-specific RL (VTool-R1, DeepEyes), Dynamo closes 65--99% of the RL gap at a fraction of the compute, and combines additively with RL when available.

顶级标签: agents multi-modal machine learning
详细标签: vision-language agents skill-tool evolution training-free adaptation visual reasoning tool selection 或 搜索:

Dynamo:视觉语言智能体的动态技能与工具演化 / Dynamo: Dynamic Skill-Tool Evolution for Vision-Language Agents


1️⃣ 一句话总结

Dynamo是一种无需重新训练模型的框架,它能让视觉语言模型通过自我分析正确与错误的推理过程,自动生成可复用的思考策略和视觉处理工具,从而在多种视觉推理任务中显著提升性能,且计算成本远低于传统强化学习方法。

源自 arXiv: 2606.30185