菜单

关于 🐙 GitHub
arXiv 提交日期: 2025-12-29
📄 Abstract - MindWatcher: Toward Smarter Multimodal Tool-Integrated Reasoning

Traditional workflow-based agents exhibit limited intelligence when addressing real-world problems requiring tool invocation. Tool-integrated reasoning (TIR) agents capable of autonomous reasoning and tool invocation are rapidly emerging as a powerful approach for complex decision-making tasks involving multi-step interactions with external environments. In this work, we introduce MindWatcher, a TIR agent integrating interleaved thinking and multimodal chain-of-thought (CoT) reasoning. MindWatcher can autonomously decide whether and how to invoke diverse tools and coordinate their use, without relying on human prompts or workflows. The interleaved thinking paradigm enables the model to switch between thinking and tool calling at any intermediate stage, while its multimodal CoT capability allows manipulation of images during reasoning to yield more precise search results. We implement automated data auditing and evaluation pipelines, complemented by manually curated high-quality datasets for training, and we construct a benchmark, called MindWatcher-Evaluate Bench (MWE-Bench), to evaluate its performance. MindWatcher is equipped with a comprehensive suite of auxiliary reasoning tools, enabling it to address broad-domain multimodal problems. A large-scale, high-quality local image retrieval database, covering eight categories including cars, animals, and plants, endows model with robust object recognition despite its small size. Finally, we design a more efficient training infrastructure for MindWatcher, enhancing training speed and hardware utilization. Experiments not only demonstrate that MindWatcher matches or exceeds the performance of larger or more recent models through superior tool invocation, but also uncover critical insights for agent training, such as the genetic inheritance phenomenon in agentic RL.

顶级标签: agents multi-modal model training
详细标签: tool-integrated reasoning multimodal chain-of-thought autonomous agents benchmark evaluation agent training infrastructure 或 搜索:

MindWatcher:迈向更智能的多模态工具集成推理 / MindWatcher: Toward Smarter Multimodal Tool-Integrated Reasoning


1️⃣ 一句话总结

这篇论文提出了一个名为MindWatcher的新型智能体,它能够像人一样自主思考、调用各种工具(如图像搜索)来解决复杂的跨领域问题,其核心创新在于让模型在推理过程中随时切换思考和工具调用,并通过高效训练实现了比更大模型更优的性能。

源自 arXiv: 2512.23412