菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-27
📄 Abstract - GEM: Generative Supervision Helps Embodied Intelligence

Embodied Vision-Language Models (VLMs) have demonstrated impressive performance and generalization in robotics, particularly within Vision-Language-Action frameworks. However, a significant gap remains between the high-level semantic focus of standard text-guided pre-training paradigms and the low-level spatial and physical knowledge critical for execution in embodied environments. In this paper, we introduce GEM, a Generative-supervised Embodied vision-language Model designed to bridge this divide. We propose integrating a depth map generation task directly into the VLM pre-training phase. By training this generative objective jointly with the main model, we observe substantial improvements in embodied intelligence, significantly enhancing both semantic understanding and physical operation capabilities. To support this paradigm, we curate and release GEM-4M, a comprehensive large-scale dataset featuring a mixture of grounding, reasoning, and planning data paired with high-quality depth supervision. Extensive experiments demonstrate that GEM achieves state-of-the-art results across diverse embodied benchmarks. Furthermore, our deployed action model, GEM-VLA, exhibits vastly superior task execution abilities in both simulation environments and real-world evaluations. Code, models, and datasets are available at this https URL

顶级标签: multi-modal robotics model training
详细标签: embodied intelligence vision-language-action depth map generation benchmark pre-training 或 搜索:

GEM:生成式监督助力具身智能 / GEM: Generative Supervision Helps Embodied Intelligence


1️⃣ 一句话总结

这篇论文提出了一种名为GEM的具身视觉语言模型,通过在预训练阶段引入深度图生成任务,弥补了高层语义理解与低层空间物理知识之间的鸿沟,显著提升了机器人在仿真和真实环境中的任务执行能力。

源自 arXiv: 2605.28548