RAE-NWM:基于稠密视觉表示空间的导航世界模型 / RAE-NWM: Navigation World Model in Dense Visual Representation Space
1️⃣ 一句话总结
这篇论文提出了一种新的导航世界模型,它通过在一个能保留更多细节的稠密视觉特征空间中模拟机器人的行动和状态变化,从而让机器人在复杂环境中能更稳定、更精准地规划路径并到达目标。
Visual navigation requires agents to reach goals in complex environments through perception and planning. World models address this task by simulating action-conditioned state transitions to predict future observations. Current navigation world models typically learn state evolution under actions within the compressed latent space of a Variational Autoencoder, where spatial compression often discards fine-grained structural information and hinders precise control. To better understand the propagation characteristics of different representations, we conduct a linear dynamics probe and observe that dense DINOv2 features exhibit stronger linear predictability for action-conditioned transitions. Motivated by this observation, we propose the Representation Autoencoder-based Navigation World Model (RAE-NWM), which models navigation dynamics in a dense visual representation space. We employ a Conditional Diffusion Transformer with Decoupled Diffusion Transformer head (CDiT-DH) to model continuous transitions, and introduce a separate time-driven gating module for dynamics conditioning to regulate action injection strength during generation. Extensive evaluations show that modeling sequential rollouts in this space improves structural stability and action accuracy, benefiting downstream planning and navigation.
RAE-NWM:基于稠密视觉表示空间的导航世界模型 / RAE-NWM: Navigation World Model in Dense Visual Representation Space
这篇论文提出了一种新的导航世界模型,它通过在一个能保留更多细节的稠密视觉特征空间中模拟机器人的行动和状态变化,从而让机器人在复杂环境中能更稳定、更精准地规划路径并到达目标。
源自 arXiv: 2603.09241