菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-06
📄 Abstract - Graph Sparse Sampling: Breaking the Curse of the Horizon in Continuous MDP Planning

Planning under uncertainty in continuous domains is essential for autonomous systems, yet computationally demanding. Tree-based search methods such as Monte Carlo Tree Search (MCTS) remain popular, but their branching structure can require sampling budgets that grow exponentially with lookahead depth in the worst case. From a tree perspective, continuous state or action spaces become especially challenging, since the planner must decide where to search in an infinite branching hierarchy. We propose Graph Sparse Sampling (GSS), an online planning algorithm that shares sampled futures across many candidate decisions, rather than sampling separate successors for each candidate action. This branch-free graph exposes large GPU-friendly batches, while using heuristics to focus computation. We prove finite-sample performance guarantees for GSS covering full-rank or low-rank generative simulators via smoothed backups, and discrete or sampled continuous action spaces. Under suitable overlap, regularity, and action-coverage conditions, these bounds have polynomial dependence on the planning horizon, formalizing when shared futures can avoid the exponential horizon dependence of tree-shaped sparse sampling. We demonstrate continuous-control simulations where GSS substantially outperforms tree-based planners on long horizons or achieves near-optimal performance, supporting no-branching graph planning as a complementary design principle for online control.

顶级标签: reinforcement learning planning
详细标签: monte carlo tree search continuous control online planning sample complexity horizon curse 或 搜索:

图稀疏采样:打破连续马尔可夫决策过程规划中“地平线诅咒” / Graph Sparse Sampling: Breaking the Curse of the Horizon in Continuous MDP Planning


1️⃣ 一句话总结

本文提出一种名为“图稀疏采样”的在线规划算法,通过让多个候选决策共享相同未来模拟样本、避免传统树形搜索中的分支结构,从而在连续状态和动作空间的长期规划任务中大幅降低计算复杂度,并用理论证明其性能随规划步长仅呈多项式增长而非指数增长。

源自 arXiv: 2607.05359