菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-01-20
📄 Abstract - KAGE-Bench: Fast Known-Axis Visual Generalization Evaluation for Reinforcement Learning

Pixel-based reinforcement learning agents often fail under purely visual distribution shift even when latent dynamics and rewards are unchanged, but existing benchmarks entangle multiple sources of shift and hinder systematic analysis. We introduce KAGE-Env, a JAX-native 2D platformer that factorizes the observation process into independently controllable visual axes while keeping the underlying control problem fixed. By construction, varying a visual axis affects performance only through the induced state-conditional action distribution of a pixel policy, providing a clean abstraction for visual generalization. Building on this environment, we define KAGE-Bench, a benchmark of six known-axis suites comprising 34 train-evaluation configuration pairs that isolate individual visual shifts. Using a standard PPO-CNN baseline, we observe strong axis-dependent failures, with background and photometric shifts often collapsing success, while agent-appearance shifts are comparatively benign. Several shifts preserve forward motion while breaking task completion, showing that return alone can obscure generalization failures. Finally, the fully vectorized JAX implementation enables up to 33M environment steps per second on a single GPU, enabling fast and reproducible sweeps over visual factors. Code: this https URL.

顶级标签: reinforcement learning benchmark model evaluation
详细标签: visual generalization distribution shift ppo-cnn jax implementation 2d platformer 或 搜索:

KAGE-Bench:面向强化学习的快速已知轴视觉泛化评估基准 / KAGE-Bench: Fast Known-Axis Visual Generalization Evaluation for Reinforcement Learning


1️⃣ 一句话总结

这篇论文提出了一个名为KAGE-Bench的新基准测试,它通过一个可精确控制视觉变化的2D游戏环境,系统性地揭示了仅依赖像素输入的强化学习智能体在面对不同视觉变化(如背景、光照)时泛化能力会严重下降,并提供了高效的测试工具来加速相关研究。

源自 arXiv: 2601.14232