菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-28
📄 Abstract - Semi-Markov Reinforcement Learning for City-Scale EV Ride-Hailing with Feasibility-Guaranteed Actions

We study city-scale control of electric-vehicle (EV) ride-hailing fleets where dispatch, repositioning, and charging decisions must respect charger and feeder limits under uncertain, spatially correlated demand and travel times. We formulate the problem as a hex-grid semi-Markov decision process (semi-MDP) with mixed actions -- discrete actions for serving, repositioning, and charging, together with continuous charging power -- and variable action durations. To guarantee physical feasibility during both training and deployment, the policy learns over high-level intentions produced by a masked, temperature-annealed actor. These intentions are projected at every decision step through a time-limited rolling mixed-integer linear program (MILP) that strictly enforces state-of-charge, port, and feeder constraints. To mitigate distributional shifts, we optimize a Soft Actor--Critic (SAC) agent against a Wasserstein-1 ambiguity set with a graph-aligned Mahalanobis ground metric that captures spatial correlations. The robust backup uses the Kantorovich--Rubinstein dual, a projected subgradient inner loop, and a primal--dual risk-budget update. Our architecture combines a two-layer Graph Convolutional Network (GCN) encoder, twin critics, and a value network that drives the adversary. Experiments on a large-scale EV fleet simulator built from NYC taxi data show that PD--RSAC achieves the highest net profit, reaching \$1.22M, compared with \$0.58M--\$0.70M for strong heuristic, single-agent RL, and multi-agent RL baselines, including Greedy, SAC, MAPPO, and MADDPG, while maintaining zero feeder-limit violations.

顶级标签: reinforcement learning agents systems
详细标签: semi-markov decision process ev ride-hailing feasibility-guaranteed robust optimization graph convolutional network 或 搜索:

面向城市级电动网约车调度的半马尔可夫强化学习:具有可行性保证的行动策略 / Semi-Markov Reinforcement Learning for City-Scale EV Ride-Hailing with Feasibility-Guaranteed Actions


1️⃣ 一句话总结

本文提出一种结合半马尔可夫决策过程与鲁棒软演员-评论家算法(PD-RSAC)的强化学习方法,用于大规模电动网约车调度,通过混合整数线性规划保证充电、接单和重新定位动作的物理可行性,并在纽约出租车数据仿真中实现零充电桩越限和最高净收益(122万美元)。

源自 arXiv: 2604.25848