AgentJet:一种灵活的强化学习智能体群训练框架 / AgentJet: A Flexible Swarm Training Framework for Agentic Reinforcement Learning
1️⃣ 一句话总结
AgentJet是一种创新的分布式训练框架,通过将模型优化与智能体执行解耦,支持异构多模型协作、多任务混合训练、容错运行和实时代码修改,同时引入上下文追踪模块加速训练,并能够自动完成长达数天的复杂强化学习研究实验。
We present AgentJet, a distributed swarm training framework for large language model (LLM) agent reinforcement learning. Unlike centralized frameworks that tightly couple agent rollouts with model optimization, AgentJet adopts a decoupled multi-node architecture in which swarm server nodes host trainable models and run optimization on GPU clusters, whereas swarm client nodes execute arbitrary agents on arbitrary devices. This design provides capabilities that are difficult to support in centralized frameworks: (1) heterogeneous multi-model reinforcement learning, enabling the training of heterogeneous multi-agent teams with multiple LLM as brains; (2) multi-task cocktail training with isolated agent runtimes; (3) fault-tolerant execution that prevents external environment failures from interrupting the training process; and (4) live code iteration, which allows agents to be edited during training by replacing swarm client nodes. To support efficient RL in multi-model, multi-turn, and multi-agent settings, AgentJet introduces a context tracking module with timeline merging, which consolidates redundant context and achieves a 1.5-10x training speedup. Finally, AgentJet introduces an automated research system that takes a research topic as input and autonomously conducts long-horizon, multi-day RL studies on large-scale clusters. By leveraging the swarm architecture, this system reproduces key exploratory workflows of RL researchers without human intervention during execution.
AgentJet:一种灵活的强化学习智能体群训练框架 / AgentJet: A Flexible Swarm Training Framework for Agentic Reinforcement Learning
AgentJet是一种创新的分布式训练框架,通过将模型优化与智能体执行解耦,支持异构多模型协作、多任务混合训练、容错运行和实时代码修改,同时引入上下文追踪模块加速训练,并能够自动完成长达数天的复杂强化学习研究实验。
源自 arXiv: 2606.04484