菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-06
📄 Abstract - Reinforcement Learning-Based Dynamic Management of Structured Parallel Farm Skeletons on Serverless Platforms

We present a framework for dynamic management of structured parallel processing skeletons on serverless platforms. Our goal is to bring HPC-like performance and resilience to serverless and continuum environments while preserving the programmability benefits of skeletons. As a first step, we focus on the well known Farm pattern and its implementation on the open-source OpenFaaS platform, treating autoscaling of the worker pool as a QoS-aware resource management problem. The framework couples a reusable farm template with a Gymnasium-based monitoring and control layer that exposes queue, timing, and QoS metrics to both reactive and learning-based controllers. We investigate the effectiveness of AI-driven dynamic scaling for managing the farm's degree of parallelism via the scalability of serverless functions on OpenFaaS. In particular, we discuss the autoscaling model and its training, and evaluate two reinforcement learning (RL) policies against a baseline of reactive management derived from a simple farm performance model. Our results show that AI-based management can better accommodate platform-specific limitations than purely model-based performance steering, improving QoS while maintaining efficient resource usage and stable scaling behaviour.

顶级标签: systems reinforcement learning agents
详细标签: serverless computing parallel skeletons autoscaling resource management performance optimization 或 搜索:

基于强化学习的无服务器平台上结构化并行Farm骨架的动态管理 / Reinforcement Learning-Based Dynamic Management of Structured Parallel Farm Skeletons on Serverless Platforms


1️⃣ 一句话总结

这篇论文提出了一个在无服务器平台上动态管理并行计算框架的方法,通过强化学习自动调整工作节点数量,在保证程序易用性的同时,比传统反应式管理更能适应平台限制,从而提升性能并高效利用资源。

源自 arXiv: 2602.06555