FedOPAL:基于分析性视觉提示调优的单次联邦学习 / FedOPAL: One-Shot Federated Learning via Analytic Visual Prompt Tuning
1️⃣ 一句话总结
本文提出FedOPAL框架,通过引入可学习的视觉提示作为特征修正器,结合局部近端约束,将非独立同分布数据的特征分布调整为线性可分状态,从而解决分析性联邦学习在异构数据下的特征流形错位问题,实现单次通信下的高效模型聚合,在无需服务器端训练的情况下取得与迭代方法相当的精度。
With the widespread deployment of basic models in edge intelligence, communication bandwidth has become a core bottleneck restricting the scalability of federated learning. Although one-shot federated learning alleviates this problem by minimizing communication rounds, existing iterative fine-tuning or knowledge distillation methods still face challenges such as high server-side computational costs and hyperparameter sensitivity. Analytical federated learning achieves efficient gradientfree aggregation using least-squares closed-form solutions, but in environments with non-independent and identically distributed data, its static feature assumptions fail, leading to feature manifold misalignment and severely impairing model performance. To address this contradiction, this paper proposes the FedOPAL framework. This framework adapts the visual prompts as feature rectifiers, actively correcting the feature distribution of heterogeneous data to a linearly separable space by applying local proximal constraints, thereby satisfying the theoretical assumptions of analytical federated learning. Experimental results show that FedOPAL not only significantly outperforms the original analytical methods on several benchmarks, but also achieves accuracy comparable to state-of-the-art iterative methods while maintaining zero server-side training costs, providing a new engineering paradigm for efficient collaboration of large models on the edge.
FedOPAL:基于分析性视觉提示调优的单次联邦学习 / FedOPAL: One-Shot Federated Learning via Analytic Visual Prompt Tuning
本文提出FedOPAL框架,通过引入可学习的视觉提示作为特征修正器,结合局部近端约束,将非独立同分布数据的特征分布调整为线性可分状态,从而解决分析性联邦学习在异构数据下的特征流形错位问题,实现单次通信下的高效模型聚合,在无需服务器端训练的情况下取得与迭代方法相当的精度。
源自 arXiv: 2607.08368