菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-02
📄 Abstract - FlashbackCL: Mitigating Temporal Forgetting in Federated Learning

Federated Learning (FL) of foundation and edge models increasingly targets deployments where client data distributions drift over time, yet existing forgetting-mitigation methods assume each client's distribution is stationary. Flashback, the strongest recent FL method against cross-client (spatial) forgetting, uses monotonically accumulating per-class label counts as a knowledge proxy; this proxy becomes miscalibrated under temporal distribution shift and anchors the global model to an outdated class balance. We formalise temporal forgetting in FL with a per-phase metric isolated from protocol-level fluctuations and propose Flashback Continual Learning (FlashbackCL), a drop-in extension of Flashback with (i) temporally-decayed label counts; (ii) a device-aware replay buffer with Class-Balanced Reservoir Sampling (CBRS); and (iii) server-side active coreset curation on the public distillation set. The results show that FlashbackCL achieves 6.9% to 10.0% relative improvement relative to Flashback, on CIFAR-10 with 50 clients and three controlled temporal shift modes, while simultaneously reducing temporal forgetting by up to 68%. A 5-variant ablation identifies CBRS replay as the critical component. FlashbackCL also improves Flashback by 3.5 points on stationary CIFAR-100, suggesting that class-balanced replay regularises spatial heterogeneity as well as temporal shift.

顶级标签: machine learning systems
详细标签: federated learning temporal forgetting continual learning class-balanced replay distribution shift 或 搜索:

FlashbackCL:缓解联邦学习中的时间遗忘问题 / FlashbackCL: Mitigating Temporal Forgetting in Federated Learning


1️⃣ 一句话总结

本文提出FlashbackCL方法,通过引入时间衰减的标签计数、设备端类别平衡重放缓冲区和服务器端主动核心集筛选,有效缓解了联邦学习中因客户端数据分布随时间变化而导致的时间遗忘问题,在多种时间偏移场景下相比现有方法显著提升性能并降低遗忘。

源自 arXiv: 2606.03939