菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-02
📄 Abstract - FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learning

General continual learning (GCL) challenges intelligent systems to learn from single-pass, non-stationary data streams without clear task boundaries. While recent advances in continual parameter-efficient tuning (PET) of pretrained models show promise, they typically rely on multiple training epochs and explicit task cues, limiting their effectiveness in GCL scenarios. Moreover, existing methods often lack targeted design and fail to address two fundamental challenges in continual PET: how to allocate expert parameters to evolving data distributions, and how to improve their representational capacity under limited supervision. Inspired by the fruit fly's hierarchical memory system characterized by sparse expansion and modular ensembles, we propose FlyPrompt, a brain-inspired framework that decomposes GCL into two subproblems: expert routing and expert competence improvement. FlyPrompt introduces a randomly expanded analytic router for instance-level expert activation and a temporal ensemble of output heads to dynamically adapt decision boundaries over time. Extensive theoretical and empirical evaluations demonstrate FlyPrompt's superior performance, achieving up to 11.23%, 12.43%, and 7.62% gains over state-of-the-art baselines on CIFAR-100, ImageNet-R, and CUB-200, respectively. Our source code is available at this https URL.

顶级标签: machine learning model training systems
详细标签: continual learning parameter-efficient tuning brain-inspired ai expert routing temporal ensemble 或 搜索:

FlyPrompt:一种受大脑启发的随机扩展路由与时序集成专家框架,用于通用持续学习 / FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learning


1️⃣ 一句话总结

这篇论文受果蝇大脑记忆机制启发,提出了一种名为FlyPrompt的新方法,通过随机扩展路由和时序集成专家来动态适应持续变化的数据流,有效解决了通用持续学习中模型难以在单次学习且无明确任务边界的情况下高效分配和提升专家能力的关键难题,并在多个基准数据集上取得了显著性能提升。

源自 arXiv: 2602.01976