ImageHD:基于超维度计算的节能设备端视觉表征持续学习系统 / ImageHD: Energy-Efficient On-Device Continual Learning of Visual Representations via Hyperdimensional Computing
1️⃣ 一句话总结
本文提出ImageHD,一种在FPGA上实现的超轻量级持续学习加速器,通过超维度计算和硬件协同设计,在资源有限的边缘设备上实现高效的视觉数据流式学习,相比CPU和GPU能效提升数百倍。
On-device continual learning (CL) is critical for edge AI systems operating on non-stationary data streams, but most existing methods rely on backpropagation or exemplar-heavy classifiers, incurring substantial compute, memory, and latency overheads. Hyperdimensional computing (HDC) offers a lightweight alternative through fast, non-iterative online updates. Combined with a compact convolutional neural network (CNN) feature extractor, HDC enables efficient on-device adaptation with strong visual representations. However, prior HDC-based CL systems often depend on multi-tier memory hierarchies and complex cluster management, limiting deployability on resource-constrained hardware. We present ImageHD, an FPGA accelerator for on-device continual learning of visual data based on HDC. ImageHD targets streaming CL under strict latency and on-chip memory constraints, avoiding costly iterative optimization. At the algorithmic level, we introduce a hardware-aware CL method that bounds class exemplars through a unified exemplar memory and a hardware-efficient cluster merging strategy, while incorporating a quantized CNN front-end to reduce deployment overhead without sacrificing accuracy. At the system level, ImageHD is implemented as a streaming dataflow architecture on the AMD Zynq ZCU104 FPGA, integrating HDC encoding, similarity search, and bounded cluster management using word-packed binary hypervectors for massively parallel bitwise computation within tight on-chip resource budgets. On CORe50, ImageHD achieves up to 40.4x (4.84x) speedup and 383x (105.1x) energy efficiency over optimized CPU (GPU) baselines, demonstrating the practicality of HDC-enabled continual learning for real-time edge AI.
ImageHD:基于超维度计算的节能设备端视觉表征持续学习系统 / ImageHD: Energy-Efficient On-Device Continual Learning of Visual Representations via Hyperdimensional Computing
本文提出ImageHD,一种在FPGA上实现的超轻量级持续学习加速器,通过超维度计算和硬件协同设计,在资源有限的边缘设备上实现高效的视觉数据流式学习,相比CPU和GPU能效提升数百倍。
源自 arXiv: 2604.21280