StreamPPG:基于一致特权学习的低延迟远程光电容积描记法 / StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning
1️⃣ 一句话总结
本文提出一种名为StreamPPG的新型模型,通过逐帧处理视频并利用真实PPG信号作为辅助信息进行训练,在保持高精度的同时显著降低了远程心率监测的延迟,实现了实时应用。
Remote photoplethysmography (rPPG) estimates the blood volume pulse (BVP) signal from facial videos, enabling contact-free health monitoring. Conventional clip-wise approaches, which use video clips as input, require capturing over one hundred frames before inference, thus introducing several seconds of delay and hindering real-time use. Meanwhile, frame-wise approaches struggle to capture long-range temporal and periodic features of physiological rhythms, and therefore lead to reduced estimation accuracy. To overcome these issues, we propose StreamPPG, a unified architecture that enables low-latency frame-wise physiological signal estimation while achieving competitive accuracy compared with clip-wise approaches. StreamPPG is trained under a consistent privileged learning (CPL) strategy, which leverages ground-truth rPPG signals as privileged information to enhance the model's representation capability. Extensive experiments demonstrate that StreamPPG achieves state-of-the-art accuracy across multiple datasets while maintaining real-time throughput on edge devices.
StreamPPG:基于一致特权学习的低延迟远程光电容积描记法 / StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning
本文提出一种名为StreamPPG的新型模型,通过逐帧处理视频并利用真实PPG信号作为辅助信息进行训练,在保持高精度的同时显著降低了远程心率监测的延迟,实现了实时应用。
源自 arXiv: 2606.23186