神经引导的进化视频合成:用于动态视觉选择性研究 / NEvo: Neural-Guided Evolutionary Video Synthesis for Dynamic Visual Selectivity
1️⃣ 一句话总结
本文提出了一种名为NEvo的新方法,通过结合神经网络预测模型和进化搜索算法,自动生成能高效激活大脑视觉皮层不同区域的动态视频,从而帮助科学家更深入地研究大脑如何处理运动和时间变化的视觉信息。
The human brain processes dynamic visual input through hierarchically organized, functionally specialized regions. While recent in silico brain encoding models can synthesize optimal stimuli to probe selectivity in different brain regions, prior work has been largely limited to static images, leaving dynamic visual processing underexplored. We introduce a novel neural-guided video synthesis framework that generates stimuli optimized for target brain regions across visual cortex. Our method performs evolutionary search over a structured prompt space, guided by a dynamic encoding model that predicts voxel-level responses to video inputs. By maximizing predicted activity for a target ROI, the framework efficiently discovers hyper-activating dynamic stimuli that consistently surpass handcrafted localizer videos. The synthesized videos recover known selectivities across ventral, dorsal, and lateral pathways, and further reveal systematic differences in sensitivity to temporal dynamics. A searchlight analysis provides new insight into the progression toward increasingly complex social-dynamic features along the lateral stream, further supported by probing with synthesized abstract, non-naturalistic stimuli. Taken together, our framework enables in silico exploration of dynamic visual selectivity, with new predictions for in vivo experiments
神经引导的进化视频合成:用于动态视觉选择性研究 / NEvo: Neural-Guided Evolutionary Video Synthesis for Dynamic Visual Selectivity
本文提出了一种名为NEvo的新方法,通过结合神经网络预测模型和进化搜索算法,自动生成能高效激活大脑视觉皮层不同区域的动态视频,从而帮助科学家更深入地研究大脑如何处理运动和时间变化的视觉信息。
源自 arXiv: 2607.02317