菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-07-06
📄 Abstract - Probing Geospatial SSL Representations with Environmental Signals

Self-supervised learning (SSL) is designed to learn generic, transferable representations rather than representations optimized for a single task. Most geospatial benchmarks evaluate representations solely through downstream tasks, providing limited insight into the information encoded within the representation itself. We ask a different question: do SSL representations of satellite imagery preserve statistical associations with environmental variables that co-vary with the imaging process? To answer this question, we probe SSL representations using co-located ERA5 reanalysis variables, a global dataset of physically consistent environmental variables, including temperature, precipitation, surface solar radiation, surface pressure, and volumetric soil water. These variables are physically related to the spectral reflectance and radar backscatter recorded by Sentinel-1 and Sentinel-2, making them meaningful evaluation targets despite not being used during SSL pretraining. We complement this probing analysis with intrinsic representation metrics to characterize representation geometry and investigate how these properties relate to downstream performance and the encoding of environmental signals. Using DINO, MAE, and MoCo models trained under identical conditions, we show that representation-level metrics distinguish models with similar downstream benchmark performance, providing complementary information beyond task-driven benchmarks. We further find that the linear accessibility of environmental signals is associated with performance on environmentally dependent tasks in the PANGAEA benchmark. Finally, we release ERA5 annotations co-located with the SSL4EO dataset to enable physically grounded representation evaluation for future geospatial foundation models.

顶级标签: machine learning multi-modal model evaluation
详细标签: self-supervised learning geospatial satellite imagery probing representation learning 或 搜索:

利用环境信号探测地理空间自监督学习表示 / Probing Geospatial SSL Representations with Environmental Signals


1️⃣ 一句话总结

本文通过分析卫星图像的自监督学习模型能否捕捉温度、降水等真实环境变量,提出了一种基于物理环境信号的评估方法,帮助理解模型学到了什么,而不只是看它在任务上的表现。

源自 arXiv: 2607.05207