📄
Abstract - Towards Robust Deep Learning-based Rumex Obtusifolius Detection from Drone Images
Domain adaptation (DA) addresses the challenge of transferring a machine learning model trained on a source domain to a target domain with a different data distribution. In this work, we study DA for the task of Rumex obtusifolius (Rumex) image classification. We train models on a published, ground vehicle-based dataset (source) and evaluate their performance on a custom target dataset acquired by unmanned aerial vehicles (UAVs). We find that Convolutional Neural Network (CNN) models, specifically ResNets, generalize poorly to the target domain, even after fine-tuning on the source data. Applying moment-matching and maximum classifier discrepancy, two established DA techniques, substantially improves target-domain performance. However, Vision Transformer (ViT) models pretrained with self-supervised objectives (DINOv2, DINOv3) handle domain shifts intrinsically well, surpassing even moment-matching-trained ResNets, likely due to the rich, general-purpose representations acquired during large-scale pretraining. Using ViTs fine-tuned on the source dataset, we demonstrate high classification performances in the range of F1=0.8 on our target dataset. To support further research on DA for weed detection in grassland systems, we publicly release our UAV-based target dataset AGSMultiRumex, comprising data from 15 flights over Swiss meadows.
面向无人机图像的鲁棒深度学习阔叶酸模检测方法 /
Towards Robust Deep Learning-based Rumex Obtusifolius Detection from Drone Images
1️⃣ 一句话总结
本文研究了将地面车辆训练的深度学习模型迁移至无人机图像进行杂草检测的难题,发现传统卷积神经网络(如ResNet)在跨场景时表现不佳,而采用域自适应技术或自监督预训练的视觉Transformer(如DINOv2)能显著提升鲁棒性,并在新发布的瑞士草地无人机数据集上达到了F1=0.8的高分类性能。