菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-20
📄 Abstract - FruitEnsemble: MLLM-Guided Arbitration for Heterogeneous ensemble in Fine-Grained Fruit Recognition

Fine-grained fruit classification is a critical yet challenging task in agricultural computer vision, primarily hindered by a severe shortage of high-quality datasets and the high visual similarity between classes. To address these challenges, we first constructed a comprehensive dataset comprising 306 fruit categories with 116,233 samples. Moreover, we propose FruitEnsemble, a practical two-stage dynamic inference framework designed to overcome the generalization limitations of static single-model architectures. In the first stage, FruitEnsemble employs a validation-calibrated weighted ensemble of heterogeneous backbones to generate a robust Top-3 candidate pool. To tackle difficult samples, we introduce an expert arbitration mechanism: when ensemble confidence falls below 0.6, a multimodal large language model (MLLM) is triggered to perform rigorous visual verification by integrating external botanical descriptions using Chain-of-Thought (CoT) reasoning. Furthermore, we optimized the training pipeline with a hard sample-aware joint loss. Extensive experiments demonstrate that FruitEnsemble achieves a classification accuracy of 70.49\% and outperforms existing state-of-the-art models. Our framework provides an efficient, deployment-oriented solution for real-world agricultural visual sorting and quality inspection tasks.

顶级标签: computer vision machine learning multi-modal
详细标签: fine-grained classification ensemble learning multimodal llm agriculture dataset 或 搜索:

FruitEnsemble:多模态大语言模型引导的异构集成方法在细粒度水果识别中的应用 / FruitEnsemble: MLLM-Guided Arbitration for Heterogeneous ensemble in Fine-Grained Fruit Recognition


1️⃣ 一句话总结

本文提出了一个两阶段动态推理框架FruitEnsemble,先通过多个不同视觉模型加权集成生成候选结果,当模型整体信心不足时,再调用多模态大语言模型结合植物知识进行深入验证,从而在仅有少量标注数据的情况下,显著提升对相似水果品种的识别准确率。

源自 arXiv: 2605.20892