菜单

关于 🐙 GitHub
arXiv 提交日期: 2025-12-11
📄 Abstract - From Macro to Micro: Benchmarking Microscopic Spatial Intelligence on Molecules via Vision-Language Models

This paper introduces the concept of Microscopic Spatial Intelligence (MiSI), the capability to perceive and reason about the spatial relationships of invisible microscopic entities, which is fundamental to scientific discovery. To assess the potential of Vision-Language Models (VLMs) in this domain, we propose a systematic benchmark framework MiSI-Bench. This framework features over 163,000 question-answer pairs and 587,000 images derived from approximately 4,000 molecular structures, covering nine complementary tasks that evaluate abilities ranging from elementary spatial transformations to complex relational identifications. Experimental results reveal that current state-of-the-art VLMs perform significantly below human level on this benchmark. However, a fine-tuned 7B model demonstrates substantial potential, even surpassing humans in spatial transformation tasks, while its poor performance in scientifically-grounded tasks like hydrogen bond recognition underscores the necessity of integrating explicit domain knowledge for progress toward scientific AGI. The datasets are available at this https URL.

顶级标签: multi-modal benchmark model evaluation
详细标签: vision-language models spatial reasoning molecular structures scientific ai fine-tuning 或 搜索:

从宏观到微观:基于视觉语言模型的分子微观空间智能基准测试 / From Macro to Micro: Benchmarking Microscopic Spatial Intelligence on Molecules via Vision-Language Models


1️⃣ 一句话总结

这篇论文提出了一个名为MiSI-Bench的基准测试框架,用于评估AI模型在理解分子等微观实体空间关系方面的能力,发现当前先进模型表现远不如人类,但经过专门训练的小模型在某些任务上能超越人类,不过在需要科学知识的任务上仍需结合领域知识才能取得进步。


源自 arXiv: 2512.10867