菜单

🤖 系统
📄 Abstract - SAM 3: Segment Anything with Concepts

We present Segment Anything Model (SAM) 3, a unified model that detects, segments, and tracks objects in images and videos based on concept prompts, which we define as either short noun phrases (e.g., "yellow school bus"), image exemplars, or a combination of both. Promptable Concept Segmentation (PCS) takes such prompts and returns segmentation masks and unique identities for all matching object instances. To advance PCS, we build a scalable data engine that produces a high-quality dataset with 4M unique concept labels, including hard negatives, across images and videos. Our model consists of an image-level detector and a memory-based video tracker that share a single backbone. Recognition and localization are decoupled with a presence head, which boosts detection accuracy. SAM 3 doubles the accuracy of existing systems in both image and video PCS, and improves previous SAM capabilities on visual segmentation tasks. We open source SAM 3 along with our new Segment Anything with Concepts (SA-Co) benchmark for promptable concept segmentation.

顶级标签: computer vision multi-modal model training
详细标签: concept segmentation object tracking promptable segmentation video segmentation benchmark 或 搜索:

📄 论文总结

SAM 3:基于概念提示的通用分割模型 / SAM 3: Segment Anything with Concepts


1️⃣ 一句话总结

这篇论文提出了SAM 3模型,它能够根据简单的名词短语或示例图片作为概念提示,自动检测、分割并追踪图像和视频中的物体,其准确率比现有系统提高了一倍,并开源了模型和新的评测基准。


📄 打开原文 PDF