创造即所得:在广义少样本语义分割中利用合成图像实现真实性能提升 / Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation
1️⃣ 一句话总结
这篇论文提出了一个名为Syn4Seg的新方法,它通过巧妙地合成大量新类别图像并结合多阶段伪标签优化技术,有效解决了广义少样本语义分割中因新类别样本稀缺和标注质量差导致的性能瓶颈问题。
Generalized few-shot semantic segmentation (GFSS) is fundamentally limited by the coverage of novel-class appearances under scarce annotations. While diffusion models can synthesize novel-class images at scale, practical gains are often hindered by insufficient coverage and noisy supervision when masks are unavailable or unreliable. We propose Syn4Seg, a generation-enhanced GFSS framework designed to expand novel-class coverage while improving pseudo-label quality. Syn4Seg first maximizes prompt-space coverage by constructing an embedding-deduplicated prompt bank for each novel class, yielding diverse yet class-consistent synthetic images. It then performs support-guided pseudo-label estimation via a two-stage refinement that i) filters low-consistency regions to obtain high-precision seeds and ii) relabels uncertain pixels with image-adaptive prototypes that combine global (support) and local (image) statistics. Finally, we refine only boundary-band and unlabeled pixels using a constrained SAM-based update to improve contour fidelity without overwriting high-confidence interiors. Extensive experiments on PASCAL-$5^i$ and COCO-$20^i$ demonstrate consistent improvements in both 1-shot and 5-shot settings, highlighting synthetic data as a scalable path for GFSS with reliable masks and precise boundaries.
创造即所得:在广义少样本语义分割中利用合成图像实现真实性能提升 / Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation
这篇论文提出了一个名为Syn4Seg的新方法,它通过巧妙地合成大量新类别图像并结合多阶段伪标签优化技术,有效解决了广义少样本语义分割中因新类别样本稀缺和标注质量差导致的性能瓶颈问题。
源自 arXiv: 2603.27206