基于组合可解释性的内在概念提取 / Intrinsic Concept Extraction Based on Compositional Interpretability
1️⃣ 一句话总结
这篇论文提出了一种名为HyperExpress的新方法,能够从单张图片中自动分解并提取出可组合的物体级和属性级概念,使得原始图像可以通过这些概念的组合来重建,从而提升了概念提取的可解释性和组合能力。
Unsupervised Concept Extraction aims to extract concepts from a single image; however, existing methods suffer from the inability to extract composable intrinsic concepts. To address this, this paper introduces a new task called Compositional and Interpretable Intrinsic Concept Extraction (CI-ICE). The CI-ICE task aims to leverage diffusion-based text-to-image models to extract composable object-level and attribute-level concepts from a single image, such that the original concept can be reconstructed through the combination of these concepts. To achieve this goal, we propose a method called HyperExpress, which addresses the CI-ICE task through two core aspects. Specifically, first, we propose a concept learning approach that leverages the inherent hierarchical modeling capability of hyperbolic space to achieve accurate concept disentanglement while preserving the hierarchical structure and relational dependencies among concepts; second, we introduce a concept-wise optimization method that maps the concept embedding space to maintain complex inter-concept relationships while ensuring concept composability. Our method demonstrates outstanding performance in extracting compositionally interpretable intrinsic concepts from a single image.
基于组合可解释性的内在概念提取 / Intrinsic Concept Extraction Based on Compositional Interpretability
这篇论文提出了一种名为HyperExpress的新方法,能够从单张图片中自动分解并提取出可组合的物体级和属性级概念,使得原始图像可以通过这些概念的组合来重建,从而提升了概念提取的可解释性和组合能力。
源自 arXiv: 2603.11795