菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-25
📄 Abstract - TopoAlign: Topology-Aware Visual Representation Alignment

Neural networks encode inputs as high-dimensional vectors, known as representations, that capture how models process data by encoding task-relevant structure and semantics. Representation alignment refers to the degree to which different models, layers, or training conditions produce similar representations for the same inputs, with important implications for model interpretation, selection, and robustness analysis. Existing approaches to measure alignment primarily rely on geometric properties, such as neighborhood and cluster similarity, offering limited insight into the global organization of representations. In this work, we present TopoAlign, a topology-aware framework for visually comparing model representations from a structural perspective. Leveraging mapper graphs from topological data analysis, TopoAlign jointly analyzes graphs constructed from representations of shared inputs across different models or layers. The framework supports a top-down comparative workflow: it first performs global structure alignment via joint force-directed optimization to produce coordinated graph layouts; it then identifies local correspondences through automated detection of structurally matching regions, visualized with Bubble Sets; and finally it enables fine-grained pattern inspection through motif-based queries and membrane-inspired visualizations. We demonstrate TopoAlign through case studies on language and multimodal models, complemented by expert feedback. Our results show that TopoAlign provides meaningful insights into representation structure and alignment from a topological perspective.

顶级标签: machine learning model evaluation multi-modal
详细标签: representation alignment topological data analysis visualization mapper graphs model comparison 或 搜索:

TopoAlign:拓扑感知的视觉表征对齐方法 / TopoAlign: Topology-Aware Visual Representation Alignment


1️⃣ 一句话总结

本文提出了一种名为TopoAlign的拓扑感知框架,通过拓扑数据分析中的映射图来比较不同神经网络模型或层之间的表征结构,实现从全局布局到局部区域的可视化对齐,从而帮助研究者更直观地理解模型如何以拓扑方式组织信息。

源自 arXiv: 2605.25541