菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-19
📄 Abstract - MatPhys: Learning Material-Aware Physics Parameters for Deformable Object Simulation from Videos

Reconstructing simulation-ready deformable objects is important for vision, graphics, and robotics. Existing physics-driven methods can recover physical digital twins from videos, but they suffer from two fundamental limitations: they typically assume a homogeneous material across the whole object, and their scene-specific inverse optimization, combined with the inherent ambiguity of monocular observation, yields inconsistent parameters for the same material across different scenes or interactions. We propose MatPhys, a material-aware feed-forward framework that predicts spring-mass parameters from a single-view video, addressing these two issues with two coupled designs. To relax the homogeneous material assumption, we use DINO features to decompose the object into semantically meaningful parts and to query a part-level material prior, assigning each part its own physical behavior. To enforce cross-scene consistency, we introduce a learned material codebook of shared material embeddings as the bridge between appearance and physics, and further use the part-level prior as a reference distribution that constrains the decoder so that the same material yields consistent parameters across scenes and interactions. Together, these designs turn an under-constrained monocular problem into feed-forward inference grounded on shared, reusable material concepts. Experiments show that our method matches per-scene optimization baselines in reconstruction and future prediction, while achieving stronger generalization to unseen interactions and objects with more consistent physical parameters.

顶级标签: computer vision machine learning robotics
详细标签: deformable objects physics parameters video reconstruction material learning spring-mass model 或 搜索:

MatPhys:从视频中学习可变形物体模拟的材料感知物理参数 / MatPhys: Learning Material-Aware Physics Parameters for Deformable Object Simulation from Videos


1️⃣ 一句话总结

本文提出了一种名为MatPhys的新方法,能从单视角视频中自动预测可变形物体的物理参数,通过将物体分解为不同材料区域并使用共享材料代码库,实现了跨场景一致的物理仿真,无需针对每个场景单独优化。

源自 arXiv: 2605.19386