DragMesh:让交互式3D生成变得简单 / DragMesh: Interactive 3D Generation Made Easy
1️⃣ 一句话总结
这篇论文提出了一个名为DragMesh的实时交互式3D物体运动生成框架,它通过将关节参数推理与运动生成解耦,并利用创新的神经网络结构,实现了既能快速响应又能严格遵守物理运动规律的逼真3D物体操控。
While generative models have excelled at creating static 3D content, the pursuit of systems that understand how objects move and respond to interactions remains a fundamental challenge. Current methods for articulated motion lie at a crossroads: they are either physically consistent but too slow for real-time use, or generative but violate basic kinematic constraints. We present DragMesh, a robust framework for real-time interactive 3D articulation built around a lightweight motion generation core. Our core contribution is a novel decoupled kinematic reasoning and motion generation framework. First, we infer the latent joint parameters by decoupling semantic intent reasoning (which determines the joint type) from geometric regression (which determines the axis and origin using our Kinematics Prediction Network (KPP-Net)). Second, to leverage the compact, continuous, and singularity-free properties of dual quaternions for representing rigid body motion, we develop a novel Dual Quaternion VAE (DQ-VAE). This DQ-VAE receives these predicted priors, along with the original user drag, to generate a complete, plausible motion trajectory. To ensure strict adherence to kinematics, we inject the joint priors at every layer of the DQ-VAE's non-autoregressive Transformer decoder using FiLM (Feature-wise Linear Modulation) conditioning. This persistent, multi-scale guidance is complemented by a numerically-stable cross-product loss to guarantee axis alignment. This decoupled design allows DragMesh to achieve real-time performance and enables plausible, generative articulation on novel objects without retraining, offering a practical step toward generative 3D intelligence. Code: this https URL. Website: this https URL.
DragMesh:让交互式3D生成变得简单 / DragMesh: Interactive 3D Generation Made Easy
这篇论文提出了一个名为DragMesh的实时交互式3D物体运动生成框架,它通过将关节参数推理与运动生成解耦,并利用创新的神经网络结构,实现了既能快速响应又能严格遵守物理运动规律的逼真3D物体操控。
源自 arXiv: 2512.06424