菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-20
📄 Abstract - Learning to Think in Physics: Breaking Shortcut Learning in Scientific Diffusion via Representation Alignment

Physics-informed diffusion models typically enforce PDE constraints only on final outputs, leaving intermediate representations unconstrained and prone to shortcut learning under shifted boundary conditions. We introduce **REPA-P**, a teacher-free, architecture-agnostic framework that aligns intermediate features with physical states using first-principles residuals. REPA-P attaches lightweight $1{\times}1$ projection heads to selected layers, decodes hidden activations into physical quantities, and applies PDE residual losses during training. These heads are discarded at inference, introducing **zero overhead**. Across four PDE tasks, including Darcy flow, topology optimization, electrostatic potential, and turbulent channel flow, REPA-P accelerates convergence by up to $2{\times}$, reduces physics residuals by up to $66.4\%$, and improves out-of-distribution robustness by up to $49.3\%$, with consistent gains on both U-Net and Diffusion Transformer backbones. Ablations show that supervising a small set of intermediate layers captures most benefits and complements output-level physics losses. Code is available at [this https URL](this https URL).

顶级标签: machine learning systems
详细标签: physics-informed diffusion representation alignment pde residual loss shortcut learning zero overhead inference 或 搜索:

在物理中学会思考:通过表征对齐打破科学扩散模型中的捷径学习 / Learning to Think in Physics: Breaking Shortcut Learning in Scientific Diffusion via Representation Alignment


1️⃣ 一句话总结

这篇论文提出了一种名为REPA-P的新方法,通过在训练时对扩散模型的中间层施加物理约束,让模型不仅关注最终结果,更学会理解物理过程,从而在不增加推理计算量的情况下,显著提升求解偏微分方程的精度、训练速度和应对不同边界条件的鲁棒性。

源自 arXiv: 2605.20780