分布感知的扩散-大语言模型用于稳健的超长期时间序列预测 / Distribution-Aware Diffusion-LLM for Robust Ultra-Long-Term Time Series Forecasting
1️⃣ 一句话总结
这篇论文提出了一种结合条件扩散模型与大语言模型的新框架,通过让大语言模型同时学习未来数据的概率分布和语义对齐,显著提升了在超长期和少量样本场景下时间序列预测的准确性和稳健性。
Time series forecasting is a fundamental machine learning task. Recent work has explored Large Language Models (LLMs) for this purpose due to their strong generalization, pattern recognition, and zero-shot or few-shot capabilities. Despite their suitability for long-context learning, LLMs face challenges in multimodal settings: they lack calibrated probabilistic modeling for non-text data and struggle to align heterogeneous representations. To address these issues, we propose a new framework Diffusion-LLM that integrates a conditional diffusion model into an LLM-based forecasting pipeline. This joint design enables learning the conditional distribution of future data while improving semantic alignment in a shared latent space. We evaluate Diffusion-LLM on six long-term forecasting benchmarks, including ETT, Weather, and ECL. Our method consistently outperforms existing LLM-based baseline, achieving notable gains in ultra-long-term and few-shot forecasting and demonstrating the value of distribution-aware regularization for enhancing robustness and generalization in time series LLMs.
分布感知的扩散-大语言模型用于稳健的超长期时间序列预测 / Distribution-Aware Diffusion-LLM for Robust Ultra-Long-Term Time Series Forecasting
这篇论文提出了一种结合条件扩散模型与大语言模型的新框架,通过让大语言模型同时学习未来数据的概率分布和语义对齐,显著提升了在超长期和少量样本场景下时间序列预测的准确性和稳健性。
源自 arXiv: 2606.23391