菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-05-26
📄 Abstract - LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation

Personalized generation with frozen large language models requires a conditioning signal that is both compact and current. Existing personalization methods typically retrieve or summarize user histories in text, or compress them into static latent profiles and soft prompts. These approaches are efficient, but they treat a user's past behavior as an aggregate profile and therefore mix stable identity, recent drift, and item content in the same representation. We propose LAtent Trajectory Tracking and Extrapolation (LATTE), a framework that represents personalization as forecasting a peer anchored relative preference state. For each historical session, LATTE subtracts a time masked baseline formed from comparable users who responded to the same item, producing a state that measures how the target user differs from peers under a shared item context. A lightweight sequence predictor then forecasts the next state in this trajectory, and a State to Token Bridge injects the forecast into a frozen instruction tuned LLM through a single anchored soft token. We provide a latent factor analysis showing when peer anchoring cancels shared item variation and why temporal forecasting trades off stale averages against noisy recent states. Experiments on Amazon Reviews 2023 and MemoryCD show that LATTE consistently outperforms retrieval, summary memory, static latent profiles, difference aware latent profiles, and soft prompt compression baselines. On Amazon Reviews 2023, LATTE improves average ROUGE-L from 0.219 for a static latent profile and 0.245 for the strongest added latent compression baseline to 0.259. Additional pairwise comparisons and diagnostic analyses suggest that the improvement is mainly due to forecasting user-specific trajectory information, rather than merely adding a soft prompt interface.

顶级标签: llm personalization
详细标签: preference trajectory peer anchoring latent state soft prompt forecasting 或 搜索:

LATTE:预测同伴锚定偏好轨迹以实现个性化大语言模型生成 / LATTE: Forecasting Peer Anchored Preference Trajectories for Personalized LLM Generation


1️⃣ 一句话总结

本文提出LATTE框架,通过对比用户与同类人群对同一物品的偏好差异,预测用户偏好的变化轨迹,并将这种动态信息以轻量方式注入大语言模型,从而生成更精准的个性化内容,在多个评测中显著优于现有方法。

源自 arXiv: 2605.26612