TOFFEE演示:一种大规模合成数据智能体轨迹的学习系统 / Demonstrating TOFFEE: A Learned System for Synthesizing Data Agent Trajectories at Scale
1️⃣ 一句话总结
本文介绍TOFFEE系统,它利用蒙特卡洛树搜索和自适应模型选择,能够为不同数据环境自动生成高质量的智能体执行轨迹,这些轨迹可用于微调数据智能体模型或作为示例提示帮助通用大语言模型适应陌生分析任务。
LLM-powered data agents are playing an increasingly important role in data-driven decision making. However, existing data agents struggle to generalize to unseen data environments and analytical workflows, especially in heterogeneous enterprise settings. This creates a growing need for synthesizing high-quality data agent trajectories that capture complex analytical workflows for given data environments. Such trajectories support two key downstream uses: they can serve as supervised finetuning (SFT) data that adapts data agent models to the target domain, and as in-context learning (ICL) demonstrations to guide general-purpose LLMs in unfamiliar data environments. Thus, we introduce TOFFEE, a system for synthesizing high-quality data agent trajectories from given data environments via Monte Carlo Tree Search (MCTS) with adaptive model selection and cross-task prefix reuse. We show that TOFFEE can effectively generate scalable trajectory data for complex analytical tasks across heterogeneous environments. In this demonstration, we present the system framework of TOFFEE, including its task pool construction, trajectory explorer, and learned cost model. We also introduce the web interface of TOFFEE and its workflow, and demonstrate two end-to-end scenarios: trajectory synthesis for data agent finetuning, and demonstration-augmented data agent reasoning.
TOFFEE演示:一种大规模合成数据智能体轨迹的学习系统 / Demonstrating TOFFEE: A Learned System for Synthesizing Data Agent Trajectories at Scale
本文介绍TOFFEE系统,它利用蒙特卡洛树搜索和自适应模型选择,能够为不同数据环境自动生成高质量的智能体执行轨迹,这些轨迹可用于微调数据智能体模型或作为示例提示帮助通用大语言模型适应陌生分析任务。
源自 arXiv: 2607.06233