大语言模型能帮你整理数据吗?——基于LLM的应用就绪数据准备方法综述 / Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs
1️⃣ 一句话总结
这篇论文系统性地综述了如何利用大语言模型来高效地清洗、整合和丰富原始数据,使其能直接用于分析和决策,并分析了该领域从传统规则驱动到智能体驱动的工作流程转变、现有方法的优势与局限以及未来的研究方向。
Data preparation aims to denoise raw datasets, uncover cross-dataset relationships, and extract valuable insights from them, which is essential for a wide range of data-centric applications. Driven by (i) rising demands for application-ready data (e.g., for analytics, visualization, decision-making), (ii) increasingly powerful LLM techniques, and (iii) the emergence of infrastructures that facilitate flexible agent construction (e.g., using Databricks Unity Catalog), LLM-enhanced methods are rapidly becoming a transformative and potentially dominant paradigm for data preparation. By investigating hundreds of recent literature works, this paper presents a systematic review of this evolving landscape, focusing on the use of LLM techniques to prepare data for diverse downstream tasks. First, we characterize the fundamental paradigm shift, from rule-based, model-specific pipelines to prompt-driven, context-aware, and agentic preparation workflows. Next, we introduce a task-centric taxonomy that organizes the field into three major tasks: data cleaning (e.g., standardization, error processing, imputation), data integration (e.g., entity matching, schema matching), and data enrichment (e.g., data annotation, profiling). For each task, we survey representative techniques, and highlight their respective strengths (e.g., improved generalization, semantic understanding) and limitations (e.g., the prohibitive cost of scaling LLMs, persistent hallucinations even in advanced agents, the mismatch between advanced methods and weak evaluation). Moreover, we analyze commonly used datasets and evaluation metrics (the empirical part). Finally, we discuss open research challenges and outline a forward-looking roadmap that emphasizes scalable LLM-data systems, principled designs for reliable agentic workflows, and robust evaluation protocols.
大语言模型能帮你整理数据吗?——基于LLM的应用就绪数据准备方法综述 / Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs
这篇论文系统性地综述了如何利用大语言模型来高效地清洗、整合和丰富原始数据,使其能直接用于分析和决策,并分析了该领域从传统规则驱动到智能体驱动的工作流程转变、现有方法的优势与局限以及未来的研究方向。
源自 arXiv: 2601.17058