ErrorLLM:为文本到SQL的查询修正任务建立SQL错误模型 / ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement
1️⃣ 一句话总结
这篇论文提出了一个名为ErrorLLM的新框架,它通过专门训练一个大语言模型来识别和分类文本转SQL过程中产生的各种隐藏错误,并利用这些错误信息来精准地修正SQL查询语句,从而显著提升了生成SQL的准确率。
Despite the remarkable performance of large language models (LLMs) in text-to-SQL (SQL generation), correctly producing SQL queries remains challenging during initial generation. The SQL refinement task is subsequently introduced to correct syntactic and semantic errors in generated SQL queries. However, existing paradigms face two major limitations: (i) self-debugging becomes increasingly ineffective as modern LLMs rarely produce explicit execution errors that can trigger debugging signals; (ii) self-correction exhibits low detection precision due to the lack of explicit error modeling grounded in the question and schema, and suffers from severe hallucination that frequently corrupts correct SQLs. In this paper, we propose ErrorLLM, a framework that explicitly models text-to-SQL Errors within a dedicated LLM for text-to-SQL refinement. Specifically, we represent the user question and database schema as structural features, employ static detection to identify execution failures and surface mismatches, and extend ErrorLLM's semantic space with dedicated error tokens that capture categorized implicit semantic error types. Through a well-designed training strategy, we explicitly model these errors with structural representations, enabling the LLM to detect complex implicit errors by predicting dedicated error tokens. Guided by the detected errors, we perform error-guided refinement on the SQL structure by prompting LLMs. Extensive experiments demonstrate that ErrorLLM achieves the most significant improvements over backbone initial generation. Further analysis reveals that detection quality directly determines refinement effectiveness, and ErrorLLM addresses both sides by high detection F1 score while maintain refinement effectiveness.
ErrorLLM:为文本到SQL的查询修正任务建立SQL错误模型 / ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement
这篇论文提出了一个名为ErrorLLM的新框架,它通过专门训练一个大语言模型来识别和分类文本转SQL过程中产生的各种隐藏错误,并利用这些错误信息来精准地修正SQL查询语句,从而显著提升了生成SQL的准确率。
源自 arXiv: 2603.03742