📄
Abstract - AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization
Expensive optimization tasks are ubiquitous in real-world applications, demanding highly specialized solvers. While LLM-driven automated solver generation shows promise, current paradigms face three critical issues when tackling expensive optimization: factual hallucinations due to deficient domain knowledge, the frequent dismantling of previously established locally optimal structures during refinement, and the prohibitive evaluation costs alongside restricted generalization caused by executing on training instances. To address these issues, we introduce AutoSG, a fully automated workflow directly translating natural language prompts into executable customized solvers. AutoSG features three core innovations: a retrieval-augmented solver generation module strictly grounding code in verified literature; a one-step self-refinement operator introducing task-specific improvements while preserving critical structural components; and an instance-free Elo-based LLM-as-a-Judge evaluation mechanism rapidly establishing global rankings. Extensive evaluations across diverse expensive optimization tasks confirm AutoSG significantly outperforms human-designed state-of-the-art frameworks and existing LLM-generated solvers.
AutoSG:仅从任务提示出发、由大语言模型驱动的昂贵优化问题求解器自动生成方法 /
AutoSG: LLM-Driven Solver Generation Solely from Task Prompts for Expensive Optimization
1️⃣ 一句话总结
本文提出一种名为AutoSG的自动化框架,它能直接将用户用自然语言描述的任务要求转化为专用于昂贵优化问题的高效求解器,通过引用已验证文献来避免幻觉、一次性的自优化来保留已有优秀结构,以及利用无需真实算例的大语言模型评分机制快速比较不同求解器的优劣,从而在多个实际任务上超越人工设计的顶尖方法和现有自动生成方案。