DEI:用于质量多样性搜索的进化推理多样性框架 / DEI: Diversity in Evolutionary Inference for Quality-Diversity Search
1️⃣ 一句话总结
本文提出DEI框架,通过让多个不同类型的大语言模型在分布式系统中协作搜索,利用它们各自的独特创造力来生成更多样、更优质的解决方案,实验证明模型多样性比单纯增加计算资源更能提升搜索性能。
We present DEI: Diversity in Evolutionary Inference, a distributed Quality-Diversity (QD) search framework that assigns heterogeneous large language models (LLMs) as mutation operators across peer nodes communicating with non-blocking collective operations. Unlike homogeneous parallel search, which replicates a single model's inductive biases across all workers, DEI treats each LLM's distinct creative prior as a complementary source of behavioral novelty. Extending the Digital Red Queen framework with DEI, nodes share local optimal solutions at the end of each round to seed the next round's population. This creates cross-model adversarial pressure that drives robustness beyond intra-model self-play. Evaluated on the Core War domain, a competitive programming benchmark in which Redcode warrior programs battle inside a simulated machine, a four-node heterogeneous ensemble (GPT-5.4-mini, Claude Sonnet 4.6, GPT-5.2, and Claude Haiku 4.5) achieves 124 percent higher merged-archive QD-Score (45.90 vs. 20.46) and 28 percent higher coverage (80.6 percent vs. 63.0 percent of cells) than a single-node baseline at equal total LLM-call budget. The heterogeneous ensemble also outperforms an equally-budgeted homogeneous ensemble on QD-Score, coverage, and held-out solution generality across all four model families. These results provide the first empirical evidence that model diversity, not merely parallelism, is the key driver of gain in distributed LLM-based QD search.
DEI:用于质量多样性搜索的进化推理多样性框架 / DEI: Diversity in Evolutionary Inference for Quality-Diversity Search
本文提出DEI框架,通过让多个不同类型的大语言模型在分布式系统中协作搜索,利用它们各自的独特创造力来生成更多样、更优质的解决方案,实验证明模型多样性比单纯增加计算资源更能提升搜索性能。
源自 arXiv: 2605.27130