EvoPool:用于高效标签获取的进化式程序化标注框架 / EvoPool: Evolutionary Programmatic Annotation for Label-Efficient Specialized Supervision
1️⃣ 一句话总结
本文提出EvoPool框架,通过模拟达尔文进化过程,让多个AI智能体相互竞争、筛选并组合出高性能的自动标注程序,从而在生物医学、法律等专业领域中,用极少的标注成本生成大量高质量训练标签,显著超越直接用大模型标注的效果。
Large language models excel at general tasks but underperform smaller supervised models in specialized, high-stakes domains where training labels are costly. We address this regime with EvoPool, an evolutionary multi-agent framework inspired by Darwinian evolution. Three specialized agents iteratively propose executable annotator code, a small validation set provides a fitness signal, and a deterministic gate keeps only annotators that pass viability, diversity, and marginal-contribution checks across generations. Pool votes are mapped to soft training labels by EvoAgg, a text-aware aggregator combining semantic features with annotator-vote features. The authored pool runs at near-zero per-example cost and is 4500 to 31000x faster than LLM annotation on 100K examples. Across 7 of 8 LLM-weak specialized and complex tasks spanning biomedical relation extraction, legal-clause classification, complex reasoning, and dense multi-label biomedical classification, EvoPool beats the strongest LLM annotation baseline by an average +0.141 macro-F1, peaking at +0.301 on ChemProt and +0.265 on PubMed. Code is available at: this https URL
EvoPool:用于高效标签获取的进化式程序化标注框架 / EvoPool: Evolutionary Programmatic Annotation for Label-Efficient Specialized Supervision
本文提出EvoPool框架,通过模拟达尔文进化过程,让多个AI智能体相互竞争、筛选并组合出高性能的自动标注程序,从而在生物医学、法律等专业领域中,用极少的标注成本生成大量高质量训练标签,显著超越直接用大模型标注的效果。
源自 arXiv: 2606.01617