菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-06-01
📄 Abstract - EvoPool: Evolutionary Programmatic Annotation for Label-Efficient Specialized Supervision

Large language models excel at general tasks but underperform smaller supervised models in specialized, high-stakes domains where training labels are costly. We address this regime with EvoPool, an evolutionary multi-agent framework inspired by Darwinian evolution. Three specialized agents iteratively propose executable annotator code, a small validation set provides a fitness signal, and a deterministic gate keeps only annotators that pass viability, diversity, and marginal-contribution checks across generations. Pool votes are mapped to soft training labels by EvoAgg, a text-aware aggregator combining semantic features with annotator-vote features. The authored pool runs at near-zero per-example cost and is 4500 to 31000x faster than LLM annotation on 100K examples. Across 7 of 8 LLM-weak specialized and complex tasks spanning biomedical relation extraction, legal-clause classification, complex reasoning, and dense multi-label biomedical classification, EvoPool beats the strongest LLM annotation baseline by an average +0.141 macro-F1, peaking at +0.301 on ChemProt and +0.265 on PubMed. Code is available at: this https URL

顶级标签: natural language processing agent llm
详细标签: annotation evolutionary framework label efficiency biomedical multi-agents 或 搜索:

EvoPool:用于高效标签获取的进化式程序化标注框架 / EvoPool: Evolutionary Programmatic Annotation for Label-Efficient Specialized Supervision


1️⃣ 一句话总结

本文提出EvoPool框架,通过模拟达尔文进化过程,让多个AI智能体相互竞争、筛选并组合出高性能的自动标注程序,从而在生物医学、法律等专业领域中,用极少的标注成本生成大量高质量训练标签,显著超越直接用大模型标注的效果。

源自 arXiv: 2606.01617