菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-13
📄 Abstract - BITS Pilani at SemEval-2026 Task 9: Structured Supervised Fine-Tuning with DPO Refinement for Polarization Detection

The POLAR SemEval-2026 Shared Task aims to detect online polarization and focuses on the classification and identification of multilingual, multicultural, and multi-event polarization. Accurate computational detection of online polarization is challenging due to nuanced rhetoric, implicit framing, and the high cost of human-in-the-loop annotation. Building on recent findings that contextual prompting enables large language models to function as strong polarization detectors, we present a two-stage approach for detecting political polarization in social media text that combines structured supervised fine-tuning with Direct Preference Optimization (DPO) refinement. We fine-tune Qwen 2.5-7B-Instruct with LoRA using an interpretable slot-filling template (target, claim type, manifestation checklist, and justification). We then apply DPO with automatically generated preference pairs to reduce costly false negatives. Experiments on the SemEval 2026 POLAR shared task dataset show that preference-based refinement improves both accuracy and decreases false negatives without extra annotation. On the English development set, DPO increases recall from 0.5085 to 0.7797 and improves macro-F1 by ~5 points.

顶级标签: llm natural language processing model training
详细标签: polarization detection preference optimization fine-tuning social media text classification 或 搜索:

BITS Pilani在SemEval-2026任务9中的工作:结合结构化监督微调与DPO优化的极化检测方法 / BITS Pilani at SemEval-2026 Task 9: Structured Supervised Fine-Tuning with DPO Refinement for Polarization Detection


1️⃣ 一句话总结

这篇论文提出了一种两阶段方法,先通过一个可解释的结构化模板对大型语言模型进行微调,再使用偏好优化技术自动减少误判,从而更准确、低成本地检测社交媒体文本中的政治极化现象。

源自 arXiv: 2604.11121