菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-22
📄 Abstract - PerSoMed: A Large-Scale Balanced Dataset for Persian Social Media Text Classification

This research introduces the first large-scale, well-balanced Persian social media text classification dataset, specifically designed to address the lack of comprehensive resources in this domain. The dataset comprises 36,000 posts across nine categories (Economic, Artistic, Sports, Political, Social, Health, Psychological, Historical, and Science & Technology), each containing 4,000 samples to ensure balanced class distribution. Data collection involved 60,000 raw posts from various Persian social media platforms, followed by rigorous preprocessing and hybrid annotation combining ChatGPT-based few-shot prompting with human verification. To mitigate class imbalance, we employed undersampling with semantic redundancy removal and advanced data augmentation strategies integrating lexical replacement and generative prompting. We benchmarked several models, including BiLSTM, XLM-RoBERTa (with LoRA and AdaLoRA adaptations), FaBERT, SBERT-based architectures, and the Persian-specific TookaBERT (Base and Large). Experimental results show that transformer-based models consistently outperform traditional neural networks, with TookaBERT-Large achieving the best performance (Precision: 0.9622, Recall: 0.9621, F1- score: 0.9621). Class-wise evaluation further confirms robust performance across all categories, though social and political texts exhibited slightly lower scores due to inherent ambiguity. This research presents a new high-quality dataset and provides comprehensive evaluations of cutting-edge models, establishing a solid foundation for further developments in Persian NLP, including trend analysis, social behavior modeling, and user classification. The dataset is publicly available to support future research endeavors.

顶级标签: natural language processing data model evaluation
详细标签: text classification dataset persian language social media transformer models 或 搜索:

PerSoMed:一个用于波斯语社交媒体文本分类的大规模平衡数据集 / PerSoMed: A Large-Scale Balanced Dataset for Persian Social Media Text Classification


1️⃣ 一句话总结

这项研究创建了首个大规模且类别均衡的波斯语社交媒体文本分类数据集,并通过实验证明,基于Transformer的先进模型在该数据集上能取得优异的分类效果,为波斯语自然语言处理研究提供了重要的数据基础和性能基准。

源自 arXiv: 2602.19333