菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-02
📄 Abstract - Physics Informed Generative AI Enabling Labour Free Segmentation For Microscopy Analysis

Semantic segmentation of microscopy images is a critical task for high-throughput materials characterisation, yet its automation is severely constrained by the prohibitive cost, subjectivity, and scarcity of expert-annotated data. While physics-based simulations offer a scalable alternative to manual labelling, models trained on such data historically fail to generalise due to a significant domain gap, lacking the complex textures, noise patterns, and imaging artefacts inherent to experimental data. This paper introduces a novel framework for labour-free segmentation that successfully bridges this simulation-to-reality gap. Our pipeline leverages phase-field simulations to generate an abundant source of microstructural morphologies with perfect, intrinsically-derived ground-truth masks. We then employ a Cycle-Consistent Generative Adversarial Network (CycleGAN) for unpaired image-to-image translation, transforming the clean simulations into a large-scale dataset of high-fidelity, realistic SEM images. A U-Net model, trained exclusively on this synthetic data, demonstrated remarkable generalisation when deployed on unseen experimental images, achieving a mean Boundary F1-Score of 0.90 and an Intersection over Union (IOU) of 0.88. Comprehensive validation using t-SNE feature-space projection and Shannon entropy analysis confirms that our synthetic images are statistically and featurally indistinguishable from the real data manifold. By completely decoupling model training from manual annotation, our generative framework transforms a data-scarce problem into one of data abundance, providing a robust and fully automated solution to accelerate materials discovery and analysis.

顶级标签: computer vision model training multi-modal
详细标签: image segmentation generative adversarial networks domain adaptation materials science microscopy 或 搜索:

物理信息生成式人工智能实现显微镜分析的免人工分割 / Physics Informed Generative AI Enabling Labour Free Segmentation For Microscopy Analysis


1️⃣ 一句话总结

这篇论文提出了一种新方法,通过结合物理模拟和生成式人工智能,自动生成大量逼真的显微镜图像数据来训练分割模型,从而完全摆脱了对昂贵且稀缺的人工标注数据的依赖,成功实现了对真实实验图像的高精度自动分割。

源自 arXiv: 2602.01710