菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-02-05
📄 Abstract - A Mixed Reality System for Robust Manikin Localization in Childbirth Training

Opportunities for medical students to gain practical experience in vaginal births are increasingly constrained by shortened clinical rotations, patient reluctance, and the unpredictable nature of labour. To alleviate clinicians' instructional burden and enhance trainees' learning efficiency, we introduce a mixed reality (MR) system for childbirth training that combines virtual guidance with tactile manikin interaction, thereby preserving authentic haptic feedback while enabling independent practice without continuous on-site expert supervision. The system extends the passthrough capability of commercial head-mounted displays (HMDs) by spatially calibrating an external RGB-D camera, allowing real-time visual integration of physical training objects. Building on this capability, we implement a coarse-to-fine localization pipeline that first aligns the maternal manikin with fiducial markers to define a delivery region and then registers the pre-scanned neonatal head within this area. This process enables spatially accurate overlay of virtual guiding hands near the manikin, allowing trainees to follow expert trajectories reinforced by haptic interaction. Experimental evaluations demonstrate that the system achieves accurate and stable manikin localization on a standalone headset, ensuring practical deployment without external computing resources. A large-scale user study involving 83 fourth-year medical students was subsequently conducted to compare MR-based and virtual reality (VR)-based childbirth training. Four senior obstetricians independently assessed performance using standardized criteria. Results showed that MR training achieved significantly higher scores in delivery, post-delivery, and overall task performance, and was consistently preferred by trainees over VR training.

顶级标签: medical systems multi-modal
详细标签: mixed reality medical training augmented reality surgical simulation haptic feedback 或 搜索:

用于分娩训练中稳健人体模型定位的混合现实系统 / A Mixed Reality System for Robust Manikin Localization in Childbirth Training


1️⃣ 一句话总结

这项研究开发了一套混合现实分娩训练系统,它通过外部摄像头和算法精准定位物理人体模型,让医学生能在没有专家全程监督的情况下,结合虚拟指导和真实触感进行独立练习,显著提升了训练效果和学员偏好。

源自 arXiv: 2602.05588