菜单

关于 🐙 GitHub
arXiv 提交日期: 2026-04-20
📄 Abstract - Asset Harvester: Extracting 3D Assets from Autonomous Driving Logs for Simulation

Closed-loop simulation is a core component of autonomous vehicle (AV) development, enabling scalable testing, training, and safety validation before real-world deployment. Neural scene reconstruction converts driving logs into interactive 3D environments for simulation, but it does not produce complete 3D object assets required for agent manipulation and large-viewpoint novel-view synthesis. To address this challenge, we present Asset Harvester, an image-to-3D model and end-to-end pipeline that converts sparse, in-the-wild object observations from real driving logs into complete, simulation-ready assets. Rather than relying on a single model component, we developed a system-level design for real-world AV data that combines large-scale curation of object-centric training tuples, geometry-aware preprocessing across heterogeneous sensors, and a robust training recipe that couples sparse-view-conditioned multiview generation with 3D Gaussian lifting. Within this system, SparseViewDiT is explicitly designed to address limited-angle views and other real-world data challenges. Together with hybrid data curation, augmentation, and self-distillation, this system enables scalable conversion of sparse AV object observations into reusable 3D assets.

顶级标签: computer vision systems autonomous driving
详细标签: 3d asset extraction neural scene reconstruction multi-view generation sparse view reconstruction autonomous vehicle simulation 或 搜索:

资产收割者:从自动驾驶日志中提取3D资产用于仿真 / Asset Harvester: Extracting 3D Assets from Autonomous Driving Logs for Simulation


1️⃣ 一句话总结

本文提出了一种名为Asset Harvester的端到端系统,能够从自动驾驶车辆记录的真实驾驶日志中,自动提取稀疏、不完整的物体图像,并将其转化为完整、可直接用于仿真环境的3D资产,从而解决现有神经网络场景重建无法生成可操作3D物体的核心难题。

源自 arXiv: 2604.18468