菜单

🤖 系统
📄 Abstract - MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layouts

Generating realistic 3D cities is fundamental to world models, virtual reality, and game development, where an ideal urban scene must satisfy both stylistic diversity, fine-grained, and controllability. However, existing methods struggle to balance the creative flexibility offered by text-based generation with the object-level editability enabled by explicit structural representations. We introduce MajutsuCity, a natural language-driven and aesthetically adaptive framework for synthesizing structurally consistent and stylistically diverse 3D urban scenes. MajutsuCity represents a city as a composition of controllable layouts, assets, and materials, and operates through a four-stage pipeline. To extend controllability beyond initial generation, we further integrate MajutsuAgent, an interactive language-grounded editing agent} that supports five object-level operations. To support photorealistic and customizable scene synthesis, we also construct MajutsuDataset, a high-quality multimodal dataset} containing 2D semantic layouts and height maps, diverse 3D building assets, and curated PBR materials and skyboxes, each accompanied by detailed annotations. Meanwhile, we develop a practical set of evaluation metrics, covering key dimensions such as structural consistency, scene complexity, material fidelity, and lighting atmosphere. Extensive experiments demonstrate MajutsuCity reduces layout FID by 83.7% compared with CityDreamer and by 20.1% over CityCraft. Our method ranks first across all AQS and RDR scores, outperforming existing methods by a clear margin. These results confirm MajutsuCity as a new state-of-the-art in geometric fidelity, stylistic adaptability, and semantic controllability for 3D city generation. We expect our framework can inspire new avenues of research in 3D city generation. Our dataset and code will be released at this https URL.

顶级标签: computer vision multi-modal aigc
详细标签: 3d city generation language-driven generation aesthetic adaptation controllable assets interactive editing 或 搜索:

MajutsuCity: 基于自然语言驱动的审美自适应3D城市生成框架 / MajutsuCity: Language-driven Aesthetic-adaptive City Generation with Controllable 3D Assets and Layouts


1️⃣ 一句话总结

MajutsuCity是一个通过自然语言指令驱动、支持审美自适应控制和对象级交互编辑的3D城市场景生成系统,通过四阶段流程实现了结构一致且风格多样的城市生成。


2️⃣ 论文创新点

1. 语言驱动的审美自适应框架

2. 两阶段解耦生成架构

3. MajutsuAgent交互编辑代理

4. MajutsuDataset多模态数据集

5. VLM-based评估框架


3️⃣ 主要结果与价值

结果亮点

实际价值


4️⃣ 术语表

📄 打开原文 PDF