Awesome-AIGC4AEC

Collecting papers about potential AIGC applications in the AEC industry.

This is an awesome list of potential AIGC applications in the AEC industry. Wish it could be helpful for both academia and industry. (Still updating)

Please feel free to pull requests to add new resources or open issues for questions, discussion and collaborations.

Object Scale

Mesh Design

Parametric Design

• How Can Large Language Models Help Humans in Design and Manufacturing? (Arxiv'23) [Paper]

Texture Design

• Make-it-Real: Unleashing Large Multimodal Model's Ability for Painting 3D Objects with Realistic Materials (Arxiv'24) [Project] [Paper] [Code]

• MaPa: Text-driven Photorealistic Material Painting for 3D Shapes (SIGGRAPH'24) [Project] [Paper]

• DreamPBR: Text-driven Generation of High-resolution SVBRDF with Multi-modal Guidance (Arxiv'24) [Paper]

• FlashTex: Fast Relightable Mesh Texturing with LightControlNet (Arxiv'24) [Project] [Paper]

• Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Rendering (CVPR'24) [Project] [Paper] [Code]

• TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion (Arxiv'24) [Project] [Paper]

• Collaborative Control for Geometry-Conditioned PBR Image Generation (Arxiv'24) [Project] [Paper]

• Single Mesh Diffusion Models with Field Latents for Texture Generation (CVPR'24) [Project] [Paper] [Code]

• Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models (Arxiv'23) [Project] [Paper] [Code]

• Text-Guided Texturing by Synchronized Multi-View Diffusion (Arxiv'23) [Paper] [Code]

• Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation (ICCV'23) [Project] [Paper] [Code]

• TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models (ICCV'23) [Project] [Paper]

• Text2Tex: Text-driven Texture Synthesis via Diffusion Models (ICCV'23) [Project] [Paper] [Code]

• TEXTure: Text-Guided Texturing of 3D Shapes (SIGGRAPH'23) [Project] [Paper] [Code]

• Text2Mesh: Text-Driven Neural Stylization for Meshes (CVPR'22) [Porject] [Paper] [Code]

Room Scale

Mesh Design

• AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes (Arxiv'24) [Project] [Paper] [Code]

• Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Plane (Arxiv'24) [Paper]

• External Knowledge Enhanced 3D Scene Generation from Sketch (Arxiv'24) [Paper]

• DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting (Arxiv'24) [Project] [Paper]

• Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models (ICCV'23) [Project] [Paper] [Code]

• SceneWiz3D: Towards Text-guided 3D Scene Composition (Arxiv'23) [Project] [Paper] [Code]

• Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraints (Arxiv'23) [Paper]

Parametric Design

• Language Guided Generation of 3D Embodied AI Environments (CVPR'24) [Project] [Paper] [Code]

• DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis (CVPR'24) [Project] [Paper] [Code]

• InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Prior (ICLR'24) [Project] [Paper] [Code]

• Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases (Arxiv'24) [Paper]

• I-Design: Personalized LLM Interior Designer (Arxiv'24) [Project] [Paper]

• LayoutGPT: Compositional Visual Planning and Generation with Large Language Models (NeurIPS'23) [Project] [Paper] [Code]

Texture Design

• DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation (VR'24) [Project] [Paper] [Code]

• SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors (CVPR'24) [Project] [Paper] [Code]

• MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion (NeurIPS'23) [Project] [Paper] [Code]

• Text2Scene: Text-Driven Indoor Scene Stylization With Part-Aware Details (CVPR'23) [Paper]

City Scale

Mesh Design

• XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies (CVPR'24 highlight) [Project] [Paper]

• Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion (CVPR'24 highlight) [Project] [Paper] [Code]

• WonderJourney: Going from Anywhere to Everywhere (CVPR'24) [Project] [Paper] [Code]

• BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolation (Arxiv'24) [Paper]

Parametric Design

• CityDreamer: Compositional Generative Model of Unbounded 3D Cities (CVPR'24) [Project] [Paper] [Code]

• SceneX: Procedural Controllable Large-scale Scene Generation via Large-language Models (Arxiv'24) [Project] [Paper] [Code]

• Infinite Photorealistic Worlds using Procedural Generation (CVPR'23) [Project] [Paper] [Code]