Advances in 3D Neural Stylization

A review of 3D neural stylization papers, mainly neural stylization on 3D data with image or text reference.

Other variants are also welcomed, e.g., with other/no reference, 3D-aware neural stylization, non-neural 3D stylization.

Contributing

If you think I have missed out on something (or) have any suggestions (papers, implementations and other resources), feel free to pull a request

Feedback and contributions are welcome!

markdown format:

**Here is the Paper Name.**<br>
*[Author 1](homepage), Author 2, and Author 3.*<br>
Conference or Journal Year. <br>
[[Paper](link)] [[Project](link)] [[Github](link)] [[Video](link)] [[Data](link)]

Surveys

Advances in 3D Neural Stylization: A Survey
Yingshu Chen, Guocheng Shao, Ka Chun Shum, Binh-Son Hua, Sai-Kit Yeung. 2023.

If you find this work useful, please cite our paper:

@article{chen2023advances3dstyle,
  title={Advances in 3D Neural Stylization: A Survey},
  author={Chen, Yingshu and Shao, Guocheng and Shum, Ka Chun and Hua, Binh-Son and Yeung, Sai-Kit},
  journal={arXiv preprint arXiv:2311.18328},
  year={2023}
}

Other related surveys, courses

Neural Style Transfer: A Review [Paper] [Project]
Yongcheng Jing, Yezhou Yang, Zunlei Feng, Jingwen Ye, Yizhou Yu, Mingli Song. TVCG, 2019.

Multimodal Image Synthesis and Editing: The Generative AI Era [Paper] [Project]
Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu, Lingjie Liu, Adam Kortylewski, Christian Theobalt, Eric Xing. TPAMI, 2023.

Diffusion Models in Vision: A Survey [Paper] [Project]
Florinel-Alin Croitoru, Vlad Hondru, Radu Tudor Ionescu, Mubarak Shah. TPAMI, 2023.

Diffusion Models: A Comprehensive Survey of Methods and Applications [Paper][Project]
Ling Yang, Zhilong Zhang, Yang Song, Shenda Hong, Runsheng Xu, Yue Zhao, Wentao Zhang, Bin Cui, Ming-Hsuan Yang. ACM Computing Surveys 2023.

State of the Art on Diffusion Models for Visual Computing [Paper] [Project]
Ryan Po, Yifan Wang, Vladislav Golyanik, Kfir Aberman, Jon T. Barron, Amit Bermano, Eric Chan, Tali Dekel, Aleksander Holynski, Angjoo Kanazawa, C. Karen Liu, Lingjie Liu, Ben Mildenhall, Matthias Niessner, Björn Ommer, Christian Theobalt, Peter Wonka, and Gordon Wetzstein. State of the Art Report at EUROGRAPHICS 2024.

State of the Art on Neural Rendering [Paper]
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer. State of the Art Report at EUROGRAPHICS 2020.
Neural Rendering [Project] CVPR 2020 Tutorial.
Advances in Neural Rendering [Paper] [Project] SIGGRAPH 2021 Courses.

Advances in Neural Rendering [Paper]
Ayush Tewari, Justus Thies, Ben Mildenhall, Pratul Srinivasan, Edgar Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stephen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhoefer, Vladislav Golyanik. State of the Art Report at EUROGRAPHICS 2022.

Neural Fields in Visual Computing and Beyond [Paper] [Project]
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar. State of the Art Report at EUROGRAPHICS 2022.
Neural Fields for Visual Computing [Paper] [Project]
Towaki Takikawa, Shunsuke Saito, James Tompkin, Vincent Sitzmann, Srinath Sridhar, Or Litany, Alex Yu. SIGGRAPH 2023 Courses.

Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era [Paper]
Chenghao Li, Chaoning Zhang, Atish Waghwase, Lik-Hang Lee, Francois Rameau, Yang Yang, Sung-Ho Bae, Choong Seon Hong

Text-to-3D Shape Generation [Paper] [Project]
Han-Hung Lee, Manolis Savva, and Angel Xuan Chang. State of the Art Report at EUROGRAPHICS 2024.

3D Gaussian Splatting as New Era: A Survey [Paper]
Ben Fei, Jingyi Xu, Rui Zhang, Qingyuan Zhou, Weidong Yang, Ying He. TVCG 2024.

Table of Contents

• Mesh Stylization
• Volumetric Stylization
• Point Cloud Stylization
• Neural Field Stylization
• Evaluation

Overview of 3D Neural Stylization

Image guidance: Text guidance: 3D guidance:

Abbr.	Title	Venue	Paper	Project	Github
	Mesh Stylization
Neural Renderer	Neural 3D Mesh Renderer	CVPR 2018	[Paper]	[Project]	[Github]
Paparazzi	Paparazzi: Surface Editing by way of Multi-View Image Processing	SIGGRAPH Asia 2018	[Paper]	[Project]	[Github]
DGTS	Deep Geometric Texture Synthesis	SIGGRAPH 2020	[Paper]	[Project]	[Github]
3DStyleNet	3DStyleNet: Creating 3D Shapes with Geometric and Texture Style	ICCV 2021	[Paper]	[Project]
StyleMesh	StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions	CVPR 2022	[Paper]	[Project]	[Github]
Creative Birds	Creative Birds: Self-Supervised Single-View 3D Style Transfer	ICCV 2023	[Paper]		[Github]
Latent-NeRF	Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures	CVPR 2022	[Paper]	[Video]	[Github]
Text2Mesh	Text2Mesh: Text-Driven Neural Stylization for Meshes	CVPR 2022	[Paper]	[Project]	[Github]
TANGO	TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition	NeurIPS 2022	[Paper]	[Project]	[Github]
CLIP-Mesh	CLIP-Mesh: Generating textured meshes from text using pretrained image-text models	SIGGRAPH Asia 2022	[Paper]	[Project]	[Github]
Text2Scene	Text2Scene: Text-Driven Indoor Scene Stylization With Part-Aware Details	CVPR 2023	[Paper]	[Video]
TextDeformer	TextDeformer: Geometry Manipulation using Text Guidance	SIGGRAPH 2023 Conf Paper	[Paper]	[Project]	[Github]
TEXTure	TEXTure: Text-Guided Texturing of 3D Shapes	SIGGRAPH 2023 Conf Paper	[Paper]	[Project]	[Github]
Text2Tex	Text2Tex: Text-driven Texture Synthesis via Diffusion Models	ICCV 2023	[Paper]	[Project]	[Github]
TexFusion	TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models	ICCV 2023	[Paper]	[Project]
X-Mesh	X-Mesh:Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidance	ICCV 2023	[Paper]	[Project]	[Github]
Point-UV Diffusion	Texture Generation on 3D Meshes with Point-UV Diffusion	ICCV 2023	[Paper]	[Project]	[Github]
3DStyle-Diffusion	3DStyle-Diffusion: Pursuing Fine-grained Text-driven 3D Stylization with 2D Diffusion Models	ACM MM 2023	[Paper]		[Github]
RoomDreamer	RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture	ACM MM 2023	[Paper]	[Video]
DreamSpace	Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation	IEEE VR 2024	[Paper]	[Project]	[Github]
Decorate3D	Decorate3D: Text-Driven High-Quality Texture Generation for Mesh Decoration in the Wild	NeurIPS 2023	[Paper]	[Project]	[Github]
TECA	TECA: Text-Guided Generation and Editing of Compositional 3D Avatars	3DV 2024	[Paper]	[Project]	[Github]
HyperDreamer	HyperDreamer: Hyper-Realistic 3D Content Generation and Editing from a Single Image	SIGGRAPH Asia 2023 Conf Paper	[Paper]	[Project]	[Github]
SceneTex	SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors	CVPR 2024	[Paper]	[Project]	[Github]
Paint-it	Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Rendering	CVPR 2024	[Paper]	[Project]	[Github]
AlteredAvatar	AlteredAvatar: Stylizing Dynamic 3D Avatars with Fast Style Adaptation	Arxiv 2023	[Paper]	[Project]
HeadSculpt	HeadSculpt: Crafting 3D Head Avatars with Text	Neurips 2023	[Paper]	[Project]	[Github(TBA)]
HeadArtist	HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation	Arxiv 2023	[Paper]	[Project]	[Github(TBA)]
StyleAvatar	StyleAvatar: Stylizing Animatable Head Avatars	WACV 2024	[Paper]
Paint3D	Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models	CVPR 2024	[Paper]	[Project]	[Github(TBA)]
TextureDreamer	TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion	CVPR 2024	[Paper]	[Project]
TeMO	TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshes	CVPR 2024	[Paper]
3DPaintbrush	3D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillation	CVPR 2024	[Paper]	[Project]	[Github]
As-Plausible-As-Possible	As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priors	CVPR 2024	[Paper]	[Project]	[Github]
StyleCity	StyleCity: Large-Scale 3D Urban Scenes Stylization with Vision-and-Text Reference via Progressive Optimization	Arxiv 2024	[Paper]	[Project]
MaPa	MaPa: Text-driven Photorealistic Material Painting for 3D Shapes	SIGGRAPH 2024 Conf Paper	[Paper]	[Project]
DTP	Diffusion Texture Painting	SIGGRAPH 2024 Conf Paper	[Paper]	[Project]
TexPainter	TexPainter: Generative Mesh Texturing With Multi-view Consistency	SIGGRAPH 2024 Conf Paper
DreamMat	DreamMat: High-quality PBR Material Generation With Geometry- and Light-aware Diffusion Models	SIGGRAPH/TOG 2024	[Paper]
EASI-Tex	EASI-Tex: Edge-Aware Mesh Texturing from Single Image	SIGGRAPH/TOG 2024	[Paper]	[Project]	[Github]
Coin3D	Coin3D: Controllable and Interactive 3D Assets Generation With Proxy-guided Conditioning	SIGGRAPH 2024 Conf Paper	[Paper]	[Project]	[Github(TBA)]
ThemeStation	ThemeStation: Generating Theme-Aware 3D Assets from Few Exemplars	SIGGRAPH 2024 Conf Paper	[Paper]	[Project]	[Github]
DressCode	DressCode: Autoregressively Sewing and Generating Garments from Text Guidance	SIGGRAPH/TOG 2024	[Paper]	[Project]	[Github(TBA)]
CNSTDM	Controllable Neural Style Transfer for Dynamic Meshes	SIGGRAPH 2024
MeshNCA	Mesh Neural Cellular Automata	SIGGRAPH/TOG 2024	[Paper]	[Project]
	Creating LEGO Figurines From Single Images	SIGGRAPH 2024
	Volumetric Stylization
TNST	Transport-Based Neural Style Transfer for Smoke Simulations	SIGGRAPH Asia 2019	[Paper]	[Video]	[Github]
LNST	Lagrangian Neural Style Transfer for Fluids	SIGGRAPH 2020	[Paper]	[Video]	[Github]
SKPN	Volumetric appearance stylization with stylizing kernel prediction network	SIGGRAPH 2021	[Paper]	[Video]
ENST	Efficient Neural Style Transfer For Volumetric Simulations	SIGGRAPH Asia 2022	[Paper]	[Project]
ShaDDR	ShaDDR: Interactive Example-Based Geometry and Texture Generation via 3D Shape Detailization and Differentiable Rendering	SIGGRAPH Asia 2023 Conf Paper	[Paper]	[Project]	[Github]
	Point Cloud Stylization
PSNet	PSNet: A Style Transfer Network for Point Cloud Stylization on Geometry and Color	WACV 2020	[Paper]	[Video]	[Github]
PointInverter	PointInverter: Point Cloud Reconstruction and Editing via a Generative Model with Shape Priors	WACV 2023	[Paper]	[Project]
	Implicit Shape Stylization
Neural Wavelet	Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation	SIGGRAPH Asia 2022 Conf Paper, TOG 2024	[Paper]		[Github]
SPAGHETTI	SPAGHETTI: Editing Implicit Shapes Through Part Aware Generation	SIGGRAPH/TOG 2022	[Paper]	[Project]	[Github]
SALAD	SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation	ICCV 2023	[Paper]	[Project]	[Github]
EXIM	EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generation	SIGGRAPH Asia/TOG 2023	[Paper]	[Project]	[Github]
CNS-Edit	CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization	SIGGRAPH 2024	[Paper]
	Novel View or Neural Field Stylization
LSNV	Learning to stylize novel views	ICCV 2021	[Paper]	[Project]	[Github]
HyperStyle	Stylizing 3D Scene via Implicit Representation and HyperNetwork	WACV 2022	[Paper]	[Project]	[Github]
StylizedNeRF	StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning	CVPR 2022	[Paper]	[Project]	[Github]
3D Photo Stylization	3D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Image	CVPR 2022	[Paper]	[Project]	[Github]
ARF	ARF: Artistic Radiance Fields	ECCV 2022	[Paper]	[Project]	[Github]
INS	Unified Implicit Neural Stylization	ECCV 2022	[Paper]	[Project]	[Github]
InstantNeRFStyle	Instant Photorealistic Neural Radiance Fields Stylization	ICASSP 2024	[Paper] [IEEE]		[Github]
ArtNV	Artistic Style Novel View Synthesis Based on A Single Image	CVPRW 2022, SIGGRAPH Posters 2022	[Paper]	[Project]	[Github]
SNeRF	SNeRF: Stylized Neural Implicit Representations for 3D Scenes	SIGGRAPH 2022	[Paper]	[Project]
LipRF	Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylization	CVPR 2023	[Paper]
StyleRF	StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields	CVPR 2023	[Paper]	[Project]	[Github]
Ref-NPR	Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization	CVPR 2023	[Paper]	[Project]	[Github]
LocalStyleNeRF	Locally Stylized Neural Radiance Fields	ICCV 2023	[Paper]	[Project]	[Github]
SINE	Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field	CVPR 2023	[Paper]	[Project]	[Github]
NeRF-Art	NeRF-Art: Text-Driven Neural Radiance Fields Stylization	TVCG 2023	[Paper]	[Project]	[Github]
TSNeRF	TSNeRF: Text-driven stylized neural radiance fields via semantic contrastive learning	Computers & Graphics 2023, CCF CAD/Graphics 2023	[Paper]
Instruct-NeRF2NeRF	Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions	ICCV 2023	[Paper]	[Project]	[Github]
Blending-NeRF	Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields	ICCV 2023	[Paper]	[Project]
Vox-E	Vox-E: Text-guided Voxel Editing of 3D Objects	ICCV 2023	[Paper]	[Project]	[Github]
ClimateNeRF	ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field	ICCV 2023	[Paper]	[Project]	[Github]
ViCA-NeRF	ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields	NeurIPS 2023	[Paper]	[Project]	[Github]
UPST-NeRF	UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene	TVCG 2024	[Paper]	[Project]	[Github]
CoARF	CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields	3DV 2024	[Paper]	[Project]
DreamEditor	DreamEditor: Text-Driven 3D Scene Editing with Neural Fields	SIGGRAPH Asia 2023 Conf Paper	[Paper]	[Project]	[Github]
AvatarStudio	AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars	SIGGRAPH Asia 2023 Conf Paper	[Paper]	[Project]
GaussianEditor(Huawei)	GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions	CVPR 2024	[Paper]	[Project]
GaussianEditor(NTU)	GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting	CVPR 2024	[Paper]	[Project]	[Github]
3DFaceHybrid	3D Face Style Transfer with a Hybrid Solution of NeRF and Mesh Rasterization	WACV 2024	[Paper]
NeRFEditor	NeRFEditor: Differentiable Style Decomposition for 3D Scene Editing	WACV 2024	[Paper]	[Project]
Free-Editor	Free-Editor: Zero-shot Text-driven 3D Scene Editing	Arxiv 2023	[Paper]	[Project]
RePaint-NeRF	RePaint-NeRF: NeRF Editing via Semantic Masks and Diffusion Models	IJCAI 2023	[Paper]	[Project]	[Github]
ED-NeRF	ED-NeRF: Efficient Text-Guided Editing of 3D Scene With Latent Space NeRF	ICLR 2024	[Paper]	[Project]
FPRF	FPRF: Feed-Forward Photorealistic Style Transfer of Large-Scale 3D Neural Radiance Fields	AAAI 2024	[Paper]	[Project]
PNeSM	PNeSM: Arbitrary 3D Scene Stylization via Prompt-Based Neural Style Mapping	AAAI 2024	[Paper]
Neural3DStrokes (3D Strokes)	Neural 3D Strokes: Creating Stylized 3D Scenes with Vectorized 3D Strokes	CVPR 2024	[Paper]	[Project]	[Github]
Geo-SRF	Geometry Transfer for Stylizing Radiance Fields	CVPR 2024	[Paper]	[Project]	[Github(TBA)]
S-DyRF	S-DyRF: Reference-Based Stylized Radiance Fields for Dynamic Scenes	CVPR 2024	[Paper]	[Project]	[Github(TBA)]
LAENeRF	LAENeRF: Local Appearance Editing for Neural Radiance Fields	CVPR 2024	[Paper]	[Project]	[Github]
PDS	Posterior Distillation Sampling	CVPR 2024	[Paper]	[Project]	[Github]
NeRF Analogies	NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs	CVPR 2024	[Paper]	[Project]
StyleGaussian	StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting	Arxiv 2024	[Paper]	[Project]	[Github]
GaussCtrl	GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing	Arxiv 2024	[Paper]	[Project]
UAV-ENeRF	UAV-ENeRF: Text-driven UAV Scene Editing with Neural Radiance Fields	TGRS 2024	[Paper]
Freditor	Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition	Arxiv 2024	[Paper]	[Project]
StylizedGS	StylizedGS: Controllable Stylization for 3D Gaussian Splatting	Arxiv 2024	[Paper]
TIP-Editor	TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts	SIGGRAPH/TOG 2024	[Paper]	[Project]	[Github]
SC-GS	SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes	CVPR 2024	[Paper]	[Project]	[Github]
SC4D	SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfer	Arxiv 2024	[Paper]	[Project]
GSDeformer	GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting	Arxiv 2024	[Paper]	[Project]
Portrait3D	Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Prior	SIGGRAPH/TOG 2024	[Paper]	[Project]	[Github]
SketchDream	SketchDream: Sketch-based Text-to-3D Generation and Editing	SIGGRAPH/TOG 2024	[Paper]	[Project]
DreamFont3D	DreamFont3D: Personalized Text-to-3D Artistic Font Generation	SIGGRAPH 2024 Conf Paper
Spice-E	Spice-E: Structural Priors in 3D Diffusion using Cross-Entity Attention	SIGGRAPH 2024 Conf Paper	[Paper]	[Project]	[Github]
3Doodle	3Doodle: Compact Abstraction of Objects with 3D Strokes	SIGGRAPH/TOG 2024	[Paper]
	Multi-view / Light Field Stylization
StereoNST	Stereoscopic Neural Style Transfer	CVPR 2018	[Paper]	[Video]
NSIST	Neural Stereoscopic Image Style Transfer	ECCV 2018	[Paper]
LFST	Style Transfer for Light Field Photography	WACV 2020	[Paper]		[Github]
MuVieCAST	MuVieCAST: Multi-View Consistent Artistic Style Transfer	3DV 2024	[Paper]	[Project]	[Github]

Other Related 3D Generation

Image guidance: Text guidance: 3D guidance:

Abbr.	Title	Venue	Paper	Project	Github
CLIP-Mesh	CLIP-Mesh: Generating textured meshes from text using pretrained image-text models	SIGGRAPH Asia 2022 Conf Paper	[Paper]	[Project]	[Github]
DreamFusion	DreamFusion: Text-to-3D using 2D Diffusion	ICLR 2023	[Paper]	[Project]	[Github] (unofficial)
SJC	Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation	CVPR 2023	[Paper]	[Project]	[Github]
Magic3D	Magic3D: High-Resolution Text-to-3D Content Creation	CVPR 2023	[Paper]	[Project]
Fantasia3D	Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation	ICCV 2023	[Paper]	[Project]	[Github]
Zero-1-to-3	Zero-1-to-3: Zero-shot One Image to 3D Object	ICCV 2023	[Paper]	[Project]	[Github]
ProlificDreamer	ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation	NeurIPS 2023	[Paper]	[Project]	[Github]
3D VADER	Autodecoding Latent 3D Diffusion Models	NeurIPS 2023	[Paper]	[Project]	[Github]
HiFA	HiFA: High-fidelity Text-to-3D with Advanced Diffusion Guidance	ICLR 2024	[Paper]	[Project]	[Github]
DreamCraft3D	DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior	ICLR 2024	[Paper]	[Project]	[Github]
DreamGaussian	DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation	ICLR 2024	[Paper]	[Project]	[Github]
Progressive3D	Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts	ICLR 2024	[Paper]	[Project]	[Github]
SyncDreamer	SyncDreamer: Generating Multiview-consistent Images from a Single-view Image	ICLR 2024	[Paper]	[Project]	[Github]
GaussianDreamer	GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models	CVPR 2024	[Paper]	[Project]	[Github]
GSGEN	GSGEN: Text-to-3D using Gaussian Splatting	CVPR 2024	[Paper]		[Github]
LucidDreamer	LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes	CVPR 2024	[Paper]	[Project]	[Github]
BlockFusion	BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolation	SIGGRAPH/TOG 2024	[Paper]	[Project]	[Github(TBA)]
MVD2	MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusion	SIGGRAPH 2024 Conf Paper	[Paper]

Other 3D Stylization

Image guidance: Text guidance: 3D guidance:

Abbr.	Title	Venue	Paper	Project	Github
StyleLit	StyLit: Illumination-Guided Example-Based Stylization of 3D Renderings	SIGGRAPH 2016	[Paper]	[Project]	[Demo]
StyleBlit	StyleBlit: Fast Example‐Based Stylization with Local Guidance	Computer Graphics Forum, EG 2019	[Paper]	[Project]	[Github] [Unity Plugin]
StyleProp	StyleProp: Real‐time Example‐based Stylization of 3D Models	Computer Graphics Forum, PG 2020	[Paper]	[Project]
Cubic Stylization	Cubic Stylization	SIGGRAPH Asia 2019	[Paper]	[Project]	[Github1] [Github2]
Normal-Driven	Normal‐Driven Spherical Shape Analogies	Computer Graphics Forum, SGP 2021	[Paper]	[Video]	[Github1] [Github2]
Stroke Transfer	Stroke Transfer: Example-based Synthesis of Animatable Stroke Styles	SIGGRAPH 2022 Conf Paper	[Paper]	[Project]	[Github]
Stealth Shaper	Stealth Shaper: Reflectivity Optimization as Surface Stylization	SIGGRAPH 2023 Conf Paper	[Paper]	[Project]	[Github]
LayGA	LayGA: Layered Gaussian Avatars for Animatable Clothing Transfer	SIGGRAPH 2024 Conf Paper	[Paper]	[Project]
PBFLR	Physically-based Feature Line Rendering	SIGGRAPH Asia/TOG 2021	[Paper]	[Project]
SRFoE	Stylized Rendering as a Function of Expectation	SIGGRAPH/TOG 2024	[Paper]

Mesh Stylization

Neural 3D Mesh Renderer
Hiroharu Kato, Yoshitaka Ushiku, Tatsuya Harada
CVPR 2018. [Paper][Project] [Github]
Features:

• approximate gradient for rasterization
• single-image 3d mesh reconstruction with 2d supervision
• gradient-based 3d mesh editing including 2d->3d style transfer(image->mesh)

Paparazzi: Surface Editing by way of Multi-View Image Processing
Hsueh-Ti Derek Liu, Michael Tao, Alec Jacobson
SIGGRAPH Asia 2018. [Paper] [Project] [Github]
Features:

• image-guided mesh surface stylization
• vertex position optimization
• sample training cameras on the offset surface

3DStyleNet: Creating 3D Shapes with Geometric and Texture Style
Kangxue Yin, Jun Gao, Maria Shugrina, Sameh Khamis, Sanja Fidler
ICCV 2021. [Paper] [Project]
Features:

• 3D shape and texture style tranfer
• 3D textured model as guidance
• Large 3D data driven

StyleMesh: Style Transfer for Indoor 3D Scene Reconstructions
Lukas Höllein, Justin Johnson, Matthias Nießner
CVPR 2022. [Paper] [Project] [Github]
Features:

• 3D consistent texture optimization
• depth-aware and angle-aware optimization for equally-sized and unstreched stylization patterns

Text2Mesh: Text-Driven Neural Stylization for Meshes
Oscar Michel, Roi Bar-On, Richard Liu, Sagie Benaim, Rana Hanocka
CVPR 2022.[Paper] [Project] [Github]
Features:

• based on CLIP[Github]
• handle low quality meshes

TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition
Yongwei Chen, Rui Chen, Jiabao Lei, Yabin Zhang, Kui Jia
Neurips 2022. [Paper] [Project] [Github]

Creative Birds: Self-Supervised Single-View 3D Style Transfer
Renke Wang, Guimin Que, Shuo Chen, Xiang Li, Jun Li, Jian Yang
ICCV 2023. [Paper] [Github]

Text2Scene: Text-Driven Indoor Scene Stylization With Part-Aware Details
Inwoo Hwang, Hyeonwoo Kim, Young Min Kim
CVPR 2023. [Paper] [Video] [Github]

TextDeformer: Geometry Manipulation using Text Guidance
William Gao, Noam Aigerman, Thibault Groueix, Vladimir G. Kim, Rana Hanocka
SIGGRAPH Conference Proceedings 2023. [Paper] [Project] [Github]

TEXTure: Text-Guided Texturing of 3D Shapes
Elad Richardson, Gal Metzer, Yuval Alaluf, Raja Giryes, Daniel Cohen-Or
SIGGRAPH Conference Proceedings 2023. [Paper] [Project] [Github]

Text2Tex: Text-driven Texture Synthesis via Diffusion Models
Dave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov, Matthias Nießner
ICCV 2023. [Paper] [Project] [Github]

X-Mesh:Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidance
Yiwei Ma, Xiaioqing Zhang, Xiaoshuai Sun, Jiayi Ji, Haowei Wang, Guannan Jiang, Weilin Zhuang, Rongrong Ji
ICCV 2023. [Paper] [Project] [Github]

Volumetric Stylization

Transport-Based Neural Style Transfer for Smoke Simulations
Byungsoo Kim, Vinicius C. Azevedo, Markus Gross, Barbara Solenthaler
SIGGRAPH Asia 2019.| [Paper] [Video] [Github]
Features:

• dynamic smoke
• optimization-based stylization

Lagrangian Neural Style Transfer for Fluids
Byungsoo Kim, Vinicius C. Azevedo, Markus Gross, Barbara Solenthaler
SIGGRAPH 2020. [Paper] [Video] [Github]
Features:

• fluid
• optimization-based stylization

Volumetric appearance stylization with stylizing kernel prediction network
Jie Guo, Mengtian Li, Zijing Zong, Yuntao Liu, Jingwu He, Yanwen Guo, Ling-Qi Yan
SIGGRAPH 2021. [Paper)] [Video]|
Features:

• dynamic or static model
• arbitrary style transfer

Efficient Neural Style Transfer For Volumetric Simulations
Joshua Aurand, Raphaël Oritz, Sylvia Nauer, Vinicius Azevedo
ACM SIGGRAPH Asia, 2022. [Paper][Video]
Features:

• mainly for smoke
• view-independent stylization
• feed-forward network for acceleration

Point Cloud Stylization

PSNet: A Style Transfer Network for Point Cloud Stylization on Geometry and Color
Xu Cao, Weimin Wang, Katashi Nagao, Ryosuke Nakamura
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2020
[Paper] [Github] [Video] Features:

• explicit point cloud stylization
• geometric and color stylization

Neural Field Stylization

General Neural Rendering

Learning to stylize novel views
Hsin-Ping Huang, Hung-Yu Tseng, Saurabh Saini, Maneesh Singh, Ming-Hsuan Yang.
ICCV 2021. [Paper] [Project] [Github]
Features:

• Point-cloud based feature
• Style feature transformation
• Require MVS reconstruction, depth rendering
• zero-shot novel view stylization

3D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Image
Fangzhou Mu, Jian Wang, Yicheng Wu, Yin Li
CVPR 2022. [Paper] [Project] [Github]
Features:

• pre-trained NeRF with color prediction module replaced with a style network
• mutual learning for two parts mentioned above

Artistic Style Novel View Synthesis Based on A Single Image
Kuan-Wei Tseng, Yao-Chih Lee, Chu-Song Chen
CVPR Workshop 2022 / SIGGRAPH Poster 2022.[Paper] [Project] [Github]
Features:

• based on Synsin(differentiable point cloud renderer)[Paper]
• occlusion aware dense matching
• mainly for VR

Radiance Field Based Rendering

Stylizing 3D Scene via Implicit Representation and HyperNetwork
Pei-Ze Chiang, Meng-Shiun Tsai, Hung-Yu Tseng, Wei-sheng Lai, Wei-Chen Chiu.
WACV 2022. [Paper] [Project] [Github]
Features:

• hypernetwork to control NeRF weights
• two-step training and patch-subsampling
• zero-shot novel view stylization

StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning
Yi-Hua Huang, Yue He, Yu-Jie Yuan, Yu-Kun Lai, Lin Gao
CVPR 2022. [Paper] [Project] [Github]
Features:

• pre-trained NeRF with color prediction module replaced with a style network
• mutual learning for two parts mentioned above
• zero-shot novel view stylization

ARF: Artistic Radiance Fields
Kai Zhang, Nick Kolkin, Sai Bi, Fujun Luan, Zexiang Xu, Eli Shechtman, Noah Snavely
ECCV 2022. [Paper] [Project] [Github]
Features:

• pre-trained NeRF with color prediction module replaced with a style network
• mutual learning for two parts mentioned above

Unified Implicit Neural Stylization
Zhiwen Fan, Yifan Jiang, Peihao Wang, Xinyu Gong, Dejia Xu, Zhangyang Wang
ECCV 2022. [Paper] [Project] [Github]
Features:

• continuous in the style space(allow interpolation between styles)

Instant Neural Radiance Fields Stylization
Shaoxu Li, Ye Pan
[Paper] [Github]
Features:

• training for novel view stylization image synthesis only costs 10 minutes.
• extend the style target of NeRF stylization from images to 3D scene image sets

SNeRF: Stylized Neural Implicit Representations for 3D Scenes
Thu Nguyen-Phuoc, Feng Liu, Lei Xiao
SIGGRAPH 2022.[Paper]
Features:

• applies to indoor scenes, outdoor scenes and 4D dynamic avatars
• reduce GPU memory requirement

Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylization
Zicheng Zhang, Yinglu Liu, Congying Han, Yingwei Pan, Tiande Guo, Ting Yao
CVPR 2023. [Paper]
Features:

• photo-realistic
• based on Lipschitz transformation and condition

StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fields
Kunhao Liu, Fangneng Zhan, Yiwen Chen, Jiahui Zhang, Yingchen Yu, Abdulmotaleb El Saddik, Shijian Lu, Eric Xing
CVPR 2023. [Paper] [Project] [Github]
Features:

• zero-shot 3d stylization
• sampling-invariant content transformation
• deferring style transformation to 2D feature maps
• zero-shot novel view stylization

Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization
Yuechen Zhang, Zexin He, Jinbo Xing, Xufeng Yao, Jiaya Jia
CVPR 2023. [Paper] [Project] [Github]
Features:

• reference based ray registration process and a template-based feature matching scheme to achieve geometrically and perceptually consistent stylization

Locally Stylized Neural Radiance Fields
Hong-Wing Pang, Binh-Son Hua, Sai-Kit Yeung
ICCV 2023. [Paper] [Project] [Github]
Features:

• explicitly semantic match stylization
• based on instant-NGP
• room stylization

Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field
Chong Bao, Yinda Zhang, Bangbang Yang, Tianxing Fan, Zesong Yang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui
CVPR 2023. [Paper] [Project] [Github]
Features:

• edit a photo-realistic NeRF with a single-view image or with text prompts
• cyclic constraints with a proxy mesh for geometric editing
• the color compositing mechanism to enhance texture editing
• feature-cluster-based regularization to control the affected editing area and maintain irrelevant parts unchanged

NeRF-Art: Text-Driven Neural Radiance Fields Stylization
Can Wang, Ruixiang Jiang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
TVCG 2023. [Paper] [Project] [Github]
Features:

• combine CLIP[Github] with NeRF
• cover global structures and local details
• adopt a weight regularization to effectively reduce cloudy artifacts and geometry noises

Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
Ayaan Haque, Matthew Tancik, Alexei A. Efros, Aleksander Holynski, Angjoo Kanazawa
ICCV 2023. [Paper] [Project] [Github]
Features:

• extract shape and appearance priors from a 2D diffusion model
• edit input images and change 3d implicit field representation

Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields
ICCV 2023. [Paper] [Project]
Features:

• text-guided local editing