3D Gaussian Splatting (3DGS) opens a new window for using neural rendering for real applications. This repo is intended to provide a collection of papers that are related to 3DGS, but not necessarily use 3DGS.
In general, 3D Gaussian Splatting can be considered as a variant of NeRF. This repo will more focused on the practical side of NeRF, e.g. realtime, compatibility with Unity/Unreal, ease of editing, etc.
Other resources: Dynamic NeRF
Verified: Papers listed with [+] have been verfied by myself or colleagues. The code is runnable. Please leave an issue if you need help on setting up.
If you have any additions or suggestions, feel free to contribute. Everything is welcome.
- May 2024: added 2024 section
- Dec 2023: added verified section
- 26 Nov 2023: added more details for cumstom data.
- Nov 2023: Start a separate page for NeRF
- 29 Oct 2023: Start a separate page for Dynamic NeRF
- 3D Gaussian Splatting for Real-Time Radiance Field Rendering,
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis, SIGGRAPH 2023 (Best Paper).
[📄 Paper (Low Resolution) | 📄 Paper (High Resolution) | 🌐 Project Page | 💻 Code | 🎥 Short Presentation | 🎥 Explanation Video |
]
- N-BVH: Neural ray queries with bounding volume hierarchies, SIGGRAPH 2024. [Paper | Project | Code]
- High-quality Surface Reconstruction using Gaussian Surfels. [Paper | Code]
General
-
2DGS: 2D Gaussian Splatting for Geometrically Accurate Radiance Fields, SIGGRAPH 2024. [Paper | Project | Code]
-
Deblur-GS: 3D Gaussian Splatting from Camera Motion Blurred Images, I3D 2024. [Paper | Code]
-
GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting, [Paper | Code]
-
GaussianPro: 3D Gaussian Splatting with Progressive Propagation, [Paper | Project]
-
VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality, [Paper | Project]
-
MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Images, [Paper | Project]
-
DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting, [Paper | Project]
SLAM & Sensor Fusion
- Gaussian Splatting SLAM, CVPR 2024 [Paper | Code]
- SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM, CVPR 2024. [Paper | Code]
- RGBD GS-ICP SLAM, [Paper | Code]
- Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting, [Paper | Code]
- Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Cameras, [Paper | Code]
Compression & Efficiency
- GaussianPro: 3D Gaussian Splatting with Progressive Propagation, [Paper | Code]
- InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 10 Seconds, [Paper
- HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression, [Paper | Code]
- Reducing the Memory Footprint of 3D Gaussian Splatting, [Paper | Project]
- SUNDAE: Spectrally Pruned Gaussian Fields with Neural Compensation, [Paper | Code]
Speed & Efficiency
[+]LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS, 2023. [Paper | Code][+]SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering, 2023. [Paper | Code]- Compact 3D Gaussian Representation for Radiance Field, [Paper | Code]
- Compact3D: Compressing Gaussian Splat Radiance Field Models with Vector Quantization, [Paper | Code]
Quality
- Mip-Splatting: Alias-free 3D Gaussian Splatting, [Paper | Code]
- FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Information, Paper
- Multi-Scale 3D Gaussian Splatting for Anti-Aliased Rendering, Paper
- COLMAP-Free 3D Gaussian Splatting, [Paper | Project]
- NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance, Paper
- Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images, Paper
- GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting, Paper
Reflection & Relighting
- GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfaces, [Paper | Code]
- Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing, Paper
Others
- Splatter Image: Ultra-Fast Single-View 3D Reconstruction, [Paper | Code]
- pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction, [Paper | Project Page]
[+]4D Gaussian Splatting for Real-Time Dynamic Scene Rendering, [Paper | Project Page | Code |[+]4K4D: Real-Time 4D View Synthesis at 4K Resolution. [Paper | Project Page | Code (Inference)]]- Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis, [Paper | Project Page | Code | Explanation Video]
- Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction, [Paper | Project Page | Code]
- Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting, Paper
- GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis, Project Page
Papers with shared code are ranked higher in this list
- DreamGaussian4D: Generative 4D Gaussian Splatting, [Paper | Code]
- Text-to-3D using Gaussian Splatting, [📄 Paper | Project Page | Code | Explanation Video]
- DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation, Paper | Project Page | Code | Explanation Video]
- GaussianDreamer: Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors, [Paper | Project Page | Code]
- Gsgen: Text-to-3D using Gaussian Splatting, [Paper | Project Page | Code]
- LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes, [Paper | Project Page]
- PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics, [Paper | Project Page]
- HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting, [Paper]
- Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting, [Paper | Code]
- Gaussian Shell Maps for Efficient 3D Human Generation, [Paper | Code]
- GauHuman: Articulated Gaussian Splatting from Monocular Human Videos, [Paper | Project Page | Code]
- HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting, Paper
- HUGS: Human Gaussian Splats, Paper
- SplatArmor: Articulated Gaussian splatting for animatable humans from monocular RGB videos, Paper
- Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling, Paper
- Human101: Training 100+FPS Human Gaussians in 100s from 1 View, Paper
- Deformable 3D Gaussian Splatting for Animatable Human Avatars, Paper
- LangSplat: 3D Language Gaussian Splatting, [Paper | Project Page | Code]