Dynamic NeRF

1. Datasets

Custom Data Preparation

• Monocular Dynamic View Synthesis: A Reality Check
• Process a video into a Nerfie dataset
• Robust Dynamic Radiance Fields Estimate monocular depth, Predict optical flows, Obtain motion mask.
• Neural Scene Flow Fields Instructions for custom data.

Synthetic

• D-Nerf Dataset

Real

• Plenoptic Dataset
• Hypernerf Dataset
• Nerfies Dataset
• Dynamic NeRF Balloon1, Balloon2, Jumping, Playground, Skating, Truck, Umbrella

2. My Notebooks

• Robust Dynamic Radiance Fields, Liu et. al., CVPR, 2023. [Kaggle]

3. Papers

2024

• Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis, Luiten et. al., International Conference on 3D Vision (3DV), 2024. [Paper | Project Page | Code | Explanation Video]
• DaReNeRF: Direction-aware Representation for Dynamic Scenes, CVPR 2024
• DynPoint: Dynamic Neural Point For View Synthesis, NeurIPS 2024.
• Sync-NeRF: Generalizing Dynamic NeRFs to Unsynchronized Videos, AAAI2024. [Code]
• SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes. [Code]
• InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 40 Seconds, Project
• GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation
• Entity-NeRF: Detecting and Removing Moving Entities in Urban Scenes, CVPR 2024. Project
• Ced-NeRF: A Compact and Efficient Method for Dynamic Neural Radiance Fields, AAAI 2024. Paper

2023

• DynIBaR: Neural Dynamic Image-Based Rendering, CVPR, 2023 [Project Page]
• Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Rendering, Shao et. al., CVPR, 2023. [Paper | Code]
• HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling, CVPR 2023 (Highlight). Code
• HexPlane: A Fast Representation for Dynamic Scenes, Cao et. al., CVPR, 2023. [Paper | Project Page | Code]
• Robust Dynamic Radiance Fields, Liu et. al., CVPR, 2023. [Code | Kaggle]
• V4D: Voxel for 4D Novel View Synthesis, Gan et. al., IEEE Transactions on Visualization and Computer Graphics, 2023. [Paper | Code] (instructions for custom data)
• Dynamic Mesh-Aware Radiance Fields, ICCV, 2023. [Project Page | Code]
• NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields, IEEE Transactions on Visualization and Computer Graphics, vol 29(5), 2023. [Code]
• Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction, Yang et. al., ACM Transactions on Graphics, 2023. [Paper | Project Page | Code]
• V4d: Voxel for 4d novel view synthesis, Gan et. al., IEEE Transactions on Visualization and Computer Graphics, 2023. [Code]
• MixVoxels: Mixed Neural Voxels for Fast Multi-view Video Synthesis, ICCV2023 Oral. Code

2022

• Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-time, CVPR 2022 [Project Page]
• D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video, NeurIPS, 2022. [Project Page | Code]
• Monocular Dynamic View Synthesis: A Reality Check, Gao et. al., Neurips 2022. [Project Page]
• TiNeuVox: Fast Dynamic Radiance Fields with Time-Aware Neural Voxels, Fang et. al., ACM SIGGRAPH Asia 2022. [Project Page | Code]

2021

• Nerfies: Deformable Neural Radiance Fields, ICCV, 2021. [Code] (instructions for custom data, this is the one everyone refering to)
• Dynamic View Synthesis from Dynamic Monocular Video, ICCV, 2021. [Code]
• HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields, ACM Trans. Graph, 2021. [Code | Project Page | Colab] (instructions for custom data)
• BARF: Bundle-Adjusting Neural Radiance Fields, Lin et. al., ICCV 2021 (Oral). [Code]

2020

• D-NeRF: Neural Radiance Fields for Dynamic Scenes, Pumarola et. al, CVPR 2020. [Project Page | Code]