Research Papers

Research papers on ML for CG, generative 3D, neural rendering, and related topics. Each entry: title (the plain-English summary), year, and venue/links in the description.

• 3D Neural Scene Representations for Visuomotor Control. Li et al., CoRL 2021 Oral
• 3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows. ArXiv 2022 paper on integrating text-to-image AI in 3D design workflows.
• A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields. Park et al., Arxiv 2021 | github
• A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis. Pan et al., NeurIPS 2021 | github
• Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models. 🌐 Project Page
• AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training. Jiang et al., CVPR 2023
• Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies. Peng et al., ICCV 2021 | github
• Animatable Neural Radiance Fields from Monocular RGB Videos. Chen et al., Arxiv 2021 | github
• AutoInt: Automatic Integration for Fast Neural Volume Rendering. Lindell et al., CVPR 2021 | github
• BeyondPixels: A Review of the Evolution of Neural Radiance Fields. AKM Shahariar Azad Rabby and Chengcui Zhang, Arxiv 2023
• Block-NeRF: Scalable Large Scene Neural View Synthesis. Tancik et al., Arxiv 2022
• BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects. Wen et al., CVPR 2023 | github
• CADOps-Net: Jointly Learning CAD Operation Types and Steps from Boundary-Representations. 3DV 2022 | [project]
• CLA-NeRF: Category-Level Articulated Neural Radiance Field. Tseng et al., ICRA 2022
• CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields. Wang et al., CVPR 2022 | github
• CodeNeRF: Disentangled Neural Radiance Fields for Object Categories. Jang et al., ICCV 2021
• Color-NeRF. NeRF research paper on color and appearance modelling.
• Consolidating Attention Features for Multi-view Image Editing. 🌐 Project Page
• Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusion. Bhalgat et al., NeurIPS 2023 (Spotlight)
• CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representation. Moreau et al., ICCV 2023
• D-NeRF: Neural Radiance Fields for Dynamic Scenes. Pumarola et al., CVPR 2021 | github
• Deep Generative Models on 3D Representations: A Survey. 🌐 Project Page
• DeepCAD: A Deep Generative Network for Computer-Aided Design Models. ICCV 2021 | [project] [code]
• Deformable Neural Radiance Fields. Park et al., Arxiv 2020 | github
• Depth-supervised NeRF: Fewer Views and Faster Training for Free. Deng et al., Arxiv 2021 | github
• DeRF: Decomposed Radiance Fields. Rebain et al., Arxiv 2020
• DFNet: Enhance Absolute Pose Regression with Direct Feature Matching. Chen et al., ECCV 2022 | github
• Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction. Sun et al., CVPR 2022 | github
• DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Images. 💻 Code
• DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model. 🌐 Project Page
• DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks. Neff et al., CGF 2021 | github
• Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models. 🌐 Project Page
• DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior. 🌐 Project Page | 💻 Code
• DreamFusion: Text-to-3D using 2D Diffusion. 🌐 Project Page | 💻 Code
• DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation. 🌐 Project Page | 💻 Code
• DreamGaussian4D: Generative 4D Gaussian Splatting. 🌐 Project Page | 💻 Code
• DreamWaltz: Make a Scene with Complex 3D Animatable Avatars. 🌐 Project Page | 💻 Code
• DyLiN: Making Light Field Networks Dynamic. Yu et al., CVPR 2023 | github
• Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction. Gafni et al., CVPR 2021 | github
• DynIBaR: Neural Dynamic Image-Based Rendering. Li et al., CVPR 2023
• Editable Free-viewpoint Video Using a Layered Neural Representation. Zhang et al., SIGGRAPH 2021 | github
• Editing Conditional Radiance Fields. Liu et al., Arxiv 2021 | github
• En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Data. 🌐 Project Page | 💻 Code
• EndoGaussian: Real-time Gaussian Splatting for Dynamic Endoscopic Scene Reconstruction. 🌐 Project Page | 💻 Code
• ENeRF: Efficient Neural Radiance Fields for Interactive Free-viewpoint Video. Lin et al., SIGGRAPH 2022 | github
• FastNeRF: High-Fidelity Neural Rendering at 200FPS. Garbin et al., Arxiv 2021
• FiG-NeRF: Figure Ground Neural Radiance Fields for 3D Object Category Modelling. Xie et al., Arxiv 2021
• From 2D CAD Drawings to 3D Parametric Models: A Vision-Language Approach. AAAI 2025 | [project]
• GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting. 🌐 Project Page | 💻 Code
• GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimation. Chng et al., ECCV 2022
• GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians. 🌐 Project Page
• GaussianObject: High-Quality 3D Object Reconstruction from Four Views with Gaussian Splatting. 🌐 Project Page | 💻 Code
• Gemini Robotics 1.5. Embodied reasoning, thinking, and motion transfer.
• Generative Occupancy Fields for 3D Surface-Aware Image Synthesis. Xu et al., NeurIPS 2021 | github
• GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields. Niemeyer et al., CVPR 2021
• GNeRF: GAN-based Neural Radiance Field without Posed Camera. Meng et al., Arxiv 2021
• GO-NeRF: Generating Objects in Neural Radiance Fields for Virtual Reality Content Creation. 🌐 Project Page
• GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis. Schwarz et al., NeurIPS 2020 | github
• GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering. Trevithick and Yang, Arxiv 2020 | github
• Ha-NeRF: Hallucinated Neural Radiance Fields in the Wild. Chen et al., CVPR 2022 | github
• HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video. Weng et al., CVPR 2022 | github
• IBRNet: Learning Multi-View Image-Based Rendering. Wang et al., CVPR 2021 | github
• IDE-3D: Interactive Disentangled Editing for High-Resolution 3D-aware Portrait Synthesis. 🌐 Project Page | 💻 Code
• Image Sculpting: Precise Object Editing with 3D Geometry Control. 🌐 Project Page | 💻 Code
• Importance Sampling for Production Rendering. SIGGRAPH course notes on importance sampling for production rendering.
• In-Place Scene Labelling and Understanding with Implicit Scene Representation. Zhi et al., Arxiv 2021
• iNeRF: Inverting Neural Radiance Fields for Pose Estimation. Yen-Chen et al. IROS 2021
• InfNeRF: Towards Infinite Scale NeRF Rendering with O(log n) Space Complexity. Liang et al., SIGGRAPH Asia 2024 | github
• Instant3D: Instant Text-to-3D Generation. 🌐 Project Page | 💻 Code
• KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs. Reiser et al., ICCV 2021 | github
• KiloNeuS: Implicit Neural Representations with Real-Time Global Illumination. Esposito et al., Arxiv 2022
• L2G-NeRF: Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields. Chen et al., CVPR 2023 | github
• Learned Initializations for Optimizing Coordinate-Based Neural Representations. Tancik et al., CVPR 2021 | github
• Learning Compositional Radiance Fields of Dynamic Human Heads. Wang et al., Arxiv 2020
• Learning Neural Transmittance for Efficient Rendering of Reflectance Fields. Mohammad Shafiei et al., BMVC 2021
• Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering. Yang et al., ICCV 2021 | github
• Learning the 3D Fauna of the Web. 🌐 Project Page | 💻 Code
• Lightning NeRF: Efficient Hybrid Scene Representation for Autonomous Driving. Cao et al. ICRA 2024 | github
• Loc-NeRF: Monte Carlo Localization using Neural Radiance Fields. Maggio et al., ICRA 2023 | github
• Local 3D Editing via 3D Distillation of CLIP Knowledge. Hyung et al., CVPR 2023| github
• M3DBench: Let's Instruct Large Models with Multi-modal 3D Prompts. 🌐 Project Page | 💻 Code
• Magic3D: High-Resolution Text-to-3D Content Creation. 🌐 Project Page
• Make-A-Character: High Quality Text-to-3D Character Generation within Minutes. 🌐 Project Page | 💻 Code
• Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior. 🌐 Project Page | 💻 Code
• MinD-3D: Reconstruct High-quality 3D objects in Human Brain. 🌐 Project Page | 💻 Code
• MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis. Jiaxin Li et al., ICCV 2021 | github
• Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields. Barron et al., Arxiv 2022
• Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields. Barron et al., Arxiv 2021 | github
• Mixture of Volumetric Primitives for Efficient Neural Rendering. Lombardi et al., SIGGRAPH 2021
• MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo. Chen et al., ICCV 2021 | github
• NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes. Irshad et al., ICCV 2023 | github
• NeRF (paper site). Mildenhall et al., ECCV 2020 | github
• NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images. Ben Mildenhall et al, arXiv 2021
• NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections. Martin-Brualla et al., CVPR 2021
• NeRF--: Neural Radiance Fields Without Known Camera Parameters. Wang et al., Arxiv 2021 | github
• NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors. Liu et al., Arxiv 2022
• NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields. Irshad et al., ECCV 2024
• NeRF-SOS: Any-view Self-supervised Object Segmentation on Complex Real-world Scenes. Fan et al., ICLR 2023
• NeRF-VAE: A Geometry Aware 3D Scene Generative Model. Kosiorek et al., Arxiv 2021
• NeRF: Neural Radiance Field in 3D Vision, Introduction and Review. Kyle Gao, Yina Gao, Hongjie He, Dening Lu, Linlin Xu, Jonathan Li
• NeRF++: Analyzing and Improving Neural Radiance Fields. Zhang et al., Arxiv 2020 | github
• NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo. Wei et al., ICCV 2021
• NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis. Srinivasan et al. CVPR 2021
• Neural 3D Video Synthesis from Multi-view Video. Li et al., CVPR 2022
• Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans. Peng et al., CVPR 2021 | github
• Neural Radiance Flow for 4D View Synthesis and Video Processing. Du et al., Arxiv 2020
• Neural Rays for Occlusion-aware Image-based Rendering. Liu et al., Arxiv 2021
• Neural Refinement for Absolute Pose Regression with Feature Synthesis. Chen et al., CVPR 2024 | github
• Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes. Li et al., CVPR 2021 | github
• Neural Scene Graphs for Dynamic Scenes. Ost et al., CVPR 2021
• Neural Sparse Voxel Fields. Liu et al., NeurIPS 2020 | github
• Neural Volume Rendering: NeRF. Dellaert and Yen-Chen, Arxiv 2020 | blog
• NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction. Wang et al., NeurIPS 2021 | github
• Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video. Tretschk et al., Arxiv 2020 | github
• NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior. Bian et al., CVPR 2023 | github
• One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion. 🌐 Project Page | 💻 Code
• ParSeNet: A Parametric Surface Fitting Network for 3D Point Clouds. ECCV 2020 | [project] [code]
• PC2WF: 3D Wireframe Reconstruction from Raw Point Clouds. ICLR 2021 | [code]
• Photo tourism: Exploring photo collections in 3D. Snavely, Seitz, Szeliski. SIGGRAPH 2006.
• pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis. Chan et al., CVPR 2021
• pixelNeRF: Neural Radiance Fields from One or Few Images. Yu et al., CVPR 2021 | github
• PlankAssembly: 3D Reconstruction from Three Orthographic Views with Learnt Shape Programs. ICCV 2023 | [project] [code]
• PlenOctrees for Real-time Rendering of Neural Radiance Fields. Yu et al., Arxiv 2021 | github
• Point-NeRF: Point-based Neural Radiance Fields. Xu et al., CVPR 2022 | github
• Point2Cyl: Reverse Engineering 3D Objects from Point Clouds to Extrusion Cylinders. CVPR 2022 | [project] [code]
• PolyGen: An Autoregressive Generative Model of 3D Meshes. ICML 2020 | [code]
• Ponder: Point Cloud Pre-training via Neural Rendering. Huang et al., ICCV 2023
• PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm. Zhu et al., Arxiv 2023 | github
• PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction. Bian et al., ICLR 2024 | github
• Portrait Neural Radiance Fields from a Single Image. Gao et al., Arxiv 2020
• Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts. 🌐 Project Page | 💻 Code
• PSAvatar: A Point-based Shape Model for Real-Time Head Avatar Animation with 3D Gaussian Splatting. 💻 Code
• Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis. Matthew Tancik et al., Arxiv 2021
• PVA: Pixel-aligned Volumetric Avatars. Raj et al., CVPR 2021
• PVDeconv: Point-voxel deconvolution for autoencoding cad construction in 3D. ICIP 2020 | [project]
• Reconstructing Editable Prismatic CAD from Rounded Voxel Models. SIGGRAPH Asia 2022
• Recovering HDR Radiance Maps (Debevec & Malik, 1997). SIGGRAPH 1997 paper. Original HDR-from-bracketed-exposures recovery method.
• Rendering Synthetic Objects into Real Scenes (Debevec, 1998). SIGGRAPH 1998 paper founding image-based lighting.
• RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3D. 🌐 Project Page | 💻 Code
• Rig3DGS: Creating Controllable Portraits from Casual Monocular Videos. 🌐 Project Page
• Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion. Wang et al., CVPR 2023 | github
• RT-NeRF: Real-Time On-Device Neural Radiance Fields Towards Immersive AR/VR Rendering. Li et al., ICCAD 2022
• SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearance. 🌐 Project Page
• Self-Calibrating Neural Radiance Fields. Jeong et al., ICCV 2021 | github
• SIGNeRF: Scene Integrated Generation for Neural Radiance Fields. 🌐 Project Page | 💻 Code
• SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field. Bao et al., CVPR 2023 | github
• SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image. Xu et al., ECCV 2022 | github
• Space-time Neural Irradiance Fields for Free-Viewpoint Video. Xian et al., CVPR 2021
• Streaming Radiance Fields for 3D Video Synthesis. Li et al. NeurIPS 2022 | github
• Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splatting. 🌐 Project Page | 💻 Code
• StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis. Gu et al., Arxiv 2021
• Supervised Fitting of Geometric Primitives to 3D Point Clouds. CVPR 2019 | [code]
• SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenes. Gao et al., CVPR 2023 | github
• Switch-NeRF: Learning Scene Decomposition with Mixture of Experts for Large-scale Neural Radiance Fields. Mi et al., ICLR 2023 | github
• Taming Mode Collapse in Score Distillation for Text-to-3D Generation. 🌐 Project Page | 💻 Code
• Text-To-4D Dynamic Scene Generation. 🌐 Project Page
• Text2CAD: Text to 3D CAD Generation via Technical Drawings. NeurIPS 2024 | [project]
• TextField3D: Towards Enhancing Open-Vocabulary 3D Generation with Noisy Text Fields. 🌐 Project Page
• TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion. 🌐 Project Page
• TiNeuVox: Fast Dynamic Radiance Fields with Time-Aware Neural Voxels. Fang et al., SIGGRAPH Asia 2022 | github
• TOSS:High-quality Text-guided Novel View Synthesis from a Single Image. 🌐 Project Page
• Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers. 🌐 Project Page
• UV Volumes for Real-time Rendering of Editable Free-view Human Performance. Chen et al., CVPR 2023 | github
• ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields. 💻 Code
• Volume Rendering of Neural Implicit Surfaces. Yariv et al., NeurIPS 2021 | github
• Wonder3D: Single Image to 3D using Cross-Domain Diffusion. 🌐 Project Page | 💻 Code
• X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360° Insufficient RGB-D Views. Zhu et al., WACV 2023 | github
• Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model. 🌐 Project Page | 💻 Code | 🤗 Hugging Face