Resources tagged: nerf

99 curated 3D resources tagged nerf (Tech). Browse all tags.

• 3D Gaussian Splatting (INRIA reference impl) reference. Official INRIA code for the 2023 3D Gaussian Splatting paper, with training, viewer and evaluation scripts.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• 3D Neural Scene Representations for Visuomotor Control paper. Li et al., CoRL 2021 Oral.
  in AI & Machine Learning for CG → Research Papers
• 3DGS Introduction reference. HuggingFace introductory guide to 3D Gaussian Splatting.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• 3DGS.cpp tool. Cross-platform, high performance 3DGS renderer in C++ and Vulkan Compute, supporting Windows, macOS, Linux, iOS, and visionOS.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• 4D Gaussian Splatting reference. Dynamic scenes (CVPR 2024).
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields paper. Park et al., SIGGRAPH Asia 2021. HyperNeRF: lifts NeRF into a higher-dimensional space to handle scenes whose topology changes.
  in AI & Machine Learning for CG → Research Papers
• A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis paper. Pan et al., NeurIPS 2021. ShadeGAN: 3D-aware GAN with explicit lighting and shading for more accurate generated shapes.
  in AI & Machine Learning for CG → Research Papers
• AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training paper. Jiang et al., CVPR 2023. Alignment-aware training that reduces misalignment blur so NeRF renders high-resolution detail.
  in AI & Machine Learning for CG → Research Papers
• Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies paper. Peng et al., ICCV 2021. Builds animatable NeRF human models from multi-view video using skeleton-driven deformation fields.
  in AI & Machine Learning for CG → Research Papers
• AutoInt: Automatic Integration for Fast Neural Volume Rendering paper. Lindell et al., CVPR 2021. Learns closed-form integrals of volume rendering to speed up neural rendering.
  in AI & Machine Learning for CG → Research Papers
• Block-NeRF: Scalable Large Scene Neural View Synthesis paper. Tancik et al., Arxiv 2022.
  in AI & Machine Learning for CG → Research Papers
• Brush tool. Cross-platform Gaussian Splatting reconstruction and viewer (Rust/wgpu), runs in browser.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects paper. Wen et al., CVPR 2023. Jointly tracks the 6-DoF pose of an unknown object and reconstructs its 3D shape from RGB-D video.
  in AI & Machine Learning for CG → Research Papers
• CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields paper. Wang et al., CVPR 2022. Edits the shape and color of NeRF objects using CLIP text or image prompts.
  in AI & Machine Learning for CG → Research Papers
• CodeNeRF: Disentangled Neural Radiance Fields for Object Categories paper. Jang et al., ICCV 2021. Category-level NeRF with separate shape and texture codes for editing and novel view synthesis.
  in AI & Machine Learning for CG → Research Papers
• Color-NeRF paper. NeRF research paper on color and appearance modelling.
  in AI & Machine Learning for CG → Research Papers
• Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusion paper. Bhalgat et al., NeurIPS 2023 (**Spotlight**)
  in AI & Machine Learning for CG → Research Papers
• D-NeRF: Neural Radiance Fields for Dynamic Scenes paper. Pumarola et al., CVPR 2021. Extends NeRF with a time-conditioned deformation field to render dynamic scenes from monocular video.
  in AI & Machine Learning for CG → Research Papers
• Deformable Neural Radiance Fields paper. Park et al., ICCV 2021. Nerfies: adds a learned deformation field to NeRF to capture non-rigid scenes from handheld phone video.
  in AI & Machine Learning for CG → Research Papers
• DFNet: Enhance Absolute Pose Regression with Direct Feature Matching paper. Chen et al., ECCV 2022. Improves camera pose regression by matching features against novel views rendered from a NeRF.
  in AI & Machine Learning for CG → Research Papers
• DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks paper. Neff et al., CGF 2021. Uses a depth oracle network to cut samples per ray for near real-time NeRF rendering.
  in AI & Machine Learning for CG → Research Papers
• DyLiN: Making Light Field Networks Dynamic paper. Yu et al., CVPR 2023. Extends light field networks to dynamic scenes for fast rendering of deforming content.
  in AI & Machine Learning for CG → Research Papers
• Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction paper. Gafni et al., CVPR 2021. Dynamic NeRF conditioned on expression parameters to build 4D facial avatars from monocular video.
  in AI & Machine Learning for CG → Research Papers
• DynIBaR: Neural Dynamic Image-Based Rendering paper. Li et al., CVPR 2023. Image-based rendering method for novel view synthesis from long monocular videos of dynamic scenes.
  in AI & Machine Learning for CG → Research Papers
• Editable Free-viewpoint Video Using a Layered Neural Representation paper. Zhang et al., SIGGRAPH 2021. Layered neural representation of free-viewpoint video that lets performers be moved, scaled or removed.
  in AI & Machine Learning for CG → Research Papers
• Editing Conditional Radiance Fields paper. Liu et al., ICCV 2021. Conditional radiance fields that let users edit shape and color of object categories with a few scribbles.
  in AI & Machine Learning for CG → Research Papers
• ENeRF: Efficient Neural Radiance Fields for Interactive Free-viewpoint Video paper. Lin et al., SIGGRAPH Asia 2022. Generalizable NeRF using cascaded cost volumes for interactive free-viewpoint video of dynamic scenes.
  in AI & Machine Learning for CG → Research Papers
• FiG-NeRF: Figure Ground Neural Radiance Fields for 3D Object Category Modelling paper. Xie et al., 3DV 2021. Separates foreground objects from background with two NeRFs to model 3D object categories.
  in AI & Machine Learning for CG → Research Papers
• Gaussian Head Avatars: A Summary reference. Summary of Gaussian-splatting head-avatar techniques (Towards Data Science).
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• Generative Occupancy Fields for 3D Surface-Aware Image Synthesis paper. Xu et al., NeurIPS 2021. Combines occupancy and radiance fields in a 3D-aware GAN for more accurate surfaces.
  in AI & Machine Learning for CG → Research Papers
• Ha-NeRF: Hallucinated Neural Radiance Fields in the Wild paper. Chen et al., CVPR 2022. Builds NeRFs from in-the-wild photo collections, handling appearance changes and transient occluders.
  in AI & Machine Learning for CG → Research Papers
• HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video paper. Weng et al., CVPR 2022. Renders moving people from new viewpoints using a NeRF trained on a single monocular video.
  in AI & Machine Learning for CG → Research Papers
• IBRNet: Learning Multi-View Image-Based Rendering paper. Wang et al., CVPR 2021. Learns to blend nearby source views for image-based rendering that generalizes to unseen scenes.
  in AI & Machine Learning for CG → Research Papers
• In-Place Scene Labelling and Understanding with Implicit Scene Representation paper. Zhi et al., ICCV 2021. Semantic-NeRF: adds semantic labels to a radiance field to propagate sparse labels across a scene.
  in AI & Machine Learning for CG → Research Papers
• iNeRF: Inverting Neural Radiance Fields for Pose Estimation paper. Yen-Chen et al. IROS 2021.
  in AI & Machine Learning for CG → Research Papers
• InfNeRF: Towards Infinite Scale NeRF Rendering with O(log n) Space Complexity paper. Liang et al., SIGGRAPH Asia 2024. Octree-based level-of-detail NeRF that renders very large scenes with O(log n) memory.
  in AI & Machine Learning for CG → Research Papers
• instant-ngp (NVIDIA) Free, non-commercial tool. NVIDIA fast NeRF trainer and viewer using multiresolution hash encoding.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• JaxNeRF reference. Deng et al., 2020. JAX NeRF with multi-device training.
  in Tools, Pipeline & Utilities → Photogrammetry & 3D Scanning
• L2G-NeRF: Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields paper. Chen et al., CVPR 2023. Bundle-adjusting NeRF that registers cameras locally per pixel before global alignment.
  in AI & Machine Learning for CG → Research Papers
• Learning Compositional Radiance Fields of Dynamic Human Heads paper. Wang et al., CVPR 2021. Hybrid voxel and MLP radiance field for rendering dynamic human heads with fine detail.
  in AI & Machine Learning for CG → Research Papers
• Learning Neural Transmittance for Efficient Rendering of Reflectance Fields paper. Mohammad Shafiei et al., BMVC 2021.
  in AI & Machine Learning for CG → Research Papers
• Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering paper. Yang et al., ICCV 2021. Object-compositional NeRF that lets individual objects in a scene be moved, duplicated or removed.
  in AI & Machine Learning for CG → Research Papers
• LichtFeld Studio tool. Native desktop app for training, inspecting, editing, and exporting 3D Gaussian Splatting scenes. Plugin extensible.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• MegaSaM reference. Structure and motion recovery from casual handheld video.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis paper. Li et al., ICCV 2021. Combines multiplane images with NeRF to predict continuous-depth MPIs from a single image.
  in AI & Machine Learning for CG → Research Papers
• Mip-NeRF reference. google, 2021. Anti-aliased NeRF reference implementation.
  in Tools, Pipeline & Utilities → Photogrammetry & 3D Scanning
• Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields paper. Barron et al., Arxiv 2022.
  in AI & Machine Learning for CG → Research Papers
• Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields paper. Barron et al., ICCV 2021. Renders anti-aliased cones instead of rays so NeRF handles multiple scales without aliasing.
  in AI & Machine Learning for CG → Research Papers
• msplat tool. A modular differential gaussian rasterization library.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo paper. Chen et al., ICCV 2021. Uses multi-view stereo cost volumes so radiance fields generalize to new scenes from three input views.
  in AI & Machine Learning for CG → Research Papers
• NeRF reference. Mildenhall et al., 2020. Original NeRF reference implementation.
  in Tools, Pipeline & Utilities → Photogrammetry & 3D Scanning
• NeRF (paper site) paper. Mildenhall et al., ECCV 2020. The original NeRF: an MLP that maps 5D coordinates to color and density for novel view synthesis.
  in AI & Machine Learning for CG → Research Papers
• NeRF (PyTorch3D) reference. facebookresearch, 2020. NeRF project inside PyTorch3D.
  in Tools, Pipeline & Utilities → Photogrammetry & 3D Scanning
• NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images paper. Ben Mildenhall et al, arXiv 2021.
  in AI & Machine Learning for CG → Research Papers
• NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections paper. Martin-Brualla et al., CVPR 2021.
  in AI & Machine Learning for CG → Research Papers
• NeRF--: Neural Radiance Fields Without Known Camera Parameters paper. Wang et al., arXiv 2021. Trains NeRF while jointly estimating camera intrinsics and extrinsics from forward-facing images.
  in AI & Machine Learning for CG → Research Papers
• NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors paper. Liu et al., arXiv 2022. Removes user-selected objects from a NeRF scene using RGB-D inpainting priors.
  in AI & Machine Learning for CG → Research Papers
• NeRF-PyTorch (yenchenlin) reference. Yen-Chen Lin, 2020. Faithful PyTorch reimplementation of NeRF.
  in Tools, Pipeline & Utilities → Photogrammetry & 3D Scanning
• NeRF-PyTorch-Lightning (nerf_pl) reference. kwea123, 2020. NeRF in PyTorch-Lightning.
  in Tools, Pipeline & Utilities → Photogrammetry & 3D Scanning
• NeRF-SOS: Any-view Self-supervised Object Segmentation on Complex Real-world Scenes paper. Fan et al., ICLR 2023. Self-supervised object segmentation that works from any view of complex real-world scenes using NeRF.
  in AI & Machine Learning for CG → Research Papers
• NeRF-W (nerf_pl) reference. kwea123, 2021. NeRF in the Wild reimplementation.
  in Tools, Pipeline & Utilities → Photogrammetry & 3D Scanning
• NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo paper. Wei et al., ICCV 2021. Guides NeRF optimization with monocular depth priors for indoor multi-view stereo reconstruction.
  in AI & Machine Learning for CG → Research Papers
• NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis paper. Srinivasan et al. CVPR 2021.
  in AI & Machine Learning for CG → Research Papers
• Neural 3D Video Synthesis from Multi-view Video paper. Li et al., CVPR 2022. Dynamic NeRF conditioned on latent codes that renders novel views of multi-view video.
  in AI & Machine Learning for CG → Research Papers
• Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans paper. Peng et al., CVPR 2021. Anchors latent codes to a deformable body mesh to render dynamic humans from sparse multi-view video.
  in AI & Machine Learning for CG → Research Papers
• Neural Radiance Flow for 4D View Synthesis and Video Processing paper. Du et al., ICCV 2021. Learns a 4D radiance and flow field for view synthesis and video processing such as denoising and super-resolution.
  in AI & Machine Learning for CG → Research Papers
• Neural Rays for Occlusion-aware Image-based Rendering paper. Liu et al., CVPR 2022. Image-based rendering that predicts visibility per ray to handle occlusions when synthesizing novel views.
  in AI & Machine Learning for CG → Research Papers
• Neural Refinement for Absolute Pose Regression with Feature Synthesis paper. Chen et al., CVPR 2024. Refines camera pose regression at test time using features rendered from a neural feature field.
  in AI & Machine Learning for CG → Research Papers
• Neural Rendering (YouTube) channel. YouTube channel run by Ben Mildenhall with talks and videos on NeRF and neural rendering research.
  in Tools, Pipeline & Utilities → Photogrammetry & 3D Scanning
• Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes paper. Li et al., CVPR 2021. Models dynamic scenes as time-varying scene flow fields for space-time view synthesis from monocular video.
  in AI & Machine Learning for CG → Research Papers
• Neural Scene Graphs for Dynamic Scenes paper. Ost et al., CVPR 2021. Decomposes dynamic scenes like driving footage into a learned scene graph of moving objects.
  in AI & Machine Learning for CG → Research Papers
• Neural Sparse Voxel Fields paper. Liu et al., NeurIPS 2020. Organizes a radiance field into a sparse voxel octree to skip empty space and render faster.
  in AI & Machine Learning for CG → Research Papers
• Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video paper. Tretschk et al., ICCV 2021. Reconstructs deforming scenes from monocular video with a NeRF plus a learned ray-bending deformation field.
  in AI & Machine Learning for CG → Research Papers
• NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior paper. Bian et al., CVPR 2023. Trains NeRF without pose priors by using monocular depth to constrain relative camera poses.
  in AI & Machine Learning for CG → Research Papers
• pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis paper. Chan et al., CVPR 2021. 3D-aware GAN using SIREN periodic activations in a radiance field to generate view-consistent images.
  in AI & Machine Learning for CG → Research Papers
• PlenOctrees for Real-time Rendering of Neural Radiance Fields paper. Yu et al., ICCV 2021. Bakes NeRFs into octrees of spherical harmonics for real-time rendering.
  in AI & Machine Learning for CG → Research Papers
• Point-NeRF: Point-based Neural Radiance Fields paper. Xu et al., CVPR 2022. Uses neural point clouds to model radiance fields, initialized from multi-view stereo for fast training.
  in AI & Machine Learning for CG → Research Papers
• Pointrix tool. Differentiable point-based rendering framework for Gaussian Splatting.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• Ponder: Point Cloud Pre-training via Neural Rendering paper. Huang et al., ICCV 2023. Pre-trains point cloud encoders by rendering color and depth images through differentiable neural rendering.
  in AI & Machine Learning for CG → Research Papers
• PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction paper. Bian et al., ICLR 2024. Learns a pose residual field to refine camera poses for more accurate neural surface reconstruction.
  in AI & Machine Learning for CG → Research Papers
• Portrait Neural Radiance Fields from a Single Image paper. Gao et al., arXiv 2020. Meta-learned NeRF that reconstructs a portrait radiance field from a single headshot.
  in AI & Machine Learning for CG → Research Papers
• Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis paper. Matthew Tancik et al., Arxiv 2021.
  in AI & Machine Learning for CG → Research Papers
• PVA: Pixel-aligned Volumetric Avatars paper. Raj et al., CVPR 2021. Builds volumetric head avatars from a few input views using pixel-aligned features.
  in AI & Machine Learning for CG → Research Papers
• PyTorch Implementation reference. Curated implementation of Vanilla 3DGS in PyTorch.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion paper. Wang et al., CVPR 2023. Diffusion model that generates 3D digital avatars as neural radiance fields, including from text or a photo.
  in AI & Machine Learning for CG → Research Papers
• Self-Calibrating Neural Radiance Fields paper. Jeong et al., ICCV 2021. Jointly learns scene geometry and camera calibration, including lens distortion, without a calibration target.
  in AI & Machine Learning for CG → Research Papers
• SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field paper. Bao et al., CVPR 2023. Edits a NeRF from a single edited image using semantic and geometric priors.
  in AI & Machine Learning for CG → Research Papers
• SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image paper. Xu et al., ECCV 2022. Trains a NeRF on complex scenes from a single image using semi-supervised geometry and semantic losses.
  in AI & Machine Learning for CG → Research Papers
• Space-time Neural Irradiance Fields for Free-Viewpoint Video paper. Xian et al., CVPR 2021. Space-time irradiance field that renders free-viewpoint video from a single monocular video plus depth.
  in AI & Machine Learning for CG → Research Papers
• spaTV tool. WebGL Viewer for 4D Gaussians (based on SpaceTime Gaussian) with demo here.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• SpectacularAI tool. Conversion scripts for different 3DGS conventions.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• splatviz tool. Viewer that allows you to edit the rendering code during runtime or to display multiple scenes at once.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis paper. Gu et al., ICLR 2022. Style-based 3D-aware generator combining NeRF and StyleGAN to synthesize high-resolution, view-consistent images.
  in AI & Machine Learning for CG → Research Papers
• Switch-NeRF: Learning Scene Decomposition with Mixture of Experts for Large-scale Neural Radiance Fields paper. Mi et al., ICLR 2023. Mixture-of-experts NeRF that learns to split large-scale scenes into sub-networks.
  in AI & Machine Learning for CG → Research Papers
• Taichi 3D GS tool. Taichi-based implementation (Apache-2.0).
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• TiNeuVox: Fast Dynamic Radiance Fields with Time-Aware Neural Voxels paper. Fang et al., SIGGRAPH Asia 2022. Time-aware voxel features that train dynamic radiance fields in minutes.
  in AI & Machine Learning for CG → Research Papers
• UV Volumes for Real-time Rendering of Editable Free-view Human Performance paper. Chen et al., CVPR 2023. Encodes human performances in UV volumes so free-view video renders in real time and can be retextured.
  in AI & Machine Learning for CG → Research Papers
• vkgs tool. Cross-platform, high performance 3DGS renderer in C++ and Vulkan Compute/Graphics.
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF
• Warp 3DGS tool. Warp/Python-based implementation (AGPL-3.0).
  in Tools, Pipeline & Utilities → Gaussian Splatting & NeRF