GraftRay method integrates meshes into Gaussian Splatting scenes with accurate lighting

Researchers have developed GraftRay, a novel method for seamlessly integrating mesh objects into scenes reconstructed using Gaussian Splatting. This technique ensures physically accurate lighting and shadows between the inserted object and the scene, addressing limitations of previous approaches that either compromised multi-view consistency or used simplified scene illumination models. GraftRay recovers scene materials and emitter properties, then uses a hybrid renderer to path-trace both the scene's Gaussians and the meshes, achieving superior rendering fidelity and shadow accuracy. AI

IMPACT Enhances realism and consistency in virtual object insertion for AR and synthetic data generation.

RANK_REASON The cluster contains a research paper detailing a new method for 3D scene reconstruction and object insertion. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• 2DGS
• 3D Gaussian splatting
• arXiv
• ComGS
• EAG-PT
• Fundação de Apoio ao Instituto de Pesquisas Tecnológicas
• Gaussian splatting
• GraftRay

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →