Apple Machine Learning Research has introduced Luce, a novel 3D asset generation system that unifies geometry and physically based rendering (PBR) materials within a voxelized multimodal Gaussian cloud. This representation allows for relighting and integration into standard rendering pipelines by incorporating modalities like albedo, metallic-roughness, and surface normals. Luce utilizes a variational autoencoder and a rectified-flow transformer to generate these PBR Gaussians from a single image, achieving state-of-the-art results on the Toys4K benchmark with a 28% FID improvement and enhancing CLIP image-alignment scores. AI
IMPACT This research could advance the creation of realistic 3D assets for gaming, film, and virtual environments.
RANK_REASON The cluster describes a new research paper detailing a novel 3D asset generation method.
- Luce
- physically based rendering
- Rectified Flow transformer
- Toys4K
- variational auto-encoder
- voxelized multimodal Gaussian cloud
- Alvise Memo
- Apple Machine Learning Research
- Behrooz Shahsavari
- David E. Jacobs
- DSplats
- European Conference on Computer Vision
- Mayank Singh
- Michele Stoppa
- Muhammad Ahmed Riaz
- Rui Yu
- Sree Harsha Kalli
- Srimanth Gunturi
- Waleed H. Abdulla
AI-generated summary · Google Gemini · from 3 sources. How we write summaries →