WeatherOcc3D uses VLM to improve 3D prediction in bad weather

By PulseAugur Editorial · Summary by gemini-2.5-flash-lite from 1 source

Researchers have developed a new framework called WeatherOcc3D that uses Visual-Language Models (VLMs) to improve 3D semantic occupancy prediction in adverse weather conditions. The system leverages CLIP's latent space and weather-specific text embeddings to dynamically adjust the fusion of camera and LiDAR sensor data. This adaptive approach prioritizes camera features in clear daylight and LiDAR features during rainy nights, significantly outperforming traditional fusion methods on the nuScenes dataset. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

IMPACT Improves robustness of autonomous driving perception systems in challenging weather conditions.

RANK_REASON The cluster contains an academic paper detailing a new method for 3D semantic occupancy prediction. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

paper
other

COVERAGE [1]

arXiv cs.CV TIER_1 · Hasan F. Ates · 2026-05-15 16:12

WeatherOcc3D: VLM-Assisted Adverse Weather Aware 3D Semantic Occupancy Prediction

While multi-modal 3D semantic occupancy prediction typically enhances robustness by fusing camera and LiDAR inputs, its effectiveness is fundamentally constrained by environmental variability. Specifically, camera sensors suffer from severe low-light degradation, while LiDAR sens…

COVERAGE [1]

WeatherOcc3D: VLM-Assisted Adverse Weather Aware 3D Semantic Occupancy Prediction

RELATED ENTITIES

RELATED TOPICS