PulseAugur
EN
LIVE 09:11:15

X-Lens model enables real-time metric depth estimation with heterogeneous cameras

Researchers have developed X-Lens, a novel feed-forward model for real-time metric depth estimation using a variable number of heterogeneous cameras, including fisheye and pinhole views. The model utilizes learnable calibration tokens and a Jacobian-parameterized distortion bias to achieve cross-camera consistency and robust generalization with a compact 0.04B parameters, operating at up to 41 FPS. X-Lens was trained on public datasets and the newly released OmniScene synthetic dataset, demonstrating superior accuracy and efficiency compared to existing methods. AI

IMPACT This model could improve real-time perception systems in robotics and autonomous vehicles by enabling more accurate depth estimation from diverse camera inputs.

RANK_REASON The cluster describes a research paper detailing a new model for computer vision tasks.

Read on arXiv cs.CV →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

X-Lens model enables real-time metric depth estimation with heterogeneous cameras

COVERAGE [2]

  1. arXiv cs.CV TIER_1 English(EN) · Heng Zhou, Shuhong Liu, Yonghao He, Bohao Zhang, Fa Fu, Chenhui Hou, Xianbao Hou, Lijun Han, Wei Sui ·

    X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Cameras

    arXiv:2607.12993v1 Announce Type: new Abstract: We present X-lens, a compact feed-forward model for metric depth estimation from a variable number of calibrated fisheye and pinhole views. To support real-time downstream perception, X-lens is built around a geometry-aware heteroge…

  2. arXiv cs.CV TIER_1 English(EN) · Wei Sui ·

    X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Cameras

    We present X-lens, a compact feed-forward model for metric depth estimation from a variable number of calibrated fisheye and pinhole views. To support real-time downstream perception, X-lens is built around a geometry-aware heterogeneous camera formulation with two key components…