PulseAugur
EN
LIVE 09:14:28

New JEPA Architectures Achieve Stable End-to-End Training from Pixels

Researchers have developed LeWorldModel (LeWM), a novel Joint Embedding Predictive Architecture (JEPA) that stably trains end-to-end from raw pixels. Unlike previous fragile JEPA methods, LeWM uses only two loss terms and can be trained on a single GPU in hours, planning up to 48 times faster than foundation-model-based world models. A subsequent paper introduces UR-JEPA, which refines JEPA training by targeting uniform rectifiability, showing improved seed stability and distinct geometric representations compared to LeJEPA. AI

IMPACT These advancements in JEPA architectures offer more stable and efficient methods for learning world models from raw pixels, potentially accelerating progress in AI planning and control tasks.

RANK_REASON Two academic papers introducing new architectures and training methods for Joint Embedding Predictive Architectures.

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

New JEPA Architectures Achieve Stable End-to-End Training from Pixels

COVERAGE [2]

  1. arXiv cs.LG TIER_1 English(EN) · Lucas Maes, Quentin Le Lidec, Damien Scieur, Yann LeCun, Randall Balestriero ·

    LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels

    arXiv:2603.19312v3 Announce Type: replace Abstract: Joint Embedding Predictive Architectures (JEPAs) offer a compelling framework for learning world models in compact latent spaces, yet existing methods remain fragile, relying on complex multi-term losses, exponential moving aver…

  2. arXiv cs.AI TIER_1 English(EN) · Triet M. Le ·

    UR-JEPA: Uniform Rectifiability as a Regularizer for Joint-Embedding Predictive Architectures

    arXiv:2606.01443v1 Announce Type: cross Abstract: A central difficulty in training Joint-Embedding Predictive Architectures (JEPAs) is preventing representation collapse. LeJEPA addresses this by enforcing an isotropic Gaussian target on the embeddings via Sketched Isotropic Gaus…