New Temporal-Distance JEPA Enhances AI World Model Planning

Researchers have introduced Temporal-Distance JEPA (TD-JEPA), a novel approach to representation learning for latent world model predictive control. This method enhances Joint-Embedding Predictive Architectures (JEPAs) by mining a directed temporal cost from reward-free trajectories, improving the ability to plan based on goal progress. TD-JEPA uses same-trajectory step order as positive targets and cross-trajectory pairs as heuristic negatives, alongside a rollout-consistency term. This approach aims to bridge the gap between training and planning in JEPA world models by uncovering temporal progress structures within offline logs. AI

IMPACT This research could improve the planning capabilities of AI systems by enabling them to better understand and predict future states from observational data.

RANK_REASON This is a research paper detailing a new method for representation learning in AI. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• arXiv
• Joint-Embedding Predictive Architectures
• Lewman
• OGB-Cube
• RC-aux
• Temporal-Distance JEPA
• Two Room

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →