Clin-JEPA: A Multi-Phase Co-Training Framework for Joint-Embedding Predictive Pretraining on EHR Patient Trajectories
Researchers have developed Clin-JEPA, a novel multi-phase co-training framework designed for joint-embedding predictive pretraining on electronic health records (EHR). This framework addresses the challenge of creating a single AI model that can both forecast patient trajectories and perform various downstream risk-prediction tasks without requiring task-specific fine-tuning. Clin-JEPA employs a five-phase pretraining curriculum to stably co-train a Qwen3-8B encoder and a latent trajectory predictor, demonstrating improved performance on EHR data by uniquely converging latent rollout drift and learning clinically discriminative latent geometries. AI
IMPACT This framework could advance the development of AI models capable of complex predictive tasks within healthcare, improving patient care and risk assessment.