Apple's REFACTOR-VLA system addresses limitations in current vision-language-action (VLA) models by learning reusable skills through a wake/sleep architecture. Unlike monolithic models that output raw commands, REFACTOR-VLA organizes behaviors into structured programs, improving performance on long-horizon tasks. The system uses a Behavioral-Equivalence Kernel and Hindley-Milner-inspired typed lambda terms, with findings indicating that simply increasing model size is less effective than optimizing the training objective, particularly by adding an auxiliary supervised contrastive loss. AI
IMPACT Improves robot learning by enabling more interpretable and reusable skills for complex tasks.
RANK_REASON Research paper detailing a new system for learning motor programs.
Read on Apple Machine Learning Research →
- Behavioral-Equivalence Kernel
- Hindley--Milner
- InfoNCE
- Libero
- minimum description length
- OpenVLA
- RDT-1B
- real-LIBERO
- REFACTOR-VLA
- RT-2
- Conference on Neural Information Processing Systems
- Hindley–Milner
- π0
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →