Orbit Open-Source RL Framework Enables Single-Node Trillion-Parameter Model Training
Sphere AI Lab has released Orbit, an open-source framework designed for the post-training of large language models. This framework allows for the fine-tuning of trillion-parameter models, such as DeepSeek-V4, to be conducted on a single high-performance node. The development aims to make advanced model training more accessible. AI
IMPACT Enables fine-tuning of massive models on single nodes, potentially lowering the barrier to entry for advanced LLM research and development.