Janas

Janas project enables LLMs larger than RAM via SSD streaming

A new open-source project called Janas enables running large language models (LLMs) that exceed a computer's available RAM by efficiently streaming model layers from a Solid State Drive (SSD). This technique allows for …