Nex2 mini Phase Twin - 16gb footprint, 30b model
A new 30 billion parameter model, Nex2 mini Phase Twin, has been released, optimized for local LLM users, particularly those with Intel Arc A770 GPUs. The model is designed to perform well on single-card setups and even better with two cards, automatically calibrating to the user's hardware for optimal performance. Initial reports indicate good performance, with one user achieving 89 tokens/second on a 16GB card. AI
IMPACT Provides a new option for users running local LLMs, especially those with specific hardware like Intel Arc GPUs.