We need a 80-160B model urgently. The unified memory device market needs more Models.
Users on the r/LocalLLaMA subreddit are expressing a strong need for new large language models (LLMs) in the 80-160 billion parameter range. Current models are either too small for users with high-capacity but slower unified memory systems (like Apple devices or AMD Ryzen AI 395) or too large for those with limited VRAM. The community is requesting models that can effectively utilize systems with 80-128GB of RAM or 64GB of VRAM, as existing options are either outdated or poorly suited for their hardware configurations. AI
IMPACT The demand highlights a gap in the market for LLMs optimized for high-capacity, lower-bandwidth memory systems, potentially influencing future model development priorities.