New Server Hopes to Break Through AI’s “Memory Wall”
AI startup Majestic Labs is developing a new server called Prometheus, designed to overcome the limitations of current AI hardware by significantly increasing memory capacity. The server will feature up to 128 terabytes of memory, a substantial leap from existing solutions, utilizing a DRAM-centric architecture with a proprietary interface. This approach aims to address the "memory wall" that hinders LLM performance, particularly for large models, by providing more memory bandwidth and capacity than compute. AI
IMPACT This server's massive memory capacity could enable larger, more capable LLMs and accelerate inference, potentially lowering costs for AI operators.