Furiosa AI selling inference chip to consumer market will be a game changer to local llm
South Korean startup Furiosa AI has developed a new inference chip, the Renegade, built on a 5nm node with 48GB of HBM3 VRAM and 1.5TB/s memory bandwidth. While initially not intended for the consumer market, the chip has been tested with LG's LLM. The company's potential to open its programming interface could significantly impact the local LLM landscape, especially if priced competitively around $2.5k. AI
IMPACT This chip's high memory bandwidth and VRAM could significantly improve local LLM performance if made accessible to consumers.