Oxford-based Lumai has unveiled the Iris Nova, the world's first optical computing system capable of running a billion-parameter large language model in real time. This new system significantly reduces power consumption for AI inference, using up to 90% less energy than traditional systems. The development promises more efficient delivery of AI services for companies. AI
IMPACT Potentially reduces energy costs for AI inference, enabling more widespread deployment of LLMs.
RANK_REASON Launch of a novel computing system with significant power efficiency gains for AI inference.
Read on Mastodon — fosstodon.org →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →