Brief

Meta's Llama 4 Scout, a 109 billion parameter mixture-of-experts model, requires approximately 25GB of VRAM for usable performance at Q4_K_M quantization. The RTX 5090 with 32GB of VRAM is presented as the sole single consumer GPU capable of running the model locally. For a more cost-effective local solution, a dual RTX 3090 setup offers comparable performance and more VRAM for a similar price, though it involves greater complexity. Cloud GPU instances are recommended for users who only need to run the model occasionally. AI

Prospector Labs has introduced "luckrig," a concept for evaluating the specific hardware configurations, or "rigs," used to run large language models, rather than just the models themselves. This system aims to fill a gap by allowing users to test models with exact GPU specifications, quantization, and context lengths, inspired by the early P2P tool Hotline Connect. Users can earn access to other people's rigs by contributing their own tuning notes and timing measurements, with a focus on hardware diversity over speed or leaderboards. AI

The NVIDIA RTX 5090, released in early 2025, offers a significant upgrade for local LLM users with its 32GB of GDDR7 memory, compared to the RTX 4090's 24GB of GDDR6X. This increased VRAM allows the 5090 to comfortably run larger models, such as 34B parameter models at higher quantization levels, and even 70B models at lower quantizations, which are impossible on the 4090. While the 5090 comes at a higher price point of approximately $2,000, it provides substantial benefits for those needing to run larger models or requiring more VRAM for longer context windows, whereas the RTX 4090 remains a strong option for users primarily working with smaller models. AI

Microsoft's Copilot is being utilized for creative tasks such as generating program names and background images, with tips provided on how to elicit desired responses. Separately, Ray-Ban Meta's second-generation smart sunglasses have launched in Japan, retailing from 73,700 yen. Additionally, a new gaming PC featuring the GeForce RTX 5090 Founders Edition and a Ryzen 7 9800X3D CPU has been released, boasting powerful performance for both gaming and generative AI applications. AI

Razer has officially unveiled its new Blade 18 laptop, featuring high-end specifications aimed at gamers and professionals. The device boasts the latest Intel Core Ultra processors and NVIDIA GeForce RTX 5090 graphics, promising top-tier performance. However, the premium hardware comes with a significant price tag, which is noted as being notably high. AI