PulseAugur
EN
LIVE 03:54:58

Astera's Leo X boosts AI inference with fabric-attached DRAM

Astera has introduced its Leo X product, designed to enhance AI inference racks. This new technology utilizes fabric-attached DRAM to provide AI accelerators with increased space for KV caches, which is crucial for handling long-context workloads. AI

IMPACT This hardware advancement could improve the efficiency and capability of AI models handling long-context data.

RANK_REASON Product launch for AI hardware component.

Read on Mastodon — mastodon.social →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Astera's Leo X boosts AI inference with fabric-attached DRAM

COVERAGE [1]

  1. Mastodon — mastodon.social TIER_1 English(EN) · michel_k ·

    Astera’s Leo X targets AI inference racks with fabric-attached DRAM, giving accelerators more room for KV caches in long-context workloads. # tech # technology

    Astera’s Leo X targets AI inference racks with fabric-attached DRAM, giving accelerators more room for KV caches in long-context workloads. # tech # technology # ai # memory # cxl # datacenter https:// techshowup.com/News/Article/01 a0f00d-3c99-79fd-b61f-ce9e0825d1e3/astera-leo-x…