AWS Trainium3

AI inference splits: SRAM for decode, HBM for training

AI inference is diverging into two distinct paths based on hardware requirements. Latency-sensitive decode operations are moving to SRAM-based chips that eschew High Bandwidth Memory (HBM), exemplified by NVIDIA's Groq …