RSR++

New SSR method accelerates ternary LLM inference

Researchers have developed Sparse Segment Reduction (SSR), a new method for accelerating the inference of ternary Large Language Models (LLMs). This approach optimizes matrix multiplication for ternary weights, which ar…