sliding-window softmax attention

GLIDE: New Attention Method Boosts LLM Inference Efficiency

Researchers have introduced GLIDE, a novel approach to enhance the efficiency of large language models (LLMs) during inference, particularly for long-context generation. GLIDE employs a Guided Layerwise Hybrid Attention…