Ruliad

Aphrodite Engine renamed Sonar, enhances vLLM inference capabilities

Sonar, formerly known as Aphrodite Engine, is an inference engine for Hugging Face-compatible language and multimodal models. It is based on vLLM and incorporates features like continuous batching, paged KV-cache manage…