llama.cpp SYCL benchmarks show mixed performance for Gemma and Qwen models

Benchmarks for the llama.cpp project using the SYCL backend have been released, showcasing performance metrics for various models. The tests included Gemma 4 models of different sizes (4.65B, 11.91B, and 25.23B parameters) and Qwen 35 models (27.32B and 34.66B parameters). While the SYCL backend appears functional, the results suggest that performance could be further optimized. AI

IMPACT Provides insights into the performance of SYCL backend for local LLM inference, potentially guiding optimization efforts.

RANK_REASON The item details performance benchmarks for a specific software implementation (llama.cpp) using a particular backend (SYCL) with various language models. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

• Gemma 4
• llama.cpp
• Qwen 35

• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →