Unsloth Gemma 4 mmproj breaks llama.cpp multimodal features

A user on r/LocalLLaMA reported that Unsloth's Gemma 4 mmproj files caused multimodal features like vision and audio processing to fail on newer builds of llama.cpp. The issue manifested as the model outputting unused tokens instead of meaningful results for image and audio inputs. The user speculated that this incompatibility arose because Unsloth's independent conversion pipeline for mmproj files did not keep pace with changes in llama.cpp's internal processing of multimodal tokens, unlike the official GGUF models maintained by the same organization. AI

IMPACT Highlights potential compatibility issues when using third-party model quantizations with evolving inference engines.

RANK_REASON User-reported issue with a specific software component's compatibility.

Read on r/LocalLLaMA →

• Gemma 4
• llama.cpp
• mmproj
• ScreenMind
• Unsloth

• product
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →