Can't seem to enable reasoning in llama.cpp
A user on the r/LocalLLaMA subreddit is seeking assistance with enabling reasoning capabilities in the llama.cpp software. They have attempted to use specific parameters like '--chat-template-kwargs '{"enable_thinking":true}' --reasoning on --reasoning-budget -1' and adding '/think' to prompts, but these methods have not yielded the desired results. The user is specifically trying to utilize models known to support reasoning, such as TheDrummer Rocinante X 12B. AI
IMPACT This query highlights a user-level challenge in leveraging advanced features of local LLM deployments, indicating potential friction points in the adoption of reasoning capabilities.