User seeks help enabling reasoning in llama.cpp

A user on the r/LocalLLaMA subreddit is seeking assistance with enabling reasoning capabilities in the llama.cpp software. They have attempted to use specific parameters like '--chat-template-kwargs '{"enable_thinking":true}' --reasoning on --reasoning-budget -1' and adding '/think' to prompts, but these methods have not yielded the desired results. The user is specifically trying to utilize models known to support reasoning, such as TheDrummer Rocinante X 12B. AI

IMPACT This query highlights a user-level challenge in leveraging advanced features of local LLM deployments, indicating potential friction points in the adoption of reasoning capabilities.

RANK_REASON User is asking for help with a specific software tool.

Read on r/LocalLLaMA →

• llama.cpp
• TheDrummer Rocinante X 12B

• product
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →