A bug in Qwen Code 0.22.3 causes API errors when interacting with llama.cpp servers due to overly large string maxLength limits in its built-in tool schemas. These large limits prevent llama.cpp from successfully compiling the necessary grammar for tool calling, leading to a 400 error before any model generation occurs. The issue can be temporarily resolved by setting `tools.eager` to an empty list in the Qwen Code settings, which defers tool schema processing until they are actually used. AI
IMPACT This bug highlights potential integration issues between LLM clients and local inference servers, requiring careful schema management for tool use.
RANK_REASON The item describes a bug in a specific version of a software tool (Qwen Code) that affects its integration with another tool (llama.cpp), along with a workaround.
- API Error: 400 Failed to initialize samplers: failed to parse grammar
- Gemma
- JSON
- llama.cpp
- loop_wakeup
- Qwen Code
- Qwen Code 0.22.3
- ~/.qwen/settings.json
- report_findings
- schema
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →