Developer adds GBNF grammar support to ShapeCraft for local LLM output control

A developer has enhanced the ShapeCraft structured output library by adding support for GBNF grammars, enabling local LLMs to generate output that strictly adheres to predefined formats. This new feature, implemented via a `gbnf` schema type, prevents models from producing malformed responses, a common issue with local deployments. The implementation includes a native `llama.cpp` backend that enforces grammars at the token level, and a best-effort approach for other backends like OpenAI and Groq where the grammar is injected into the prompt and the output is validated. AI

IMPACT Enables more reliable structured output from local LLMs, reducing errors in automated workflows.

RANK_REASON Developer adds new functionality to an existing library.

Read on dev.to — LLM tag →

• Anthropic
• GBNF
• GPT-4o mini
• Groq
• json-schema
• llama-3.2-3b-instruct.gguf
• llama.cpp
• node-llama-cpp
• Ollama
• OpenAI
• ShapeCraft
• XML
• Zod

• product
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →