Codex CLI integrates local Gemma-4 LLM via llama.cpp on WSL2

This guide details how to set up the Codex CLI to interact with a local LLM, specifically Gemma-4, using llama.cpp on Windows Subsystem for Linux (WSL2). The process involves installing Codex, configuring it to use llama.cpp as a model provider, and then running the llama.cpp server with the Gemma-4 model. The author shares specific commands and configuration file examples, including troubleshooting a context size error. AI

IMPACT Enables developers to run LLM tools locally, reducing reliance on cloud services and potentially improving privacy.

RANK_REASON The article describes a technical setup guide for integrating existing tools, not a new product or model release.

Read on dev.to — LLM tag →

• Codex CLI
• Gemma-4
• llama.cpp
• Node.js
• NVIDIA GeForce RTX 3070
• WSL2

• product
• infra

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →