I Built a Private AI Assistant That Queries My Git History and Project Management Data — Using Only Local LLMs
A developer built a private AI assistant to query their project management and Git history data using only local LLMs. The system leverages a Text-to-SQL approach, translating natural language questions into SQL queries executed against a local SQLite database. This method ensures all data remains on the user's machine, prioritizing privacy and avoiding cloud-based APIs. The assistant uses Ollama to run models like Qwen2.5-coder locally, with a system prompt that includes the database schema, sample values, and few-shot examples to guide the LLM in generating accurate SQL queries and summarizing results. AI
IMPACT Enables developers to build custom, private AI tools for managing structured data, reducing reliance on cloud services.