Brief

A developer has integrated real-time Slack alerts into the open-source LLM gateway Ajah, enabling immediate notifications for cost spikes and potential risks. The system can alert users if a feature's daily LLM spend surpasses a set threshold, with a daily deduplication mechanism. Additionally, it flags responses for issues like hallucinations or contradictions, providing specific risk levels and reasons. AI

Ajah, a new self-hostable LLM gateway, has been developed to address the limitations of existing observability tools, particularly for enterprises with strict data privacy requirements. The tool was created in response to Helicone's acquisition and subsequent maintenance mode, which left many developers seeking alternatives. Ajah offers a unified solution for gateway proxying, RAG verification, hallucination flagging, and multi-agent session tracing, all while keeping sensitive data within the user's own servers. AI