redb.Route.Llm 3.1.1 — per-message audit fields for LLM compliance / replay
The developer Rinat Kozin has released version 3.1.1 of redb.Route.Llm, introducing seven new nullable audit fields to enhance LLM compliance and replay capabilities. These fields, applied to persisted messages, include sampling parameters like Temperature and MaxTokens, a ToolSetHash for tracking tool configurations, and a ProviderSystemFingerprint to identify the specific model backend used. The update aims to provide auditors with more precise information, such as prompt template versions and effective sampling parameters, to reproduce LLM responses accurately, especially for closed-source providers where bit-exact replay is challenging. AI
IMPACT Enhances LLM auditability and replayability, crucial for compliance and debugging in production environments.