Rugved Chandekar

LLM token usage slashed by 99% with RAG, TOON, and batching

A production engineering approach has significantly reduced LLM token usage and processing time for an automated candidate sourcing system. By implementing retrieval-augmented generation (RAG) with semantic routing and …