Cheap

LLM cost savings: Route by token purpose, not task difficulty

A new approach to optimizing LLM costs suggests routing tasks based on the purpose of tokens rather than the perceived difficulty of a request. This method involves distinguishing between mechanical tasks like classific…