Cascade Policy Network

RLCascadeRouter optimizes LLM routing with reinforcement learning

Researchers have developed RLCascadeRouter, a novel framework that optimizes query routing for large language models (LLMs) by treating it as a Markov decision process. This approach directly optimizes the performance-c…