prompt embedding

AI cost-saving router fails to predict model difficulty

A team attempted to build a router to predict when a cheaper language model would suffice for a given task, thereby reducing costs. However, their classifier performed poorly, failing to achieve an AUC score significant…