Sarathi-Serve

LLM inference and reasoning techniques advance with new research and hardware

Researchers are exploring novel methods to enhance the efficiency and reasoning capabilities of large language models (LLMs). Google Research is developing techniques to train LLMs to reason in a Bayesian manner, improv…