ProactiveLLM

ProactiveLLM learns active interaction for streaming LLMs

Researchers have introduced ProactiveLLM, a novel approach to enhance streaming large language models by enabling them to actively decide when to interact with incoming data. This method addresses the latency and comput…