EvaByte

Probabilistic circuits boost LLM generation speed and expressiveness

Researchers have developed a new method called MTPC to improve the speed and expressiveness of multi-token prediction in large language models. This approach uses probabilistic circuits to model the joint distributions …