QuietBox

vLLM integrates Tenstorrent hardware for LLM serving via new TT Plugin

vLLM has released a new TT Plugin that enables the use of Tenstorrent hardware for serving large language models. This plugin integrates Tenstorrent's accelerators into the vLLM framework via a standard platform plugin …