实体 Mmq

Mmq

PulseAugur coverage of Mmq — every cluster mentioning Mmq across labs, papers, and developer communities, ranked by signal.

总计 · 30天

1

90 天内 1

发布 · 30天

0

90 天内 0

论文 · 30天

0

90 天内 0

层级分布 · 90 天

最近 · 第 1/1 页 · 共 1 条

TOOL · CL_03576 · Apr 25 · 14:22

llama.cpp CUDA pull request optimizes MMQ stream-k overhead for MoE models

A pull request to the llama.cpp project aims to reduce overhead in CUDA's MMQ stream-k operations. This optimization targets Mixture of Experts (MoE) models, potentially leading to faster prompt processing speeds. The c…