实体 Smelt

Smelt

PulseAugur coverage of Smelt — every cluster mentioning Smelt across labs, papers, and developer communities, ranked by signal.

总计 · 30天

1

90 天内 1

发布 · 30天

0

90 天内 0

论文 · 30天

1

90 天内 1

层级分布 · 90 天

主题

情绪 · 30 天

1 天有情绪数据

最近 · 第 1/1 页 · 共 1 条

RESEARCH · CL_231614 · Sep 1 · 00:00

SMELT architecture improves MoE Transformer training efficiency

Researchers have developed SMELT, a new architecture for Mixture-of-Experts (MoE) Transformers that improves training efficiency and downstream performance. By looping the middle layers of the transformer twice while ca…