128

MoE expert caching evaluation methods found to be misleading

Researchers have identified critical flaws in trace-driven evaluation methods for Mixture-of-Experts (MoE) models, which can lead to misleading conclusions about expert caching policies. The study highlights how replay …