PTQ methods

New quantization method MODE slashes MoE-MLLM memory costs

Researchers have introduced MODE, a novel quantization framework designed to reduce the significant memory costs associated with Mixture-of-Experts Multimodal Large Language Models (MoE-MLLMs). The framework addresses b…