YouZhi-LLM通过自适应KV缓存压缩提升金融AI并发能力

报道来源 [2]

1. arXiv cs.CL TIER_1 English(EN) · PSBC LLM Team, Huawei LLM Team, Ruihan Long, Junjie Wu, Tianan Zhang, Duo Zhang, Yaozong Wu, Jinbin Fu, Chang Liu, Zhentao Tang, Wenshuang Yang, Xin Wang, Zhihao Song, Ning Huang, Wenjing Xu, Shuai Zong, Shupei Sun, Sen Wang, Jing Hu, Bin Wang, Xinyu Wa… · 2026-06-05 04:00

   YouZhi：通过自适应GQA到MLA的转换，实现高并发金融大模型

   arXiv:2606.05868v1 Announce Type: new Abstract: Large language models (LLMs) drive significant financial innovations, yet their high-concurrency deployment is severely bottlenecked by KV cache memory overhead, which inflates infrastructure costs and throttles scalability. To addr…

2. arXiv cs.CL TIER_1 English(EN) · Xinzhuang Niu · 2026-06-04 08:44

   YouZhi：通过自适应GQA到MLA的转换，实现高并发金融大模型

   Large language models (LLMs) drive significant financial innovations, yet their high-concurrency deployment is severely bottlenecked by KV cache memory overhead, which inflates infrastructure costs and throttles scalability. To address this, we propose YouZhi-LLM, a highly effici…