PulseAugur
中
实时 19:46:39
English(EN) Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

新的 LLM 研究解决了遗忘、加速、服务和评估问题

多篇研究论文探讨了大语言模型(LLM)能力和效率方面的进展。“Nullify” 提出了一种无需训练的方法,可以在不影响效用的情况下从 LLM 中遗忘敏感信息。DynaTE 提出了一种硬件-软件协同设计,通过动态调整基于 token 状态的执行来加速扩散 LLM。Mooncake 提供了一种用于 LLM 服务的解耦架构,优化 KVCache 利用率以提高吞吐量并满足延迟要求。其他研究则侧重于可复现的 LLM 推理基准测试、来自隐式反馈的无偏奖励建模,以及像 CM-DPO 这样的新颖优化技术,用于 LLM 规划,以及 Clean 用于以线性内存成本进行二阶训练。 AI

影响 这些论文引入了用于 LLM 遗忘、加速、服务效率、评估和优化的新颖技术,有可能提高模型性能、隐私和资源利用率。

排序理由 多篇在 arXiv 上发表的研究论文,详细介绍了 LLM 的新方法和架构。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 100 个来源。 我们如何撰写摘要 →

新的 LLM 研究解决了遗忘、加速、服务和评估问题

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
多篇在 arXiv 上发表的研究论文,详细介绍了 LLM 的新方法和架构。
Source corroboration
100 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
paper, infra, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
55 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+47 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

完整方法见我们的编辑标准。

报道来源 [100]

  1. arXiv cs.CL TIER_1 English(EN) · Md Sabbir Hossen, Anichur Rahman, Pabon Shaha, Airin Afroj Aishi, Andrew H. Sung, Md Shohel Rana ·

    谁为高效推理付费?跨任务和语言的基于置信度的大小模型路由

    arXiv:2610.23249v1 Announce Type: new Abstract: Small-to-large language model routing can reduce inference cost by escalating difficult inputs while retaining easier ones on a smaller model. Its success, however, depends on identifying examples that benefit from escalation, and t…

  2. arXiv cs.AI TIER_1 English(EN) · Giovanni Vaccarino, Emanuele La Malfa, Dehai Min, Hanrong Zhang, Pier Luca Lanzi, Lu Cheng, Michael J. Wooldridge, Philip S. Yu, Sara Bernardini ·

    使用确定性诊断修复LLM生成的规范

    arXiv:2610.22568v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as formalizers: given a reasoning problem expressed in natural language, they produce a formal specification that a symbolic solver can then solve, with guarantees relative to that …

  3. arXiv cs.CL TIER_1 English(EN) · LoongSage Team, Bowei Song, Caiwei Zhao, Chuwen Liu, Dechuang Gu, Dong Fang, Feiyu Xie, Huaiyu Li, Hui Zhang, Jian Tian, Jian Wang, Jie Zhao, Liguang Li, Maoyun Wang, Meiyan Yang, Minghan Zhu, Pai Liu, Pandeng Yao, Renbao Tian, Ru Yang, Shuai Jia, Shuai … ·

    LoongSage:面向前沿大模型的生产级、高效率代理强化学习框架,附带经验证的配方

    arXiv:2610.16352v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has emerged as a critical phase in the post-training pipeline of large language models (LLMs). As the frontier of LLM capabilities shifts from static reasoning to agentic tasks--characterized by…

  4. arXiv cs.CL TIER_1 English(EN) · Minghan Wang, Jinhang Zuo, Zhongxiang Dai, Zhiyong Wang, Fang Kong ·

    MARS:面向会话级 LLM 助手的内存感知路由

    arXiv:2610.23583v1 Announce Type: new Abstract: Long-term LLM assistants must repeatedly decide what prior context to expose and which model should answer as an interaction evolves. Existing memory systems and model routers usually make these decisions separately, although memory…

  5. arXiv cs.LG TIER_1 English(EN) · Tingfeng Lan, Yusen Wu, Bin Ma, Zhaoyuan Su, Rui Yang, Tekin Bicer, Masahiro Tanaka, Olatunji Ruwase, Dong Li, Yue Cheng ·

    ZenFlow:实现 LLM 训练的无停滞卸载

    arXiv:2505.12242v4 Announce Type: replace-cross Abstract: Fine-tuning large language models (LLMs) often exceeds GPU memory limits, prompting systems to offload model states to CPU memory. However, existing offloaded training frameworks like ZeRO-Offload treat all parameters equa…

  6. arXiv cs.LG TIER_1 English(EN) · Zhi Zhang, Arash A. Amini ·

    测试时 LLM 集成的两种样本量:缓冲 ERM 和 Minimax 理论

    arXiv:2610.21363v1 Announce Type: cross Abstract: Test-time scaling can improve the performance of large language models by generating multiple answers to a question and aggregating them. Weighted ensembles extend this idea by drawing answers from several models, with the weights…

  7. arXiv cs.AI TIER_1 English(EN) · Ruiqi Wang, Xinchen Wang, Cuiyun Gao, Chun Yong Chong, Xin Xia, Qing Liao ·

    通过约束扰动和校准对代码大语言模型作为评判者进行基准测试

    arXiv:2512.20159v2 Announce Type: replace-cross Abstract: Code from LLM-assisted development may contain defects like API hallucinations, motivating the development of code evaluation metrics to assess such code before deployment. As conventional rule-based metrics merely score c…

  8. arXiv cs.AI TIER_1 English(EN) · Michael Hind, Basel Shbita, Bo Wu, Farhan Ahmed, Chad DeLuca, Nathan Fulton, David Cox, Dan Gutfreund ·

    LLMON: 一种原生于大语言模型的标记语言,用于在LLM接口中利用结构和语义

    arXiv:2603.22519v4 Announce Type: replace-cross Abstract: Textual Large Language Models (LLMs) provide a simple and familiar interface: a string of text is used for both input and output. However, the information conveyed to an LLM often has a richer structure and semantics, whic…

  9. arXiv cs.LG TIER_1 English(EN) · Xingyu Qu, Tianhao Lin, Yiqi Li, Zhiyu Chen, Sheng Wang ·

    HAServe:面向高效LLM服务的视界感知调度与内存协同设计

    arXiv:2605.08581v2 Announce Type: replace Abstract: Online large language model (LLM) services process requests that share context but differ in prefix structure and arrival timing. Finite capacity couples request admission and key-value (KV) retention. This paper addresses one o…

  10. arXiv cs.AI TIER_1 English(EN) · Jiacheng Liang, Yuhui Wang, Tanqiu Jiang, Ting Wang ·

    LaCache:LLM服务的高鲁棒性语义缓存

    arXiv:2608.01718v2 Announce Type: replace Abstract: Semantic caching, reusing responses to answer semantically similar queries, has seen growing adoption in LLM serving, offering faster responses and reduced costs. Yet existing schemes are fundamentally vulnerable to cache-collis…

  11. arXiv cs.AI TIER_1 English(EN) · Xuanlin Yang, Jia Li, Zhouchen Lin ·

    StructZO:用于内存高效 LLM 微调的结构化零阶优化

    arXiv:2610.16451v1 Announce Type: cross Abstract: Fine-tuning large language models at scale is increasingly limited by the memory cost of backpropagation. Zeroth-Order (ZO) optimizers reduce this burden by relying only on forward function evaluations, but they still exhibit a su…

  12. arXiv cs.AI TIER_1 English(EN) · Huihao Jing, Wenbin Hu, Shaojin Chen, Haochen Shi, Haoyu Huang, Sirui Zhang, Yuxuan Liu, Zhongwei Xie, Haoran Li ·

    RadixFlow:为 Prefix-Cached 混合 LLM 服务填充执行气泡

    arXiv:2610.18143v1 Announce Type: new Abstract: Prefix reuse improves LLM inference by sharing the KV cache of common prompt prefixes. This helps only if the scheduler can execute a matched branch in the current worker round. Schedulers assume that a matched prefix is ready, whic…

  13. arXiv cs.AI TIER_1 English(EN) · Xinnan Dai, Kaiqi Yang, Yaxin Li, Cheng Luo, Wanli Li, Mingqing Xiao, Xinyang Jiang, Daoan Zhang, Kaitao Song, Fengze Liu, Zefan Cai, Caihua Shan ·

    Words to World: Benchmarking LLMs in Interactive Physical Environments

    arXiv:2610.15228v1 Announce Type: new Abstract: Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that affect the physical world. However, current benchmarks largely evaluate LLMs throug…

  14. arXiv cs.AI TIER_1 English(EN) · Xianglong Yan, Zenan Wu, Kewei Zhang, Kaicheng Yang, Yulun Zhang ·

    SAGE:推动 2 位矢量量化大模型走向实际可用性

    arXiv:2610.14745v1 Announce Type: new Abstract: Extreme low-bit weight-only quantization is an effective approach to reducing the deployment costs of large language models. Below 3 bits, scalar quantization often suffers severe accuracy loss, while vector quantization (VQ) better…

  15. arXiv cs.AI TIER_1 English(EN) · Zeyu Yang, Wes Armour ·

    跨基准测试、推理模式和硬件衡量开源大语言模型 (LLM) 的推理能效

    arXiv:2610.14389v1 Announce Type: new Abstract: Benchmark scores tell us what an LLM can do, but not how much energy is required to deliver that capability. We directly measure this trade-off for 86 open-weight model checkpoints, evaluated on seven benchmarks and six hardware pla…

  16. arXiv cs.LG TIER_1 English(EN) · Miko{\l}aj Pi\'orczy\'nski, Wojciech Masarczyk, Damian S\'ojka, Sebastian Cygert, Bart{\l}omiej Twardowski ·

    关于多模态大语言模型基于表征的测试时自适应的局限性

    arXiv:2610.19892v1 Announce Type: new Abstract: Vision-language models suffer significant accuracy drops under common corruptions. While test-time adaptation (TTA) successfully mitigates these shifts in CLIP-like contrastive models, its application to generative multimodal large …

  17. arXiv cs.LG TIER_1 English(EN) · Casper L. Christensen, Kyle J. Ray, Dmitry Manning-Coe, Adam Shai, Paul Riechers ·

    LLMs 使用可重用和可组合的抽象表示进行编程

    arXiv:2610.19238v1 Announce Type: new Abstract: When writing code, the same computation can be expressed in different programming languages and through different implementation strategies. We show that the activations of LLMs capture this shared structure in reusable and composab…

  18. arXiv cs.CL TIER_1 English(EN) · Tongwei Deng, Jinyu Zhu, Yue Cao, Chenxu Wang, Yanzhen Zou, Bing Xie ·

    LintEval:在 Linter 指导的文件重构方面对 LLM 进行基准测试

    arXiv:2610.20027v1 Announce Type: cross Abstract: Linters are widely used in code maintenance and real-time IDE editing to surface lint alerts related to performance, style, error-prone, and other patterns in source files. However, existing code benchmarks do not explicitly evalu…

  19. arXiv cs.AI TIER_1 English(EN) · Huihao Jing, Wenbin Hu, Shaojin Chen, Haochen Shi, Zhongwei Xie, Guijia Zhang, Yuxuan Liu, Haoyu Huang, Haoran Li, Yangqiu Song ·

    SoFT:用于可泛化大模型微调的软目标

    arXiv:2609.32493v2 Announce Type: replace-cross Abstract: Distillation enables student language models to acquire new capabilities from expert teachers. However, integrating knowledge from multi-teacher, multi-domain demonstrations into a single student remains challenging. We st…

  20. arXiv cs.AI TIER_1 English(EN) · Eunsu Kim, Haneul Yoo, Guijin Son, Hitesh Patel, Amit Agarwal, Alice Oh ·

    基准测试并非原子化:使用 BenchHub 进行面向组合的 LLM 评估

    arXiv:2506.00482v2 Announce Type: replace-cross Abstract: LLM benchmarks are often treated as coherent measurement units, yet they are heterogeneous collections of instances spanning diverse domains, skills, formats, and contexts. As a result, aggregate benchmark scores can confl…

  21. Hugging Face Daily Papers TIER_1 English(EN) ·

    LLMs 使用可重用和可组合的抽象表示进行编程

    When writing code, the same computation can be expressed in different programming languages and through different implementation strategies. We show that the activations of LLMs capture this shared structure in reusable and composable abstract representations when they generate c…

  22. Hugging Face Daily Papers TIER_1 English(EN) ·

    Words to World: Benchmarking LLMs in Interactive Physical Environments

    Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that affect the physical world. However, current benchmarks largely evaluate LLMs through static text responses, offline tool calls, or …

  23. arXiv cs.AI TIER_1 English(EN) · Minghan Jiang, Jiayi Wang, Shuaiting Li, Haibin Shen, Kejie Huang ·

    DynaTE:通过动态令牌执行加速扩散大语言模型

    arXiv:2610.11284v1 Announce Type: cross Abstract: Diffusion-based LLMs (dLLMs) have recently emerged as a promising alternative to autoregressive (AR) LLMs by enabling bidirectional parallel refinement, alleviating the sequential decoding bottleneck of AR generation. However, the…

  24. arXiv cs.AI TIER_1 English(EN) · Ruoyu Qin, Zheming Li, Weiran He, Mingxing Zhang, Yongwei Wu, Weimin Zheng, Xinran Xu ·

    Mooncake:一种以 KVCache 为中心的解耦 LLM 服务架构

    arXiv:2407.00079v5 Announce Type: replace-cross Abstract: Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. It features a KVCache-centric disaggregated architecture that separates the prefill and decoding clusters. It also leverages the und…

  25. arXiv cs.LG TIER_1 English(EN) · Younwoo Choi, Leo Feng, Vincent Liu, Haanvid Lee ·

    LLM 的摊销离轨策略评估

    arXiv:2610.10848v1 Announce Type: new Abstract: Accurate evaluation is central to selecting which LLM to deploy, yet testing a candidate on live traffic exposes real users to an unvetted model. Teams therefore evaluate candidates offline, on data produced by already-deployed mode…

  26. arXiv cs.AI TIER_1 English(EN) · Wei Zhai, Xiang Liu, Qiang Huang, Rui Qian, Lemao Liu, Ziwei Li, Ziqi Wang, Zhitao Huang, Dejing Dou ·

    Nullify:用于无训练大型语言模型遗忘的零空间激活引导

    arXiv:2610.10655v1 Announce Type: cross Abstract: Large Language Models (LLMs) inevitably internalize substantial amounts of sensitive or private information during pre-training, while LLM unlearning aims to selectively erase specific knowledge to prevent privacy leakage with min…

  27. arXiv cs.LG TIER_1 English(EN) · Rabimba Karanjai, Qun Gu, Hemanth Hegadehalli Madhavarao, Wenhuan Sun, Xiaojiao Yu, Suryabhan Singh Hada, Libin N. George, Uma Kona, Richard Williamson, Linsey Pang, Prakhar Mehrotra ·

    CM-DPO:LLM规划的约束边距直接偏好优化

    arXiv:2610.09219v1 Announce Type: cross Abstract: Direct Preference Optimization (DPO) treats all constraint violations equally: a $1 budget overshoot and a $1,000 overshoot induce the same training signal. It is also susceptible to length and style bias when preference pairs com…

  28. arXiv cs.LG TIER_1 English(EN) · Arnold Olympio, Juan Manuel Servera Bondroit, Wael Abdelmalek, Guang Lu, Jo\~ao Carvalho ·

    可复现的LLM推理基准测试:用于回归测试的顺序隔离协议

    arXiv:2610.09778v1 Announce Type: cross Abstract: Reproducible benchmarking of Large Language Model (LLM) inference is challenging because repeated measurements can vary with execution and system state. We present the Sequential Isolation Methodology, a controlled benchmarking an…

  29. arXiv cs.CL TIER_1 English(EN) · Beheshteh T. Rakhshan, Sahar Rajabi, Maziar Sargordi Shikai Fang, Guillaume Rabusseau, Sirisha Rambhatla ·

    Clean: 通过Nyström草图实现线性内存成本的二阶LLM训练

    arXiv:2610.04204v2 Announce Type: replace-cross Abstract: Training large language models (LLMs) entails a fundamental trade-off: memory-efficient optimizers such as Adam discard cross-parameter curvature, whereas full-curvature methods such as SOAP can accelerate convergence at p…

  30. arXiv cs.LG TIER_1 English(EN) · Shai Feldman, Yaniv Romano ·

    硬资源约束下LLM评估的动态预算分配

    arXiv:2610.07362v1 Announce Type: new Abstract: We evaluate large language models (LLMs) in multi-turn interactions through their time-to-event: the number of interaction steps required to produce an event of interest, such as a successful jailbreak or agentic task completion. Un…

  31. arXiv cs.AI TIER_1 English(EN) · Jinhyeok Kim, Hye-Young Jung ·

    惩罚性无有效选项MCQA:分析LLM在无效选择下的弃权行为

    arXiv:2610.08153v1 Announce Type: cross Abstract: Multiple-choice question answering (MCQA) is commonly used to evaluate large language models under the assumption that one of the provided options is correct, typically using answer-selection accuracy. However, in real deployments…

  32. arXiv cs.AI TIER_1 English(EN) · Hao Wang, Haocheng Yang, Licheng Pan, Lei Shen, Xiaoxi Li, Yinuo Wang, Zhichao Chen, Yuan Lu, Haoxuan Li, Zhouchen Lin ·

    Unbiased Reward Modeling from Implicit Feedback for LLM Alignment

    arXiv:2603.23184v2 Announce Type: replace-cross Abstract: Despite the success of reinforcement learning from human feedback (RLHF), existing reward modeling methods largely rely on explicit feedback, which is costly to collect and difficult to scale. This work studies implicit re…

  33. arXiv cs.AI TIER_1 English(EN) · Abhinav Sudhakar Dubey (University of California Santa Cruz), Scott Sirri (University of California Santa Cruz), Vaggos Chatziafratis (University of California Santa Cruz), C. Seshadhri (University of California Santa Cruz) ·

    通过随机嵌入扰动越狱开源大模型

    arXiv:2610.07125v1 Announce Type: cross Abstract: While open-weight models have enjoyed steady progress in capabilities and wide adoption across multiple domains, their safety remains an important concern. One key feature is the ability to refuse or deflect harmful, malicious, or…

  34. arXiv cs.AI TIER_1 English(EN) · Zhishen Sun, Hongzhan Wang, Sizhe Dang, Guang Dai, Haishan Ye ·

    DART-ES:一种用于通过进化策略微调LLM的具有难度感知重加权和目标重放的方法

    arXiv:2610.06993v1 Announce Type: cross Abstract: Evolution Strategies (ES) enable memory efficient full parameter fine-tuning of large language models (LLMs) using only forward computation. However, standard ES uniformly averages rewards across problems and compresses problem le…

  35. arXiv cs.MA (Multiagent) TIER_1 English(EN) · Dou Shen ·

    AGAR:用于LLM程序进化的强化学习基础

    Given a task and an evaluator, a language model can rewrite a candidate program while a search loop decides which rewrites survive, offering a practical route to algorithm discovery. But that loop is governed by five constants set by hand: which parent to select, how hard to muta…

  36. Hugging Face Daily Papers TIER_1 English(EN) ·

    面向鲁棒LLM训练后优化的动态Minimax regret优化

    Modern LLM training increasingly relies on heterogeneous data sources spanning different domains, tasks, preference distributions, and difficulty levels. We study dynamic minimax regret for group-distributionally robust LLM post-training under instantaneous mini-batch-only bandit…

  37. arXiv cs.AI TIER_1 English(EN) · Yuyang Dai, Rana Shahout, Mahmood Sharif ·

    抢跑:利用LLM调度中的长度预测漏洞

    arXiv:2610.03430v1 Announce Type: new Abstract: Efficient request scheduling is increasingly important for reducing completion time in large language model (LLM) serving. Size-based policies such as Shortest Job First prioritize shorter requests, but output lengths are unknown be…

  38. arXiv cs.LG TIER_1 English(EN) · Arda Fazla, Antesh Upadhyay, Ege C. Kaya, M. Berk Sahin, Abolfazl Hashemi ·

    自适应批处理为何有助于 LLM 预训练?来自无界方差的视角

    arXiv:2610.02355v1 Announce Type: new Abstract: Increasing the batch size during training is a common practice in large language model (LLM) pretraining, yet the theoretical justification behind its success is not well understood. Analyses of stochastic optimization often assume …

  39. arXiv cs.AI TIER_1 English(EN) · Zhouliang Xie, Changliang Zhou, Genghui Li, Zhenkun Wang ·

    使用大型语言模型实现多任务演进以实现零样本跨问题泛化

    arXiv:2610.03316v1 Announce Type: new Abstract: Designing effective heuristics for diverse combinatorial optimization problems requires substantial expertise and repeated search. Large language models (LLMs) automate heuristic generation and refinement, but heuristic search typic…

  40. arXiv cs.AI TIER_1 English(EN) · Md Nurul Absar Siddiky, Liuwan Zhu, Yingfei Dong ·

    频率而非敏感度:识别稀疏MoE大模型中的安全敏感专家

    arXiv:2610.02910v1 Announce Type: new Abstract: Suppressing a small set of routed experts can weaken the safety behavior of a sparse Mixture-of-Experts (MoE) language model without retraining. Which experts to suppress is therefore a security question, and the usual answer is act…

  41. arXiv cs.CL TIER_1 English(EN) · Xueqi Cheng, Liang Wu, Kelly Wan, Liangjie Hong, Yushun Dong ·

    LLM压缩的能力缩减法则

    arXiv:2610.02462v1 Announce Type: cross Abstract: LLM compression reduces inference costs and memory requirements, but selecting a method and configuration remains largely empirical because comparable resource reductions can produce different capability losses. We systematically …

  42. arXiv cs.LG TIER_1 English(EN) · Hongyu Chen, Xinyi Luo, Ming Zhao, Lin Tang, Zihan Xu, Jing Li, Yuxuan Wang, Haoran Deng, Wei Zhang ·

    每个批次都是其自身的验证集:留一法梯度匹配用于LLM微调中的在线数据选择

    arXiv:2610.00436v1 Announce Type: new Abstract: Online batch selection fine-tunes a language model on the most useful part of each candidate batch. Selectors that match the gradient of the candidate batch are attractive because they need no held-out data, yet they rarely beat tra…

  43. arXiv cs.LG TIER_1 English(EN) · Tianshuo Qiao, Naiqian Zheng, Xiaopeng Liu, Shuguang Wang, Diandian Gu, Xuanzhe Liu, Xin Jin ·

    FastCI:LLM训练框架的高效GPU密集型CI

    arXiv:2610.01967v1 Announce Type: new Abstract: As large language models (LLMs) keep growing in size and complexity, their training frameworks evolve at a rapid pace as well. Therefore, continuous integration (CI) is critical for maintaining the quality and stability of these fra…

  44. arXiv cs.LG TIER_1 English(EN) · Zailong Tian, Yanzhe Chen, Zhuoheng Han, Houfeng Wang, Lizi Liao ·

    学习方向,规范增益:LoRA的训练后归一化

    arXiv:2610.02067v1 Announce Type: new Abstract: While Low-Rank Adaptation (LoRA) enables efficient task specialization, its learned updates can compromise capabilities beyond the target task. We identify \textbf{adaptation imbalance}: a few singular directions dominate the traine…

  45. arXiv cs.LG TIER_1 English(EN) · Cristian McGee, El Houcine Bergou, Aritra Dutta ·

    信任方向,搜索步数:LLM 微调的零阶和一阶方法

    arXiv:2610.02190v1 Announce Type: new Abstract: Step-size selection remains a central challenge in large-scale neural network optimization; conservative steps slow convergence, while aggressive steps can destabilize it. We combine \textbf{Z}ero-and-\textbf{F}irst-\textbf{O}rder o…

  46. arXiv cs.LG TIER_1 English(EN) · Jichao Jiang (University of Central Florida), Cristian McGee (University of Central Florida), El Houcine Bergou (Mohammed VI Polytechnic University), Hanqin Cai (University of Central Florida), Aritra Dutta (University of Central Florida) ·

    TACO:用于大语言模型微调的三元绝对最大值按列稀疏优化器

    arXiv:2610.02199v1 Announce Type: new Abstract: Full-parameter fine-tuning of large language models (LLMs) incurs substantial optimizer state memory overhead, limiting the model sizes that fit on modern GPUs. Existing approaches either compress optimizer state, abandon first-orde…

  47. arXiv cs.LG TIER_1 English(EN) · Geon-Woo Kim, Joon Ha Kim, Daehyeok Kim ·

    Leto:LLM训练在幸存硬件上的快速就地恢复

    arXiv:2610.00687v1 Announce Type: cross Abstract: Hardware-operable failures (HOFs) interrupt large language model (LLM) training but permit recovery on the same hardware without reset, repair, or replacement. Existing recovery systems nevertheless reload checkpoints, recompute l…

  48. arXiv cs.LG TIER_1 English(EN) · Hang Zou, Chao Zhang, Yuzhi Yang, Yu Tian, Samson Lasaulce, M\'erouane Debbah ·

    FedFit:通过向量库参数化和量化对大语言模型进行联邦微调

    arXiv:2610.01537v1 Announce Type: new Abstract: Federated Learning (FL) enables privacy-preserving fine-tuning of Large Language Models (LLMs), yet the massive communication overhead remains a critical bottleneck. Furthermore, applying Low-Rank Adaptation (LoRA) in FL faces a fun…

  49. arXiv cs.NE (Neural & Evolutionary) TIER_1 English(EN) · Nguyen Dang ·

    AdaEva:通过自适应部分求值加速LLM驱动的算法设计

    Large Language Models (LLMs) are increasingly used for automated algorithm design. However the computational cost of evaluating the generated algorithms can be excessive. We consider the common LLM-driven automated algorithm design (LLM4AD) setting in which a candidate algorithm …

  50. arXiv cs.LG TIER_1 English(EN) · Kemou Li, Qizhou Wang, Yue Wang, Fengpeng Li, Zhuan Shi, Negar Rostamzadeh, Golnoosh Farnadi, Masashi Sugiyama, Jiantao Zhou ·

    通过梯度密封对禁止能力获取进行先发制人的LLM遗忘

    arXiv:2609.39866v1 Announce Type: new Abstract: Open-weight LLMs are released not only as fixed products but also as substrates for downstream fine-tuning. This openness, however, creates legal and ethical risks because users may misuse fine-tuning to instill illicit knowledge or…

  51. arXiv cs.LG TIER_1 English(EN) · Yichen Wang, Fanghui Liu, Yudong Chen ·

    从光谱到 LLM 预训练中的联合调度:3+3(+2) 缩放定律模式

    arXiv:2609.40148v1 Announce Type: new Abstract: Power-law learning curves are often treated as fixed properties of a model and its data, although learning-rate and batch-size schedules can change the observed loss. We study this dependence in noisy online SGD with linear random f…

  52. arXiv cs.AI TIER_1 English(EN) · Qijia He, Ruinan Jin, Jun Luo, Shaofeng Zou, Yingbin Liang ·

    异步大模型训练后:分组批量封顶与收敛性分析

    arXiv:2610.01896v1 Announce Type: cross Abstract: Asynchronous reinforcement learning (RL) improves the efficiency of large language model post-training but introduces stale rollouts generated by earlier policies. Theoretical understanding of how this staleness affects convergenc…

  53. arXiv cs.AI TIER_1 English(EN) · Haozhan Tang, Xiuqi Zhu, Xinyin Zhang, Boxun Li, Virginia Smith, Kevin Kuo ·

    超越LoRA与全量微调:梯度引导优化器路由用于LLM适配

    arXiv:2605.07111v3 Announce Type: replace-cross Abstract: Recent literature on fine-tuning Large Language Models highlights a fundamental debate. While Full Fine-Tuning (FFT) provides greater representational plasticity, Low-Rank Adaptation (LoRA) can match or surpass FFT perform…

  54. arXiv cs.AI TIER_1 English(EN) · Shixuan Liu, Tongli Zhou, Junwei Deng, Pingbang Hu, Jiaqi W. Ma ·

    dattri-LLM:一个统一高效的库,用于大规模 LLM 的训练数据归因

    arXiv:2609.38767v1 Announce Type: cross Abstract: Training data attribution (TDA) estimates the contribution of individual training examples to model outputs. Most scalable TDA methods rely on per-example gradients, whose computation and use at LLM scale pose challenges in effici…

  55. arXiv cs.AI TIER_1 English(EN) · Huaiyu Fu, Heng Cao, Hao Wang, Jian Ya, Tao Chen ·

    面向LLM智能体基于RL的后训练的显式轨迹多样性

    arXiv:2609.38805v1 Announce Type: cross Abstract: LLM agents often admit multiple high-quality solutions to the same task, differing in reasoning structure, tool-use pattern, or interaction trajectory. Yet existing notions of diversity in LLM post-training are mostly implicit, ar…

  56. arXiv cs.AI TIER_1 English(EN) · Tyler Skow, Shravan Chaudhari, Rama Chellappa, Abhay Yadav ·

    LLM 遗忘中的语言漏洞:从 174 种语言基准到覆盖感知遗忘

    arXiv:2609.40286v1 Announce Type: cross Abstract: Unlearning a fact in one language does not guarantee its removal in others as changing the query or even the requested answer language can reopen seemingly forgotten knowledge -- a cross-lingual loophole. The most straightforward …

  57. arXiv cs.AI TIER_1 English(EN) · Qingao Yi, Jiaang Duan, Jun Zhang, Haiyan Zhao, Shiyou Qian, Dingyu Yang, Jian Cao, Jinghua Tang ·

    EDGC:熵驱动的动态梯度压缩,实现高效LLM训练

    arXiv:2511.10333v2 Announce Type: replace-cross Abstract: Training large language models (LLMs) at scale incurs substantial communication overhead, while static gradient compression cannot adapt to gradient evolution and may degrade model quality. We propose EDGC, an entropy-driv…

  58. arXiv cs.AI TIER_1 English(EN) · Chenhao Ye, Huaizheng Zhang, Mingcong Han, Baoquan Zhong, Xiang Li, Qixiang Chen, Xinyi Zhang, Weidong Zhang, Kaihua Jiang, Wang Zhang, He Sun, Wencong Xiao, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau ·

    TensorHub:可扩展且弹性的LLM RL训练权重迁移

    arXiv:2604.09107v2 Announce Type: replace-cross Abstract: Modern LLM reinforcement learning (RL) workloads require a high-performance weight transfer system to scale training across heterogeneous compute resources. However, efficiently transferring terabyte-scale model weights ac…

  59. arXiv cs.CL TIER_1 English(EN) · Srishti Ginjala, Eric Fosler-Lussier, Srinivasan Parthasarathy ·

    公平超越单次运行:语音大模型适应中的训练种子变异性

    arXiv:2609.38976v1 Announce Type: new Abstract: Demographic fairness gaps in automatic speech recognition are almost always reported from a single training run. We fine-tune the Q-former projector and LoRA adapters of a speech LLM at five audio compression factors and six random …

  60. Hugging Face Daily Papers TIER_1 English(EN) ·

    公平性超越单次运行:语音大模型适配中的训练种子变异性

    Demographic fairness gaps in automatic speech recognition are almost always reported from a single training run. We fine-tune the Q-former projector and LoRA adapters of a speech LLM at five audio compression factors and six random seeds, holding the encoder, base decoder, data a…

  61. arXiv cs.LG TIER_1 English(EN) · Shufan Shen, Zhongni Hou, Junshu Sun, Yufei Zhang, Wei Lin, Guojun Yin, Qingming Huang, Shuhui Wang ·

    LLM训练后泛化能力源于策略内参数更新方向

    arXiv:2609.36659v1 Announce Type: new Abstract: The strong generalization performance of on-policy post-training paradigms has motivated studies of their parameter update behaviors. However, these studies treat the observed behaviors only as byproducts in on-policy training, over…

  62. arXiv cs.AI TIER_1 English(EN) · Chenliang Li, Neiwen Ling, Zijun Wei, Alfredo Garcia ·

    停滞在哪里累积?用于 LLM 训练后异步 RL 的池感知有效停滞控制

    arXiv:2609.36830v1 Announce Type: new Abstract: Fully asynchronous reinforcement learning (RL) improves resource utilization in large language model post-training by overlapping rollout generation with policy optimization, but it also introduces policy lag as trajectories are gen…

  63. arXiv cs.AI TIER_1 English(EN) · Pengyu He, Yan Zhang, Ruien Li, Guangwen Yang ·

    AutoLoCo:通过自适应同步实现通信高效的分布式大模型训练

    arXiv:2609.36662v1 Announce Type: cross Abstract: The pre-training of Large Language Models (LLMs) is increasingly conducted across multiple data centers. As training scales to a larger number of accelerators, the fraction of time spent on computation decreases, while the fractio…

  64. arXiv cs.AI TIER_1 English(EN) · Zhehao Huang, Changxin Tian, Qingyuan Yang, Kunlong Chen, Ziqi Liu, Zhiqiang Zhang, Xiaolin Huang, Jun Zhou ·

    轨迹汤:通过多样化轨迹推动 LLM 中期训练的计算扩展前沿

    arXiv:2609.37169v1 Announce Type: cross Abstract: Mid-training equips pretrained large language models with specialized and reasoning capabilities, but the returns of this stage are bounded since additional serial compute yields little further downstream improvement and can even …

  65. arXiv cs.CL TIER_1 English(EN) · Tianhao Qian, Ziming Hong, Chongyang Gao, Kezhen Chen, Lixu Wang ·

    存储并非策略:LLM 遗忘的状态条件支持控制

    arXiv:2609.37858v1 Announce Type: cross Abstract: Many localized large language model (LLM) unlearning methods select a small parameter subset from a localization signal and keep it fixed during optimization. The parameters most associated with a target, however, need not be the …

  66. arXiv cs.LG TIER_1 English(EN) · Haozhan Tang, Hao Kang, Han Cai, Song Han, Chenyan Xiong ·

    Delta-Matching:弥合大语言模型原生8位训练的最后一道鸿沟

    arXiv:2609.37852v1 Announce Type: new Abstract: Reliable FP8 attention remains a barrier to fully native 8-bit large language model training. We derive how forward-backward inconsistencies produce stale delta and empirically show how it distorts training dynamics. Our stale-delta…

  67. Hugging Face Daily Papers TIER_1 English(EN) ·

    LLM训练后泛化能力源于策略内参数更新方向

    The strong generalization performance of on-policy post-training paradigms has motivated studies of their parameter update behaviors. However, these studies treat the observed behaviors only as byproducts in on-policy training, overlooking their potential to serve as optimization…

  68. Hugging Face Daily Papers TIER_1 English(EN) ·

    Nereus:LLM 训练后自适应并行

    Reinforcement learning (RL) post-training for large language models (LLMs) coordinates multiple models across generation, inference, and training on GPU clusters. Several factors may change during a run, including resource availability, sequence length, memory pressure, and stage…

  69. arXiv stat.ML TIER_1 English(EN) · Aditya Kulkarni, Davide Sartor, Carlos Soto, Nathan Wycoff ·

    能有多低:使用贝叶斯优化微调 LLM (LlMBO)

    arXiv:2610.18504v1 Announce Type: new Abstract: Recently, Morris et al. introduced TinyLoRA, a strategy for LLM fine-tuning which introduces arbitrarily few parameters, and demonstrated accuracy improvements using less than $10$ parameters rather than the ${\gtrsim 10,000}$ typic…

  70. arXiv stat.ML TIER_1 English(EN) · Hang Yin, Haozhe Wang, Yuhua Luo, Zhangqi Pan, Xiaoxing Wang, Junchi Yan ·

    ChainLoRA:用于大型语言模型持续学习的几何保持任务向量合并

    arXiv:2610.00431v1 Announce Type: new Abstract: Continual parameter-efficient fine-tuning for large language models (LLMs) must balance retention of previously acquired knowledge, adaptation to new tasks, and strict parameter budgets. We present \textbf{ChainLoRA}, a replay-free …

  71. The Register — AI TIER_1 English(EN) ·

    使用 KillSwitch 编写抗机器人代码,这是一种旨在混淆 LLM 的编程语言

    Lies, lots of adverbs, and prosaic stories don't make for very machine-readable code, it turns out

  72. Towards AI TIER_1 English(EN) · Ashish Abraham ·

    LLM推理优化终极指南 - 第三部分

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://pub.towardsai.net/the-ultimate-guide-to-llm-inference-optimization-part-3-cef44d73aec7?source=rss----98111c9905da---4"><img src="https://cdn-images-1.medium.com/max/1228/1*CIiWf7PJyst5EkEUWndOzw.png" widt…

  73. Medium — MLOps tag TIER_1 English(EN) · Shlokdhanokar ·

    LLM推理优化:降低生产成本和延迟

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://medium.com/accredian/llm-inference-optimization-cut-cost-and-latency-in-production-7b04caaacc79?source=rss------mlops-5"><img src="https://cdn-images-1.medium.com/max/1070/0*o4yoFyij28yqsnLf.jpeg" width="…

  74. dev.to — MCP tag TIER_1 English(EN) · Renato Marinho ·

    通过大型语言模型管理物理安全:为何逻辑层比API访问更重要

    <p>When we talk about giving an AI agent 'access' to a system, our mental model usually defaults to software. We think of an agent reading a Jira ticket, querying a Postgres database, or sending a message via Slack. But the boundary between digital intent and physical reality is …

  75. Medium — Claude tag TIER_1 English(EN) · Eun Ji ·

    ds-specs: 一个用于 LLM 优先设计系统的 Claude Skill,支持双向 Figma 同步

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://uxplanet.org/ds-specs-a-claude-skill-for-llm-first-design-systems-with-two-way-figma-sync-3d6d77dbc12b?source=rss------claude-5"><img src="https://cdn-images-1.medium.com/max/1870/1*b45ZNk5vX9eqd3BktAlyrA…

  76. dev.to — MCP tag TIER_1 English(EN) · Japan Open Data Lab ·

    我构建多个 MCP 服务器以运行本地 LLM(Qwen3-8B)的经验:工具粒度、延迟陷阱和内部测试

    <p>Recently, I have been building a local data analysis stack pairing <strong>LM Studio (<code>Qwen3-8B</code>)</strong> with custom <strong>Model Context Protocol (MCP)</strong> servers to query and cross-analyze over 180 normalized Japanese government and corporate datasets.</p…

  77. Medium — fine-tuning tag TIER_1 Deutsch(DE) · William Antônio Siqueira ·

    使用 Kale 和 Kubeflow Pipelines 微调 LLMs

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://william-siqueira.medium.com/fine-tuning-llms-using-kale-and-kubeflow-pipelines-4b7750c68089?source=rss------fine_tuning-5"><img src="https://cdn-images-1.medium.com/max/1405/1*XbPuYhnoxnevop-qWH5V0Q.png" …

  78. Medium — MLOps tag TIER_1 English(EN) · Shahad Mahmud ·

    从演示到生产:六个导致 LLM 应用失败的鸿沟

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://levelup.gitconnected.com/from-demo-to-production-six-gaps-that-break-llm-apps-a5cf67b9b124?source=rss------mlops-5"><img src="https://cdn-images-1.medium.com/max/2600/0*VmSu1zwieipxUkIw" width="4747" /></…

  79. dev.to — LLM tag TIER_1 English(EN) · qjlsh ·

    公平比较LLM API的免费套餐

    <h2> Understanding Free Tiers </h2> <p>Free tiers of Large Language Model (LLM) APIs offer a starting point for experimenting with AI capabilities without significant upfront costs. However, these tiers often come with limitations such as request quotas, response size, and model …

  80. dev.to — LLM tag TIER_1 English(EN) · Dhanush Kumar Sivaji ·

    通往AI FDE #01之路:LLM应用请求的解剖

    <p>I've spent 8+ years building React/TypeScript front ends. Now I'm learning applied AI in public, working toward AI Engineer, then AI Solution Architect, and (I hope) AI Forward Deployed Engineer. Before tokens, RAG or agents, I wanted one map: what actually happens when a user…

  81. dev.to — LLM tag TIER_1 English(EN) · abdul rahman ·

    vLLM 对比 Ollama 对比 llama.cpp:LLM 推理引擎终极指南

    <p><strong>ENTERPRISE AI ARCHITECTURE &amp; INFERENCE SYSTEMS ENGINEERING</strong></p> <p><em>Technical Audit: PagedAttention KV Cache Physics, GGUF Quantization, Concurrent Token Throughput &amp; Cloud Serving Economics</em></p> <p><a class="article-body-image-wrapper" href="htt…

  82. dev.to — LLM tag TIER_1 English(EN) · Sven Welack ·

    在消费级硬件上运行大型语言模型 — 第7部分:战略家 — 云模型判断,本地执行

    <p><em>Part 7 of a series. Previously: <a href="https://dev.to/USERNAME/PART-6-SLUG">Part 6 — The Orchestration Ceiling</a>.</em></p> <p>Part 6 made the team's execution reliable: by moving the control loop out of the model and into deterministic code, the orchestrator could carr…

  83. dev.to — LLM tag TIER_1 English(EN) · Swathi Rajagopal ·

    使用 LLM 构建可靠的文档处理管道

    <p><a href="https://www.securekloud.com/generative-ai-services" rel="noopener noreferrer">Large Language Models (LLMs)</a> have made it easier to extract structured information from unstructured documents. A developer can send an invoice, bank statement, or application form to a …

  84. dev.to — LLM tag TIER_1 English(EN) · Malek AIT OUARET ·

    将 7B 本地 LLM 用作编程语言前端的经验分享

    <p>Pseudocode is how we teach algorithms, yet it has never been executable. You can write "repeat divisor from 2 to 50"<br /> on a whiteboard, but not run it. I wanted to change that without inventing yet another syntax, so I built<br /> <strong>Pseudo.NET</strong>: you write pse…

  85. dev.to — LLM tag TIER_1 English(EN) · Vainamoinen | Pulsed Media ·

    一个API密钥,三种方言:工具中的开放权重LLM

    <p><em>9.99 € a month buys 9,990,000 credits on one API key: about 6 million input tokens on GLM-5.3, or about 37 million on the fast default model, from curl, your own code, Claude Code or Gemini CLI. Under the current rules the credits don't expire.</em></p> <p><em>I'm Väinämöi…

  86. dev.to — LLM tag TIER_1 English(EN) · Sven Welack ·

    大型语言模型在消费级硬件上运行 — 第 6 部分:编排上限 — 为何更大的协调器无法修复循环

    <p><em>Part 6 of a series. Previously: <a href="https://dev.to/USERNAME/PART-5-SLUG">Part 5 — Distributing the Workers and the Memory Budget</a>.</em></p> <p>Part 5 ended with the 77 GB coordinator finally running as it should — resident, no thrashing, the memory problem resolved…

  87. dev.to — LLM tag TIER_1 English(EN) · Kuldeep Paul ·

    流式传输LLM响应端到端:SSE、背压和中间生成取消

    <p><a class="article-body-image-wrapper" href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fb7j842v6aryzuvtmobck.png"><img alt="Streaming LLM Re…

  88. dev.to — LLM tag TIER_1 English(EN) · Sven Welack ·

    大型语言模型在消费级硬件上运行 — 第5部分:分发工作者和内存预算

    <p>Part 4 ended against a wall. A coordinator capable enough to be worth running — the 77 GB <code>gpt-oss:120b</code> — could not share a machine with the workers it had to call; every delegation forced roughly 100 GB of model-swapping, and a greeting took nearly five minutes. T…

  89. dev.to — LLM tag TIER_1 English(EN) · EME GUG ·

    运行大于内存的 MoE LLM:使用 llama.cpp 进行 mmap、专家卸载和 SSD 流式传输的实用指南

    <p>Tuần này trên Hacker News có một project khá thú vị tên Janas: chạy LLM lớn hơn RAM bằng cách stream các expert từ SSD. Đọc xong mình nhớ lại hồi đầu năm, khi cố nhét một model MoE hơn 100B params vào con laptop 32GB RAM. Lần đầu thì máy treo cứng, swap kín ổ. Lần sau thì chạy…

  90. dev.to — LLM tag TIER_1 English(EN) · Phil IPS ·

    本地部署大语言模型:Ollama、LM Studio、llama.cpp 与 vLLM 对比

    <p>Liquid syntax error: Unknown tag 'endraw'</p>

  91. dev.to — LLM tag TIER_1 English(EN) · Phil IPS ·

    本地部署大语言模型:Ollama、llama.cpp 和 vLLM 对比

    <h1> Deploying LLMs Locally: Ollama, llama.cpp, and vLLM Comparison </h1> <p>Run any model on your hardware — no API keys, no cloud, complete privacy.</p> <h2> Introduction </h2> <p>Local LLMs have matured. You can now run 7B-70B models on consumer hardware with near-cloud perfor…

  92. dev.to — LLM tag TIER_1 English(EN) · Phil IPS ·

    在消费级硬件上微调LLM:LoRA指南2024

    <h1> Fine-Tuning LLMs on Consumer Hardware: LoRA Guide 2024 </h1> <p>Train custom models on your GPU using LoRA/QLoRA — no cloud credits needed.</p> <h2> Introduction </h2> <p>Fine-tuning used to require A100s and thousands of dollars. With LoRA (Low-Rank Adaptation) and QLoRA (Q…

  93. dev.to — LLM tag TIER_1 English(EN) · AI Tech News ·

    设备端大语言模型推理:规格表中无人提及的权衡

    <h2> TL;DR </h2> <p>Running a language model on a device, a tablet, a handset, an edge box, is not just the cloud without the network. It is a different budget. Memory is fixed, precision is a lever, latency includes a cold start, and there is no autoscaler to hide your mistakes.…

  94. dev.to — LLM tag TIER_1 English(EN) · lucanu ·

    自托管 LLM 提示库:快速生成生产代码:实用指南

    <h1> Stop Wasting Hours on Prompt Engineering: Your Self-Hosted LLM Just Got Smarter </h1> <p>Running your own LLM locally is freedom. Running Llama-3 or Mistral on your infrastructure means no API costs, no rate limits, no vendor lock-in. But there's a hidden cost nobody talks a…

  95. dev.to — LLM tag TIER_1 English(EN) · Muthali Ganesh ·

    Claude Opus 5.5 LLM 测试:基准结果、安全发现和成本分析

    <p>Claude Opus 5.5 fixed all 18 critical defects in GoML's LatticeBench evaluation and resolved six of seven <code>very_hard</code> issues. The evaluation also revealed a surprising weakness: despite its performance on complex security defects, the model struggled with straightfo…

  96. dev.to — LLM tag TIER_1 English(EN) · LLM API Cost Calculator Token ·

    缓存前缀交叉:当更便宜的LLM变成更昂贵的那个

    <p>Most LLM cost comparisons collapse a model to one number: <strong>$X per million<br /> input tokens</strong>. That number is the price of a cache <em>miss</em>. Once prompt caching<br /> is on, most of the tokens you send on every request are billed at the cached-read<br /> ra…

  97. dev.to — LLM tag TIER_1 English(EN) · aifree.dev ·

    9款免费大语言模型API对比:速率限制、卡片规则及注意事项(2026)

    <p>You can prototype on LLMs without paying anything - but "free tier" means very different things depending on the provider. Some give permanent rate-limited access, some give a monthly credit, and some only free a handful of models.</p> <p>Here are nine LLM APIs that need <stro…

  98. dev.to — LLM tag TIER_1 English(EN) · Nexus Labs ·

    驯服LLM:从通用到黄金,解决Go性能瓶颈

    <p>Alright folks, let's talk about Large Language Models. Specifically, my recent adventure trying to coerce one into giving me genuinely <em>actionable</em> advice for a gnarly, old Go microservice. We've all seen the headlines, right? "AI optimizes your code!" "Let an LLM find …

  99. dev.to — LLM tag TIER_1 English(EN) · Abhash Chakraborty ·

    微调一个0.8B模型以在某项工作中超越托管LLM

    <p>I needed a model for one narrow decision. When a new fact about someone comes in, does it replace something already known? "I moved to Berlin" should retire "I live in Pune". "Watched two episodes of The Bear" should leave "works at Infosys" alone.</p> <p>It sounds trivial, bu…

  100. r/OpenAI TIER_2 English(EN) · /u/lulzxdxdxd ·

    LLM定价的可复现的每任务成本方法:每token的标价在我自己的两个基准测试中也对模型进行了不同排名

    <table> <tr><td> <a href="https://www.reddit.com/r/OpenAI/comments/1x0q5u5/a_reproducible_costpertask_method_for_llm_pricing/"> <img alt="A reproducible cost-per-task method for LLM pricing: sticker price per token ranked models differently in my own two benchmarks too" src="http…