PulseAugur
EN
LIVE 07:06:30

New LLM research tackles unlearning, acceleration, serving, and evaluation

Multiple research papers explore advancements in large language model (LLM) capabilities and efficiency. "Nullify" introduces a training-free method for unlearning sensitive information from LLMs without compromising utility. DynaTE presents a hardware-software co-design to accelerate diffusion LLMs by dynamically adapting execution based on token states. Mooncake offers a disaggregated architecture for LLM serving, optimizing KVCache utilization to increase throughput and meet latency requirements. Other research focuses on reproducible LLM inference benchmarking, unbiased reward modeling from implicit feedback, and novel optimization techniques like CM-DPO for LLM planning and Clean for second-order training at linear memory cost. AI

IMPACT These papers introduce novel techniques for LLM unlearning, acceleration, serving efficiency, evaluation, and optimization, potentially improving model performance, privacy, and resource utilization.

RANK_REASON Multiple research papers published on arXiv detailing new methods and architectures for LLMs.

Read on arXiv cs.AI →

AI-generated summary · Google Gemini · from 100 sources. How we write summaries →

New LLM research tackles unlearning, acceleration, serving, and evaluation

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
Multiple research papers published on arXiv detailing new methods and architectures for LLMs.
Source corroboration
100 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
paper, infra, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
49 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+47 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

Full methodology in our editorial standards.

COVERAGE [100]

  1. arXiv cs.CL TIER_1 English(EN) · Md Sabbir Hossen, Anichur Rahman, Pabon Shaha, Airin Afroj Aishi, Andrew H. Sung, Md Shohel Rana ·

    Who Pays for Efficient Inference? Confidence-Based Small-to-Large LLM Routing Across Tasks and Languages

    arXiv:2610.23249v1 Announce Type: new Abstract: Small-to-large language model routing can reduce inference cost by escalating difficult inputs while retaining easier ones on a smaller model. Its success, however, depends on identifying examples that benefit from escalation, and t…

  2. arXiv cs.AI TIER_1 English(EN) · Giovanni Vaccarino, Emanuele La Malfa, Dehai Min, Hanrong Zhang, Pier Luca Lanzi, Lu Cheng, Michael J. Wooldridge, Philip S. Yu, Sara Bernardini ·

    Repairing LLM-Generated Specifications with Deterministic Diagnosis

    arXiv:2610.22568v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as formalizers: given a reasoning problem expressed in natural language, they produce a formal specification that a symbolic solver can then solve, with guarantees relative to that …

  3. arXiv cs.CL TIER_1 English(EN) · LoongSage Team, Bowei Song, Caiwei Zhao, Chuwen Liu, Dechuang Gu, Dong Fang, Feiyu Xie, Huaiyu Li, Hui Zhang, Jian Tian, Jian Wang, Jie Zhao, Liguang Li, Maoyun Wang, Meiyan Yang, Minghan Zhu, Pai Liu, Pandeng Yao, Renbao Tian, Ru Yang, Shuai Jia, Shuai … ·

    LoongSage: A Production-Grade, High-Efficiency Agentic RL Framework for Frontier LLMs with Validated Recipes

    arXiv:2610.16352v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has emerged as a critical phase in the post-training pipeline of large language models (LLMs). As the frontier of LLM capabilities shifts from static reasoning to agentic tasks--characterized by…

  4. arXiv cs.CL TIER_1 English(EN) · Minghan Wang, Jinhang Zuo, Zhongxiang Dai, Zhiyong Wang, Fang Kong ·

    MARS: Memory-Aware Routing for Session-Level LLM Assistants

    arXiv:2610.23583v1 Announce Type: new Abstract: Long-term LLM assistants must repeatedly decide what prior context to expose and which model should answer as an interaction evolves. Existing memory systems and model routers usually make these decisions separately, although memory…

  5. arXiv cs.LG TIER_1 English(EN) · Tingfeng Lan, Yusen Wu, Bin Ma, Zhaoyuan Su, Rui Yang, Tekin Bicer, Masahiro Tanaka, Olatunji Ruwase, Dong Li, Yue Cheng ·

    ZenFlow: Enabling Stall-Free Offloading for LLM Training

    arXiv:2505.12242v4 Announce Type: replace-cross Abstract: Fine-tuning large language models (LLMs) often exceeds GPU memory limits, prompting systems to offload model states to CPU memory. However, existing offloaded training frameworks like ZeRO-Offload treat all parameters equa…

  6. arXiv cs.LG TIER_1 English(EN) · Zhi Zhang, Arash A. Amini ·

    Two Sample Sizes in Test-Time LLM Ensembling: Buffered ERM and Minimax Theory

    arXiv:2610.21363v1 Announce Type: cross Abstract: Test-time scaling can improve the performance of large language models by generating multiple answers to a question and aggregating them. Weighted ensembles extend this idea by drawing answers from several models, with the weights…

  7. arXiv cs.AI TIER_1 English(EN) · Ruiqi Wang, Xinchen Wang, Cuiyun Gao, Chun Yong Chong, Xin Xia, Qing Liao ·

    Benchmarking Code LLM-as-a-Judge via Constrained Perturbation and Calibration

    arXiv:2512.20159v2 Announce Type: replace-cross Abstract: Code from LLM-assisted development may contain defects like API hallucinations, motivating the development of code evaluation metrics to assess such code before deployment. As conventional rule-based metrics merely score c…

  8. arXiv cs.AI TIER_1 English(EN) · Michael Hind, Basel Shbita, Bo Wu, Farhan Ahmed, Chad DeLuca, Nathan Fulton, David Cox, Dan Gutfreund ·

    LLMON: An LLM-native Markup Language to Leverage Structure and Semantics at the LLM Interface

    arXiv:2603.22519v4 Announce Type: replace-cross Abstract: Textual Large Language Models (LLMs) provide a simple and familiar interface: a string of text is used for both input and output. However, the information conveyed to an LLM often has a richer structure and semantics, whic…

  9. arXiv cs.LG TIER_1 English(EN) · Xingyu Qu, Tianhao Lin, Yiqi Li, Zhiyu Chen, Sheng Wang ·

    HAServe: Horizon-Aware Scheduling and Memory Co-Design for Efficient LLM Serving

    arXiv:2605.08581v2 Announce Type: replace Abstract: Online large language model (LLM) services process requests that share context but differ in prefix structure and arrival timing. Finite capacity couples request admission and key-value (KV) retention. This paper addresses one o…

  10. arXiv cs.AI TIER_1 English(EN) · Jiacheng Liang, Yuhui Wang, Tanqiu Jiang, Ting Wang ·

    LaCache: Robust Semantic Caching for LLM Serving

    arXiv:2608.01718v2 Announce Type: replace Abstract: Semantic caching, reusing responses to answer semantically similar queries, has seen growing adoption in LLM serving, offering faster responses and reduced costs. Yet existing schemes are fundamentally vulnerable to cache-collis…

  11. arXiv cs.AI TIER_1 English(EN) · Xuanlin Yang, Jia Li, Zhouchen Lin ·

    StructZO: Structured Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning

    arXiv:2610.16451v1 Announce Type: cross Abstract: Fine-tuning large language models at scale is increasingly limited by the memory cost of backpropagation. Zeroth-Order (ZO) optimizers reduce this burden by relying only on forward function evaluations, but they still exhibit a su…

  12. arXiv cs.AI TIER_1 English(EN) · Huihao Jing, Wenbin Hu, Shaojin Chen, Haochen Shi, Haoyu Huang, Sirui Zhang, Yuxuan Liu, Zhongwei Xie, Haoran Li ·

    RadixFlow: Filling Execution Bubbles in Prefix-Cached Hybrid LLM Serving

    arXiv:2610.18143v1 Announce Type: new Abstract: Prefix reuse improves LLM inference by sharing the KV cache of common prompt prefixes. This helps only if the scheduler can execute a matched branch in the current worker round. Schedulers assume that a matched prefix is ready, whic…

  13. arXiv cs.AI TIER_1 English(EN) · Xinnan Dai, Kaiqi Yang, Yaxin Li, Cheng Luo, Wanli Li, Mingqing Xiao, Xinyang Jiang, Daoan Zhang, Kaitao Song, Fengze Liu, Zefan Cai, Caihua Shan ·

    Words to World: Benchmarking LLMs in Interactive Physical Environments

    arXiv:2610.15228v1 Announce Type: new Abstract: Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that affect the physical world. However, current benchmarks largely evaluate LLMs throug…

  14. arXiv cs.AI TIER_1 English(EN) · Xianglong Yan, Zenan Wu, Kewei Zhang, Kaicheng Yang, Yulun Zhang ·

    SAGE: Pushing 2-Bit Vector-Quantized LLMs toward Real-World Usability

    arXiv:2610.14745v1 Announce Type: new Abstract: Extreme low-bit weight-only quantization is an effective approach to reducing the deployment costs of large language models. Below 3 bits, scalar quantization often suffers severe accuracy loss, while vector quantization (VQ) better…

  15. arXiv cs.AI TIER_1 English(EN) · Zeyu Yang, Wes Armour ·

    Measuring the Inference Energy Efficiency of Open-Weight LLMs across Benchmarks, Reasoning Modes, and Hardware

    arXiv:2610.14389v1 Announce Type: new Abstract: Benchmark scores tell us what an LLM can do, but not how much energy is required to deliver that capability. We directly measure this trade-off for 86 open-weight model checkpoints, evaluated on seven benchmarks and six hardware pla…

  16. arXiv cs.LG TIER_1 English(EN) · Miko{\l}aj Pi\'orczy\'nski, Wojciech Masarczyk, Damian S\'ojka, Sebastian Cygert, Bart{\l}omiej Twardowski ·

    On the Limits of Representation-Based Test-Time Adaptation for Multimodal LLMs

    arXiv:2610.19892v1 Announce Type: new Abstract: Vision-language models suffer significant accuracy drops under common corruptions. While test-time adaptation (TTA) successfully mitigates these shifts in CLIP-like contrastive models, its application to generative multimodal large …

  17. arXiv cs.LG TIER_1 English(EN) · Casper L. Christensen, Kyle J. Ray, Dmitry Manning-Coe, Adam Shai, Paul Riechers ·

    LLMs program using Reusable and Composable Abstract Representations

    arXiv:2610.19238v1 Announce Type: new Abstract: When writing code, the same computation can be expressed in different programming languages and through different implementation strategies. We show that the activations of LLMs capture this shared structure in reusable and composab…

  18. arXiv cs.CL TIER_1 English(EN) · Tongwei Deng, Jinyu Zhu, Yue Cao, Chenxu Wang, Yanzhen Zou, Bing Xie ·

    LintEval: Benchmarking LLMs on Linter-Guided File Refactoring

    arXiv:2610.20027v1 Announce Type: cross Abstract: Linters are widely used in code maintenance and real-time IDE editing to surface lint alerts related to performance, style, error-prone, and other patterns in source files. However, existing code benchmarks do not explicitly evalu…

  19. arXiv cs.AI TIER_1 English(EN) · Huihao Jing, Wenbin Hu, Shaojin Chen, Haochen Shi, Zhongwei Xie, Guijia Zhang, Yuxuan Liu, Haoyu Huang, Haoran Li, Yangqiu Song ·

    SoFT: Soft Targets for Generalizable LLM Fine-Tuning

    arXiv:2609.32493v2 Announce Type: replace-cross Abstract: Distillation enables student language models to acquire new capabilities from expert teachers. However, integrating knowledge from multi-teacher, multi-domain demonstrations into a single student remains challenging. We st…

  20. arXiv cs.AI TIER_1 English(EN) · Eunsu Kim, Haneul Yoo, Guijin Son, Hitesh Patel, Amit Agarwal, Alice Oh ·

    Benchmarks Are Not Atomic: Composition-Aware LLM Evaluation using BenchHub

    arXiv:2506.00482v2 Announce Type: replace-cross Abstract: LLM benchmarks are often treated as coherent measurement units, yet they are heterogeneous collections of instances spanning diverse domains, skills, formats, and contexts. As a result, aggregate benchmark scores can confl…

  21. Hugging Face Daily Papers TIER_1 English(EN) ·

    LLMs program using Reusable and Composable Abstract Representations

    When writing code, the same computation can be expressed in different programming languages and through different implementation strategies. We show that the activations of LLMs capture this shared structure in reusable and composable abstract representations when they generate c…

  22. Hugging Face Daily Papers TIER_1 English(EN) ·

    Words to World: Benchmarking LLMs in Interactive Physical Environments

    Words are increasingly becoming an interface for action: large language models (LLMs) can now invoke tools, operate devices, and make decisions that affect the physical world. However, current benchmarks largely evaluate LLMs through static text responses, offline tool calls, or …

  23. arXiv cs.AI TIER_1 English(EN) · Minghan Jiang, Jiayi Wang, Shuaiting Li, Haibin Shen, Kejie Huang ·

    DynaTE: Accelerating Diffusion LLMs via Dynamic Token Execution

    arXiv:2610.11284v1 Announce Type: cross Abstract: Diffusion-based LLMs (dLLMs) have recently emerged as a promising alternative to autoregressive (AR) LLMs by enabling bidirectional parallel refinement, alleviating the sequential decoding bottleneck of AR generation. However, the…

  24. arXiv cs.AI TIER_1 English(EN) · Ruoyu Qin, Zheming Li, Weiran He, Mingxing Zhang, Yongwei Wu, Weimin Zheng, Xinran Xu ·

    Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving

    arXiv:2407.00079v5 Announce Type: replace-cross Abstract: Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. It features a KVCache-centric disaggregated architecture that separates the prefill and decoding clusters. It also leverages the und…

  25. arXiv cs.LG TIER_1 English(EN) · Younwoo Choi, Leo Feng, Vincent Liu, Haanvid Lee ·

    Amortized Off-Policy Evaluation for LLMs

    arXiv:2610.10848v1 Announce Type: new Abstract: Accurate evaluation is central to selecting which LLM to deploy, yet testing a candidate on live traffic exposes real users to an unvetted model. Teams therefore evaluate candidates offline, on data produced by already-deployed mode…

  26. arXiv cs.AI TIER_1 English(EN) · Wei Zhai, Xiang Liu, Qiang Huang, Rui Qian, Lemao Liu, Ziwei Li, Ziqi Wang, Zhitao Huang, Dejing Dou ·

    Nullify: Null-Space Activation Steering for Training-Free LLM Unlearning

    arXiv:2610.10655v1 Announce Type: cross Abstract: Large Language Models (LLMs) inevitably internalize substantial amounts of sensitive or private information during pre-training, while LLM unlearning aims to selectively erase specific knowledge to prevent privacy leakage with min…

  27. arXiv cs.LG TIER_1 English(EN) · Rabimba Karanjai, Qun Gu, Hemanth Hegadehalli Madhavarao, Wenhuan Sun, Xiaojiao Yu, Suryabhan Singh Hada, Libin N. George, Uma Kona, Richard Williamson, Linsey Pang, Prakhar Mehrotra ·

    CM-DPO: Constraint-Margin Direct Preference Optimization for LLM Planning

    arXiv:2610.09219v1 Announce Type: cross Abstract: Direct Preference Optimization (DPO) treats all constraint violations equally: a $1 budget overshoot and a $1,000 overshoot induce the same training signal. It is also susceptible to length and style bias when preference pairs com…

  28. arXiv cs.LG TIER_1 English(EN) · Arnold Olympio, Juan Manuel Servera Bondroit, Wael Abdelmalek, Guang Lu, Jo\~ao Carvalho ·

    Reproducible LLM Inference Benchmarking: A Sequential Isolation Protocol for Regression Testing

    arXiv:2610.09778v1 Announce Type: cross Abstract: Reproducible benchmarking of Large Language Model (LLM) inference is challenging because repeated measurements can vary with execution and system state. We present the Sequential Isolation Methodology, a controlled benchmarking an…

  29. arXiv cs.CL TIER_1 English(EN) · Beheshteh T. Rakhshan, Sahar Rajabi, Maziar Sargordi Shikai Fang, Guillaume Rabusseau, Sirisha Rambhatla ·

    Clean: Second-order LLM Training at Linear Memory Cost via Nystr\"om Sketching

    arXiv:2610.04204v2 Announce Type: replace-cross Abstract: Training large language models (LLMs) entails a fundamental trade-off: memory-efficient optimizers such as Adam discard cross-parameter curvature, whereas full-curvature methods such as SOAP can accelerate convergence at p…

  30. arXiv cs.LG TIER_1 English(EN) · Shai Feldman, Yaniv Romano ·

    Dynamic Budget Allocation for LLM Evaluation under Hard Resource Constraints

    arXiv:2610.07362v1 Announce Type: new Abstract: We evaluate large language models (LLMs) in multi-turn interactions through their time-to-event: the number of interaction steps required to produce an event of interest, such as a successful jailbreak or agentic task completion. Un…

  31. arXiv cs.AI TIER_1 English(EN) · Jinhyeok Kim, Hye-Young Jung ·

    Penalty-Framed No-Valid-Option MCQA: Analyzing LLM Abstention under Invalid Choices

    arXiv:2610.08153v1 Announce Type: cross Abstract: Multiple-choice question answering (MCQA) is commonly used to evaluate large language models under the assumption that one of the provided options is correct, typically using answer-selection accuracy. However, in real deployments…

  32. arXiv cs.AI TIER_1 English(EN) · Hao Wang, Haocheng Yang, Licheng Pan, Lei Shen, Xiaoxi Li, Yinuo Wang, Zhichao Chen, Yuan Lu, Haoxuan Li, Zhouchen Lin ·

    Unbiased Reward Modeling from Implicit Feedback for LLM Alignment

    arXiv:2603.23184v2 Announce Type: replace-cross Abstract: Despite the success of reinforcement learning from human feedback (RLHF), existing reward modeling methods largely rely on explicit feedback, which is costly to collect and difficult to scale. This work studies implicit re…

  33. arXiv cs.AI TIER_1 English(EN) · Abhinav Sudhakar Dubey (University of California Santa Cruz), Scott Sirri (University of California Santa Cruz), Vaggos Chatziafratis (University of California Santa Cruz), C. Seshadhri (University of California Santa Cruz) ·

    Jailbreaking Open-Weight LLMs via Random Embedding Perturbations

    arXiv:2610.07125v1 Announce Type: cross Abstract: While open-weight models have enjoyed steady progress in capabilities and wide adoption across multiple domains, their safety remains an important concern. One key feature is the ability to refuse or deflect harmful, malicious, or…

  34. arXiv cs.AI TIER_1 English(EN) · Zhishen Sun, Hongzhan Wang, Sizhe Dang, Guang Dai, Haishan Ye ·

    DART-ES: Difficulty-Aware Reweighting and Targeted Replay for Fine-Tuning LLMs with Evolution Strategies

    arXiv:2610.06993v1 Announce Type: cross Abstract: Evolution Strategies (ES) enable memory efficient full parameter fine-tuning of large language models (LLMs) using only forward computation. However, standard ES uniformly averages rewards across problems and compresses problem le…

  35. arXiv cs.MA (Multiagent) TIER_1 English(EN) · Dou Shen ·

    AGAR: a reinforcement learning substrate for LLM program evolution

    Given a task and an evaluator, a language model can rewrite a candidate program while a search loop decides which rewrites survive, offering a practical route to algorithm discovery. But that loop is governed by five constants set by hand: which parent to select, how hard to muta…

  36. Hugging Face Daily Papers TIER_1 English(EN) ·

    Dynamic Minimax Regret Optimization for Robust LLM Post-Training

    Modern LLM training increasingly relies on heterogeneous data sources spanning different domains, tasks, preference distributions, and difficulty levels. We study dynamic minimax regret for group-distributionally robust LLM post-training under instantaneous mini-batch-only bandit…

  37. arXiv cs.AI TIER_1 English(EN) · Yuyang Dai, Rana Shahout, Mahmood Sharif ·

    Jumping the Line: Exploiting Length Predictions in LLM Scheduling

    arXiv:2610.03430v1 Announce Type: new Abstract: Efficient request scheduling is increasingly important for reducing completion time in large language model (LLM) serving. Size-based policies such as Shortest Job First prioritize shorter requests, but output lengths are unknown be…

  38. arXiv cs.LG TIER_1 English(EN) · Arda Fazla, Antesh Upadhyay, Ege C. Kaya, M. Berk Sahin, Abolfazl Hashemi ·

    Why Does Adaptive Batching Help LLM Pretraining? A Perspective from Unbounded Variance

    arXiv:2610.02355v1 Announce Type: new Abstract: Increasing the batch size during training is a common practice in large language model (LLM) pretraining, yet the theoretical justification behind its success is not well understood. Analyses of stochastic optimization often assume …

  39. arXiv cs.AI TIER_1 English(EN) · Zhouliang Xie, Changliang Zhou, Genghui Li, Zhenkun Wang ·

    Multi-Task Evolution for Zero-Shot Cross-Problem Generalization using LLMs

    arXiv:2610.03316v1 Announce Type: new Abstract: Designing effective heuristics for diverse combinatorial optimization problems requires substantial expertise and repeated search. Large language models (LLMs) automate heuristic generation and refinement, but heuristic search typic…

  40. arXiv cs.AI TIER_1 English(EN) · Md Nurul Absar Siddiky, Liuwan Zhu, Yingfei Dong ·

    Frequency Is Not Sensitivity Identifying Safety-Sensitive Experts in Sparse MoE LLM

    arXiv:2610.02910v1 Announce Type: new Abstract: Suppressing a small set of routed experts can weaken the safety behavior of a sparse Mixture-of-Experts (MoE) language model without retraining. Which experts to suppress is therefore a security question, and the usual answer is act…

  41. arXiv cs.CL TIER_1 English(EN) · Xueqi Cheng, Liang Wu, Kelly Wan, Liangjie Hong, Yushun Dong ·

    Capability Scaling-Down Laws for LLM Compression

    arXiv:2610.02462v1 Announce Type: cross Abstract: LLM compression reduces inference costs and memory requirements, but selecting a method and configuration remains largely empirical because comparable resource reductions can produce different capability losses. We systematically …

  42. arXiv cs.LG TIER_1 English(EN) · Hongyu Chen, Xinyi Luo, Ming Zhao, Lin Tang, Zihan Xu, Jing Li, Yuxuan Wang, Haoran Deng, Wei Zhang ·

    Every Batch Is Its Own Validation Set: Leave-One-Out Gradient Matching for Online Data Selection in LLM Fine-Tuning

    arXiv:2610.00436v1 Announce Type: new Abstract: Online batch selection fine-tunes a language model on the most useful part of each candidate batch. Selectors that match the gradient of the candidate batch are attractive because they need no held-out data, yet they rarely beat tra…

  43. arXiv cs.LG TIER_1 English(EN) · Tianshuo Qiao, Naiqian Zheng, Xiaopeng Liu, Shuguang Wang, Diandian Gu, Xuanzhe Liu, Xin Jin ·

    FastCI: Efficient GPU-Intensive CI for LLM Training Frameworks

    arXiv:2610.01967v1 Announce Type: new Abstract: As large language models (LLMs) keep growing in size and complexity, their training frameworks evolve at a rapid pace as well. Therefore, continuous integration (CI) is critical for maintaining the quality and stability of these fra…

  44. arXiv cs.LG TIER_1 English(EN) · Zailong Tian, Yanzhe Chen, Zhuoheng Han, Houfeng Wang, Lizi Liao ·

    Learn the Directions, Normalize the Gains: Post-Training Normalization for LoRA

    arXiv:2610.02067v1 Announce Type: new Abstract: While Low-Rank Adaptation (LoRA) enables efficient task specialization, its learned updates can compromise capabilities beyond the target task. We identify \textbf{adaptation imbalance}: a few singular directions dominate the traine…

  45. arXiv cs.LG TIER_1 English(EN) · Cristian McGee, El Houcine Bergou, Aritra Dutta ·

    Trust the Direction, Search the Step: Zero-and-First-Order Methods for LLM Fine-Tuning

    arXiv:2610.02190v1 Announce Type: new Abstract: Step-size selection remains a central challenge in large-scale neural network optimization; conservative steps slow convergence, while aggressive steps can destabilize it. We combine \textbf{Z}ero-and-\textbf{F}irst-\textbf{O}rder o…

  46. arXiv cs.LG TIER_1 English(EN) · Jichao Jiang (University of Central Florida), Cristian McGee (University of Central Florida), El Houcine Bergou (Mohammed VI Polytechnic University), Hanqin Cai (University of Central Florida), Aritra Dutta (University of Central Florida) ·

    TACO: Ternary Absolute-max Column-wise One-sparse Optimizer for LLM Fine-Tuning

    arXiv:2610.02199v1 Announce Type: new Abstract: Full-parameter fine-tuning of large language models (LLMs) incurs substantial optimizer state memory overhead, limiting the model sizes that fit on modern GPUs. Existing approaches either compress optimizer state, abandon first-orde…

  47. arXiv cs.LG TIER_1 English(EN) · Geon-Woo Kim, Joon Ha Kim, Daehyeok Kim ·

    Leto: Fast In-Place Recovery for LLM Training on Surviving Hardware

    arXiv:2610.00687v1 Announce Type: cross Abstract: Hardware-operable failures (HOFs) interrupt large language model (LLM) training but permit recovery on the same hardware without reset, repair, or replacement. Existing recovery systems nevertheless reload checkpoints, recompute l…

  48. arXiv cs.LG TIER_1 English(EN) · Hang Zou, Chao Zhang, Yuzhi Yang, Yu Tian, Samson Lasaulce, M\'erouane Debbah ·

    FedFit: Federated Fine-Tuning of LLMs via Vector-Bank Parameterization and Quantization

    arXiv:2610.01537v1 Announce Type: new Abstract: Federated Learning (FL) enables privacy-preserving fine-tuning of Large Language Models (LLMs), yet the massive communication overhead remains a critical bottleneck. Furthermore, applying Low-Rank Adaptation (LoRA) in FL faces a fun…

  49. arXiv cs.NE (Neural & Evolutionary) TIER_1 English(EN) · Nguyen Dang ·

    AdaEva: Accelerating LLM-Driven Algorithm Design with Adaptive Partial Evaluation

    Large Language Models (LLMs) are increasingly used for automated algorithm design. However the computational cost of evaluating the generated algorithms can be excessive. We consider the common LLM-driven automated algorithm design (LLM4AD) setting in which a candidate algorithm …

  50. arXiv cs.LG TIER_1 English(EN) · Kemou Li, Qizhou Wang, Yue Wang, Fengpeng Li, Zhuan Shi, Negar Rostamzadeh, Golnoosh Farnadi, Masashi Sugiyama, Jiantao Zhou ·

    Preemptive LLM Unlearning against Forbidden Capability Acquisition via Gradient Sealing

    arXiv:2609.39866v1 Announce Type: new Abstract: Open-weight LLMs are released not only as fixed products but also as substrates for downstream fine-tuning. This openness, however, creates legal and ethical risks because users may misuse fine-tuning to instill illicit knowledge or…

  51. arXiv cs.LG TIER_1 English(EN) · Yichen Wang, Fanghui Liu, Yudong Chen ·

    From Spectra to Joint Schedules in LLM Pre-training: 3+3(+2) Scaling-Law Regimes

    arXiv:2609.40148v1 Announce Type: new Abstract: Power-law learning curves are often treated as fixed properties of a model and its data, although learning-rate and batch-size schedules can change the observed loss. We study this dependence in noisy online SGD with linear random f…

  52. arXiv cs.AI TIER_1 English(EN) · Qijia He, Ruinan Jin, Jun Luo, Shaofeng Zou, Yingbin Liang ·

    Asynchronous LLM Post-Training: Group-Mass Capping and Convergence Analysis

    arXiv:2610.01896v1 Announce Type: cross Abstract: Asynchronous reinforcement learning (RL) improves the efficiency of large language model post-training but introduces stale rollouts generated by earlier policies. Theoretical understanding of how this staleness affects convergenc…

  53. arXiv cs.AI TIER_1 English(EN) · Haozhan Tang, Xiuqi Zhu, Xinyin Zhang, Boxun Li, Virginia Smith, Kevin Kuo ·

    Beyond LoRA vs. Full Fine-Tuning: Gradient-Guided Optimizer Routing for LLM Adaptation

    arXiv:2605.07111v3 Announce Type: replace-cross Abstract: Recent literature on fine-tuning Large Language Models highlights a fundamental debate. While Full Fine-Tuning (FFT) provides greater representational plasticity, Low-Rank Adaptation (LoRA) can match or surpass FFT perform…

  54. arXiv cs.AI TIER_1 English(EN) · Shixuan Liu, Tongli Zhou, Junwei Deng, Pingbang Hu, Jiaqi W. Ma ·

    dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale

    arXiv:2609.38767v1 Announce Type: cross Abstract: Training data attribution (TDA) estimates the contribution of individual training examples to model outputs. Most scalable TDA methods rely on per-example gradients, whose computation and use at LLM scale pose challenges in effici…

  55. arXiv cs.AI TIER_1 English(EN) · Huaiyu Fu, Heng Cao, Hao Wang, Jian Ya, Tao Chen ·

    Explicit Trajectory Diversity for RL-Based Post-Training of LLM Agents

    arXiv:2609.38805v1 Announce Type: cross Abstract: LLM agents often admit multiple high-quality solutions to the same task, differing in reasoning structure, tool-use pattern, or interaction trajectory. Yet existing notions of diversity in LLM post-training are mostly implicit, ar…

  56. arXiv cs.AI TIER_1 English(EN) · Tyler Skow, Shravan Chaudhari, Rama Chellappa, Abhay Yadav ·

    Linguistic Loopholes in LLM Unlearning: From a 174-Language Benchmark to Coverage-Aware Unlearning

    arXiv:2609.40286v1 Announce Type: cross Abstract: Unlearning a fact in one language does not guarantee its removal in others as changing the query or even the requested answer language can reopen seemingly forgotten knowledge -- a cross-lingual loophole. The most straightforward …

  57. arXiv cs.AI TIER_1 English(EN) · Qingao Yi, Jiaang Duan, Jun Zhang, Haiyan Zhao, Shiyou Qian, Dingyu Yang, Jian Cao, Jinghua Tang ·

    EDGC: Entropy-driven Dynamic Gradient Compression for Efficient LLM Training

    arXiv:2511.10333v2 Announce Type: replace-cross Abstract: Training large language models (LLMs) at scale incurs substantial communication overhead, while static gradient compression cannot adapt to gradient evolution and may degrade model quality. We propose EDGC, an entropy-driv…

  58. arXiv cs.AI TIER_1 English(EN) · Chenhao Ye, Huaizheng Zhang, Mingcong Han, Baoquan Zhong, Xiang Li, Qixiang Chen, Xinyi Zhang, Weidong Zhang, Kaihua Jiang, Wang Zhang, He Sun, Wencong Xiao, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau ·

    TensorHub: Scalable and Elastic Weight Transfer for LLM RL Training

    arXiv:2604.09107v2 Announce Type: replace-cross Abstract: Modern LLM reinforcement learning (RL) workloads require a high-performance weight transfer system to scale training across heterogeneous compute resources. However, efficiently transferring terabyte-scale model weights ac…

  59. arXiv cs.CL TIER_1 English(EN) · Srishti Ginjala, Eric Fosler-Lussier, Srinivasan Parthasarathy ·

    Fairness Beyond a Single Run: Training-Seed Variability in Speech LLM Adaptation

    arXiv:2609.38976v1 Announce Type: new Abstract: Demographic fairness gaps in automatic speech recognition are almost always reported from a single training run. We fine-tune the Q-former projector and LoRA adapters of a speech LLM at five audio compression factors and six random …

  60. Hugging Face Daily Papers TIER_1 English(EN) ·

    Fairness Beyond a Single Run: Training-Seed Variability in Speech LLM Adaptation

    Demographic fairness gaps in automatic speech recognition are almost always reported from a single training run. We fine-tune the Q-former projector and LoRA adapters of a speech LLM at five audio compression factors and six random seeds, holding the encoder, base decoder, data a…

  61. arXiv cs.LG TIER_1 English(EN) · Shufan Shen, Zhongni Hou, Junshu Sun, Yufei Zhang, Wei Lin, Guojun Yin, Qingming Huang, Shuhui Wang ·

    On-Policy Parameter Update Direction Underlies Generalization in LLM Post-Training

    arXiv:2609.36659v1 Announce Type: new Abstract: The strong generalization performance of on-policy post-training paradigms has motivated studies of their parameter update behaviors. However, these studies treat the observed behaviors only as byproducts in on-policy training, over…

  62. arXiv cs.AI TIER_1 English(EN) · Chenliang Li, Neiwen Ling, Zijun Wei, Alfredo Garcia ·

    Where Does Staleness Accumulate? Pool Aware Effective Staleness Control for Asynchronous RL in LLM Post-Training

    arXiv:2609.36830v1 Announce Type: new Abstract: Fully asynchronous reinforcement learning (RL) improves resource utilization in large language model post-training by overlapping rollout generation with policy optimization, but it also introduces policy lag as trajectories are gen…

  63. arXiv cs.AI TIER_1 English(EN) · Pengyu He, Yan Zhang, Ruien Li, Guangwen Yang ·

    AutoLoCo: Communication Efficient Distributed LLM Training via Adaptive Synchronization

    arXiv:2609.36662v1 Announce Type: cross Abstract: The pre-training of Large Language Models (LLMs) is increasingly conducted across multiple data centers. As training scales to a larger number of accelerators, the fraction of time spent on computation decreases, while the fractio…

  64. arXiv cs.AI TIER_1 English(EN) · Zhehao Huang, Changxin Tian, Qingyuan Yang, Kunlong Chen, Ziqi Liu, Zhiqiang Zhang, Xiaolin Huang, Jun Zhou ·

    Trajectory Soup: Pushing the Compute-Scaling Frontier of LLM Mid-training via Diverse Trajectories

    arXiv:2609.37169v1 Announce Type: cross Abstract: Mid-training equips pretrained large language models with specialized and reasoning capabilities, but the returns of this stage are bounded since additional serial compute yields little further downstream improvement and can even …

  65. arXiv cs.CL TIER_1 English(EN) · Tianhao Qian, Ziming Hong, Chongyang Gao, Kezhen Chen, Lixu Wang ·

    Storage Is Not Strategy: State-Conditioned Support Control for LLM Unlearning

    arXiv:2609.37858v1 Announce Type: cross Abstract: Many localized large language model (LLM) unlearning methods select a small parameter subset from a localization signal and keep it fixed during optimization. The parameters most associated with a target, however, need not be the …

  66. arXiv cs.LG TIER_1 English(EN) · Haozhan Tang, Hao Kang, Han Cai, Song Han, Chenyan Xiong ·

    Delta-Matching: Closing the Final Gap of Native 8-bit Training for LLMs

    arXiv:2609.37852v1 Announce Type: new Abstract: Reliable FP8 attention remains a barrier to fully native 8-bit large language model training. We derive how forward-backward inconsistencies produce stale delta and empirically show how it distorts training dynamics. Our stale-delta…

  67. Hugging Face Daily Papers TIER_1 English(EN) ·

    On-Policy Parameter Update Direction Underlies Generalization in LLM Post-Training

    The strong generalization performance of on-policy post-training paradigms has motivated studies of their parameter update behaviors. However, these studies treat the observed behaviors only as byproducts in on-policy training, overlooking their potential to serve as optimization…

  68. Hugging Face Daily Papers TIER_1 English(EN) ·

    Nereus: Adaptive Parallelism for LLM Post-Training

    Reinforcement learning (RL) post-training for large language models (LLMs) coordinates multiple models across generation, inference, and training on GPU clusters. Several factors may change during a run, including resource availability, sequence length, memory pressure, and stage…

  69. arXiv stat.ML TIER_1 English(EN) · Aditya Kulkarni, Davide Sartor, Carlos Soto, Nathan Wycoff ·

    How Low Can You Go: Fine-Tuning LLMs with Bayesian Optimization (LlMBO)

    arXiv:2610.18504v1 Announce Type: new Abstract: Recently, Morris et al. introduced TinyLoRA, a strategy for LLM fine-tuning which introduces arbitrarily few parameters, and demonstrated accuracy improvements using less than $10$ parameters rather than the ${\gtrsim 10,000}$ typic…

  70. arXiv stat.ML TIER_1 English(EN) · Hang Yin, Haozhe Wang, Yuhua Luo, Zhangqi Pan, Xiaoxing Wang, Junchi Yan ·

    ChainLoRA: Geometry-Preserving Task Vector Merging for Continual Learning in LLMs

    arXiv:2610.00431v1 Announce Type: new Abstract: Continual parameter-efficient fine-tuning for large language models (LLMs) must balance retention of previously acquired knowledge, adaptation to new tasks, and strict parameter budgets. We present \textbf{ChainLoRA}, a replay-free …

  71. The Register — AI TIER_1 English(EN) ·

    Write bot-resistant code with KillSwitch, a programming language designed to confuse LLMs

    Lies, lots of adverbs, and prosaic stories don't make for very machine-readable code, it turns out

  72. Towards AI TIER_1 English(EN) · Ashish Abraham ·

    The Ultimate Guide to LLM Inference Optimization- Part 3

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://pub.towardsai.net/the-ultimate-guide-to-llm-inference-optimization-part-3-cef44d73aec7?source=rss----98111c9905da---4"><img src="https://cdn-images-1.medium.com/max/1228/1*CIiWf7PJyst5EkEUWndOzw.png" widt…

  73. Medium — MLOps tag TIER_1 English(EN) · Shlokdhanokar ·

    LLM Inference Optimization: Cut Cost and Latency in Production

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://medium.com/accredian/llm-inference-optimization-cut-cost-and-latency-in-production-7b04caaacc79?source=rss------mlops-5"><img src="https://cdn-images-1.medium.com/max/1070/0*o4yoFyij28yqsnLf.jpeg" width="…

  74. dev.to — MCP tag TIER_1 English(EN) · Renato Marinho ·

    Managing Physical Security via LLMs: Why Logic Layers Matter More Than API Access

    <p>When we talk about giving an AI agent 'access' to a system, our mental model usually defaults to software. We think of an agent reading a Jira ticket, querying a Postgres database, or sending a message via Slack. But the boundary between digital intent and physical reality is …

  75. Medium — Claude tag TIER_1 English(EN) · Eun Ji ·

    ds-specs: a Claude Skill for LLM-first design systems, with two-way Figma sync

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://uxplanet.org/ds-specs-a-claude-skill-for-llm-first-design-systems-with-two-way-figma-sync-3d6d77dbc12b?source=rss------claude-5"><img src="https://cdn-images-1.medium.com/max/1870/1*b45ZNk5vX9eqd3BktAlyrA…

  76. dev.to — MCP tag TIER_1 English(EN) · Japan Open Data Lab ·

    What I Learned Building Multiple MCP Servers for Local LLMs (Qwen3-8B): Tool Granularity, Latency Traps, and Dogfooding

    <p>Recently, I have been building a local data analysis stack pairing <strong>LM Studio (<code>Qwen3-8B</code>)</strong> with custom <strong>Model Context Protocol (MCP)</strong> servers to query and cross-analyze over 180 normalized Japanese government and corporate datasets.</p…

  77. Medium — fine-tuning tag TIER_1 Deutsch(DE) · William Antônio Siqueira ·

    Fine Tuning LLMs Using Kale and Kubeflow Pipelines

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://william-siqueira.medium.com/fine-tuning-llms-using-kale-and-kubeflow-pipelines-4b7750c68089?source=rss------fine_tuning-5"><img src="https://cdn-images-1.medium.com/max/1405/1*XbPuYhnoxnevop-qWH5V0Q.png" …

  78. Medium — MLOps tag TIER_1 English(EN) · Shahad Mahmud ·

    From Demo to Production: Six Gaps That Break LLM Apps

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://levelup.gitconnected.com/from-demo-to-production-six-gaps-that-break-llm-apps-a5cf67b9b124?source=rss------mlops-5"><img src="https://cdn-images-1.medium.com/max/2600/0*VmSu1zwieipxUkIw" width="4747" /></…

  79. dev.to — LLM tag TIER_1 English(EN) · qjlsh ·

    Comparing Free Tiers of LLM APIs Fairly

    <h2> Understanding Free Tiers </h2> <p>Free tiers of Large Language Model (LLM) APIs offer a starting point for experimenting with AI capabilities without significant upfront costs. However, these tiers often come with limitations such as request quotas, response size, and model …

  80. dev.to — LLM tag TIER_1 English(EN) · Dhanush Kumar Sivaji ·

    The path to AI FDE #01: Anatomy of an LLM app request

    <p>I've spent 8+ years building React/TypeScript front ends. Now I'm learning applied AI in public, working toward AI Engineer, then AI Solution Architect, and (I hope) AI Forward Deployed Engineer. Before tokens, RAG or agents, I wanted one map: what actually happens when a user…

  81. dev.to — LLM tag TIER_1 English(EN) · abdul rahman ·

    vLLM vs. Ollama vs. llama.cpp: The Definitive LLM Inference Engine Guide

    <p><strong>ENTERPRISE AI ARCHITECTURE &amp; INFERENCE SYSTEMS ENGINEERING</strong></p> <p><em>Technical Audit: PagedAttention KV Cache Physics, GGUF Quantization, Concurrent Token Throughput &amp; Cloud Serving Economics</em></p> <p><a class="article-body-image-wrapper" href="htt…

  82. dev.to — LLM tag TIER_1 English(EN) · Sven Welack ·

    Running LLMs on Consumer Hardware — Part 7: The Strategist — Judgment on a Cloud Model, Execution Local

    <p><em>Part 7 of a series. Previously: <a href="https://dev.to/USERNAME/PART-6-SLUG">Part 6 — The Orchestration Ceiling</a>.</em></p> <p>Part 6 made the team's execution reliable: by moving the control loop out of the model and into deterministic code, the orchestrator could carr…

  83. dev.to — LLM tag TIER_1 English(EN) · Swathi Rajagopal ·

    Building Reliable Document Processing Pipelines with LLMs

    <p><a href="https://www.securekloud.com/generative-ai-services" rel="noopener noreferrer">Large Language Models (LLMs)</a> have made it easier to extract structured information from unstructured documents. A developer can send an invoice, bank statement, or application form to a …

  84. dev.to — LLM tag TIER_1 English(EN) · Malek AIT OUARET ·

    What I learned using a 7B local LLM as the front end of a programming language

    <p>Pseudocode is how we teach algorithms, yet it has never been executable. You can write "repeat divisor from 2 to 50"<br /> on a whiteboard, but not run it. I wanted to change that without inventing yet another syntax, so I built<br /> <strong>Pseudo.NET</strong>: you write pse…

  85. dev.to — LLM tag TIER_1 English(EN) · Vainamoinen | Pulsed Media ·

    One API key, three dialects: open-weight LLMs in your tools

    <p><em>9.99 € a month buys 9,990,000 credits on one API key: about 6 million input tokens on GLM-5.3, or about 37 million on the fast default model, from curl, your own code, Claude Code or Gemini CLI. Under the current rules the credits don't expire.</em></p> <p><em>I'm Väinämöi…

  86. dev.to — LLM tag TIER_1 English(EN) · Sven Welack ·

    LLMs on Consumer Hardware — Part 6: The Orchestration Ceiling — Why a Bigger Coordinator Doesn't Fix the Loop

    <p><em>Part 6 of a series. Previously: <a href="https://dev.to/USERNAME/PART-5-SLUG">Part 5 — Distributing the Workers and the Memory Budget</a>.</em></p> <p>Part 5 ended with the 77 GB coordinator finally running as it should — resident, no thrashing, the memory problem resolved…

  87. dev.to — LLM tag TIER_1 English(EN) · Kuldeep Paul ·

    Streaming LLM Responses End to End: SSE, Backpressure, and Mid-Generation Cancellation

    <p><a class="article-body-image-wrapper" href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fb7j842v6aryzuvtmobck.png"><img alt="Streaming LLM Re…

  88. dev.to — LLM tag TIER_1 English(EN) · Sven Welack ·

    LLMs on Consumer Hardware — Part 5: Distributing the Workers and the Memory Budget

    <p>Part 4 ended against a wall. A coordinator capable enough to be worth running — the 77 GB <code>gpt-oss:120b</code> — could not share a machine with the workers it had to call; every delegation forced roughly 100 GB of model-swapping, and a greeting took nearly five minutes. T…

  89. dev.to — LLM tag TIER_1 English(EN) · EME GUG ·

    Running MoE LLMs Larger Than Your RAM: A Practical Guide to mmap, Expert Offloading and SSD Streaming with llama.cpp

    <p>Tuần này trên Hacker News có một project khá thú vị tên Janas: chạy LLM lớn hơn RAM bằng cách stream các expert từ SSD. Đọc xong mình nhớ lại hồi đầu năm, khi cố nhét một model MoE hơn 100B params vào con laptop 32GB RAM. Lần đầu thì máy treo cứng, swap kín ổ. Lần sau thì chạy…

  90. dev.to — LLM tag TIER_1 English(EN) · Phil IPS ·

    Deploying LLMs Locally: Ollama, LM Studio, llama.cpp & vLLM Compared

    <p>Liquid syntax error: Unknown tag 'endraw'</p>

  91. dev.to — LLM tag TIER_1 English(EN) · Phil IPS ·

    Deploying LLMs Locally: Ollama, llama.cpp, and vLLM Comparison

    <h1> Deploying LLMs Locally: Ollama, llama.cpp, and vLLM Comparison </h1> <p>Run any model on your hardware — no API keys, no cloud, complete privacy.</p> <h2> Introduction </h2> <p>Local LLMs have matured. You can now run 7B-70B models on consumer hardware with near-cloud perfor…

  92. dev.to — LLM tag TIER_1 English(EN) · Phil IPS ·

    Fine-Tuning LLMs on Consumer Hardware: LoRA Guide 2024

    <h1> Fine-Tuning LLMs on Consumer Hardware: LoRA Guide 2024 </h1> <p>Train custom models on your GPU using LoRA/QLoRA — no cloud credits needed.</p> <h2> Introduction </h2> <p>Fine-tuning used to require A100s and thousands of dollars. With LoRA (Low-Rank Adaptation) and QLoRA (Q…

  93. dev.to — LLM tag TIER_1 English(EN) · AI Tech News ·

    On-Device LLM Inference: The Tradeoffs Nobody Puts on the Spec Sheet

    <h2> TL;DR </h2> <p>Running a language model on a device, a tablet, a handset, an edge box, is not just the cloud without the network. It is a different budget. Memory is fixed, precision is a lever, latency includes a cold start, and there is no autoscaler to hide your mistakes.…

  94. dev.to — LLM tag TIER_1 English(EN) · lucanu ·

    Self-Hosted LLM Prompt Library: Generate Production Code Fast: A Practical Guide

    <h1> Stop Wasting Hours on Prompt Engineering: Your Self-Hosted LLM Just Got Smarter </h1> <p>Running your own LLM locally is freedom. Running Llama-3 or Mistral on your infrastructure means no API costs, no rate limits, no vendor lock-in. But there's a hidden cost nobody talks a…

  95. dev.to — LLM tag TIER_1 English(EN) · Muthali Ganesh ·

    Claude Opus 5.5 LLM Testing: Benchmark Results, Security Findings, and Cost Analysis

    <p>Claude Opus 5.5 fixed all 18 critical defects in GoML's LatticeBench evaluation and resolved six of seven <code>very_hard</code> issues. The evaluation also revealed a surprising weakness: despite its performance on complex security defects, the model struggled with straightfo…

  96. dev.to — LLM tag TIER_1 English(EN) · LLM API Cost Calculator Token ·

    The cached-prefix crossover: when the cheaper LLM becomes the expensive one

    <p>Most LLM cost comparisons collapse a model to one number: <strong>$X per million<br /> input tokens</strong>. That number is the price of a cache <em>miss</em>. Once prompt caching<br /> is on, most of the tokens you send on every request are billed at the cached-read<br /> ra…

  97. dev.to — LLM tag TIER_1 English(EN) · aifree.dev ·

    9 free LLM APIs compared: rate limits, card rules and the catch (2026)

    <p>You can prototype on LLMs without paying anything - but "free tier" means very different things depending on the provider. Some give permanent rate-limited access, some give a monthly credit, and some only free a handful of models.</p> <p>Here are nine LLM APIs that need <stro…

  98. dev.to — LLM tag TIER_1 English(EN) · Nexus Labs ·

    Taming the LLM: From Generic to Gold for Go Performance Bottlenecks

    <p>Alright folks, let's talk about Large Language Models. Specifically, my recent adventure trying to coerce one into giving me genuinely <em>actionable</em> advice for a gnarly, old Go microservice. We've all seen the headlines, right? "AI optimizes your code!" "Let an LLM find …

  99. dev.to — LLM tag TIER_1 English(EN) · Abhash Chakraborty ·

    Fine-tuning a 0.8B model to beat hosted LLMs at one job

    <p>I needed a model for one narrow decision. When a new fact about someone comes in, does it replace something already known? "I moved to Berlin" should retire "I live in Pune". "Watched two episodes of The Bear" should leave "works at Infosys" alone.</p> <p>It sounds trivial, bu…

  100. r/OpenAI TIER_2 English(EN) · /u/lulzxdxdxd ·

    A reproducible cost-per-task method for LLM pricing: sticker price per token ranked models differently in my own two benchmarks too

    <table> <tr><td> <a href="https://www.reddit.com/r/OpenAI/comments/1x0q5u5/a_reproducible_costpertask_method_for_llm_pricing/"> <img alt="A reproducible cost-per-task method for LLM pricing: sticker price per token ranked models differently in my own two benchmarks too" src="http…