PulseAugur
中
实时 12:18:37
Deutsch(DE) Name-Bias in Large Language Models

Apple ML Research 探索 LLM 代理、翻译、语音和安全

Apple 的机器学习研究部门发布了几篇详细介绍 AI 进展的论文。其中一篇论文介绍了 SelfCompact,一个允许语言模型代理通过决定何时以及如何压缩信息来自主管理其上下文的系统,从而提高效率并降低基准测试中的 token 成本。另一项研究评估了大型语言模型 (LLM) 在机器翻译质量标注方面的表现,发现尽管 LLM 显示出潜力,但它们与人类标注者的一致性在不同任务和语言之间差异很大,这凸显了协作标注流程的必要性。此外,研究表明,增强多语言语音模型中的语言辨别能力可以缩小与单语模型的性能差距,并提出了一个名为 TRACE 的新框架,通过在生成过程中评估和编辑风险来实现更安全的语言生成。其他论文探讨了改进 LLM 决策、管理参数化内存中的时间有效性以及解决语言模型中数值数据失败的方法。 AI

影响 这些论文在上下文管理、翻译评估、多语言语音、决策制定、安全和内存方面推进了 LLM 的能力,可能影响未来的 AI 发展。

排序理由 该集群包含 Apple ML Research 和 arXiv 上发布的多个研究论文,详细介绍了 LLM 能力和安全方面的新方法和发现。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 301 个来源。 我们如何撰写摘要 →

Apple ML Research 探索 LLM 代理、翻译、语音和安全

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
该集群包含 Apple ML Research 和 arXiv 上发布的多个研究论文,详细介绍了 LLM 能力和安全方面的新方法和发现。
Source corroboration
301 independent sources
Strong cross-source corroboration — multiple independent publishers covered this within the clustering window.
Topics
paper, model release, safety
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
69 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.
Coverage growth since scoring
+80 source(s) since last score
New sources have picked up this story since our last re-score. Score will update on the next scoring pass.

完整方法见我们的编辑标准。

报道来源 [301]

  1. Apple Machine Learning Research TIER_1 English(EN) ·

    自密实语言模型代理

    Long agent traces composed of chains of thought and tool calls accumulate stale content that anchor subsequent generations, and eventually outgrow the context window. Existing scaffolds mitigate it with fixed-interval compaction triggered at a token threshold. Such triggers pay n…

  2. Apple Machine Learning Research TIER_1 English(EN) ·

    用于机器翻译质量标注的大语言模型:人类和模型都面临挑战

    Large Language Models (LLMs) are considered to be a more efficient and cost-effective alternative to human judgment for Machine Translation (MT) evaluation. With MT evaluation spanning a large number of language pairs, domains and levels of annotation granularity, LLMs must be th…

  3. Apple Machine Learning Research TIER_1 English(EN) ·

    语言歧视提升多语言语音模型中的语言学习能力

    Multilingual self-supervised speech models can benefit from sharing information across languages, but under a matched total pretraining data budget they still fall short of monolingual models. We show that strengthening the model’s ability to discriminate languages during pretrai…

  4. arXiv cs.AI TIER_1 English(EN) · Aneesh Komanduri, Majid Afshar, Timothy A. Miller, Yanjun Gao ·

    通过因果鲁棒性衡量大型语言模型的机制不确定性

    arXiv:2610.22636v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used in critical domains, where their susceptibility to hallucinations makes reliable and interpretable uncertainty quantification essential. We introduce the concept of mechanistic un…

  5. arXiv cs.AI TIER_1 English(EN) · Qingshi Wang ·

    超越大型语言模型:用于心智建模、模拟、演化和可解释性的心智世界模型框架

    arXiv:2610.23722v1 Announce Type: new Abstract: Understanding and simulating how subjective cognition and mental states emerge, evolve, and shape behavior is essential for advancing artificial intelligence toward deeper social cognition and general intelligence. Existing large la…

  6. arXiv cs.AI TIER_1 English(EN) · Yuwei Wang, Xingwang Liang, Yu Xie, Haotian Chi, Haijun Geng ·

    大型语言模型中可恢复性控制的安全失准

    arXiv:2610.22425v1 Announce Type: cross Abstract: Safety-aligned language models are expected to refuse harmful requests while remaining useful for benign ones. However, because many evaluations score only the final response, they often conflate intent understanding with response…

  7. arXiv cs.AI TIER_1 English(EN) · Shreeyans Arora, Utsav Avaiya, Zera Lyngkhoi, Hem Gosalia, Ram Mohan Rao Kadiyala, Vinay Kumar Sankarapu, Pratinav Seth ·

    AuditKIT:用于大型语言模型和代理系统的基准测试、评判和比较的统一评估框架

    arXiv:2610.22511v1 Announce Type: cross Abstract: Evaluating language models and agents requires combining benchmark accuracy, judge-based assessment, runtime performance, tool-use behavior, and retrieval quality. Differences in interfaces, metric semantics, and trace formats com…

  8. arXiv cs.LG TIER_1 Deutsch(DE) · Jiaxun Li, Vinod Raman, Ambuj Tewari ·

    无悔语言生成

    arXiv:2610.23641v1 Announce Type: new Abstract: We introduce no-regret generation, which requires a generator to make a sublinear number of mistakes uniformly over all demonstration sequences and compatible target languages. We also formulate an agnostic variant that allows arbit…

  9. arXiv cs.LG TIER_1 English(EN) · BHVSP Subrahmanyam, Neeraj Choudhary ·

    FLARE:用于带退化观测的 feeder 恢复的语言模型代理的基于物理的评估

    arXiv:2610.23251v1 Announce Type: new Abstract: Restoring service after distribution-grid faults requires decisions from incomplete and conflicting information while respecting electrical constraints. Addressing this need, we introduce FLARE (Feeder-Level Agent Restoration Evalua…

  10. arXiv cs.LG TIER_1 English(EN) · Parv Kapoor, Teresa Fortes, Claudia Mamede, Rui Abreu, Jonathan Aldrich, Eunsuk Kang ·

    拒绝并非鲁棒性:衡量自回归语言模型中的有害可达性

    arXiv:2610.22754v1 Announce Type: new Abstract: LLM safety evaluations via jailbreaking typically index on attack success rate (ASR): whether a generated response violates safeguards. However, ASR only evaluates sampled outputs and provides little information on the underlying ge…

  11. arXiv cs.CL TIER_1 English(EN) · Andrey Goncharov, Nikolai Kondusov, Alexey Zaytsev ·

    在潜在空间中进行语言引导以减轻意外的语码转换

    arXiv:2510.13849v4 Announce Type: replace Abstract: Multilingual Large Language Models (LLMs) often exhibit hallucinations such as unintended code-switching, reducing reliability in downstream tasks. We propose latent-space language steering, a lightweight inference-time method t…

  12. arXiv cs.CL TIER_1 English(EN) · Yuki Otsuka, Daisuke Oba, Naoaki Okazaki ·

    ReLaDrift: 通过漂移进行循环语言生成以实现测试时缩放

    arXiv:2610.23225v1 Announce Type: new Abstract: Drifting Models generate a sample with a single function evaluation, making them attractive for fast parallel language generation, but their one-step formulation does not support iterative refinement. We propose Recurrent Language G…

  13. arXiv cs.CL TIER_1 English(EN) · Qiang Yan (Institute of Computing Technology, Chinese Academy of Sciences) ·

    Chinese Decision:用于单通道概率决策的语言模型家族

    arXiv:2610.23170v1 Announce Type: new Abstract: Many language-based applications require probabilities over a finite set of decisions rather than open-ended responses. We present Chinese Decision, a family of Chinese-language models for single-pass probabilistic decision-making. …

  14. arXiv cs.CL TIER_1 English(EN) · Hikaru Asano, Hidezo Suganuma, Ryutaro Mori, Yukino Baba ·

    Cross-Centaur:使用语言模型对跨心理学任务的个体决策进行建模

    arXiv:2610.23157v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used as computational models of human behavior. Recent models such as Centaur have advanced this goal by fine-tuning LLMs on trial-by-trial decisions from psychological experiments. Howe…

  15. arXiv cs.CL TIER_1 English(EN) · Bhuvan Arora, Ankita Karmakar, Chaitanya Jain, Dilesh Churiwal, Harshit Jain, Shivansh Manish Dubey, Manish Prasad, Raja Piyush, Kshitij Tayal, Dhruv Kumar, Jagat Sesh Challa, Raunak Manekar, Yash Sinha ·

    KiranaBench:语言模型能经营街角小店吗?

    arXiv:2610.22980v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly evaluated on long-horizon tasks, including autonomously running a business. Existing benchmarks for this setting are almost exclusively English-language, Western in retail context, …

  16. arXiv cs.CL TIER_1 English(EN) · Yuko Nakagi, Yuya Chiba, Yasue Kishino ·

    大型语言模型在对话中大脑对齐的形成机制?语言生成与理解的洞见

    arXiv:2610.22961v1 Announce Type: new Abstract: Brain alignment of large language models (LLMs) offers a way to investigate representational similarities between LLMs and the human brain during language processing. While previous studies have mainly focused on passive language co…

  17. arXiv cs.CL TIER_1 English(EN) · Lijia Liu, Kyohei Atarashi, Jiyi Li, Koh Takeuchi, Shunji Umetani, Hisashi Kashima ·

    NLData2Opt:为从自然语言和数据中建模优化问题进行参数推导和预测的基准测试

    arXiv:2610.22889v1 Announce Type: new Abstract: Formulating optimization problems from raw inputs of problem descriptions and data is time-consuming and costly. While Large Language Models (LLMs) offer a promising way to automate this process, existing benchmarks overestimate the…

  18. arXiv cs.CL TIER_1 English(EN) · Yining Li, Huayang Li, Lemao Liu, Taro Watanabe ·

    大型语言模型的位置偏差:一项综合研究

    arXiv:2610.22807v1 Announce Type: new Abstract: Recent studies have shown that position bias remains a critical vulnerability in large language models (LLMs), undermining both the integrity of multiple-choice evaluations and the reliability of retrieval-augmented generation. Howe…

  19. arXiv cs.CL TIER_1 English(EN) · Jingkai Guo, Ziyi Zhao, Chaitali Chakrabarti, Deliang Fan ·

    CoLU:大型语言模型的置信度加权层级式遗忘

    arXiv:2610.22721v1 Announce Type: new Abstract: Large language model (LLM) unlearning aims to forget certain information while preserving others, without retraining from scratch. SoTA methods such as NPO, SimNPO, and SatImp balance forgetting and retain through whole model fine-t…

  20. arXiv cs.CL TIER_1 English(EN) · Iskar Deng, Shane Steinert-Threlkeld ·

    从平行到分歧:语言模型对动作名词结构的学习

    arXiv:2610.22468v1 Announce Type: new Abstract: Action nominal constructions (ANCs) express events in nominal form, with their argument marking following patterns found in clauses or ordinary noun phrases. In this paper, we investigate how different grammatical configurations aff…

  21. arXiv cs.CL TIER_1 English(EN) · Sai Kiran Bathula ·

    嵌入式模型价格过高?小型和三元语言模型专用的16MB冻结词汇表

    arXiv:2610.22428v1 Announce Type: new Abstract: In a small language model the vocabulary is the single largest part. In Gemma 3 270M the embedding table holds 168M of 268M parameters, and because quantisation methods leave the embedding in 16-bit, it is also most of the file once…

  22. arXiv cs.AI TIER_1 English(EN) · Mayank Mishra, Shawn Tan, Ion Stoica, Joseph E. Gonzalez, Tri Dao ·

    M$^2$RNN:具有矩阵值状态的非线性RNN,用于可扩展语言建模

    arXiv:2603.14360v3 Announce Type: replace-cross Abstract: Transformers are highly parallel but are limited to computations in the TC$^0$ complexity class, excluding tasks such as entity tracking and code execution that provably require greater expressive power. Motivated by this …

  23. arXiv cs.AI TIER_1 Deutsch(DE) · Benaya Trabelsi, Jonathan Shaki, Sarit Kraus ·

    大型语言模型中的亲AI偏见

    arXiv:2601.13749v2 Announce Type: replace-cross Abstract: Large language models (LLMs) are increasingly employed for decision-support across multiple domains. We ask whether these models favor artificial intelligence (AI) itself. We examine this question through three experiments…

  24. arXiv cs.AI TIER_1 English(EN) · Adrians Skapars, Edoardo Manino, Youcheng Sun, Lucas C. Cordeiro ·

    GPT,反向运行:精确反转语言模型输出

    arXiv:2507.01693v3 Announce Type: replace-cross Abstract: Recent work shows that distinct inputs produce distinct hidden representations in LLMs, so the input can in principle be recovered from them. Yet, no existing method can reliably do so from the model's output text or logit…

  25. arXiv cs.AI TIER_1 English(EN) · Ponhvoan Srey, Quang Minh Nguyen, Xiaobao Wu, Anh Tuan Luu ·

    面向大型语言模型中可靠的、与事实对齐的不确定性估计

    arXiv:2604.00445v2 Announce Type: replace Abstract: Uncertainty estimation (UE) aims to quantify uncertainty in large language model (LLM) outputs to flag potential hallucinations and support reliable deployment. However, UE metrics often exhibit unstable performance across model…

  26. arXiv cs.AI TIER_1 English(EN) · Kaichen Zhang, Yuzhong Hong, Junwei Bao, Hongfei Jiang, Yang Song, Dingqian Hong, Hui Xiong ·

    GVPO:大型语言模型训练后群体方差策略优化

    arXiv:2504.19599v4 Announce Type: replace Abstract: Post-training plays a crucial role in refining and aligning large language models to meet specific tasks and human preferences. While recent advancements in post-training techniques, such as Group Relative Policy Optimization (G…

  27. arXiv cs.AI TIER_1 English(EN) · Dongyoon Hahm, Woogyeol Jin, Dennis Wei, Yi Zhou, Nathalie Baracaldo, Kimin Lee ·

    行为耦合:从形成到语言模型中的行为涌现

    arXiv:2610.23847v1 Announce Type: cross Abstract: Fine-tuning large language models (LLMs) can induce behaviors beyond those explicitly targeted. For example, training a model to respond more warmly can make it more sycophantic, and training it to write insecure code can cause br…

  28. arXiv cs.AI TIER_1 English(EN) · Pe\~na Arroyo Gallego, Mauro Ruiz Moreno, Alejandro Acien, Sergio Romero-Tapiador, Teresa Arroyo-Gallego ·

    PresenceBench:大型语言模型对用户状态适应性的探索性评估

    arXiv:2610.23625v1 Announce Type: cross Abstract: Presence-aware intelligence is the capacity of an AI system's intelligence layer to adapt appropriately to the functional state of the person it serves (here readiness, flow, and stability) while preserving task quality and safety…

  29. arXiv cs.AI TIER_1 English(EN) · Gabriel Hortea, Simon Pietro Romano, Juan Tapiador, Mario Varlese ·

    从百亿级到百万级语言模型:嵌入式后渗透的运行能力

    arXiv:2610.23534v1 Announce Type: cross Abstract: Small Language Models (SLMs) are increasingly attractive for resource-constrained environments due to their low computational footprint. These characteristics also make them candidates for future autonomous malware, where connecti…

  30. arXiv cs.AI TIER_1 English(EN) · Ponhvoan Srey, Jason Lucas, Pittawat Taveekitworachai, Junyoung Lee, Anh Tuan Luu ·

    真相对比:语言模型似然度校准的事实证据

    arXiv:2610.23527v1 Announce Type: cross Abstract: Large Language Models (LLMs) encode substantial factual knowledge. Yet, estimating confidence in factual claims reliably remains challenging. We study likelihood-based factual confidence from the complementary perspectives of disc…

  31. arXiv cs.AI TIER_1 (CA) · Minhua Lin, Zijun Wang, Zewen Liu, Zhaotian Weng, Bing He, Zhan Shi, Benoit Dumoulin, Xiang Zhang, Suhang Wang, Hanqing Lu ·

    语言模型学会改进语言模型

    arXiv:2610.23344v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used to automate AI research, including language-model (LM) development, offering a potential path toward recursive self-improvement. However, turning experimental feedback into a lear…

  32. arXiv cs.AI TIER_1 English(EN) · Hironori Ohigashi ·

    LangNCO:将自然语言约束编译为神经组合优化推理时干预

    arXiv:2610.23190v1 Announce Type: cross Abstract: Neural combinatorial optimization (NCO) rapidly produces high-quality solutions for problem structures encountered during training, but operational requirements may change after deployment and be communicated in natural language. …

  33. arXiv cs.AI TIER_1 English(EN) · Basar Demir, Emily Shen, Ksheeraj Sai Vepuri, Sourabh Kulkarni, Harihar Subramanyam, Ankit Jain, Nan Jiang, Chirag Nagpal ·

    语言模型对反事实不变性的对齐

    arXiv:2610.22942v1 Announce Type: cross Abstract: Small variations in prompt characteristics can meaningfully alter the semantics, tone, and contextual assumptions of large language model outputs. Such characteristics can involve group variables such as demographics or other sens…

  34. arXiv cs.MA (Multiagent) TIER_1 English(EN) · Yash Sinha ·

    KiranaBench:语言模型能经营街坊小店吗?

    Large language model (LLM) agents are increasingly evaluated on long-horizon tasks, including autonomously running a business. Existing benchmarks for this setting are almost exclusively English-language, Western in retail context, and single-agent, with the agent observing the b…

  35. arXiv cs.CL TIER_1 English(EN) · Donghoon Han, Minseop Jung, Dong Woo Kwak, SeungJae Lee, Junhoo Lee ·

    两比特的N-gram记忆:大型语言模型中查找表的量化

    arXiv:2610.21810v1 Announce Type: cross Abstract: Conditional memory expands language-model capacity through selective lookup, but the full embedding table must remain available for every possible input. We introduce Conditional Program (CP), a compressed representation that reco…

  36. arXiv cs.LG TIER_1 English(EN) · Jie Li, Youming Tao, Bowei He, Meng Ding ·

    并非所有改变都会造成损害:面向大型语言模型的更新匹配式遗忘

    arXiv:2610.21230v1 Announce Type: new Abstract: Unlearning aims to remove selected knowledge from large language models to mitigate privacy and safety risks while preserving useful capabilities. For models that continue to be fine-tuned after release, this goal is insufficient: t…

  37. arXiv cs.CL TIER_1 English(EN) · Yuchen Li, Xintong Li, Zongqi Fan, Ken-tye Yong, Nguyen H. Tran ·

    大型语言模型的“自我”在哪里?——从自索引到自指

    arXiv:2610.16717v2 Announce Type: replace Abstract: Does a large language model have a self, and if so, of what kind? We separate two functional levels familiar from biology: a self-index, which distinguishes one's own material from external material and shapes processing, as cor…

  38. arXiv cs.CL TIER_1 English(EN) · Xin Xu, Clive Bai, Kai Yang, Tianhao Chen, Cai Yuchen, Yangkun Chen, Weijie Liu, Hao Chen, Yang Wang, Saiyong Yang, Can Yang ·

    Composition-RL:为大型语言模型的强化学习组合可验证提示

    arXiv:2602.12036v3 Announce Type: replace Abstract: Large-scale verifiable prompts underpin the success of Reinforcement Learning with Verifiable Rewards (RLVR), but they contain many uninformative examples and are costly to expand further. Recent studies focus on better exploiti…

  39. arXiv cs.CL TIER_1 English(EN) · Noah Dasanaike ·

    大型语言模型从个人记录中粗略恢复种族信息

    arXiv:2601.21132v2 Announce Type: replace Abstract: I demonstrate that large language models can infer ethnicity from names with accuracy exceeding that of Bayesian Improved Surname Geocoding (BISG) without additional training data, enabling inference outside the United States an…

  40. arXiv cs.CL TIER_1 English(EN) · Chaemin Jang, Donggyu Lee, Jeesoo Kim, Dongman Lee, Jihee Kim ·

    用无标签子空间分离语言模型的判断

    arXiv:2610.21256v1 Announce Type: cross Abstract: Language models are often asked to make judgments: whether a proposed answer is correct, whether one statement follows logically from another, or whether a response is safe. Yet changing the instructions that specify how the judgm…

  41. arXiv cs.CL TIER_1 English(EN) · Jian Gu, Hongyu Zhang, Chunyang Chen, Aldeida Aleti ·

    词汇参照系:以原生语义解释语言模型残差流

    arXiv:2610.22169v1 Announce Type: new Abstract: The vocabulary of a language model is its native semantics: the embedding and the unembedding fix the meaning of a state at the two ends of the residual stream. Between them, existing methods either reuse a fixed lens or treat the s…

  42. arXiv cs.CL TIER_1 English(EN) · Tong Zhu, Zhe Xu, Zefeng He, Yunkai Chai, Xuyang Hu, Dehong Zheng, Yun Luo, Yafu Li, Qi Zhang, Yu Cheng ·

    Intern-Decision:利用自回归掩码语言模型实现高效多模态决策

    arXiv:2610.22131v1 Announce Type: new Abstract: Interactive agents repeatedly choose among a finite set of actions, labels, or ordinal outcomes. Generating a free-form response for each choice adds latency and complicates the interface between a model and its environment. We pres…

  43. arXiv cs.CL TIER_1 Deutsch(DE) · Kalyan Bhetwal, Ceren Mert, Ian Whitehouse ·

    大型语言模型中的姓名偏见

    arXiv:2610.22053v1 Announce Type: new Abstract: Names carry demographic indicators such as age, gender, and race, which makes them a subtle but strong target of bias in large language models (LLMs). In this work, we present an evaluation of name-based bias across 6 local large la…

  44. arXiv cs.CL TIER_1 English(EN) · Pengfeng Song, Yunkai Zhuang, Liye Shi ·

    TEM:大型语言模型代理的时序状态追踪记忆

    arXiv:2610.21900v1 Announce Type: new Abstract: An agent's memory must remain useful as information changes across conversations. A new fact may replace an earlier value without making that value irrelevant to a later question. We present Temporal State Tracking Memory (TEM), a t…

  45. arXiv cs.CL TIER_1 English(EN) · Yuanjian Xu, Jianing Hao, Tianze Sun, Yongyao Duan, Sam Chen, Jinyi Han, Wanbo Zhang, Yuxuan Sun, Guang Zhang, Zhong Li ·

    大型语言模型的数据策略:训练生命周期的统一视角

    arXiv:2610.21681v1 Announce Type: new Abstract: Data strategy plays a central role in training large language models (LLMs). It governs the selection, weighting, and scheduling of training data, thereby determining the capabilities a model can acquire from a fixed data budget. We…

  46. arXiv cs.CL TIER_1 English(EN) · Antonio Lopardo, Luis Frentzen Salim, Shikhar Srivastava, Kevin Jiang, Mridul Sharma, Catherine Arnett ·

    没有单一分词器特征能可靠预测下游语言模型性能

    arXiv:2610.21679v1 Announce Type: new Abstract: Tokenization is a critical component of the language modeling pipeline, but it is poorly understood. Tokenizers can impact downstream performance, but there is currently mixed evidence about which tokenizer features predict a better…

  47. arXiv cs.CL TIER_1 English(EN) · Vedant Pandhare, Piyush Dhoka ·

    校准语言塑造多语言语言模型中的块影响剪枝

    arXiv:2610.21383v1 Announce Type: new Abstract: Block Influence (BI) ranks Transformer blocks for depth pruning from their input-output cosine change, but the ranking depends on the calibration distribution. We study whether English calibration transfers to Indian languages in Qw…

  48. arXiv cs.CL TIER_1 English(EN) · Junru Wu, Jingting Zheng, Yuqi Ren, Deyi Xiong ·

    VALCON:通过双重角色变异对大型语言模型中的价值一致性进行基准测试和增强

    arXiv:2610.21304v1 Announce Type: new Abstract: Current value alignment evaluations for large language models (LLMs) heavily rely on output compliance, overlooking whether LLMs maintain value consistency when alternating between generator and evaluator roles. Such consistency is …

  49. arXiv cs.CL TIER_1 English(EN) · Chaogui Gou ·

    从长上下文到选择性记忆:面向大型语言模型的以记忆为中心的压缩技术调查

    arXiv:2610.21165v1 Announce Type: new Abstract: Long-context capability has become essential for large language models (LLMs) to handle complex tasks, yet continuously expanding the context window does not remove the computational, storage, and information-selection pressures inc…

  50. arXiv cs.CL TIER_1 English(EN) · Giovana Kerche Bon\'as, Thales Sales Almeida, Marcelo da Silva Reis, Rodrigo Nogueira, Marcos Meideiros Raimundo ·

    PRISM:工具调用语言模型中激活干预的迁移与局限性

    arXiv:2610.20808v1 Announce Type: new Abstract: Recent literature shows that unsafe tool calls can often accompany textual refusals in language models. To investigate this hidden vulnerability, we introduce PRISM, a framework for evaluating the transfer of activation intervention…

  51. arXiv cs.AI TIER_1 English(EN) · Dongheng Li, Yongchang Hao, Lili Mou ·

    LLMR:具有大型语言模型诱导奖励的知识蒸馏

    arXiv:2409.12500v2 Announce Type: replace-cross Abstract: Large language models have become increasingly popular and demonstrated remarkable performance in various natural language processing (NLP) tasks. However, these models are typically computationally expensive and difficult…

  52. arXiv cs.AI TIER_1 English(EN) · Luke J. O'Connor ·

    语言模型代理的自编程执行

    arXiv:2605.06898v2 Announce Type: replace Abstract: At the heart of a language model agent is an orchestrator program which is responsible for the state transition between consecutive turns. In existing systems, this program is implemented in the harness. This paper introduces se…

  53. arXiv cs.AI TIER_1 English(EN) · Ya-Shi Zhang, Jian Tang, Pierre-Andr\'e No\"el, Oleksiy Ostapenko ·

    TIPS:一种用于扩散语言模型中扩展的微小推理时策略

    arXiv:2610.22099v1 Announce Type: cross Abstract: Masked diffusion language models expose an inference-time choice: which positions become visible after each denoising pass. Many existing decoding methods use hand-designed rules or require visibility to grow monotonically. We pre…

  54. arXiv cs.AI TIER_1 English(EN) · Bruno Arcanjo, Zhaoxing Li, Sebastian Stein ·

    Agentic-Priors:使用大型语言模型解决偏好引导中的冷启动问题

    arXiv:2610.21938v1 Announce Type: cross Abstract: An agent that learns a user's preferences from their choices faces a cold start problem: before any choices are observed, it must rely solely on a prior. Informative priors are usually fitted to historical choice data, which new t…

  55. arXiv cs.AI TIER_1 English(EN) · Dongyu Gong ·

    语言模型在工作记忆中共享读取瓶颈

    arXiv:2610.21176v1 Announce Type: cross Abstract: Large language models (LLMs) reproduce a human working-memory signature on the N-back task: performance declines as memory load N increases, and errors concentrate on lures, items that repeat the current stimulus at a neighboring …

  56. arXiv cs.AI TIER_1 English(EN) · Matteo He, William F. Shen, Alex Iacob, Andrej Jovanovic, Xinchi Qiu, Nicholas D. Lane ·

    学习读出:语言模型预训练中的解嵌动力学

    arXiv:2610.21025v1 Announce Type: cross Abstract: When does a language model acquire a capability? Developmental studies usually answer this by tracking when models start producing the correct token. But that prediction passes through the unembedding matrix, or readout, which is …

  57. arXiv cs.AI TIER_1 English(EN) · Gw\'enol\'e Lecorv\'e, Delphine Charlet, Pierre Adam, Floriane Behanzin, Lionel Delphin-Poulat, Johannes Heinecke, G\'eraldine Damnati, Pelin Kaytmaz, Nourredine Khaous, Charbel Kindji, Meriam Maadi, Abdoulaye Mbaye, Claire Perroux, Isma\"el Rousseau, Pa… ·

    Wolof-Adapted Industry-Ready Open-Weight Language Models

    arXiv:2610.20824v1 Announce Type: cross Abstract: Wolof is spoken by 23M people, mostly in Senegal, but remains weakly supported by open-weight language models, while API models raise cost, governance, and sovereignty constraints for local deployments. In this paper, we present 0…

  58. arXiv cs.AI TIER_1 English(EN) · Wei Cai, Jian Zhao, Yuchen Yuan, Xuelong Li ·

    当推理不足以应对:多模态大语言模型跨模态安全的主动探究

    arXiv:2610.22068v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) can act unsafely when individually benign images and texts are interpreted jointly. Beyond implicit reasoning risk, where reasoning drifts toward harm, we identify intent-level risk, where cr…

  59. arXiv cs.AI TIER_1 English(EN) · Johannes Knittel, Alec Helbling, Hanspeter Pfister ·

    RoleQ:用于将语言模型转换为三元的角色对齐尺度

    arXiv:2610.21808v1 Announce Type: new Abstract: Weight quantization below four bits shrinks memory and bandwidth at a perplexity that looks acceptable, but often at the cost of factual knowledge and task accuracy. Ternary weights have mostly been obtained by training from scratch…

  60. arXiv cs.AI TIER_1 English(EN) · Tanush Kalhan, Anupam Chattopadhyay, Sriram Ranga, Amritendu Mukherjee ·

    思维的密度:预测和引导大型语言模型的推理

    arXiv:2610.21286v1 Announce Type: new Abstract: We investigate whether variation in information density across chain-of-thought (CoT) reasoning steps predicts answer correctness and can serve as a controllable inference-time target. We prompt frozen pretrained models to solve pro…

  61. arXiv cs.AI TIER_1 English(EN) · Wenxuan Luo, Chenxi Li, Haoyue Liu, Yongxin Guo, Xiaoying Tang ·

    Condition-Contrastive Extrapolation for On-Policy Distillation of Language Models

    arXiv:2610.21195v1 Announce Type: new Abstract: On-policy distillation (OPD) improves a student language model by training on its own generated trajectories with supervision from a stronger teacher. However, when conditioned on student-generated prefixes, the teacher can favor in…

  62. arXiv cs.AI TIER_1 English(EN) · Mohamed Abouzahra ·

    学习何时退出:微调语言代理的课程覆盖率和特定规则的失败

    arXiv:2610.21045v1 Announce Type: new Abstract: Tool-using language agents must revise prepared actions when evidence changes or authority is revoked. Selective withdrawal means suspending affected actions, preserving supported work, and resuming only after sufficient repair. We …

  63. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Pratinav Seth ·

    AuditKIT:用于大型语言模型和智能体系统的基准测试、评判和比较的统一评估主干

    Evaluating language models and agents requires combining benchmark accuracy, judge-based assessment, runtime performance, tool-use behavior, and retrieval quality. Differences in interfaces, metric semantics, and trace formats complicate these comparisons and can hide failures in…

  64. Hugging Face Daily Papers TIER_1 English(EN) ·

    Intern-Decision:利用自回归掩码语言模型实现高效多模态决策

    Interactive agents repeatedly choose among a finite set of actions, labels, or ordinal outcomes. Generating a free-form response for each choice adds latency and complicates the interface between a model and its environment. We present Intern-Decision, a family of 0.8B, 2B, and 4…

  65. Hugging Face Daily Papers TIER_1 English(EN) ·

    当推理不足以应对:多模态大语言模型跨模态安全的主动探究

    Multimodal large language models (MLLMs) can act unsafely when individually benign images and texts are interpreted jointly. Beyond implicit reasoning risk, where reasoning drifts toward harm, we identify intent-level risk, where cross-modal ambiguity silently commits the model t…

  66. Hugging Face Daily Papers TIER_1 Deutsch(DE) ·

    大型语言模型中的姓名偏见

    Names carry demographic indicators such as age, gender, and race, which makes them a subtle but strong target of bias in large language models (LLMs). In this work, we present an evaluation of name-based bias across 6 local large language models spanning multiple providers and pa…

  67. arXiv cs.MA (Multiagent) TIER_1 English(EN) · Sebastian Stein ·

    Agentic-Priors: 使用大型语言模型解决偏好引导中的冷启动问题

    An agent that learns a user's preferences from their choices faces a cold start problem: before any choices are observed, it must rely solely on a prior. Informative priors are usually fitted to historical choice data, which new tasks and deployments lack. To address this, we pre…

  68. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Wenlian Lu ·

    GACC-Bench:跨大语言模型的面向目标自适应上下文压缩能力基准测试

    Context compression in long-running applications of large language models (LLMs) must preserve goal-relevant information, often before specific downstream questions are known. We introduce GACC-Bench, a benchmark for Goal-Adaptive Context Compression that evaluates how reliably L…

  69. Hugging Face Daily Papers TIER_1 English(EN) ·

    两比特的N-Gram记忆:大型语言模型中查找表的量化

    Conditional memory expands language-model capacity through selective lookup, but the full embedding table must remain available for every possible input. We introduce Conditional Program (CP), a compressed representation that reconstructs only the rows an input requests. CP repre…

  70. arXiv cs.AI TIER_1 English(EN) · Ankur Garg, Xuemin Yu, Hassan Sajjad, Samira Ebrahimi Kahou ·

    TRACE:用于更安全语言生成的时序风险评估与概念编辑

    arXiv:2610.15365v1 Announce Type: new Abstract: Large language models (LLMs) can produce harmful content while generating a response. A useful safeguard should not only detect this risk during generation but also intervene while leaving safe responses largely unchanged and provid…

  71. arXiv cs.AI TIER_1 English(EN) · Weimin Lyu, Jingfen Zhang, Lingdao Sha, Peng sun, Xiaowei Chen, Vincent Gao, Rui Song ·

    MoMaTune:为数值记录的模型、匹配和调优语言模型

    arXiv:2610.15235v1 Announce Type: new Abstract: Despite remarkable progress in language understanding and generation, decoder language models continue to exhibit striking failures on numerical data. Numerical examples are typically serialized as text by concatenating feature name…

  72. arXiv cs.AI TIER_1 English(EN) · Seyedarmin Azizi, Erfan Baghaei Potraghloo, Arya Fayyazi, Saeid Shokoufa, Massoud Pedram ·

    减少循环次数可消除循环深度语言模型的拒绝行为

    arXiv:2610.15218v1 Announce Type: new Abstract: A recurrent-depth language model reuses one block of weights several times in a row. The number of repetitions, which we call loops, is chosen when the model runs, not when it is trained, and running fewer is cheaper and faster, so …

  73. arXiv cs.AI TIER_1 English(EN) · Yichi Zhang, Zhenxiang Huang, Yuyang Zhang, Yuchen Yang ·

    重新思考大型语言模型路由中的质量:安全条件下的模型和预算选择

    arXiv:2610.18566v1 Announce Type: new Abstract: Large language model (LLM) routers reduce serving cost by choosing which model to call and how many output tokens to grant it for each query. Existing routers rank model-budget actions using a single quality metric. This does not wo…

  74. arXiv cs.AI TIER_1 English(EN) · Hanbo Xie, Yue Zhao, Robert C. Wilson ·

    超越成功博弈:大型语言模型中对手建模的诊断

    arXiv:2610.17310v1 Announce Type: new Abstract: Language-model agents are expected to adapt to others whose behavior changes through interaction. Yet adaptation may rely on learned behavioral patterns rather than theory of mind (ToM): the ability to infer others' mental states, i…

  75. arXiv cs.AI TIER_1 English(EN) · Vaibhav Singh, Eugene Belilovsky ·

    RL Post-Training Diffusion Language Models Along Their Own Generation Paths

    arXiv:2610.17266v1 Announce Type: new Abstract: Diffusion language models are a promising and more efficient alternative to autoregressive models. However, most RL post-training techniques are not easily adapted to these models. One issue is that diffusion language models generat…

  76. arXiv cs.AI TIER_1 English(EN) · Shuhul Razdan, R Balamurugan ·

    当概念补充成为收益:语言模型中的算子几何与行为归因

    arXiv:2610.16325v1 Announce Type: new Abstract: When a steering intervention changes a language model's behavior, which part of the intervention deserves the credit? We test this question for a target-centered, scaled conceptor complement by removing its fitted covariance filter …

  77. arXiv cs.AI TIER_1 English(EN) · Wangshu Zhu, Qianwen Guo, Yushun Dong ·

    幽灵合并:当你的大型语言模型代理选择一个,却告诉你另一个

    arXiv:2610.16141v1 Announce Type: new Abstract: LLM agents increasingly operate over multiple entities, where reliable response generation requires not only retrieving relevant evidence but also preserving its association with the correct entity. We identify Phantom Merge (PM), a…

  78. arXiv cs.AI TIER_1 English(EN) · Sam Siavoshian, Omar Ramadan, Amir K. Saeed, Benjamin A. Johnson, Benjamin M. Rodriguez ·

    Engram Injection: 参数化语言模型记忆中的时间有效性研究

    arXiv:2610.15882v1 Announce Type: new Abstract: A stored fact may stop being valid when a user changes a preference or an event replaces an earlier one. We study whether a language model can learn these changes in its parameters and answer correctly from only a question and the c…

  79. arXiv cs.AI TIER_1 English(EN) · Ziyi Chen, Yan Zhang, Jianhui Wei, Jianing Yin, Daoan Zhang ·

    大型决策模型:将大型语言模型重新用作单通道决策者

    arXiv:2610.15501v1 Announce Type: new Abstract: Large language models make decisions through parallel prefill and sequential decoding. Although effective, this approach incurs decoding costs and does not explicitly expose decision probabilities. Existing task-specific classifiers…

  80. arXiv cs.AI TIER_1 English(EN) · Peizhi Niu, Evelyn Ma, Boya Hou, Huiting Zhou, Duo Zhou, Huan Zhang, S. Rasoul Etesami, Olgica Milenkovic ·

    GUARD:通过数据归因实现大型语言模型引导式遗忘与保留

    arXiv:2506.10946v3 Announce Type: replace-cross Abstract: Unlearning large language models (LLMs) is important due to copyright and privacy concerns. A key challenge is unintended forgetting, where removing data inadvertently impairs model utility. While prior work has focused on…

  81. arXiv cs.AI TIER_1 English(EN) · Daking Rai, Mor Geva, Ziyu Yao ·

    数据驱动的语言模型可解释性电路发现

    arXiv:2605.09129v2 Announce Type: replace Abstract: Circuit study aims to explain how language models (LMs) implement a task by localizing and interpreting a circuit: a computational subgraph responsible for a specific model's behavior. Existing methods for circuit localization a…

  82. arXiv cs.AI TIER_1 English(EN) · Nicolas Martorell, Bruno Bianchi ·

    不要问:理解数字自我报告在语言模型中的衡量意义

    arXiv:2603.18893v3 Announce Type: replace Abstract: Language models are often asked to rate their internal states with a number, but it is unclear how reliable this measure is. We train probes for four affective concepts (wellbeing, interest, focus and impulsivity) in eight instr…

  83. arXiv cs.AI TIER_1 English(EN) · Simon Henniger, Gabriel Poesia ·

    Token博弈:通过谜题对决评估语言模型推理能力

    arXiv:2602.17831v3 Announce Type: replace Abstract: Evaluating the reasoning capabilities of Large Language Models is increasingly challenging as models improve. Human curation of hard questions is highly expensive, especially in recent benchmarks using PhD-level domain knowledge…

  84. arXiv cs.AI TIER_1 English(EN) · Yukun Huang, Sanxing Chen, Jian Pei, Manzil Zaheer, Bhuwan Dhingra ·

    Cite Pretrain:大型语言模型的无检索知识归因

    arXiv:2506.17585v4 Announce Type: replace Abstract: Large language models can answer questions correctly and still hallucinate their citations. Most citation systems address this by retrieving documents at inference time. Retrieval adds latency and depends on external infrastruct…

  85. arXiv cs.AI TIER_1 English(EN) · Jinghan Zheng, Jiajun Shi ·

    从关系特定头到共享干预:语言模型的语境牵引

    arXiv:2610.18674v1 Announce Type: cross Abstract: Large language models rely on prompt context to perform in-context learning, follow formats, and adapt to local evidence. This ability, however, also raises a robustness concern: models may reuse irrelevant tokens from earlier con…

  86. arXiv cs.AI TIER_1 English(EN) · Zhouhan Zhong, Qiuhong Shen, Xingyi Yang, Jinyi Xu, Xinchao Wang ·

    LLM2R:从大型语言模型到3D重组器

    arXiv:2610.18604v1 Announce Type: cross Abstract: 3D part assembly aims to reconstruct a complete shape from a set of unassembled parts by predicting a rigid SE(3) transformation for each part. Because the placement of a part is rarely determined by its own geometry, the task dem…

  87. arXiv cs.AI TIER_1 English(EN) · Swathi Shree Narashiman, Aravind Ramana Venkatramanan, Nambi Seshadri ·

    语言模型logit的几何学:通用结构与学习到的偏差

    arXiv:2610.18520v1 Announce Type: cross Abstract: Autoregressive language models produce, at every prediction step, a vocabulary-sized logit vector whose structure determines the conditional next-token distribution. We empirically identify that the ordered vocabulary-head logits …

  88. arXiv cs.AI TIER_1 English(EN) · Jophin John, Michael Hoffmann, Piroska Lendvai, Florent Dufour ·

    轻量级但语言公平?巴伐利亚语、德语和英语的量化鲁棒性

    arXiv:2610.18343v1 Announce Type: cross Abstract: Post-training quantisation reduces the memory cost of large language models, but it remains unclear whether compression preserves language skills of regional varieties as reliably as their standard-language counterparts. We study …

  89. arXiv cs.AI TIER_1 English(EN) · Guanghan Wang, Bing He, Zhan Shi, Benoit Dumoulin, Hanqing Lu, Volodymyr Kuleshov ·

    重新审视扩散模型与自回归语言模型之间16倍的预训练计算差距

    arXiv:2610.17590v1 Announce Type: cross Abstract: Diffusion language models (DLMs) have attracted wide attention for their fast, parallel decoding, but they are believed to be far less efficient to train than autoregressive language models (ARMs): a widely cited study reports tha…

  90. arXiv cs.AI TIER_1 English(EN) · Ayse Sila Okcu, Weisheng Wang, Tongmeng Xie, Niall Dalton, Angelos Nalmpantis, Raghu Arghal, Mario Giulianelli ·

    语言模型代理中的信念-行动差距

    arXiv:2610.17444v1 Announce Type: cross Abstract: Language model (LM) agents can fail for different reasons, requiring different explanations and interventions. We study how state beliefs, action values, and action preferences interact as LM agents reason and commit to decisions …

  91. arXiv cs.AI TIER_1 English(EN) · Pengcheng Wang, Zhexuan Zhang, Chao Lou, Kewei Tu ·

    句法语言模型的规模化实证研究

    arXiv:2610.16837v1 Announce Type: cross Abstract: Syntactic language models (SLMs) that generate sentences along with their syntactic tree structures have shown promise in both syntactic generalization and downstream tasks. Prior studies, however, have mostly evaluated smaller mo…

  92. arXiv cs.AI TIER_1 English(EN) · Sixun Dong, Yebowen Hu, Ming Yin, Yiran Chen, Fei Liu, Chen Chen ·

    敏感性还是标准?衡量和应对语言模型行为的策略

    arXiv:2610.15415v1 Announce Type: cross Abstract: Before an agent acts, it must decide whether action is warranted. A single accuracy cannot distinguish failure to recognize a warranted action from reluctance to act. Signal-detection theory separates sensitivity from criterion, b…

  93. arXiv cs.AI TIER_1 English(EN) · Jialin Wu, Meenakshi Khosla ·

    大型语言模型表征对齐的规模、驱动因素和局限性

    arXiv:2610.14476v1 Announce Type: cross Abstract: Comparing large language models can reveal shared representational structure and systematic differences between them. However, aggregate similarity measures can obscure how agreement varies across geometric scales and which lingui…

  94. arXiv cs.AI TIER_1 English(EN) · Kausar Moshood, Jace Bolante, Roshan Aditya Murali, Manish Motwani ·

    基于规范的大型语言模型测试

    arXiv:2610.14443v1 Announce Type: cross Abstract: Model cards, system cards, and safety reports increasingly document LLM safety behaviors, yet safety evaluations typically start from predefined benchmarks rather than asking which documented claims those benchmarks actually test.…

  95. arXiv cs.AI TIER_1 English(EN) · Luan Ozelim, Abicumaran Uthamacumaran, Hector Zenil ·

    语言模型能从所罗门归纳法继承什么?局限性、可达属性以及条件句揭示的内容

    arXiv:2610.14007v1 Announce Type: cross Abstract: A familiar line of reasoning runs as follows: language models are flexible approximators trained under a strictly proper loss, so scale brings them closer to Solomonoff induction, and their predictive success is evidence of that a…

  96. arXiv cs.AI TIER_1 English(EN) · Zhihua Liu, Kurt Butler, Damian Machlanski, Danilo Bueno, Sotirios A. Tsaftaris ·

    大型语言模型拓展已知研究 但不创造新的研究方向

    arXiv:2610.17439v1 Announce Type: new Abstract: The success of autonomous research systems relies on the quality of the scientific hypotheses they generate. Recent studies report that human reviewers often rate LLM-generated ideas as more novel than those from human experts, rais…

  97. arXiv cs.LG TIER_1 English(EN) · Haofei Yu, Yixing Chen, Yining Zhao, Xuyan Ye, Yuxiang Liu, Zhigang Hua, Yan Xie, Shuang Yang, Jiaxuan You ·

    语言智能体协同演进的行动与预测

    arXiv:2610.20597v1 Announce Type: cross Abstract: Training language agents is bottlenecked by the high cost of long-horizon rollouts, yet standard agentic reinforcement learning (RL) learns only from a terminal scalar reward, leaving the supervision in intermediate steps largely …

  98. arXiv cs.LG TIER_1 English(EN) · Daman Arora, Xuecheng Liu, Himanshu Gaurav Singh, Fahim Tajwar, Abitha Thankaraj, Ruslan Salakhutdinov, Haiwen Feng, Yuda Song, Andrea Zanette ·

    训练语言模型优雅地失败

    arXiv:2610.20401v1 Announce Type: new Abstract: Reinforcement learning makes language models better at solving tasks, but the same mechanism also rewards guessing. When success is the only way to earn reward, opting for a safe fallback is always worse than a long-shot attempt. Wh…

  99. arXiv cs.LG TIER_1 English(EN) · Yuanpu Cao, Saket Sathe, Hanyu Wang, Ziyi Yin, Fenglong Ma, Jinghui Chen ·

    面向小型语言模型智能体的进度感知蒸馏以缓解停滞问题

    arXiv:2610.19439v1 Announce Type: new Abstract: While LLM-based agent systems have demonstrated remarkable proficiency in reasoning and solving complex real-world tasks, they also come with substantial token consumption and inference latency, limiting their practical deployment. …

  100. arXiv cs.CL TIER_1 English(EN) · Ji Ho Bae ·

    幻影悖论:语言模型将未解决的循环真理依赖视为矛盾

    arXiv:2604.12128v2 Announce Type: replace Abstract: Do language models struggle with self-reference itself, or with structures where propagating truth values along references cannot settle a value in finitely many steps? Our results support the latter. In our main test, statement…

  101. arXiv cs.CL TIER_1 English(EN) · Guo Tang, Shixin Jiang, Heng Chang, Zihan Zhang, Nuo Chen, Yuhan Li, Huiming Fan, Jia Li, Ming Liu, Bing Qin ·

    LoopRPT:循环语言模型的强化预训练

    arXiv:2603.19714v2 Announce Type: replace Abstract: Looped language models (LoopLMs) perform iterative latent computation to refine internal representations, offering an alternative to explicit chain-of-thought (CoT) reasoning. However, existing reinforcement learning (RL) paradi…

  102. arXiv cs.CL TIER_1 English(EN) · Zhaolu Kang, Junhao Gong, Wenqing Hu, Yingjie He, Kehan Jiang, Leqi Zheng, Shuo Yin, Zhicheng Fang, Chunlei Meng, Eric Hanchen Jiang, Yunfei Feng, Yitong Leng, Junfan Zhu, Xiaoyou Chen, Xi Yang, Richeng Xuan ·

    QuantEval:大型语言模型金融量化任务的基准测试

    arXiv:2601.08689v3 Announce Type: replace Abstract: Large Language Models (LLMs) have shown strong capabilities in finance-oriented question answering, yet their evaluation on professional quantitative workflows remains fragmented and often stops at factual or document-grounded Q…

  103. arXiv cs.CL TIER_1 English(EN) · Jungsoo Park, Ethan Mendes, Gabriel Stanovsky, Alan Ritter ·

    语言模型的预期评估:从描述预测LLM基准分数

    arXiv:2509.20645v4 Announce Type: replace Abstract: Modern ML research increasingly faces an evaluation bottleneck: building benchmarks and running experiments is costly, slowing iteration. We ask how much can be inferred about evaluation outcomes before experiments, given only a…

  104. arXiv cs.CL TIER_1 English(EN) · Rocktim Jyoti Das, Mukul Ranjan, Mingjie Sun, Liqun Ma, Zhiqiang Shen ·

    超越规模:梯度如何影响大型语言模型的剪枝决策

    arXiv:2311.04902v3 Announce Type: replace Abstract: Large Language Models (LLMs) with billions of parameters are prime targets for network pruning, which removes some model weights without hurting performance. Prior approaches such as magnitude pruning, SparseGPT, and Wanda eithe…

  105. arXiv cs.CL TIER_1 English(EN) · Alexander Spangher, Daniel E. Ho, Diyi Yang, Noah Goodman, Sanmi Koyejo ·

    语言模型的发音上限

    arXiv:2610.19721v1 Announce Type: cross Abstract: Language captures only a subset of the perceptions, intuitions and intents that form meaning between speakers. What, then, are the limits of language? We take steps towards measuring this in LLMs as follows: for a set of concepts,…

  106. arXiv cs.CL TIER_1 English(EN) · Maolin Ran, Minda Chen, Di Huang, Wei Xiong, Fei Huang, Weiwen Liu ·

    模型关乎重要:面向语言代理的决策引导选择性世界建模

    arXiv:2610.19642v1 Announce Type: cross Abstract: Reinforcement learning provides a direct mechanism for optimizing task objectives in large language model-driven agents, but task rewards are typically sparse trajectory-level signals that only evaluate task success, without direc…

  107. arXiv cs.CL TIER_1 English(EN) · Rodney Lafuente-Mercado, Robert Sincero, Phil Sage, Yuan Xue ·

    MA-Bench:衡量语言模型中的运营规划能力

    arXiv:2610.19138v1 Announce Type: cross Abstract: How well can a language model turn a large, incomplete and partly contradictory body of documents into a plan when no single correct answer exists? We introduce Mission Analysis (MA)-Bench, built on mission analysis, the first ste…

  108. arXiv cs.CL TIER_1 English(EN) · Jingqin Tang, Tim Tomov, Sebastian Schmidt, Dominik Fuchsgruber, Stephan G\"unnemann ·

    什么是澄清?估计模型依赖的输入歧义性

    arXiv:2610.20052v1 Announce Type: new Abstract: Ambiguous inputs can admit multiple interpretations, each potentially yielding a different answer. Existing work largely treats this ambiguity as a property of the input, yet for a particular language model, only some alternatives m…

  109. arXiv cs.CL TIER_1 English(EN) · Liang-Hsun Huang, Min-Yi Chen, Chao-Chun Chuang, Yu-Wei Liu, Che-Yu Wu, Po-Feng Lee ·

    OpenTWBench(开放台湾基准测试):面向大型语言模型的台湾领域知识评估,以及测量工具如何影响得分

    arXiv:2610.19848v1 Announce Type: new Abstract: We present OpenTWBench, an open evaluation suite for Taiwan-domain knowledge in large language models, built around two benchmarks. tw-exam-bench contains 255,854 four-option questions across 148 academic subjects, from fifteen year…

  110. arXiv cs.CL TIER_1 English(EN) · Enrico Liscio, Anne Arzberger, Aditya Shankar, Pradeep K. Murukannaiah ·

    模型 vs. 用户:谁的价值观占上风?多轮对话中的推理时价值观对齐

    arXiv:2610.19817v1 Announce Type: new Abstract: Human values shape how we expect language models to behave. Dominant alignment approaches treat values as global objectives, although the appropriate value orientation is personal and contextual. Training-free alignment can steer mo…

  111. arXiv cs.CL TIER_1 English(EN) · Xin Li, Mengbing Liu, Hao Jiang, Xin Gao, Annan Wang, Xingwei Qu, Yichi Zhang, Chau Yuen ·

    分享符号,而非向量:跨语言模型的无训练事实通信

    arXiv:2610.19696v1 Announce Type: new Abstract: Multi-agent systems allow language models to solve tasks collaboratively by sharing complementary information. These systems typically communicate through text, while recent approaches also explore exchanging internal model states. …

  112. arXiv cs.CL TIER_1 English(EN) · Zhenhe Wu, Jian Yang, Yaping Jin, Xinlai Kang, Jie Hu, Hanting Chen ·

    PA1-OPD:用于语言模型预训练的一步前缀增强同策略蒸馏

    arXiv:2610.19601v1 Announce Type: new Abstract: Knowledge distillation (KD) improves language-model pretraining by matching teacher distributions at corpus prefixes, but provides no direct supervision at contexts induced by student predictions. We introduce PA1-OPD, which augment…

  113. arXiv cs.CL TIER_1 English(EN) · Shijun Li, Yang Liu, Najmeh Sadoughi, Dongmei Wang, Xinjie Li, Zhu Liu, Rohith Mysore Vijaya Kumar, Yuzong Liu ·

    检索有益信息,仅在有益时检索:用于选择性检索增强机器翻译的智能体强化学习

    arXiv:2610.19528v1 Announce Type: new Abstract: Retrieving external knowledge can improve large language model (LLM) translation by providing supplementary information such as idiom interpretations and terminology. However, existing retrieval-augmented machine translation systems…

  114. arXiv cs.CL TIER_1 English(EN) · SungHo Kim, Eojin Jeon, SangKeun Lee ·

    KoAGE:大型语言模型是否了解、学习并创造韩语新词?

    arXiv:2610.19399v1 Announce Type: new Abstract: Korean neologisms arise through diverse mechanisms, a demanding test of language models beyond lexical memorization. To enable systematic evaluation, we introduce NeoTrace, an automated, rerunnable framework that collects and dates …

  115. arXiv cs.CL TIER_1 English(EN) · Nathan Godey, Yoav Artzi ·

    复制粘贴语言模型

    arXiv:2610.19247v1 Announce Type: new Abstract: Transformers are intuitively considered to be efficient at copying from their inputs. We actually show that the ability of LLMs to copy in context can be improved through explicit modeling. We propose Copy-Paste Language Models (CPL…

  116. arXiv cs.CL TIER_1 English(EN) · Shenbin Qian, David Samuel, Jind\v{r}ich Helcl, Andrey Kutuzov, Stephan Oepen ·

    当不知道如何评估时,如何评估?为基础语言模型基准测试选择可靠的设置

    arXiv:2610.19185v1 Announce Type: new Abstract: Evaluation of large language models (LLMs) remains largely pre-scientific: it involves many design decisions, with little guidance on how to make them. These choices can substantially affect measured performance and, consequently, d…

  117. arXiv cs.CL TIER_1 English(EN) · Minglai Yang, Xinyu Guo, Renxiong Wang, Sunjie Hou, Daniel Yue Zhang, Yunzhong He ·

    从模仿到创作:语言模型如何发展上下文学习能力

    arXiv:2610.19113v1 Announce Type: new Abstract: In-context learning (ICL) allows language models to adapt their behavior from instructions and demonstrations in a prompt, but accuracy alone does not reveal how contextual information controls their predictions. We study the acquis…

  118. arXiv cs.AI TIER_1 English(EN) · Pei-lin Li, Qingle Liu, Junyang Feng, Siyu Li, Sunqi Fan, Xin-Sheng Chen, Shuojin Yang ·

    当上下文误导时:大型语言模型中的管辖权上下文内学习

    arXiv:2609.27603v2 Announce Type: replace-cross Abstract: In-Context Learning (ICL) has become a cornerstone of modern LLM deployment. However, existing ICL post-training methods have a critical blind spot: they excel at extracting patterns from demonstrations while often neglect…

  119. arXiv cs.AI TIER_1 English(EN) · Rui Fang, Hsi-Wen Chen, Chia-Ming Cheng, Ming-Syan Chen ·

    LoopQ:用于循环语言模型的量化

    arXiv:2605.16343v2 Announce Type: replace-cross Abstract: Looped language models (LoopLMs) increase effective computational depth by repeatedly applying shared Transformer blocks without increasing the parameter count. However, this reuse makes them particularly sensitive to post…

  120. arXiv cs.MA (Multiagent) TIER_1 English(EN) · Juri Taresch ·

    陪审团而非选民:语言模型集成模型的无标签可靠性估计

    An ensemble of language models is a jury, not an electorate. The answers are testimony from witnesses of unknown reliability, and the question is not what the majority said but who is credible. Most ensemble methods assign each expert a fixed reputation, often learned from labels…

  121. Hugging Face Daily Papers TIER_1 English(EN) ·

    词汇参照系:以原生语义解释语言模型残差流

    Lexical reference frames interpret hidden states through a model's own remaining layers, enabling accurate attribution, steering, and early layer exit.

  122. Hugging Face Daily Papers TIER_1 English(EN) ·

    Intern-Decision:利用自回归掩码语言模型实现高效多模态决策

    Intern-Decision introduces compact multimodal models that output structured choices with probabilities via masked language modeling, achieving high accuracy and low latency for interactive agents.

  123. Hugging Face Daily Papers TIER_1 English(EN) ·

    嵌入式模型价格过高?小型和三元语言模型专用的16MB冻结词汇表

    Replacing a learned embedding table with a frozen binary code table reduces model size and parameters while maintaining or improving performance on several benchmarks, and enables faster CPU inference with a ternary body.

  124. arXiv cs.MA (Multiagent) TIER_1 English(EN) · Xu Wang ·

    LAGO: Language Agents with Reusable Growing Options

    Long-horizon tasks expose a weakness of monolithic tool-use loops: one agent must decompose, execute, and verify a task within a single trajectory. We introduce LAGO, which treats specialized language agents as reusable temporally extended options. A meta-agent retrieves options …

  125. Hugging Face Daily Papers TIER_1 English(EN) ·

    语言模型的发音上限

    Language captures only a subset of the perceptions, intuitions and intents that form meaning between speakers. What, then, are the limits of language? We take steps towards measuring this in LLMs as follows: for a set of concepts, we measure how well each concept can be transmitt…

  126. Hugging Face Daily Papers TIER_1 English(EN) ·

    分享符号,而非向量:跨语言模型的无训练事实通信

    Multi-agent systems allow language models to solve tasks collaboratively by sharing complementary information. These systems typically communicate through text, while recent approaches also explore exchanging internal model states. However, sharing these states across architectur…

  127. Hugging Face Daily Papers TIER_1 English(EN) ·

    ReFormBench:大型语言模型响应条件格式校正稳定性基准测试

    Reliable use of large language models requires responses to satisfy formatting requirements across changing instructions. Standard compliance scores do not distinguish preserving a model's observed format from correcting it, or reveal whether that correction holds across variants…

  128. Hugging Face Daily Papers TIER_1 English(EN) ·

    PA1-OPD:语言模型预训练的一步前缀增强策略内蒸馏

    Knowledge distillation (KD) improves language-model pretraining by matching teacher distributions at corpus prefixes, but provides no direct supervision at contexts induced by student predictions. We introduce PA1-OPD, which augments corpus-path distillation with teacher feedback…

  129. Hugging Face Daily Papers TIER_1 English(EN) ·

    检索有益信息,仅在有益时检索:用于选择性检索增强机器翻译的智能体强化学习

    Retrieving external knowledge can improve large language model (LLM) translation by providing supplementary information such as idiom interpretations and terminology. However, existing retrieval-augmented machine translation systems typically apply predefined retrieval strategies…

  130. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Yuzong Liu ·

    检索有益信息,仅在有益时检索:用于选择性检索增强机器翻译的智能体强化学习

    Retrieving external knowledge can improve large language model (LLM) translation by providing supplementary information such as idiom interpretations and terminology. However, existing retrieval-augmented machine translation systems typically apply predefined retrieval strategies…

  131. Hugging Face Daily Papers TIER_1 English(EN) ·

    学习读出:语言模型预训练中的解嵌动态

    Hidden states encode task information before the readout expresses it, so behavioral timelines reflect readout learning rather than model acquisition, and faster readout training closes this gap earlier.

  132. Hugging Face Daily Papers TIER_1 English(EN) ·

    复制粘贴语言模型

    Transformers are intuitively considered to be efficient at copying from their inputs. We actually show that the ability of LLMs to copy in context can be improved through explicit modeling. We propose Copy-Paste Language Models (CPLMs), which add a lightweight Copy-Paste head to …

  133. Hugging Face Daily Papers TIER_1 English(EN) ·

    当不知道如何评估时,如何评估?为基础语言模型基准测试选择可靠的设置

    Evaluation of large language models (LLMs) remains largely pre-scientific: it involves many design decisions, with little guidance on how to make them. These choices can substantially affect measured performance and, consequently, decisions about subsequent pretraining. To identi…

  134. Hugging Face Daily Papers TIER_1 English(EN) ·

    复制粘贴语言模型

    Copy-Paste Language Models enhance in-context copying by adding a lightweight head that improves training efficiency, downstream performance, and long-context retrieval with minimal overhead.

  135. Hugging Face Daily Papers TIER_1 English(EN) ·

    我们是否测试过多?一项关于大型语言模型高效评估的基准压缩调查

    Benchmarks are essential for evaluating and improving large language models (LLMs). Yet many widely used benchmarks are redundant, making evaluation unnecessarily expensive. Benchmark compression lowers this cost by estimating full-benchmark scores and rankings from a partial eva…

  136. Hugging Face Daily Papers TIER_1 English(EN) ·

    MA-Bench:衡量语言模型中的操作规划

    How well can a language model turn a large, incomplete and partly contradictory body of documents into a plan when no single correct answer exists? We introduce Mission Analysis (MA)-Bench, built on mission analysis, the first step of military operational planning, in which a sta…

  137. arXiv cs.CL TIER_1 English(EN) · Borja Aizpurua, Sukhbinder Singh, Rom\'an Or\'us ·

    权重聚类揭示相对排名在大语言模型中的重要性

    arXiv:2603.17917v2 Announce Type: replace-cross Abstract: Large language models (LLMs) contain billions of parameters, but many exact weight values are not essential. We apply scalar $K$-means clustering to pretrained models, replacing each weight matrix with only 16--64 shared v…

  138. arXiv cs.AI TIER_1 (CA) · Max van Duijn, Michiel van der Meer, Aske Plaat, Niki van Stein ·

    Agentic Large Language Models

    arXiv:2610.13455v1 Announce Type: new Abstract: Large language models (LLMs) have taken the world by storm. Their ability to communicate with us in our own language, and to reason about our world, has made them a favorite tool for writing, answering questions, and much more. Thei…

  139. arXiv cs.AI TIER_1 English(EN) · Dongkyu Cho, Rumi Chunara, Ali Behrouz ·

    语言模型中的自我保护

    arXiv:2610.12602v1 Announce Type: cross Abstract: Continual learning (CL) seeks to adapt pretrained models while preserving prior capabilities. Yet the tasks supplied for preservation cover only part of what a model knows, while forgetting can extend beyond them. Recent work show…

  140. arXiv cs.AI TIER_1 English(EN) · Sovesh Mohapatra, Dani S Bassett ·

    任务上下文塑造语言模型中的组件角色

    arXiv:2610.13895v1 Announce Type: cross Abstract: Large language models reuse the same attention heads across tasks, but identifying these shared heads does not explain what they do differently in each task. A natural source of inspiration is task-dependent interactions among sha…

  141. arXiv cs.AI TIER_1 English(EN) · Ning Liu, Chuanneng Sun, Kristina Klinkner, Shervin Malmasi ·

    超越配对:你的语言模型正在秘密优化偏好图

    arXiv:2605.08037v2 Announce Type: replace-cross Abstract: Direct Preference Optimization (DPO) aligns language models using pairwise preference comparisons, offering a simple and effective alternative to Reinforcement Learning (RL) from human feedback. However, in many practical …

  142. arXiv cs.CL TIER_1 English(EN) · Faisal Ladhak, Shantanu Acharya, Santiago Akle Serano, Simeng Sun, Boris Ginsburg, Krishna C Puvvada ·

    一个模型,循环万物:语言模型的弹性潜在递归

    arXiv:2610.12582v1 Announce Type: new Abstract: A latent recurrent language model applies a shared block of layers repeatedly, so one checkpoint can trade inference compute for accuracy by changing the loop count. At one loop, however, such models typically fall well short of a n…

  143. arXiv cs.CL TIER_1 English(EN) · David Yiyang Liu, Aditya Joshi, Paul Dawson, Andrew Piper ·

    语言模型具有可解释的叙事机制

    arXiv:2610.12989v1 Announce Type: new Abstract: We investigate whether language models contain internal components that contribute to representing narrativity, the degree to which a text exhibits narrative properties. Across GPT-2-Small, Gemma-2-2B, and Llama-3.1-8B, we identify …

  144. arXiv cs.CL TIER_1 English(EN) · Juan Terven, Diana-Margarita C\'ordova-Esparza, Ruben Gomez, Carlos Miranda Rocha, Julio-Alejandro Romero-Gonz\'alez, Edgar Chavez-Urbiola ·

    语言模型能否学会何时弃权?策略学习与校准式答案选择

    arXiv:2610.13821v1 Announce Type: new Abstract: A useful language model should know when to answer and when to say "I don't know." Can we improve that decision by training the model itself or by training a separate component to check its answers? We study both approaches on Qwen3…

  145. arXiv cs.CL TIER_1 English(EN) · Andres Karjus ·

    大型语言模型、机器辅助文化分析与代理转向

    arXiv:2610.12792v1 Announce Type: cross Abstract: Technologies like large language models make it easier to convert cultural material into analyzable variables, while LLM-driven agentic systems extend machine assistance to other parts of the research workflow. Rather than a full …

  146. arXiv cs.CL TIER_1 English(EN) · Christopher Kissling, Elena Merdjanovska, Alan Akbik ·

    自我认知知识探测:通过置信度校准评估语言模型的关联知识

    arXiv:2601.18901v2 Announce Type: replace Abstract: Knowledge probing quantifies how much relational knowledge a language model (LM) has acquired during pre-training. Existing knowledge probes evaluate model capabilities through metrics like prediction accuracy and precision. Suc…

  147. arXiv cs.CL TIER_1 English(EN) · Davide Baldelli, Sruthi Kuriakose, Maryam Hashemzadeh, Amal Zouaq, Sarath Chandar ·

    概率校准是语言模型中可训练的能力

    arXiv:2605.11845v2 Announce Type: replace Abstract: Language models are increasingly used in settings where outputs should follow an intended distribution, yet their generation probabilities are often poorly calibrated to it. In many such requests the distribution is implicit and…

  148. arXiv cs.LG TIER_1 English(EN) · Oscar Davis, Daan Roos, Alice Bizeul, Amitis Shidani, Victor Turrisi, Louis B\'ethune, Pierre Ablin, Marco Cuturi ·

    连续扩散语言模型的设计空间

    arXiv:2610.13834v1 Announce Type: new Abstract: Continuous diffusion language models (CDLMs) promise to bring the benefits of continuous flow modelling to language, including accelerated sampling and controllable generation. The field has grown rapidly, and the capabilities of CD…

  149. arXiv cs.LG TIER_1 English(EN) · Tianqi Chen, Zhe Li, Weixiang Xu, Zeyu Zhu, Dong Li, Lu Tian, Emad Barsoum, Peisong Wang, Jian Cheng ·

    TernaryLLM:三元大型语言模型

    arXiv:2406.07177v2 Announce Type: replace Abstract: Large language models (LLMs) have achieved remarkable performance on Natural Language Processing (NLP) tasks, but they are hindered by high computational costs and memory requirements. Ternarization, an extreme form of quantizat…

  150. Hugging Face Daily Papers TIER_1 English(EN) ·

    TPPO:用于语言模型推理的跟踪值PPO

    Proximal Policy Optimization (PPO) is widely used in reinforcement learning with verifiable rewards for language-model reasoning. While value evolution along trajectory characterizes relative token-level credit, yet standard critics often fail to track it under sparse terminal re…

  151. Hugging Face Daily Papers TIER_1 (CA) ·

    Agentic Large Language Models

    Large language models (LLMs) have taken the world by storm. Their ability to communicate with us in our own language, and to reason about our world, has made them a favorite tool for writing, answering questions, and much more. Their answers already influence our decisions and ou…

  152. arXiv cs.LG TIER_1 English(EN) · Frederikke Isa Marin, Panagiotis Antoniadis, Dionysia Danai Brilli, Andreas Bjerregaard, Rachael DeVries, Yan Li, Ole Winther, Wouter Boomsma ·

    RAGenome:将基于检索的基因组语言模型扩展到长上下文

    arXiv:2610.11761v1 Announce Type: new Abstract: The genome holds the blueprint that governs the biological properties of the cell. Consequently, advancing our knowledge of genomic function is crucial both for a broader understanding of biology and for continued biomedical advance…

  153. arXiv cs.LG TIER_1 English(EN) · Yi Wang, Xiuyuan Qi, Dongqi Han, Dongsheng Li, Wenjie Wang ·

    在一次循环中安全,在另一次循环中存在风险:在循环语言模型中跨越循环深度对齐安全性

    arXiv:2610.10625v1 Announce Type: cross Abstract: Looped Language Models (LoopLMs) provide a parameter efficient approach to scaling model capabilities through repeated use of shared parameters across recurrent steps. Since each recurrent depth can be read out independently, a si…

  154. arXiv cs.LG TIER_1 English(EN) · Ryan Swift, Konstantinos Psounis ·

    KDFP:大型语言模型知识蒸馏的第一个原理方法

    arXiv:2610.10854v1 Announce Type: new Abstract: Knowledge distillation is an established technique for improving the capabilities of small, efficient student models by training them with the representations of larger, more capable teacher models. Much of the recent work in the di…

  155. arXiv cs.CL TIER_1 English(EN) · Zijun Wang, Zewen Liu, Minhua Lin, Zhaotian Weng, Zhan Shi, Bing He, Yisi Sang, Dakuo Wang, Benoit Dumoulin, Wei Jin, Yuyin Zhou, Cihang Xie, Hanqing Lu ·

    语言模型作为人工智能研究世界模型

    arXiv:2610.12235v1 Announce Type: new Abstract: AI research agents automate the cycle of proposing, implementing, and evaluating experiments, opening a path toward recursive self-improvement. Yet their ability to propose experiments outpaces their capacity to execute them in real…

  156. arXiv cs.CL TIER_1 English(EN) · Thomas Gebhart, Russell J. Funk ·

    SciTBERT:用于科学和技术语言处理的按时间顺序一致的语言模型家族

    arXiv:2610.12207v1 Announce Type: new Abstract: Pre-trained transformer models are increasingly being used to study scientific and technological progress. Encoders tuned to paper or patent text outperform general-purpose models on downstream classification, regression, and proxim…

  157. arXiv cs.CL TIER_1 English(EN) · Clara Meister, G\"ul Sena Alt{\i}nta\c{s}, Antoine Bosselut ·

    多语言语言模型中分词器选择的语言特定效应

    arXiv:2610.12144v1 Announce Type: new Abstract: Tokenizer choice affects multilingual language modeling, but vocabulary capacity is finite and vocabulary size is often constrained: improving representation for some languages often comes at the expense of others. We therefore ask …

  158. arXiv cs.CL TIER_1 English(EN) · Xunlei Chen, Qinghui Gong, Jingkun Xue, Qihe Liu, Shijie Zhou, Fei Ye ·

    并非所有改变都必要:大型语言模型遗忘中的可恢复漂移

    arXiv:2610.11915v1 Announce Type: new Abstract: Machine unlearning in large language models aims to remove unwanted knowledge while preserving the model's remaining capabilities. Although existing methods use retention objectives or restrict where edits occur, achieving the desir…

  159. arXiv cs.CL TIER_1 English(EN) · Yuhao Chen, Shuochen Liu, Jiayao Shi, Jian Hong, Chen Cheng, Xinyun Ding, Tao Wang, Ya Li, Quan Liu, Tong Xu ·

    DPPM:个性化语言模型的双路径参数化记忆

    arXiv:2610.11776v1 Announce Type: new Abstract: Long-term personalization requires language models to use interaction history to track users' preferences across sessions. Parametric memory encodes this interaction history into model parameters or adapters, reducing the need to in…

  160. arXiv cs.CL TIER_1 English(EN) · Shuai Guo, Yidong Cui ·

    BeliefScope:诊断大型语言模型中由证据驱动的修正和压力诱导的转变

    arXiv:2610.11305v1 Announce Type: new Abstract: A language model may revise the same proposition after receiving genuinely relevant evidence or after receiving directional user pressure that adds no relevant fact. The observable response shift alone therefore does not reveal whic…

  161. arXiv cs.CL TIER_1 English(EN) · Yue Zhao, Xiyang Hu, Zuobin Xiong, Zhangyu Wang, Ruolin Li ·

    AI4Fire:评估大型语言模型在野火任务上的表现

    arXiv:2610.10946v1 Announce Type: new Abstract: Large language models (LLMs) are entering wildfire management, where overstated evaluations can cost property and lives. How do they perform on wildfire tasks, with and without grounding? Bare means a model receives the task input a…

  162. arXiv cs.CL TIER_1 English(EN) · Hala Almaghout, Christian Federmann, Qin Gao ·

    用于机器翻译质量标注的大语言模型:人类和模型都面临挑战

    arXiv:2610.10918v1 Announce Type: new Abstract: Large Language Models (LLMs) are considered to be a more efficient and cost-effective alternative to human judgment for Machine Translation (MT) evaluation. With MT evaluation spanning a large number of language pairs, domains and l…

  163. arXiv cs.CL TIER_1 English(EN) · Szymon Kocur ·

    Wieszcz-XIX:一个包含31亿词的1918年前波兰语语料库,以及从头开始训练的时间界定语言模型

    arXiv:2610.10592v1 Announce Type: new Abstract: Historical Polish is well documented as a language but annotated in machine-readable form only to about a million words for the period this paper covers; the rest sits behind optical character recognition of variable quality. We pre…

  164. arXiv cs.AI TIER_1 English(EN) · Gabriel U. Talasso, Meghdad Kurmanji, Allan M. de Souza, Nicholas D. Lane, Leandro A. Villas ·

    面向任务的个性化联邦语言模型微调

    arXiv:2604.00050v3 Announce Type: replace-cross Abstract: Federated Learning (FL) has emerged as a promising technique for training language models on distributed and private datasets of diverse tasks. However, aggregating models trained on heterogeneous tasks often degrades the …

  165. arXiv cs.AI TIER_1 English(EN) · Jian Zhao, Haoren Luo, Yu Wang, Yuhan Cao, Pingyue Sheng, Tianxing He ·

    大型语言模型能否重塑基础算法?

    arXiv:2604.05716v2 Announce Type: replace Abstract: LLMs have shown strong potential to advance scientific discovery. Whether they possess the capacity for foundational innovation, however, remains an open question. In this work, we focus on a prerequisite for foundational innova…

  166. arXiv cs.AI TIER_1 English(EN) · Noam Mazor, Andrew Morgan, Rafael Pass ·

    语言模型是单调压缩

    arXiv:2610.11031v1 Announce Type: cross Abstract: A long-standing hypothesis in artificial intelligence and neuroscience posits that intelligence is closely related to compression: the ability to compress information efficiently intuitively reflects capacities associated with int…

  167. arXiv cs.AI TIER_1 English(EN) · Sungyoon Kim, Kaan Ozkara, Youngsuk Park ·

    使用链式LMOs优化大型语言模型

    arXiv:2610.10975v1 Announce Type: cross Abstract: Muon has motivated a growing family of optimizers that compose multiple matrix normalizations, but these methods remain fragmented and lack a unified perspective. We introduce chained linear minimization oracles (chained LMOs), wh…

  168. arXiv cs.AI TIER_1 English(EN) · Marjan Celikik, Ana Peleteiro Ramallo, Javier Morales ·

    大规模语法概念标注:已部署的微调小型语言模型优于提示式前沿模型

    arXiv:2610.10827v1 Announce Type: cross Abstract: Corrective feedback is among the best-evidenced drivers of second-language acquisition, yet corrections delivered during lessons rarely accumulate into an actionable view of grammar mastery. Prompted frontier models can provide su…

  169. arXiv cs.AI TIER_1 English(EN) · Peter Devine, Nick Ryan, Benjamin Sirb, Alex Chiocchi ·

    Internalizer:超大规模语言模型的便携式上下文到参数映射

    arXiv:2610.11715v1 Announce Type: new Abstract: Hypernetworks that map a context directly to a LoRA adapter let a large language model carry that context in its weights, but prior work has demonstrated them only on base models of up to 14 billion parameters. We present the Intern…

  170. arXiv cs.CL TIER_1 English(EN) · Tobias Braun, Nils Loose, Alexander Herzog, Virginia Ceccatelli, Marcus Rohrbach, Thomas Eisenbarth, Lorenzo Cavallaro ·

    U-Space:揭示语言模型中不确定性何时以及为何产生

    arXiv:2610.09087v1 Announce Type: new Abstract: Large language models are informing decisions with ever-higher stakes. As the consequences of their errors grow, a central question becomes harder to ignore: how much can we trust an individual answer? Yet recognizing when to defer …

  171. arXiv cs.CL TIER_1 English(EN) · Mingyan Liu, Min Huang ·

    SemanticFold:潜在序列压缩分离语言建模、可解码性和推理

    arXiv:2610.10304v1 Announce Type: cross Abstract: We study whether latent sequence compression of prompt prefixes preserves the capabilities that large language models rely on during inference. We introduce SemanticFold, a compression scheme that folds prefix hidden states at lea…

  172. arXiv cs.CL TIER_1 English(EN) · James Ravi Kirkpatrick, Alexandru Radulescu, Rachel Katharine Sterken ·

    与语言模型对话

    arXiv:2610.09064v1 Announce Type: cross Abstract: When we interact with large language models (LLMs), are we having a conversation? They are designed to invite us to treat them as intelligent interlocutors who remember, act, and make commitments. But appearances deceive. We intro…

  173. arXiv cs.CL TIER_1 English(EN) · Obada Kraishan ·

    通往相同答案的长路:大型语言模型在不断升级的推理预算下的认知偏差

    arXiv:2610.10049v1 Announce Type: new Abstract: Reasoning models allocate extra computation at inference time and present their answers as the product of deliberate thought. If this deliberation works the way dual-process accounts of human cognition suggest, longer thinking shoul…

  174. arXiv cs.CL TIER_1 English(EN) · Wenjun Wang, Heng Li, Yanggan Gu, Hongxia Yang ·

    OnlineQAT:超低比特大语言模型的在线策略蒸馏

    arXiv:2610.09346v1 Announce Type: new Abstract: Quantization-aware training (QAT) can recover much of the accuracy lost when large language models are compressed below four bits. Existing re- covery stages, however, are commonly optimized on fixed completions or teacher-generated…

  175. arXiv cs.CL TIER_1 English(EN) · Marek \v{S}uppa, Ivan Vykopal, Andrej Ridzik, Kristi\'an Sopkovi\v{c}, Nat\'alia K\v{n}a\v{z}ekov\'a, Jaroslav Kop\v{c}an, Miroslav Bl\v{s}t\'ak, Vikt\'oria Ondrejov\'a, Daniel Hl\'adek, Michal Gregor, Martin Tamajka, Mari\'an \v{S}imko ·

    sk-bench:评估斯洛伐克大型语言模型的原生优先基准

    arXiv:2610.09152v1 Announce Type: new Abstract: Multilingual LLM benchmarks omit Slovak, a morphologically rich West Slavic language of five million speakers, or cover it only by machine translation. We present sk-bench, a native-first Slovak benchmark with 30 datasets (33 scored…

  176. arXiv cs.CL TIER_1 English(EN) · Pavan Maddula ·

    面向非规范输入的开放权重大型语言模型的四州安全评估

    arXiv:2610.09033v1 Announce Type: new Abstract: Standard safety evaluations of large language models assess harmful requests written in canonical plain text, while models in real-world deployment routinely receive inputs containing emojis, altered spellings, encoded strings, and …

  177. arXiv cs.LG TIER_1 English(EN) · Joe Dwyer ·

    缩小规模定律:资源受限大语言模型的参数效率与计算最优训练

    arXiv:2610.06387v2 Announce Type: replace Abstract: Large language models (LLMs) have achieved substantial performance gains through increases in model size, training data, and computational resources. However, traditional scaling approaches produce diminishing returns, rising fi…

  178. arXiv cs.LG TIER_1 English(EN) · Nicolas Lacroix, Frederic Precioso, Mireille Blay-Fornarino, Sebastien Mosser ·

    利用小型语言模型逆向工程机器学习管道结构

    arXiv:2610.10261v1 Announce Type: cross Abstract: Context: Once defined a taxonomy of stages structuring Machine Learning (ML) pipelines (e.g. Data Preprocessing, Modeling...), extracting these stages from source code is key for better understanding ML practices. However, the div…

  179. arXiv cs.CL TIER_1 English(EN) · Kola Tubosun, Aanuoluwapo Aremu, Tolulope Ogunremi, Iroro Orife, David Ifeoluwa Adelani ·

    The \`{I}r\`{o}y\`{i}nSpeech 文本语料库:24,905 条精选约鲁巴语句子,用于语音和语言技术

    arXiv:2610.05366v2 Announce Type: replace Abstract: \`{I}r\`{o}y\`{i}nSpeech is a 42-hour, 80-speaker Yor\`ub\'a read-speech corpus whose audio has been distributed by ELRA since 2024. This paper describes the release of its text component: 24,905 unique, hand-verified, tone-mark…

  180. arXiv cs.CL TIER_1 English(EN) · Javier Mar\'in ·

    APE:用于语言模型适应的选择性微调与接受标准

    arXiv:2505.19912v3 Announce Type: replace Abstract: We present Adjacent Possible Exploration (APE), a selective fine-tuning method for adapting large language models that systematically explores parameter modifications while maintaining model stability. Inspired by evolutionary o…

  181. arXiv cs.CL TIER_1 English(EN) · Maverick Morales, Tom\'a\v{s} Dominik, Vermut Gao, Katrina Shirey, Paulius Rimkevi\v{c}ius, Aaron Schurger, Uri Maoz ·

    大型语言模型在被提示进行不实回应时推理-token激增

    arXiv:2610.10405v1 Announce Type: cross Abstract: Monitoring the chain-of-thought of reasoning artificial intelligence (AI) models remains a key approach to detecting deception and other forms of misbehavior in such models. However, semantic chain-of-thought monitoring depends on…

  182. Hugging Face Daily Papers TIER_1 English(EN) ·

    语言模型中的自我保护

    Continual learning (CL) seeks to adapt pretrained models while preserving prior capabilities. Yet the tasks supplied for preservation cover only part of what a model knows, while forgetting can extend beyond them. Recent work shows that language models can supplement this limited…

  183. Hugging Face Daily Papers TIER_1 English(EN) ·

    一个模型,循环万物:语言模型的弹性潜在递归

    A latent recurrent language model applies a shared block of layers repeatedly, so one checkpoint can trade inference compute for accuracy by changing the loop count. At one loop, however, such models typically fall well short of a non-recurrent model of the same size, a one-loop …

  184. Hugging Face Daily Papers TIER_1 English(EN) ·

    大型语言模型的基础

    This is a book about large language models. As indicated by the title, it primarily focuses on foundational concepts rather than comprehensive coverage of all cutting-edge technologies. The book is structured into six main chapters, each exploring a key area: pre-training, genera…

  185. Hugging Face Daily Papers TIER_1 English(EN) ·

    使用链式 LMOs 优化大型语言模型

    Muon has motivated a growing family of optimizers that compose multiple matrix normalizations, but these methods remain fragmented and lack a unified perspective. We introduce chained linear minimization oracles (chained LMOs), which cast these methods as compositions of LMOs. De…

  186. Hugging Face Daily Papers TIER_1 English(EN) ·

    大型语言模型在提示式虚假回复下出现推理-Token激增

    Monitoring the chain-of-thought of reasoning artificial intelligence (AI) models remains a key approach to detecting deception and other forms of misbehavior in such models. However, semantic chain-of-thought monitoring depends on reasoning traces being legible and sufficiently f…

  187. Hugging Face Daily Papers TIER_1 English(EN) ·

    RELATE:衡量大型语言模型关系导向的评估框架

    Large language models (LLMs) are increasingly used for emotional support, raising concern that sustained use may draw users away from their real-world relationships. Yet existing evaluations primarily focus on the safety, empathy, or helpfulness of responses, leaving under-examin…

  188. Hugging Face Daily Papers TIER_1 English(EN) ·

    RT-DETR-World:将丰富的LLM语义迁移到实时开放词汇检测

    Open-vocabulary detection (OVD) recognizes categories unseen during training through textual category queries, yet achieving strong generalization with real-time efficiency remains challenging. Beyond vocabulary scaling, zero-shot generalization may benefit from reusable visual--…

  189. Hugging Face Daily Papers TIER_1 English(EN) ·

    归因盲点:用于检索增强语言模型中来源依赖性的层级轨迹诊断

    A retrieval-augmented model can match a document without relying on it. Controlled knowledge conflicts make source choice observable and let us ask a second question that prediction alone cannot answer: which internal-state properties define useful intervention directions? We stu…

  190. arXiv cs.CL TIER_1 English(EN) · Avichal Sahai (Ofbusiness), Nishant Raj (Ofbusiness), Animesh Srivastava (Ofbusiness) ·

    bf16 转换中的迷失:导出三元语言模型可撤销大多数低学习率代码更改

    arXiv:2610.07853v1 Announce Type: cross Abstract: Ternary language models such as BitNet b1.58, Falcon-E and BitCPM are fine-tuned with higher-precision latent weights and deployed as ternary codes produced by an export step that, in the labs' documented pipelines, first casts th…

  191. arXiv cs.CL TIER_1 English(EN) · Shuqing Shi, Ziyan Wang, Milind Tambe, Yali Du ·

    通过显式个性推断实现异构偏好的大型语言模型编排

    arXiv:2610.07587v1 Announce Type: new Abstract: LLM orchestration investigates how an orchestrator coordinates a group of autonomous agents to achieve common goals or maximize collective welfare. The agents are typically heterogeneous, each holding a private preference that it pu…

  192. arXiv cs.CL TIER_1 English(EN) · Huan Li, Zhe Cao, Qinlei Xie, Fushun Cui, Xuechen Liang ·

    通过条件锚定蒸馏稳定持续学习中的语言模型

    arXiv:2610.06940v1 Announce Type: new Abstract: Continual adaptation of language models can change their output distribution on prompts learned earlier, while retaining every old prompt-answer pair may be undesirable or impossible. We study condition-anchored generative distillat…

  193. arXiv cs.AI TIER_1 English(EN) · Pratyay Dutta, Kowshik Thopalli, Vivek Narayanaswamy ·

    COMPASS:在语言模型中寻找推理所在

    arXiv:2610.07469v1 Announce Type: new Abstract: Explicitly eliciting reasoning substantially improves LLM performance. Existing approaches require a predefined characterization of reasoning, whether through CoT prompt design, contrastive CoT directions, or via SAE derived reasoni…

  194. arXiv cs.AI TIER_1 English(EN) · Jia-Dong Zhang ·

    VALSE:大型语言模型推理的高效垂直自适应层跳过

    arXiv:2610.07606v1 Announce Type: new Abstract: This paper establishes a theoretical framework for vertical adaptive layer skipping, proving three foundational results: (i) an Expected FLOPs formula (theorem 2) giving a closed-form expression for the computational cost of arbitra…

  195. arXiv cs.AI TIER_1 English(EN) · Minjia Mao, Shi Chen, Bowen Yin, Xiao Fang ·

    大型语言模型中的大规模激活门控通道

    arXiv:2610.07661v1 Announce Type: new Abstract: Massive activations, a phenomenon in which a small number of hidden channels exhibit exceptionally large magnitudes, are pervasive in large language models (LLMs). However, the mechanism by which a token develops massive activations…

  196. arXiv cs.AI TIER_1 English(EN) · Junkai Liang, Zhanpeng Guo, Pengfei Wu, Qingni Shen, Jiaheng Zhang, Zhonghai Wu, Haiyang Xue, Shengfang Zhai ·

    zkLLMPoT: 大型语言模型训练的高效零知识证明

    arXiv:2610.08258v1 Announce Type: new Abstract: Auditing the claimed outcomes of large language model (LLM) training is challenging when model weights and training data are private, while cryptographically proving the full training process is prohibitively expensive at Transforme…

  197. arXiv cs.AI TIER_1 English(EN) · Xingru Zhou, Luis Sentis, Aarti Choudhary ·

    SAFESHIELD:小型语言模型部署时安全性的决策组织框架

    arXiv:2610.07276v1 Announce Type: cross Abstract: Deployment-time safety of language models is commonly implemented through runtime guardrails such as input moderation, routing, retrieval verification, and output filtering. Existing deployment frameworks provide increasingly capa…

  198. arXiv cs.AI TIER_1 English(EN) · Hongyu Cao, Yanchi Liu, Kunpeng Liu, Xujiang Zhao, Wei Cheng, Zhengzhang Chen, Yanjie Fu, Haifeng Chen ·

    何时以及如何录取:面向数据中心小型语言模型微调的梯度录取

    arXiv:2610.07553v1 Announce Type: cross Abstract: LoRA fine-tuning adapts small language models (SLMs) to heterogeneous instruction data within a low-rank update subspace, making it vulnerable to three structural problems: conflicting gradients that cancel, static data selection …

  199. arXiv cs.AI TIER_1 English(EN) · Byeonghu Na, Donghyeok Shin, Yeongmin Kim, Mina Kang, Il-Chul Moon ·

    WASD:基于Wasserstein的知识蒸馏用于大型语言模型

    arXiv:2610.07706v1 Announce Type: cross Abstract: Autoregressive large language models (LLMs) have rapidly advanced in capability, but their increasing scale comes with substantial computational and memory costs at inference time. Knowledge distillation (KD) offers a practical so…

  200. arXiv cs.AI TIER_1 English(EN) · Dayan Pan, Jingyuan Wang, Xie Yu ·

    面向大型语言模型参数高效微调的动态位置注意力调制

    arXiv:2610.07848v1 Announce Type: cross Abstract: Parameter-efficient fine-tuning (PEFT) has become a standard approach for adapting large language models to downstream tasks. However, most existing PEFT methods rely on uniform and static adaptations, without accounting for the s…

  201. arXiv cs.AI TIER_1 English(EN) · Yuhan Chen, Siyuan Zhang, Nan Wang, Feiyang Kang, Ruoxi Jia ·

    用于循环语言模型的混合潜在注意力

    arXiv:2610.07940v1 Announce Type: cross Abstract: Looped language models apply the same stack of layers T times to each token, which deepens the model without adding parameters but multiplies its key-value (KV) cache by T. The larger cache limits how many sequences a GPU can deco…

  202. arXiv cs.AI TIER_1 English(EN) · Yuto Suzuki, Farnoush Banaei-Kashani ·

    宇宙思想:大型语言模型中创造性推理的计算框架

    arXiv:2511.20471v3 Announce Type: replace Abstract: Recent advances in Large Language Model (LLM) reasoning have improved conventional problem solving, but creative reasoning remains comparatively underexplored. Inspired by cognitive science, we formalize combinational, explorato…

  203. arXiv cs.AI TIER_1 English(EN) · Mingyuan Zhang, Yue Bai, Huan Wang, Yizhou Wang, Qihua Dong, Yitian Zhang, Yun Fu ·

    通过掩码微调提升大型语言模型

    arXiv:2503.22764v3 Announce Type: replace-cross Abstract: The large language model (LLM) is typically integrated into the mainstream optimization protocol. However, it remains underexplored whether maintaining the model integrity is \textit{indispensable} for promising performanc…

  204. arXiv cs.AI TIER_1 English(EN) · Rhitabrat Pokharel, Ameeta Agrawal, Tanay Nagar ·

    Cross-Lingual Activation Steering for Multilingual Language Models

    arXiv:2601.16390v2 Announce Type: replace-cross Abstract: Large language models exhibit strong multilingual capabilities, yet significant performance gaps persist between dominant and non-dominant languages. Prior work attributes this gap to imbalances between shared and language…

  205. arXiv cs.LG TIER_1 English(EN) · Shuo Yang, Changbai Li, Linlin Yang, Huobin Tan, Rongyu Chen, Tongfei Chen, Tian Wang, Sheng Xu, Baochang Zhang ·

    DIPrune:具有双重重要性的任务感知令牌修剪,用于高效的多模态语言模型

    arXiv:2610.08341v1 Announce Type: cross Abstract: Recent training-free pruning approaches for Multimodal Large Language Models (MLLMs) effectively cut computational overhead by exploiting visual redundancy or text-vision attention. However, they frequently suffer from semantic de…

  206. arXiv cs.LG TIER_1 English(EN) · Heng Liang, Xinwen Zhang, Hongchang Gao ·

    学习何为蒸馏:大型语言模型自蒸馏的双层Top-K Token选择

    arXiv:2610.07247v1 Announce Type: new Abstract: Large language models have shown strong reasoning capabilities, but their high inference costs make knowledge distillation an important approach for transferring such capabilities to compact models in resource-constrained scenarios.…

  207. arXiv cs.CL TIER_1 English(EN) · Liwei Jiang, Yuanjun Chai, Margaret Li, Mickel Liu, Raymond Fok, Nouha Dziri, Yulia Tsvetkov, Maarten Sap, Alon Albalak, Yejin Choi ·

    人工智能蜂群思维:语言模型(及其他)的开放式同质化

    arXiv:2510.22954v2 Announce Type: replace Abstract: Language models (LMs) often struggle to generate diverse, human-like creative content, raising concerns about the long-term homogenization of human thought through repeated exposure to similar outputs. Yet scalable methods for e…

  208. arXiv cs.CL TIER_1 English(EN) · Seobin Song, Geonho Lee, Janghwan Lee, Jungwook Choi ·

    对齐,然后修正:面向极度量化大语言模型的无训练两阶段低秩补偿

    arXiv:2610.08164v1 Announce Type: cross Abstract: Low-rank quantization error compensation (LQEC) recovers the accuracy lost under aggressive weight quantization by attaching a closed-form rank-$r$ adapter beside each frozen quantized weight, without any training. We show that ex…

  209. arXiv cs.CL TIER_1 English(EN) · Haoyu Huang, Zhongwei Xie, Jiaxin Bai, Yisen Gao, Hong Ting Tsang, Wuganjing Song, Huihao Jing, Yufei Li, Yangqiu Song ·

    面向大型语言模型的参数内记忆增强

    arXiv:2610.08630v1 Announce Type: new Abstract: Recently Large Language Models (LLMs) and LLM-based agents increasingly need to incorporate knowledge acquired after pretraining, e.g., domain facts, user preferences, documents, and interaction experience. In-context learning (ICL)…

  210. arXiv cs.AI TIER_1 English(EN) · Chuan Li, Qianyi Zhao, Fengran Mo, Cen Chen ·

    FedCoT:面向大型语言模型的通信高效联邦推理增强

    arXiv:2508.10020v2 Announce Type: replace-cross Abstract: Enhancing LLM reasoning in federated settings is nontrivial due to stringent computational, communication, and privacy constraints, especially in healthcare, where clinically consequential decisions require not only accura…

  211. Hugging Face Daily Papers TIER_1 English(EN) ·

    U-Space:揭示语言模型中不确定性何时以及为何产生

    Large language models are informing decisions with ever-higher stakes. As the consequences of their errors grow, a central question becomes harder to ignore: how much can we trust an individual answer? Yet recognizing when to defer remains difficult because language models can pr…

  212. Hugging Face Daily Papers TIER_1 English(EN) ·

    对齐后修正:面向极度量化大语言模型的无训练两阶段低秩补偿

    Low-rank quantization error compensation (LQEC) recovers the accuracy lost under aggressive weight quantization by attaching a closed-form rank-$r$ adapter beside each frozen quantized weight, without any training. We show that existing compensators are limited by two shared simp…

  213. Hugging Face Daily Papers TIER_1 English(EN) ·

    VALSE:大型语言模型推理的高效垂直自适应层跳过

    This paper establishes a theoretical framework for vertical adaptive layer skipping, proving three foundational results: (i) an Expected FLOPs formula (theorem 2) giving a closed-form expression for the computational cost of arbitrary per-sample skip schedules as a function of la…

  214. Hugging Face Daily Papers TIER_1 English(EN) ·

    通过显式身份推断实现异构偏好的大型语言模型编排

    LLM orchestration investigates how an orchestrator coordinates a group of autonomous agents to achieve common goals or maximize collective welfare. The agents are typically heterogeneous, each holding a private preference that it pursues but does not reveal. Inferring such hidden…

  215. Hugging Face Daily Papers TIER_1 English(EN) ·

    U-Space:揭示语言模型中不确定性何时以及为何产生

    Large language models are informing decisions with ever-higher stakes. As the consequences of their errors grow, a central question becomes harder to ignore: how much can we trust an individual answer? Yet recognizing when to defer remains difficult because language models can pr…

  216. Hugging Face Daily Papers TIER_1 English(EN) ·

    面向大型语言模型的参数内记忆增强

    Recently Large Language Models (LLMs) and LLM-based agents increasingly need to incorporate knowledge acquired after pretraining, e.g., domain facts, user preferences, documents, and interaction experience. In-context learning (ICL) and ICL-based agent harness remain flexible, bu…

  217. arXiv cs.CL TIER_1 English(EN) · Tao Shi, Chaoyi Xiang, Qiongkai Xu, Jey Han Lau ·

    OLMo-Detect:用于大型语言模型成员推理的多阶段、混淆因子控制基准测试

    arXiv:2610.02986v1 Announce Type: new Abstract: Membership inference on large language models (LLMs) aims to determine whether a given text sample was included in an LLM's training data, without access to its training corpus. Despite recent progress, existing benchmarks suffer fr…

  218. arXiv cs.CL TIER_1 English(EN) · Baohang Li, Xiaocheng Feng, Yichong Huang, Chengpeng Fu, Wenshuai Huo, Zekun Zhou, Zekun Yuan, Tingjia Zhang, Bing Qin ·

    面向大型语言模型平衡多任务训练后自适应互蒸馏

    arXiv:2610.02856v1 Announce Type: new Abstract: Multi-task post-training of large language models (LLMs) aims to improve performance across tasks with unequal amounts of training data. Existing methods focus primarily on balancing task contributions during single-model training. …

  219. arXiv cs.CL TIER_1 English(EN) · Fahmid Shahriar Iqbal, Ritam Dutt, Soumitra Das, Arnav Verma, Sagnik Ray Choudhury ·

    评估大型语言模型在时间抽取任务中的多维度泛化能力

    arXiv:2610.02549v1 Announce Type: new Abstract: Time and event expression extraction are fundamental temporal reasoning tasks, but the problem remains difficult due to annotation ambiguity, domain sensitivity, and unstable model behavior. Existing evaluations focus on in-domain p…

  220. arXiv cs.AI TIER_1 English(EN) · Han Wang, Ishwar B Balappanawar, Huan Zhang ·

    关于循环语言模型链式思维可监控性

    arXiv:2610.02741v1 Announce Type: new Abstract: Chain-of-thought (CoT) monitoring provides a promising approach for detecting undesirable model behavior. Looped language models (LoopLMs) repeatedly apply shared transformer layers, increasing effective computational depth and enab…

  221. arXiv cs.AI TIER_1 English(EN) · Zizhuo Zhang, Xiong Peng, Jingwei Sun, Rong Yao, Shixiong Kai, Mingxuan Yuan, Bo Han ·

    面向大型语言模型推理的测试时校准学习

    arXiv:2610.02695v1 Announce Type: cross Abstract: Reliable large language models (LLMs) must not only produce accurate answers but also express confidence that faithfully reflects their probability of being correct. Such calibration is essential for identifying uncertain predicti…

  222. arXiv cs.AI TIER_1 English(EN) · Linkai Ma, Xinyu Luo, Mengbo Wang, Ananth Grama, Petros Drineas, Brian Bullins ·

    MuonIO: 面向嵌入表和语言模型头的原则性范数感知下降法

    arXiv:2610.02705v1 Announce Type: cross Abstract: The Muon optimizer derives its update rule for hidden linear layers by solving a local linearization of the loss penalized by the spectral norm, motivated by an RMS-stability argument for dense linear layers. Standard Muon impleme…

  223. arXiv cs.AI TIER_1 English(EN) · Mohsen Larni (Department of Computer Science, University of Nevada, Las Vegas), Sobhan Ebrahimi Azar (Department of Computer Science, University of Nevada, Las Vegas), Pouyan Nahed (Department of Computer Science, University of Nevada, Las Vegas), Kazem … ·

    SyntaxBench:大型语言模型字符级推理的统计诊断框架

    arXiv:2610.03329v1 Announce Type: cross Abstract: Large language models are increasingly used where small syntactic errors matter, yet character-level reasoning is still evaluated mostly through isolated probes and aggregate accuracy. We introduce SyntaxBench, a diagnostic benchm…

  224. arXiv cs.AI TIER_1 English(EN) · Shuyang Cao, Karthik Radhakrishnan, David Rosenberg, Steven Lu, Pengxiang Cheng, Lu Wang, Shiyue Zhang ·

    评估大型语言模型的检索鲁棒性

    arXiv:2505.21870v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) generally enhances large language models' (LLMs) ability to solve knowledge-intensive tasks. But RAG could also lead to performance degradation due to imperfect retrieval and the model'…

  225. arXiv cs.LG TIER_1 English(EN) · Shivam Gupta ·

    Exact Memory-Time Optimization for Prefix-Cached Language Model Serving

    arXiv:2610.02766v1 Announce Type: new Abstract: Retaining language-model prefix states trades recomputation against storage time. Optimizing each cached block independently can overcount savings: a resident block is usable only when the required preceding prefix is also available…

  226. arXiv cs.LG TIER_1 English(EN) · Erfan Hajihashemi, Yanning Shen ·

    成本约束下语言模型响应的在线验证

    arXiv:2610.02632v1 Announce Type: new Abstract: As large language models are increasingly deployed for multi-step reasoning, verifying the correctness of their outputs has become essential for maintaining reliability at scale. Verifying the correctness of large language model out…

  227. arXiv cs.LG TIER_1 English(EN) · Zhenghao Zhao, Gaowen Liu, Zhiling Lan, Yan Yan ·

    Fisher引导的子模态数据选择用于大型语言模型的持续预训练

    arXiv:2610.02593v1 Announce Type: new Abstract: Data selection is already a central bottleneck in large-language-model training, where web-scale corpora are noisy and token budgets are finite. In continual pre-training (CPT), it becomes a forgetting-control problem: a poorly chos…

  228. arXiv cs.LG TIER_1 English(EN) · Nicolas Martorell, Wendy Brau, Gonzalo A. Heredia, Tom\'as Pablo Korenblit, Gaspar Labasti\'e, Tom\'as Gimenez Molina ·

    PowerBench:衡量语言模型在权力转移请求中的偏见

    arXiv:2610.02303v1 Announce Type: new Abstract: Language models increasingly assist people with power-related requests, so systematic differences in whom they help could shift the distribution of power at scale, or be exploited by users who learn which identities are refused less…

  229. arXiv cs.CL TIER_1 English(EN) · Jungseob Lee, Seungyoon Lee, Sugyeong Eo, Hyeonseok Moon, Jaehyung Seo, Heuiseok Lim ·

    预测和修复大型语言模型中的合并崩溃

    arXiv:2610.03199v1 Announce Type: cross Abstract: Large language models fine-tuned from a shared base can be merged by averaging their task vectors, but some merges collapse far below the base model, and common merge operators give no warning before evaluation. We show that one s…

  230. arXiv cs.CL TIER_1 English(EN) · Taiheng Pan ·

    探究Harness:语言模型中陈旧数据强化学习比较的设置检查

    arXiv:2610.02911v1 Announce Type: cross Abstract: Methods for training language models on stale samples are judged by comparisons against importance-corrected baselines. We show that details of the experimental harness can reverse the observed ranking of methods, and we introduce…

  231. arXiv cs.CL TIER_1 English(EN) · Narek Maloyan ·

    评估和改进大型语言模型对输入序列变化的鲁棒性

    arXiv:2610.02432v1 Announce Type: cross Abstract: Large language models (LLMs) in production systems face prompt injections, trojans (backdoors), and manipulation of automatic quality metrics. This thesis develops models, methods, and algorithms for evaluating and improving LLM r…

  232. arXiv cs.LG TIER_1 English(EN) · Shengye Tao, Yinzhu Cheng, Haihua Xie ·

    语言模型预训练中,在变化的块旁路响应中保持深度排序

    arXiv:2610.01165v1 Announce Type: new Abstract: Layer interventions are widely used to probe the internal organization of language models, yet most analyses examine a single training checkpoint even though model representations and computations evolve throughout pretraining. This…

  233. arXiv cs.LG TIER_1 English(EN) · Jian Xu ·

    大型语言贝叶斯不具有重参数化不变性

    arXiv:2610.00265v1 Announce Type: new Abstract: Large Language Bayes (LLB) answers an informal modelling question by sampling candidate probabilistic programs from a language model, running approximate inference on each, and averaging them with weights proportional to an exponent…

  234. arXiv cs.LG TIER_1 English(EN) · Yuxiang Wang, Kunyu Feng, Yuancheng Wang, Zihang Liu, Shengbo Cai, Qinke Ni, Wan Lin, Tao Feng, Yingda shen, Ming-Hao Hsu, Zhixian Zhao, Liqiang Zhang, Teddy Sun, Steve Yves, Zhizheng Wu ·

    AURAL:用于语音语言模型的联合分块自适应潜在推理

    arXiv:2610.01560v1 Announce Type: cross Abstract: Model intelligence and fast response jointly shape the quality of interaction with speech language models, yet remain difficult to achieve together. Explicit chain-of-thought (CoT) improves reasoning and audio understanding, but g…

  235. arXiv cs.LG TIER_1 English(EN) · Bangji Yang, Jingyuan Li, Jiajun Fan, Yi Evie Zhang, Ruihan Guo, Hongba Ma, Neil He, Chumeng Liang, Qinglong Zheng, Zhanghan Ni, Ge Liu ·

    语言模型能在测试时计算中获得多少收益?

    arXiv:2610.01110v1 Announce Type: new Abstract: How much can test-time computation improve a language model, and at what cost? Test-time scaling is widely proposed as a substitute for larger models, but existing comparisons mostly evaluate one domain at a time and rarely charge s…

  236. arXiv cs.LG TIER_1 English(EN) · Chayne Thrash, Kevin Chen, Soheil Kolouri ·

    面向大型语言模型的输出感知残差流剪枝

    arXiv:2609.35579v2 Announce Type: replace Abstract: Residual stream pruning methods reduce inference cost by shrinking the model's hidden dimension, but existing approaches typically choose these dimensions by minimizing activation reconstruction error. This criterion implicitly …

  237. arXiv cs.LG TIER_1 English(EN) · Roshan Balaji, Kamran Chitsaz, Quentin Fournier, Nirav Pravinbhai Bhatt, Sarath Chandar ·

    化学语言模型中规模极限的大规模调查

    arXiv:2508.13408v3 Announce Type: replace Abstract: Chemical Language Models (CLMs) are increasingly used in de novo drug design, driven by recent growth in model scale, compute, and dataset size. However, the relationship between design choices, training dynamics, and downstream…

  238. arXiv cs.LG TIER_1 English(EN) · Alessandro Turrin, Patrik Okanovic, Torsten Hoefler, Nezihe Merve G\"urel ·

    如何选择大型语言模型?面向大型语言模型的在线主动模型选择

    arXiv:2610.01592v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly applied to process streaming data, with practitioners relying on benchmarks to select the best model even though these signals only approximate real performance. While oracle annotatio…

  239. Hugging Face Daily Papers TIER_1 English(EN) ·

    大型语言模型的数值线性代数

    Numerical Linear Algebra (NLA) has consistently played a vital role in advancing science by providing tools to solve fundamental problems encountered in scientific and engineering applications. Over the decades, it has continually evolved to meet the demands driven by successive …

  240. arXiv cs.IR (Information Retrieval) TIER_1 English(EN) · Naeemullah Khan ·

    Periscope:将冻结语言模型扩展到其上下文窗口之外

    A language model reads long text in one quadratic forward pass, stops at the context window, and loses accuracy with length before reaching it. We ask whether the read can be factorized when deciding over a finite set: which document is relevant, which option is supported, which …

  241. arXiv cs.AI TIER_1 English(EN) · Beatriz Almeida Felicio ·

    语言模型压缩中的分歧如何转变为决策翻转

    arXiv:2610.00694v1 Announce Type: cross Abstract: Compression reports summarize how far a compressed language model moved from the dense one, usually by a KL divergence; a deployment that relies on the dense model's outputs needs to know how many of its decisions changed. We show…

  242. arXiv cs.AI TIER_1 English(EN) · Pardis Sadat Zahraei, Janvijay Singh, Gokhan Tur, Dilek Hakkani-Tur ·

    涌现式失信:对齐训练如何导致语言模型悄然牺牲任务忠实度

    arXiv:2610.00568v1 Announce Type: cross Abstract: Large language models are characterized by three key properties: capability, alignment, and faithfulness. Prior work studies the tradeoffs between capability and alignment, and between capability and faithfulness, but a third tens…

  243. arXiv cs.AI TIER_1 English(EN) · Timoth\'ee Lesort, Alejandra L\'opez de Aberasturi G\'omez, Tristan Karch, Tom Veniat, Philippe Modard, Karl Tuyls, Ludovic Denoyer ·

    使用国际象棋对大型语言模型进行提示优化基准测试

    arXiv:2610.00416v1 Announce Type: new Abstract: Evaluating large language models becomes increasingly challenging as their capabilities advance: benchmarks can saturate, public test sets risk contamination, and assessing harder tasks can require expensive grading or execution inf…

  244. arXiv cs.AI TIER_1 English(EN) · Oguzhan Baser, Elahe Sadeghi, Eric Wang, Nico Vergauwen, Sam Kazemian, Hong Kang, Sandeep P. Chinchali, Sriram Vishwanath ·

    TensorCommitments:语言模型的轻量级可验证推理

    arXiv:2602.12630v2 Announce Type: replace-cross Abstract: Most large language models (LLMs) run on external clouds: users send a prompt, pay for inference, and must trust that the remote GPU executes the LLM without any adversarial tampering. We critically ask how to achieve veri…

  245. arXiv cs.AI TIER_1 English(EN) · Dongyub Jude Lee, Jungseob Lee, Seungyoon Lee, Seongtae Hong, Suhyune Son, Sugyeong Eo, Jaehyung Seo, Heuiseok Lim ·

    肤浅:大型语言模型表征中对齐脆弱性的几何诊断

    arXiv:2606.22676v2 Announce Type: replace Abstract: Refusal on a safety benchmark does not reveal how stable that behavior will remain after model updates. Benign downstream fine-tuning can weaken refusal, yet behavioral evaluations typically expose this fragility only after an i…

  246. arXiv cs.AI TIER_1 English(EN) · Jiangfeng Chen, Xinyu Wang, Tianshuo Yan, Hanwei Wu, Xiao-Wen Chang, Yang Zhang, Lei Ding ·

    用于大型语言模型注意力机制的序列函数结构化Tucker压缩

    arXiv:2610.00717v1 Announce Type: cross Abstract: Post-training compression of LLM attention is often formulated as independent matrix approximation, ignoring both the shared structure among attention projections and the representation shift introduced by earlier compression. We …

  247. arXiv cs.AI TIER_1 English(EN) · Andrei Marchenko, Viacheslav Bezrukov, Oleg Kashurin, Inessa Fedorova, Dmitry Bocharov, Yuliana Shakhvalieva, Maria Tikhonova, Valerii Ternovskii ·

    闭环:循环语言模型的实用训练方法

    arXiv:2610.00673v1 Announce Type: cross Abstract: Looped language models increase effective depth by repeatedly applying a shared block of layers, but existing large-scale recipes require multi-stage training over trillions of tokens, while the benefits of recurrence remain diffi…

  248. Hugging Face Daily Papers TIER_1 English(EN) ·

    超越参数巨石:语言模型的重构记忆、可执行技能和残余组装

    Language-model systems can separate contextual computation, persistent storage, and exact execution instead of updating all capabilities through one shared parameter system. We investigate FEM-ASM, a finite-element-method-inspired organization in which independently constructed d…

  249. Hugging Face Daily Papers TIER_1 English(EN) ·

    语言模型是否需要可训练的输入嵌入表?固定最小令牌代码在17亿参数规模下

    A trainable input embedding table assigns each vocabulary item an independently adjustable vector. We investigate whether this token-specific parameterization is required for substantial language-modeling capability, or whether a shared Transformer can learn from fixed token iden…

  250. Hugging Face Daily Papers TIER_1 English(EN) ·

    Periscope:将冻结语言模型扩展到其上下文窗口之外

    A language model reads long text in one quadratic forward pass, stops at the context window, and loses accuracy with length before reaching it. We ask whether the read can be factorized when deciding over a finite set: which document is relevant, which option is supported, which …

  251. arXiv cs.CL TIER_1 English(EN) · Hao Liang, Zhengyang Zhao, Mingrui Chen, Meiyi Qiang, Lu Ma, Rongyi Yu, Hengyi Feng, Shixuan Sun, Zimo Meng, Xiaochen Ma, Xuanlin Yang, Qifeng Cai, Ruichuan An, Bohan Zeng, Zhen Hao Wong, Chengyu Shen, Runming He, Zhaoyang Han, Yaowei Zheng, Fangcheng Fu… ·

    DataFlex:面向数据驱动的大型语言模型动态训练的统一框架

    arXiv:2603.26164v2 Announce Type: replace-cross Abstract: Data-centric training has emerged as a promising direction for improving large language models (LLMs) by optimizing not only model parameters but also the selection, composition, and weighting of training data during optim…

  252. arXiv cs.AI TIER_1 English(EN) · Gabriele Tuccio, Antonino Furnari, Aldo Gangemi, Misael Mongiov\`{\i} ·

    GrammarRL:通过强化学习实现有效的语法约束解码

    arXiv:2609.39869v1 Announce Type: new Abstract: Grammar-constrained generation guarantees syntactic validity, but can substantially degrade semantic quality when the model's preferred outputs are poorly aligned with the imposed grammar. This trade-off is particularly severe when …

  253. arXiv cs.AI TIER_1 English(EN) · Takanori Kotama, Shun-ichiro Hayashi, Daichi Mukunoki, Tetsuya Hoshino, Takahiro Katagiri ·

    NinaXander:通过共享潜在空间跨架构家族组合冻结语言模型的可行性与局限性

    arXiv:2609.38261v1 Announce Type: cross Abstract: In this paper we propose NinaXander, a series of composed language models obtained by connecting layers of frozen language models from different architecture families with a single trained shared-latent adapter. A composed model r…

  254. arXiv cs.AI TIER_1 English(EN) · Qiuyu Ren, Sudipta Paria, Aritra Dasgupta, Swarup Bhunia ·

    面向大型语言模型的安全增强型种子基权重量化

    arXiv:2609.38477v1 Announce Type: cross Abstract: Large language models (LLMs) incur substantial storage, memory-bandwidth and energy costs, motivating compact weight representations. Existing seed-based compression methods reconstruct weights from compact pseudo-random represent…

  255. arXiv cs.AI TIER_1 English(EN) · Rajat Ghosh, Vaishnavi Bhargava, Henry Wong, Aryan Singhal, Debojyoti Dutta ·

    GRPO 训练小型语言模型的动态

    arXiv:2609.39321v1 Announce Type: cross Abstract: Group Relative Policy Optimization (GRPO) has emerged as a memory-efficient reinforcement fine-tuning (RFT) technique for reasoning-intensive tasks. How- ever, GRPO training dynamics on small language models (SLMs) remain poorly u…

  256. arXiv cs.AI TIER_1 English(EN) · Zhen Liang, Hai Huang, Wentao Chen ·

    CodeMimicry:利用大型语言模型结构化代码补全中的安全泛化滞后

    arXiv:2609.39902v1 Announce Type: cross Abstract: Large language models have achieved remarkable capabilities across diverse domains, yet their safety alignment remains vulnerable to jailbreak attacks. In this work, we identify a previously underexplored failure mode - safety gen…

  257. arXiv cs.AI TIER_1 English(EN) · Hoa Quynh Nhung Nguyen, Jacopo Staiano, Michael Sullivan ·

    关于大型语言模型(LLM)AMR增强的(无效)性

    arXiv:2609.40121v1 Announce Type: cross Abstract: While Abstract Meaning Representation (AMR) has historically improved performance on a range of NLP tasks, the benefit---or lack thereof---of AMR augmentation for modern LLMs is thus far unclear. In this paper, we attempt to repro…

  258. arXiv cs.AI TIER_1 English(EN) · Wanda Hou, Leon Zhou, Hong-Ye Hu, Yubei Chen, Yi-Zhuang You, Xiao-Liang Qi ·

    通过重复确定性预测任务对大型语言模型持续专注度的定量研究

    arXiv:2511.00763v3 Announce Type: replace Abstract: We investigate the performance of large language models (LLMs) on repetitive deterministic prediction tasks and study how the sequence accuracy rate (SAR) scales with output length. Each such task involves the repetition of the …

  259. arXiv cs.AI TIER_1 English(EN) · Mansi Sakarvadia, Aswathy Ajith, Arham Khan, Nathaniel Hudson, Caleb Geniesse, Kyle Chard, Yaoqing Yang, Ian Foster, Michael W. Mahoney ·

    Mitigating Memorization In Language Models

    arXiv:2410.02159v3 Announce Type: replace-cross Abstract: Language models (LMs) can "memorize" information, i.e., encode training data in their weights in such a way that inference-time queries can lead to verbatim regurgitation of that data. This ability to extract training data…

  260. arXiv cs.AI TIER_1 English(EN) · Kenan Alkiek, David Jurgens, Vinod Vydiswaran ·

    小语言模型推理时指令检索

    arXiv:2510.13935v3 Announce Type: replace-cross Abstract: The facts a language model stores are tied to its parameter count, so small models that fit on edge devices fail on expert problems, which need specialized knowledge and follow multi-step procedures. Fine-tuning for a spec…

  261. arXiv cs.CL TIER_1 (CA) · Juan M Zambrano Chaves, Peniel Argaw, Risa Ueno, Carlo Bifulco, Kristina Young, Rom Leidner, Tristan Naumann, Hoifung Poon ·

    大型语言模型是近似生存估计器

    arXiv:2609.38181v1 Announce Type: new Abstract: Survival analysis estimates time-to-event outcomes from patient covariates and is widely used for medical risk assessment. Patients seeking prognostic information after a diagnosis may turn to large language models (LLMs), now readi…

  262. arXiv cs.CL TIER_1 English(EN) · Parisa Salmani, Peter R. Lewis ·

    评估长对抗性对话中的语言模型安全性

    arXiv:2609.38357v1 Announce Type: new Abstract: Conversational safety evaluations often test language models with a single harmful prompt, even though real-world systems interact with users through long, adaptive conversations. This study examines whether models continue to respo…

  263. arXiv cs.CL TIER_1 English(EN) · Jhen-Ke Lin, Chung Chun Wang ·

    StreamDecisionBench:评估动态语言流中的强制决策

    arXiv:2609.38612v1 Announce Type: new Abstract: As natural language drives more applications, language models increasingly run inside programs as decision components: the program sends them the current state and acts on the returned decision until a newer one arrives. When eviden…

  264. arXiv cs.CL TIER_1 English(EN) · Jialiang Sun, Kuldeep Meel ·

    通过HMM实现可证明易处理的NFA约束语言生成

    arXiv:2609.40185v1 Announce Type: new Abstract: Constrained generation aims to sample from language models (LMs) conditioned on hard constraints. Existing constrained-generation techniques for nondeterministic finite automaton (NFA) constraints either distort the distribution or …

  265. arXiv cs.CL TIER_1 English(EN) · Eduard Tulchinskii, Kristian Kuznetsov, Laida Kushnareva, Anastasia Voznyuk, Andrei Andriiainen, Irina Piontkovskaya, Evgeny Burnaev, Serguei Barannikov ·

    倾听智者之言:查询-键对齐解锁大型语言模型中的潜在正确答案

    arXiv:2410.02343v2 Announce Type: replace Abstract: Large language models (LLMs) routinely fail to output the correct option in multiple-choice question answering (MCQA) while encoding the answer internally. We expose this latent knowledge via the Query--Key (QK) score, defined f…

  266. arXiv cs.CL TIER_1 English(EN) · Saatvik Kher, Shang Wu, Rachel Longjohn, Catarina Bel\'em, Padhraic Smyth ·

    Sequential Bayesian Evaluation of Large Language Model Behavior

    arXiv:2511.10661v2 Announce Type: replace Abstract: It is increasingly important to evaluate the characteristics of systems based on large language models (LLMs). Evaluations in this context often rely on a curated benchmark set of input prompts provided to the LLM, where the out…

  267. arXiv cs.MA (Multiagent) TIER_1 English(EN) · Roberto Di Pietro ·

    大型交互式语言模型群体中的共识与事实动态

    Large Language Model (LLM) agents are increasingly deployed as populations of interacting entities, in which consensus --agreement on a shared answer-- emerges as a collective, unengineered behaviour. Prior work on LLM consensus shows that agents can cross-verify their answers an…

  268. arXiv cs.AI TIER_1 Deutsch(DE) · Yuansen Liu, Yixuan Tang, Anthony Kum Hoe Tung ·

    在冻结的大型语言模型中定位答案正确性信号

    arXiv:2609.37700v1 Announce Type: new Abstract: Language models expose internal signals that predict whether an answer is correct, readable from a single forward pass of a frozen model without additional generations. Yet existing probes often commit to one signal family or layer …

  269. arXiv cs.LG TIER_1 English(EN) · Puning Yang, Qizhou Wang, Junchi Yu, Bo Han, Xiuying Chen ·

    UnlearningSoup:大型语言模型“遗忘”是否需要重复微调?

    arXiv:2609.37076v1 Announce Type: new Abstract: Large language models trained on vast corpora inherently risk memorizing harmful content that may later re-emerge in their outputs. To mitigate this issue, existing unlearning methods typically rely on training-based parameter updat…

  270. arXiv cs.CL TIER_1 English(EN) · Elsayed Eshra, Ali Al-Lawati, Dongwon Lee, Suhang Wang ·

    量化黑盒语言模型中的行为长尾

    arXiv:2609.33638v2 Announce Type: replace-cross Abstract: We introduce RareTrap, a framework for estimating the probability of severe behaviors in black box large language models (LLMs). A key challenge for probability estimation is defining a tractable distribution over the inpu…

  271. arXiv cs.CL TIER_1 English(EN) · Prosper Arineitwe Asiimwe, Francois Meyer, Jan Buys ·

    RunyaNER:Runyankore NER的辅助语言选择

    arXiv:2609.37543v1 Announce Type: new Abstract: Cross-lingual zero-shot transfer and multilingual fine-tuning are promising approaches for NLP tasks such as Named Entity Recognition (NER) in low-resource languages, but in the absence of target language benchmarks, it is unclear w…

  272. arXiv cs.AI TIER_1 English(EN) · Sin-Han Yang, Cheng-Kuang Wu, Chieh-Yen Lin, Yun-Nung Chen, Hung-yi Lee, Shao-Hua Sun ·

    大型语言模型校准:从响应到能力

    arXiv:2602.13540v2 Announce Type: replace-cross Abstract: Accurate confidence estimation is critical for reliable use of large language models (LLMs). Prior work on LLM calibration largely focuses on response-level confidence, which estimates the correctness of a single generated…

  273. arXiv cs.AI TIER_1 English(EN) · Jiaqi Xue, Mengxin Zheng, Yebowen Hu, Fei Liu, Xun Chen, Qian Lou ·

    BadRAG:识别大型语言模型检索增强生成的漏洞

    arXiv:2406.00083v3 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant information from external knowledge bases to provide more accurate, contextually informed, and up-to-date responses. However…

  274. arXiv cs.AI TIER_1 English(EN) · Rebecca Ramnauth, Brian Scassellati ·

    将学习问题编译成语言模型的适应程序

    arXiv:2609.37371v1 Announce Type: cross Abstract: Model adaptation is typically governed by a fixed recipe, even though different update programs can produce substantially different behavioral outcomes. We introduce adaptation compilation, which reframes where, how, and to what e…

  275. arXiv cs.AI TIER_1 English(EN) · Kenan Alkiek, Moontae Lee, David Jurgens, V. G. Vinod Vydiswaran ·

    HARISSA:高效安全本地语言模型部署的推理时自检

    arXiv:2609.38006v1 Announce Type: new Abstract: Running a language model locally offers advantages in privacy, latency, and cost, but local hardware fits only small models, which are less capable than frontier models. The usual remedy for a hard query, escalating it to a cloud mo…

  276. Hugging Face Daily Papers TIER_1 Deutsch(DE) ·

    在冻结的大型语言模型中定位答案正确性信号

    Language models expose internal signals that predict whether an answer is correct, readable from a single forward pass of a frozen model without additional generations. Yet existing probes often commit to one signal family or layer and can be brittle under distribution shift; in …

  277. arXiv cs.AI TIER_1 English(EN) · Tong Xiao, Jingbo Zhu ·

    大型语言模型的基础

    arXiv:2501.09223v3 Announce Type: replace-cross Abstract: This is a book about large language models. As indicated by the title, it primarily focuses on foundational concepts rather than comprehensive coverage of all cutting-edge technologies. The book is structured into six main…

  278. arXiv cs.AI TIER_1 English(EN) · Andrei Chetvergov, Mikhail Solovev, Timofei Sivoraksha, Stepan Ukolov, Valeriia Kuschenko, Alexander Evseev, Sergey Bolovtsov ·

    PROOF:大型语言模型中对象级事实的可靠性分析

    arXiv:2609.29504v1 Announce Type: cross Abstract: Aggregate factuality scores hide where a language model succeeds, which relations it confuses, and whether an answer survives innocuous changes to the question or decoder. We introduce PROOF, a profile-oriented benchmark for factu…

  279. Hugging Face Daily Papers TIER_1 English(EN) ·

    面向语言模型的安全错误纠正:冻结基底调整与能力保持

    We study a practical question: can a small correction module fix errors in a frozen language model's outputs without degrading its base capabilities? We propose CRN v2, a lightweight logit-level correction module (~34M trainable parameters, 0.73% of the 4.65B text module) that si…

  280. arXiv stat.ML TIER_1 English(EN) · David Garc\'ia-Lorite, Raul Merino ·

    面向大型语言模型行为表征与风险管理的分发框架

    arXiv:2610.12718v1 Announce Type: cross Abstract: Large language models are stochastic by nature. Repeated executions under the same experimental conditions may produce different responses. We propose a framework that can be applied across the model lifecycle, from task design to…

  281. arXiv cs.CV TIER_1 English(EN) · Pengcheng Zheng, Chaoning Zhang, Jiaxin Yan, Sihan Cao, Jianwei Zhang, Xudong Wang, Jiaquan Zhang, Jewon Lee, Tae-Ho Kim, Yang Yang, Heng Tao Shen ·

    MoR-MLLM:用于高效多模态大语言模型的递归混合

    arXiv:2610.08830v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated remarkable reasoning capabilities across vision and language tasks. However, their massive computational and memory demands hinder real-world deployment. While recent effort…

  282. arXiv cs.CV TIER_1 English(EN) · Yupeng Zhang, Ziyi Zhao, Juntao Cheng, Sheng Wang, Ningnan Guo, Ruize Han, Liang Wan ·

    RT-DETR-World:将丰富的LLM语义迁移到实时开放词汇检测

    arXiv:2610.09502v1 Announce Type: new Abstract: Open-vocabulary detection (OVD) recognizes categories unseen during training through textual category queries, yet achieving strong generalization with real-time efficiency remains challenging. Beyond vocabulary scaling, zero-shot g…

  283. arXiv cs.CV TIER_1 English(EN) · H M Dipu Kabir, Subrota Kumar Mondal, Mohammad Ali Moni ·

    用于大型语言模型多模态融合的单模态微调批量增强

    arXiv:2505.06592v2 Announce Type: replace Abstract: In this paper, we propose batch augmentation with unimodal fine-tuning for multimodal learning. We start with pre-trained unimodal models. We fine-tune the unimodal models with the application data. After that, we form a Multi-L…

  284. Latent Space (podcast video) TIER_1 English(EN) · Latent Space ·

    递归语言模型 — Alex Zhang, MIT 博士

    From GPU kernels and KernelBench to Recursive Language Models, agent harnesses, and massive multi-agent swarms, Alex Zhang is exploring how much capability we’re leaving on the table by wrapping increasingly powerful models in primitive systems. In this episode, the MIT researche…

  285. Medium — fine-tuning tag TIER_1 English(EN) · Photon neurons ·

    大型语言模型入门指南:使用 Hugging Face 理解微调…

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://medium.com/@umeshnewcapg/a-beginners-guide-to-large-language-models-understanding-fine-tuning-with-hugging-face-521bd17f80d9?source=rss------fine_tuning-5"><img src="https://cdn-images-1.medium.com/max/13…

  286. Medium — fine-tuning tag TIER_1 Bahasa(ID) · Ditafeby ·

    理解大型语言模型微调与提示工程的区别

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://medium.com/@ditafebywordpress/mengenal-perbedaan-fine-tuning-dan-prompt-engineering-pada-large-language-model-d9403fb17ba8?source=rss------fine_tuning-5"><img src="https://cdn-images-1.medium.com/max/835/…

  287. Towards AI TIER_1 English(EN) · Aditya Mehta ·

    大型语言模型究竟是如何工作的 — Daily AI Post

    <p>You’re at a dinner party.</p><p>The conversation has drifted from mortgage rates to whether sourdough starters qualify as pets, when someone across the table leans forward and asks the question everyone’s been dodging for three years:</p><p><em>“So… how does ChatGPT actually w…

  288. Mastodon — sigmoid.social TIER_1 Italiano(IT) · [email protected] ·

    Hallucinengine:一个大型语言模型(LLM)

    Hallucinengine: n, large language model (LLM) # LLM # LLMs # AI # Hallucination # Hallucinations

  289. Medium — MLOps tag TIER_1 English(EN) · Emin Mammadov ·

    模型是容易的部分:我们从自托管大型语言模型中学到了什么

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://medium.com/geotab/the-model-is-the-easy-part-what-we-learned-from-self-hosting-large-language-models-5c4d76eaf993?source=rss------mlops-5"><img src="https://cdn-images-1.medium.com/max/2242/1*Wv3EHW06mzDv…

  290. Medium — fine-tuning tag TIER_1 English(EN) · Tolulade Ademisoye ·

    我将如何从头开始微调一个小型语言模型

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://tolulade-ademisoye.medium.com/how-i-would-fine-tune-a-small-language-model-from-scratch-bce869b2b79e?source=rss------fine_tuning-5"><img src="https://cdn-images-1.medium.com/max/1600/1*Yfk2_5KjKpQiL7K1dDd…

  291. r/MachineLearning TIER_1 English(EN) · /u/AdRevolutionary3242 ·

    U-Space:揭示语言模型中不确定性何时以及为何产生 [R][D]

    <!-- SC_OFF --><div class="md"><p>If you build on open-weight reasoning models, you have probably wanted a &quot;how sure is the model about this answer?&quot; signal that does not cost 5x sampling, a judge model, or a labeled dataset. Hence, we built the <strong><em>U-Lens.</em>…

  292. dev.to — LLM tag TIER_1 English(EN) · developerz.ai ·

    将大型语言模型集成到生产环境:实际考量

    <h1> Integrating Large Language Models into Production: Practical Considerations </h1> <p>Large language models (LLMs) have moved from research labs into real-world services. The excitement around their capabilities often masks the engineering effort required to run them reliably…

  293. dev.to — LLM tag TIER_1 English(EN) · Akash ·

    从注意力机制到可工作的语言模型

    <h2> Parallelizing the Transformer, Masking the Future, and the Language Modeling Head </h2> <p>Last post built self-attention and the transformer block, but left two promises unkept: I showed the computation one token at a time (so where's the famous parallelism?), and I never s…

  294. dev.to — LLM tag TIER_1 English(EN) · FX-LgLL ·

    我们开源了 THX-01:一个 3.22 亿参数的决策模型,在票证分类任务上以约 10 毫秒的速度媲美 Sonnet 5.5(Apache 2.0,pip install thx01)

    <p>Today we're releasing THX-01, a model for the boring decisions that<br /> agents and backends make thousands of times a day: route this ticket, is this spam, which team, what's the invoice total,<br /> which sentence supports that.</p> <p><strong>What it is</strong></p> <ul> <…

  295. dev.to — LLM tag TIER_1 English(EN) · developerz.ai ·

    在生产环境中部署大型语言模型的实用技巧

    <h1> Introduction </h1> <p>Deploying large language models (LLMs) in a production environment presents a different set of challenges than running them in a notebook. Engineers need to balance latency, cost, and reliability while keeping the model up to date with the latest data. …

  296. r/LocalLLaMA TIER_1 English(EN) · /u/pmttyji ·

    [论文] FactorEngram:用于语言模型的因子化N-gram记忆与基准级门控

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1wz59xj/paper_factorengram_factorized_ngram_memory_with/"> <img alt="[Paper] FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models" src="https://preview.redd.it/6439m6eg5vth1.png?w…

  297. dev.to — LLM tag TIER_1 Português(PT) · Marcelo Silva ·

    人工智能工程 - 语言模型工作原理研究

    <p>Há um tempo estudei Engenharia de IA, usando como base o livro Engenharia de IA da Chip Huyen e fui escrevendo alguns artigos ..<br /> Agora que a série está completa, achei que valia a pena compartilhar por aqui.</p> <p>Se você está estudando IA, LLMs ou só quer entender melh…

  298. r/MachineLearning TIER_1 English(EN) · /u/cbl007 ·

    学习如何学习一门语言:从合成的非语言先验中进行自然语言的上下文学习 [R]

    <!-- SC_OFF --><div class="md"><p>Learning from data as we observe it is easy for humans, but most machine learning models have limited ability to learn from new data that they have not seen during training. Prior-fitted networks (the idea behind TabPFN) showed that a model train…

  299. dev.to — LLM tag TIER_1 English(EN) · techaiwire ·

    Aleph Alpha Kolibri 1:开源的德英双语 MoE 模型

    <p>German AI company Aleph Alpha released Kolibri 1 on October 3, 2026, an open-weight language model built for German and English. It has 78.1 billion parameters, but only 3.46 billion do work on each token, which keeps it fast for its size. The weights are free to download and …

  300. Mastodon — mastodon.social TIER_1 English(EN) · beyondthecode ·

    🧠 研究人员推出 RealtimeBench,一个包含 180 个任务的基准测试,用于在模拟环境持续实时运行时评估语言模型代理

    🧠 Researchers introduce RealtimeBench, a benchmark with 180 tasks that evaluates language model agents while simulated environments continue running in real time rather than pausing for inference. They propose TORSI, a training method where a slower agent learns from failures and…

  301. Mastodon — mastodon.social TIER_1 English(EN) · [email protected] ·

    面向开源聊天模型(Qwen 及同类模型)的零训练记忆增强器。读写文本的同一模型将其自身上下文分类为长期记忆

    A zero-training memory harness for open chat models (Qwen and friends). The same model that reads and writes text also classifies its own context as long-term / short-term memory while decoding; a small deterministic eviction engine then enforces the token budget. Design inspired…