English(EN)Super Weights in LLMs and the Failure of Selective Training
LLM 提示研究强调任务依赖性和技能焦点转移
作者PulseAugur 编辑部·[18 个来源]·
新的研究探讨了大型语言模型 (LLM) 的提示工程的细微差别。一项研究表明，提示的鲁棒性因任务类型而异，主观问题比客观问题对提示更改更敏感。另一篇论文引入了“提示复杂度”的概念，将其定义为从 LLM 引发特定文本或行为所需的最短合理提示，并表明这种复杂度是模型相对的。此外，研究表明，鼓励更长提示的界面设计可以增强用户对 AI 生成内容的心理归属感，而更广泛的趋势表明，技能重点正从提示工程转移到输出评估。
AI
影响
研究表明，与 LLM 交互的关键技能正从提示工程转向输出评估，这影响了用户和开发人员如何进行 AI 协作。
arXiv:2607.08733v1 Announce Type: new Abstract: Recent work identified Super Weights, individual parameters whose removal degrades model performance by orders of magnitude. We show that this degradation due to pruning Super Weights does not universally apply to all LLMs. Furtherm…
Recent work identified Super Weights, individual parameters whose removal degrades model performance by orders of magnitude. We show that this degradation due to pruning Super Weights does not universally apply to all LLMs. Furthermore, if these parameters are so important, Super…
arXiv:2607.06145v1 Announce Type: new Abstract: In this paper, we define the quantity of prompting complexity: for a fixed instruction-tuned language model, what is the shortest plausible prompt that makes deterministic decoding produce a target text? It is an LM-relative analogu…
arXiv cs.AI
TIER_1English(EN)·Sadia Kamal, Arefa Patwary, Anthony Marchiafava, Atriya Sen, Sagnik Ray Choudhury·
arXiv:2607.05554v1 Announce Type: cross Abstract: Survey-style evaluations of large language models often treat a prompted response as a measure of a model's values or beliefs. This assumption is particularly fragile when responses are read as evidence of political values, social…
In this paper, we define the quantity of prompting complexity: for a fixed instruction-tuned language model, what is the shortest plausible prompt that makes deterministic decoding produce a target text? It is an LM-relative analogue of resource-bounded Kolmogorov complexity: the…
arXiv:2503.10954v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) agents can solve *any* computational problem *without* an algorithm in a runtime *independent* of the computational complexity of that problem. Instead of specifying precisely how to solve proble…
arXiv cs.AI
TIER_1English(EN)·Nikhita Joshi, Daniel Vogel·
arXiv:2507.03670v2 Announce Type: replace-cross Abstract: Writing longer prompts for an AI assistant to generate a story increases psychological ownership, a user's feeling that the writing belongs to them. To encourage users to write longer prompts, we evaluated two interaction …
arXiv cs.CL
TIER_1English(EN)·Sagnik Ray Choudhury·
Survey-style evaluations of large language models often treat a prompted response as a measure of a model's values or beliefs. This assumption is particularly fragile when responses are read as evidence of political values, social attitudes, or beliefs. We ask whether prompt robu…
The prompt is the opening. It only gets you to a position. The game is won in the middle, in the moves you insert between the model's output and your acceptance of it.
Medium — fine-tuning tag
TIER_1English(EN)·Saunakofficial·
<div class="medium-feed-item"><p class="medium-feed-snippet">I used to think that asking an AI 2 + 2 = ? meant it was calculating — running a tiny arithmetic operation somewhere under the hood.</p><p class="medium-feed-link"><a href="https://medium.com/@ahmedtaaw/llms-are-…
Medium — Claude tag
TIER_1English(EN)·Megan Strant·
<p>Ask a model a tricky problem cold and it does what it always does — grabs the nearest familiar pattern and runs with it. On problems that have a well-known trap, the nearest pattern is exactly the wrong one.</p> <p>Try this one: how many 3-digit numbers have all distinct digit…
dev.to — LLM tag
TIER_1English(EN)·Shreyans Padmani·
<p>Large language models are only as good as the prompts you give them. The same model can look mediocre or brilliant depending on <em>how</em> you ask it to do something. Below is a practical rundown of the eight core prompting techniques every developer working with LLMs should…
<!-- SC_OFF --><div class="md"><p>A carefully written system prompt doesn't help much if the model is looking at the wrong document section. In document-heavy workflows, we often waste time tweaking instructions like "answer based only on the provided text," when the re…
