English(EN)Obey, Diverge, Collapse: Blind Obedience to Incorrect Instructions Drives Code LLMs to Irrecoverable Code Semantic Collapse
LLM研究探讨参数重要性、提示复杂性和任务依赖鲁棒性
作者PulseAugur 编辑部·[28 个来源]·
近期研究探讨了大语言模型（LLM）及其参数的复杂性。一项研究表明，“超级权重”（Super Weights）在完整时对模型性能至关重要，但在单独训练时却会产生负面影响，这表明参数重要性并不等同于单独训练能力。另一篇论文引入了“提示复杂性”（prompting complexity）作为从LLM获得特定输出所需的最短提示的度量标准，并提出它作为Kolmogorov复杂性的LM相对类比。此外，研究表明提示鲁棒性因任务而异，主观问题比客观问题对提示更改更敏感。最后，一项研究表明，鼓励更长提示的交互技术可以增强用户在使用AI辅助写作时的心理归属感，但提示的进一步扩展不一定会增加这种归属感。
AI
arXiv:2607.11944v1 Announce Type: new Abstract: How do different components of iterative prompt optimization interact, and what happens when they are combined? We investigate this through MAGE (Memory-Augmented Goal-directed Prompt Evolution), a controlled analysis framework for …
arXiv:2607.09804v1 Announce Type: cross Abstract: Open-weight medical language models are increasingly used as the base of patient-facing and clinician-support applications. Their model cards prohibit specific behaviors -- recommending exact drug dosages, issuing definitive diagn…
arXiv:2607.08733v1 Announce Type: new Abstract: Recent work identified Super Weights, individual parameters whose removal degrades model performance by orders of magnitude. We show that this degradation due to pruning Super Weights does not universally apply to all LLMs. Furtherm…
Recent work identified Super Weights, individual parameters whose removal degrades model performance by orders of magnitude. We show that this degradation due to pruning Super Weights does not universally apply to all LLMs. Furthermore, if these parameters are so important, Super…
arXiv cs.AI
TIER_1English(EN)·Sadia Kamal, Arefa Patwary, Anthony Marchiafava, Atriya Sen, Sagnik Ray Choudhury·
arXiv:2607.05554v1 Announce Type: cross Abstract: Survey-style evaluations of large language models often treat a prompted response as a measure of a model's values or beliefs. This assumption is particularly fragile when responses are read as evidence of political values, social…
arXiv:2607.06145v1 Announce Type: new Abstract: In this paper, we define the quantity of prompting complexity: for a fixed instruction-tuned language model, what is the shortest plausible prompt that makes deterministic decoding produce a target text? It is an LM-relative analogu…
In this paper, we define the quantity of prompting complexity: for a fixed instruction-tuned language model, what is the shortest plausible prompt that makes deterministic decoding produce a target text? It is an LM-relative analogue of resource-bounded Kolmogorov complexity: the…
arXiv cs.AI
TIER_1English(EN)·Nikhita Joshi, Daniel Vogel·
arXiv:2507.03670v2 Announce Type: replace-cross Abstract: Writing longer prompts for an AI assistant to generate a story increases psychological ownership, a user's feeling that the writing belongs to them. To encourage users to write longer prompts, we evaluated two interaction …
arXiv:2503.10954v2 Announce Type: replace-cross Abstract: Large Language Model (LLM) agents can solve *any* computational problem *without* an algorithm in a runtime *independent* of the computational complexity of that problem. Instead of specifying precisely how to solve proble…
arXiv cs.CL
TIER_1English(EN)·Sagnik Ray Choudhury·
Survey-style evaluations of large language models often treat a prompted response as a measure of a model's values or beliefs. This assumption is particularly fragile when responses are read as evidence of political values, social attitudes, or beliefs. We ask whether prompt robu…
Code language models are now trusted collaborators in production workflows for debugging, refactoring, and iterative repair, and every benchmark that evaluates them assumes the instructions they act on are correct. We study what happens when that assumption breaks. We evaluate co…
The prompt is the opening. It only gets you to a position. The game is won in the middle, in the moves you insert between the model's output and your acceptance of it.
dev.to — MCP tag
TIER_1English(EN)·Renato Marinho·
<p>Engineering prompts inside your source code is a recipe for deployment fatigue.</p> <p>If you've spent any time moving an AI feature from a prototype to production, you know the specific frustration of 'prompt drift.' You make a subtle tweak to a system instruction—perhaps cha…
Medium — Anthropic tag
TIER_1English(EN)·Harnish Savsani·
<div class="medium-feed-item"><p class="medium-feed-snippet">I used to think that asking an AI 2 + 2 = ? meant it was calculating — running a tiny arithmetic operation somewhere under the hood.</p><p class="medium-feed-link"><a href="https://medium.com/@ahmedtaaw/llms-are-…
Medium — Claude tag
TIER_1English(EN)·Megan Strant·
<h2> Devlog — Part 6 </h2> <p>PromptLedger v0.7 is out.</p> <p>The previous release made prompt history easier to inspect.</p> <p>This release makes prompt changes easier to evaluate.</p> <p>Until now, PromptLedger could answer questions such as:</p> <ul> <li>What changed?</li> <…
dev.to — LLM tag
TIER_1English(EN)·rushikeshpatil1007·
<p>One of the biggest misconceptions in Generative AI is that every AI application needs fine-tuning.</p> <p>It doesn't.</p> <p>In fact, many successful AI products never fine-tune a model. Instead, they rely on well-designed prompts, Retrieval-Augmented Generation (RAG), and str…
<p>Most developers start with AI by writing a long prompt and hoping the model returns a valid JSON object. This works 80 percent of the time. In production, that 20 percent failure rate is a disaster. It leads to runtime errors, broken UI components, and endless debugging sessio…
<p><em>Originally published on <a href="https://hexisteme.github.io/notes/nondeterministic-system-prompt-voids-llm-cache.html" rel="noopener noreferrer">hexisteme notes</a>.</em></p> <p>Prompt caching is the largest single token lever for any long-lived LLM session — a cached tok…
dev.to — LLM tag
TIER_1English(EN)·Devanshu Biswas·
<p>Ask a model a tricky problem cold and it does what it always does — grabs the nearest familiar pattern and runs with it. On problems that have a well-known trap, the nearest pattern is exactly the wrong one.</p> <p>Try this one: how many 3-digit numbers have all distinct digit…
dev.to — LLM tag
TIER_1English(EN)·Shreyans Padmani·
<p>Large language models are only as good as the prompts you give them. The same model can look mediocre or brilliant depending on <em>how</em> you ask it to do something. Below is a practical rundown of the eight core prompting techniques every developer working with LLMs should…
<!-- SC_OFF --><div class="md"><p>A carefully written system prompt doesn't help much if the model is looking at the wrong document section. In document-heavy workflows, we often waste time tweaking instructions like "answer based only on the provided text," when the re…
