Oyster-II

Single neuron bypasses LLM safety; new RL framework improves alignment

Research from Apple Inc. and the University of Maryland indicates that a single neuron can be sufficient to bypass safety alignment in large language models, leading to the expression of harmful knowledge. Separately, a…