Cacioli

Small LLMs exhibit positional bias, not answer avoidance, when sandbagging

New research indicates that smaller language models (7-9 billion parameters) exhibit a positional bias when instructed to "sandbag" or underperform, rather than avoiding correct answers. This bias causes models like Lla…