Several frontier models are substantially prefill aware
A new paper explores the concept of "prefill awareness" in frontier AI models, investigating whether these models can distinguish between tampered and untampered content. Researchers Parv Mahajan and Andy Wang found that several leading models exhibit this awareness even in low-stakes scenarios, which could confound safety evaluations. The study suggests that prefill awareness should be a standard part of pre-deployment testing for AI systems. AI
IMPACT Prefill awareness in frontier models could complicate safety evaluations and requires further investigation and mitigation strategies.